Commit graph

193 commits

Author SHA1 Message Date
echel0n
b13e72e0a3 Moved code for cleaning up cache folder to seperate function located in helper.py.
Added call to cache folder cleanup during SickRage main init.

Changed a error message in rss feed class to a debug message for when url returns no data.

Moved indexer api cache files to be placed under cache folder subfolder indexers.

Moved rss feed cache files to be placed under cache folder subfolder rss.
2014-07-27 04:58:14 -07:00
echel0n
14c354b551 Added proxy support to Indexer APIs.
Provider getURL and downloadResult functions now removed and replaced with ones from helpers.py to help slim the code down plus allow more better control over request sessions.

Removed TVTumbler code.

Fixed HDBits provider.

Fixed config settings that were ment to be booleans but instead where set as str or int, should help resolve random html errors.

XEM Refresh check re-coded.

NameParser code for creating show object has been changed to only attempt at the very end once its found the bestMatch result, helps on resources and performance.
2014-07-27 03:59:21 -07:00
echel0n
f47734446d Fixed further json issues with speedcd provider.
Fixed several providers and ssl cert verify issues.

Air-by-date shows now automatically get there respective season/episode numbers during release parsing.
2014-07-24 11:16:59 -07:00
echel0n
e5ac585b6a Fix for webui becoming unresponsive when using SSL and possibly in other situations as well. 2014-07-23 23:36:44 -07:00
echel0n
de5db9be64 Added ability to set a default indexer for trakt notifier used for adding shows from watch list so that SickRage knows what indexer to set the show as.
Indexer mapping now uses indexer api calls to gather its information and then stores it to a new table called indexer_mapping for instant lookups later on.

Fixed trakt related issues for adding new shows and syncing.

Centered items at bottom of pages to just look a little nicer and fit properly.
2014-07-23 22:07:01 -07:00
echel0n
a317ff61c2 Created a context manager wrapper for BeautifulSoup4 so that we can cleanup/clear tags/context on exit via WITH statements.
Fixed issues with torrent providers returning no results.
2014-07-21 21:26:58 -07:00
echel0n
5ac99b8c5c Fix for extensions being stripped off by mistake made when adding in -RP fix from few commits ago. 2014-07-21 06:29:07 -07:00
dhellwich
aba5cc10d2 Fix for symlinking during Post-Processing
As described here: https://sickrage.tv/forums/forum/help-support/bug-issue-reports/5016-several-issues
2014-07-20 21:47:37 +02:00
echel0n
02c8b867c6 Fixed -RP release issues.
Removes .nzb and .torrent extensions from files for parsing purposes.
2014-07-19 15:23:01 -07:00
echel0n
14fd0daa6c Fix for nameparser error during PP 2014-07-19 06:53:06 -07:00
echel0n
9fe6b66475 Forgot to commit these 2014-07-19 06:10:02 -07:00
echel0n
d02c0bd6eb Fixed issues with editing/saving custom scene exceptions.
Fixed charmap issues for anime show names.

Fixed issues with display show page and epCat key errors.

Fixed duplicate log messages for clearing provider caches.

Fixed issues with email notifier ep names not properly being encoded to UTF-8.

TVDB<->TVRAGE Indexer ID mapping is now performed on demand to be used when needed such as newznab providers can be searched with tvrage_id's and some will return tvrage_id's that later can be used to create show objects from for faster and more accurate name parsing, mapping is done via Trakt API calls.

Added stop event signals to schedualed tasks, SR now waits indefinate till task has been fully stopped before completing a restart or shutdown event.

NameParserCache is now persistent and stores 200 parsed results at any given time for quicker lookups and better performance, this helps maintain results between updates or shutdown/startup events.

Black and White lists for anime now only get used for anime shows as intended, performance gain for non-anime shows that dont need to load these lists.

Internal name cache now builds it self on demand when needed per show request plus checks if show is already in cache and if true exits routine to save time.

Schedualer and QueueItems classes are now a sub-class of threading.Thread and a stop threading event signal has been added to each.

If I forgot to list something it doesn't mean its not fixed so please test and report back if anything is wrong or has been corrected by this new release.
2014-07-14 19:00:53 -07:00
echel0n
9a6be98f1f Fix for symlinking during Post-Processing 2014-07-12 15:10:10 -07:00
echel0n
8045976c15 Possible fix for error 500 in web gui when trying to get a show poster and showList is not yet been init'd 2014-07-06 07:48:51 -07:00
echel0n
56e2c28bad SickRage now uses a internal name cache comprised of (showlist, scene exceptions, scene names) used to search and create show objects from which is needed for parsing search results.
Scene exceptions now uses a internal cache for scene exceptions and scene season exceptions, helps reduce overhead to DB and performs faster lookups when making scene exception requests.
2014-07-03 10:30:15 -07:00
echel0n
cadb2dba72 Testing fix for post-processing and search issues. 2014-07-02 12:36:00 -07:00
echel0n
adb4715b3e Removed all scene exception memory caches, fetches data from DB now directly. 2014-06-30 04:09:55 -07:00
echel0n
0c57676aed Updated tornado source code.
Created custom class for rss feed parser.
2014-06-29 03:05:33 -07:00
echel0n
6c3f34fd8d Possible fix for EpisodeNotFoundByAbsoluteNumberException errors 2014-06-24 17:37:03 -07:00
echel0n
7fff3e0d63 Added zip extraction exception logging. 2014-06-24 17:02:19 -07:00
echel0n
92828eca54 Added error logging for backup zip creation. 2014-06-24 16:59:14 -07:00
echel0n
7e0bb651b2 Database now closes connection after each query and reconnects if closed to ensure no more connection and locked database problems.
Fixed more internal 500 errors.
2014-06-21 15:46:59 -07:00
echel0n
5f7b8465d0 Fixed issue with extractZip function. 2014-06-19 10:04:16 -07:00
echel0n
2b7df8e67d Added backup and restore feature, this allows you to backup your config.ini and sickbeard.db files into a zipfile and save it to a destination of your choice and as well you can restore the same zip file later on then perform a restart to have the changes take affect automatically. Backups are saved date/time stamped. 2014-06-19 07:31:44 -07:00
echel0n
d00d55fdfc Modified DB code to close its connection if right after its finished with it, helps performance-wise and should resolve locked db issues as well. 2014-06-07 14:32:38 -07:00
echel0n
dfe9619ddd Fix for SSL support, reverted back to CherryPy 3.23 as 3.30 is borked for SSL. 2014-06-05 21:24:43 -07:00
echel0n
34009bb9b8 MainDB is backed up before being restored now to .r* versioned backup backups 2014-06-05 16:14:57 -07:00
echel0n
fc7b28a8bc Automatic DB restores now done if upgrade fails due to corrupt DB or incorrect db numbering 2014-06-05 16:11:07 -07:00
echel0n
99d129bd41 Fixes for anime regex matching 2014-05-31 22:39:24 -07:00
echel0n
34da3f53d8 Added Black and White list for release groups for anime shows.
Fixed anime show list splitter.

Added check for anime shows and providers so we don't perform searches with a provider that doesn't support the type of show genre we are searching.
2014-05-27 03:09:57 -07:00
echel0n
4da248ef9b Fixed internal indexer scene name cache which resolved issues with searching and snatching. 2014-05-26 14:06:54 -07:00
echel0n
f7b11e1e98 Fixed issues with post-processing.
Fixed issue with priority post-processing, bug would allow 2nd attempt to go through even if priority settings were not selected.

Fixed issues with cache retrieval and storing of provider results, properly stored now with season and ep info converted to indexer numbering.

Fixed a bug that was caching unconverted scene numbered files for post-processing causing us to skip converting them when needed.
2014-05-26 03:42:34 -07:00
echel0n
9a3e7ab0a9 Added anime support with anidb support.
Added fanzub anime nzb provider.
Fixed NyaaTorrents anime provider.

This is in testing phase so bugs are to be expected.
2014-05-25 23:29:22 -07:00
echel0n
7391a6e454 App name change in code. 2014-05-23 05:37:22 -07:00
echel0n
f5cb9ab84d Fixes issue with version update not appearing at top of page 2014-05-22 20:17:24 -07:00
echel0n
dd16da1a5f Fixed cache issues.
Fixed air-by-date issues
2014-05-13 08:44:31 -07:00
echel0n
31297b9069 Added RSS Cache updater with user-settable interval from config section of web interface, updates the cache so that searches can be more instant when looking for snatches.
Updated backlog search code to re-set skipped or missed episodes to wanted.
2014-05-12 01:52:14 -07:00
Rick van Hattem
5fff336f70 Fixing issue #463 2014-05-10 14:04:13 +02:00
echel0n
2a4f8780e2 Fixed issues with multi-threading.
Fixed issues with snatching air-by-date shows.
Fixed issues with naming patterns.
Fixed issues with invalid literals.
Fixed issues with country codes missing and causing web errors.

Fixed so many issues I can't write them all done ... :)
2014-05-08 07:04:01 -07:00
Peter Maciocia
36359b1547 Fix for #390, add flag to use proxy settings 2014-05-07 12:22:56 +01:00
echel0n
8a61eb1e26 Added in some sleep timers to help improve overall cpu usage 2014-05-06 14:35:37 -07:00
Nils Vogels
21b7aa2785 Only process if there is a name present 2014-05-05 23:08:10 +02:00
echel0n
b33e2be047 Fixes for backlog search.
Fixes for downloading the same episode twice.
Fixes for caches.
2014-05-05 06:26:02 -07:00
echel0n
a5b72dea84 Fixes issues with findpropers and airdate.
Fixes issues with unhashable dict types.
Fixes issues with 100% CPU usage.
Fixes issues with RSS feed cache.
Fixes issues with scene numbering and converting back to indexer numbering.
Fixes issues with backlog searches.
Fixes issues with season pack searches.
Fixes issues with BTN.
2014-05-04 20:08:32 -07:00
echel0n
129a8c1d7e Added cache for rss feed items.
Fixed issues with searches
2014-05-04 05:05:27 -07:00
echel0n
16441c0582 fix for issues #321 and 258 2014-05-03 05:22:50 -07:00
echel0n
75c7fbf137 Fixes issues in tvcache 2014-05-03 03:36:57 -07:00
echel0n
d5f183c171 Major changes made to search code, tvcache code, and name parser 2014-05-03 02:23:26 -07:00
echel0n
3a60683327 Fixed issues with parsing release names and naming patterns including regex for sports is now more accurate then ever!
Added option under general settings to allow specifiying a default indexer to be used for adding newshows and existing shows (All, TVDB, TVRage)
2014-05-01 17:57:51 -07:00
echel0n
85a9a81f4e Fix for issue #290, Post-processing issues 2014-05-01 15:53:37 -07:00
echel0n
3cefc5be86 Fix for startup issue when using python 2.6 2014-05-01 04:38:05 -07:00
echel0n
226b930987 Merge pull request #278 from WebSpider/dev-typo_fix_237
Small typo in debug logging
2014-05-01 03:30:57 -07:00
echel0n
20bc92650b Fix for issues relating to adding existing shows and nothing happens. 2014-05-01 03:00:05 -07:00
Nils Vogels
a3094bcbba Small typo in debug logging 2014-05-01 10:44:48 +02:00
echel0n
408ffa857a Fixed another bug in the cache searcher for NoneType indexerid 2014-04-30 19:04:34 -07:00
echel0n
85679e99f1 Fixed indexerid issue when searching SB for show ID 2014-04-30 18:34:05 -07:00
echel0n
9d191f6999 Fixes for post-processing issues.
Improvements made to caches for overall performance boost and more accurate matches.

Misc bug fixes applied.
2014-04-30 15:16:31 -07:00
echel0n
87b752b4e5 Re-coded the Indexer cache, cache lookups are only performed for existing shows and we don't add any cache entries unless we are Indexing the show in our database so we don't waste cpu cycles and memory.
Manual and backlog searches both search the cache first before even attempting to send a search request to a provider.

More bugs have been worked out.
2014-04-29 06:14:19 -07:00
echel0n
c330bbb386 Fixed issues with post-processing, we now perform the auto-detection of the indexer in a spot that doesn't require the post-processing to start all the way from the begining allowing for less processing time to take place.
Fixed more code relating to scene converting and sports event episodes/shows.

Post-processing now checks for indexer id in the cache as well as the other normal ways it did before.
2014-04-28 21:55:59 -07:00
echel0n
3fbfed7d93 Fixes cache issues with lookups resulting in wasted cpu cycles.
Fixes issues with scene numbered releases not properly being converted before a cache lookup is performed and not being properly converted when returned from providers as a possible match for a show requested to be snatched.
2014-04-28 16:04:11 -07:00
echel0n
5e38813a73 Added sports feature, acts just like air_by_date except allows us to control the date pattern to match events that air_by_date could not.
Custome sports naming patterns can be set now as well.

Fixed issues with FINDPROPERS.

Fixed issues with session connections.

Cleaned up code.
2014-04-28 02:15:29 -07:00
echel0n
2550b8c831 Couple small code fixes 2014-04-27 16:03:13 -07:00
echel0n
5772de9eec Complete re-code of season/episode search code.
Switched from using standard requests to using sessions.
Fixed bug in speedcd that was preventing config from saving.
2014-04-27 03:31:54 -07:00
echel0n
e787ef8332 XEM Scene Numbering fixes.
Deepcopy thread.lock issue fixed.
Overall performance increased, searches faster and more accurate.
2014-04-26 03:37:40 -07:00
echel0n
83bcc63683 More RSS cache fixes 2014-04-25 20:42:35 -07:00
echel0n
0d90d01460 Fix for SSL issues 2014-04-25 04:25:22 -07:00
SickBeard Custom User
484dba0de8 proper settings for proxy 2014-04-24 17:01:20 +01:00
SickBeard Custom User
65e0dd9ff7 use tor for generic providers:w 2014-04-24 16:04:44 +01:00
echel0n
8d9d62caf5 Updated sumbliminal.
Fixed issue #52
2014-04-23 20:22:21 -07:00
echel0n
23348e0bd0 Fixed bug for returning requests object exceptions 2014-04-01 22:44:47 -07:00
echel0n
ff1e6e6dbc Changed to new cache handler that stores its cached data in sqlite db files for persistance 2014-03-27 05:06:40 -07:00
echel0n
dd58028ba6 Bugfix for indexerApi improperly returning list of indexers 2014-03-26 19:01:53 -07:00
echel0n
8004685d3f Re-wrote the indexerApi wrapper, was causing a bottlekneck
Fixed bug when show folder is deleted before being deleted from SB
New Show searches now confirm results have a valid firstaired date
2014-03-26 12:28:46 -07:00
echel0n
ab124158a4 Fixed up code for searching indexers for show id which fixes a bug that was present in our post processing code 2014-03-25 19:41:28 -07:00
echel0n
22a4a066d8 Post-processing now auto-detects the correct indexer for the show both on manual processing and script based processing 2014-03-25 18:42:36 -07:00
echel0n
b8048a7e57 Improved code for searching existing shows to find there indexerID and Indexer that they belong to for speed and accuracy 2014-03-25 11:50:11 -07:00
echel0n
95d7d728e0 Re-write of Indexer API wrapper
Re-write of New Show seearch function
Re-write of Existing show search helper function for determining indexer/indexerid
Massive code cleanup and more bugs found and fixed
Indexer code fully modualized for future proofing
2014-03-24 22:57:24 -07:00
echel0n
ce5053f25d Bunch of code upgrades and bugfixes 2014-03-20 01:15:22 -07:00
echel0n
4b1dc8a63e Fixed small bug in the getUrl function for helpers. 2014-03-19 23:17:18 -07:00
echel0n
36643acf5e Added TVRage support to our scene numbering lookups.
Tweaked our API's HTTP Handlers for better performance.

Fixed a bug in metadata parser that was preventing TVRage shows from getting images.
2014-03-19 22:33:34 -07:00
echel0n
748ba6be71 Revamped the failed handler code to fix a few bugs and have everything failed sent directly to backlog 2014-03-19 07:59:34 -07:00
echel0n
dbaf9955cb Fixed issue with BTN provider.
Started to added in "archive on firstmatch" feature.
2014-03-18 06:50:13 -07:00
echel0n
5c0af16297 Fixed a bug that was majorly slowing down the performance of SB, was causing SB to search for indexer id number from RSS cache results as they came in so basically searching shows that most probally didnt even have indexed. 2014-03-17 08:57:57 -07:00
echel0n
ce193ffcdb Replaced our cache handler 'CacheControl' with 'httpcache' as we found the previous was not stable enough and was causing more issues then good.
Added cache handler to sickbeard it self so now everything should be running faster for searches and rss feeds.
2014-03-16 04:06:21 -07:00
echel0n
d0ac2936b0 New searches now search only the indexer specified when importing existing shows.
Fixed bug causing addshow's to display the id of the show instead of the name.
2014-03-15 23:28:11 -07:00
echel0n
b225794473 Fix for timeouts on TVDB and TVRage searches. 2014-03-15 20:13:30 -07:00
echel0n
fac97e5f5a Fixed another issue in showUpdater. 2014-03-15 19:17:34 -07:00
echel0n
36fd50fb9c Cleaned up code for TVDB/TVRage show searching. 2014-03-15 18:14:02 -07:00
echel0n
1f178686cc Fixed regex pattern for sports events that were preventing searches from working.
Switched out urllib2 HTTP Handler for requests HTTP Handler in main getURL function in helpers module.

Fixed date parsing for sports in NameParser module.

Misc fixes and improvements throughout the code.
2014-03-15 18:01:12 -07:00
echel0n
f2bbe76271 Code improvements for the indexer API handler and a few code cleanups as well. 2014-03-11 22:28:30 -07:00
echel0n
056b266613 Auto-detection of indexer code added in for adding existing shows along with TV Cache lookups, few bugfixes as well. 2014-03-10 16:59:22 -07:00
echel0n
45ba1e815b Bugfixes for post processing code 2014-03-10 00:01:46 -07:00
echel0n
0d9fbc1ad7 Welcome to our SickBeard-TVRage Edition ...
This version of SickBeard uses both TVDB and TVRage to search and gather it's series data from allowing you to now have access to and download shows that you couldn't before because of being locked into only what TheTVDB had to offer.

Also this edition is based off the code we used in our XEM editon so it does come with scene numbering support as well as all the other features our XEM edition has to offer.

Please before using this with your existing database (sickbeard.db) please make a backup copy of it and delete any other database files such as cache.db and failed.db if present, we HIGHLY recommend starting out with no database files at all to make this a fresh start but the choice is at your own risk!

Enjoy!
2014-03-09 22:39:12 -07:00