Commit graph

154 commits

Author SHA1 Message Date
echel0n
7cbeef5ed0 Fixed invalid naming pattern error.
Fixed sports regexes.
Fixed name parsing issues.
2014-07-15 02:40:21 -07:00
echel0n
4a061d4dd2 AniDB now updates its xml lists daily.
Added writeback cache for both rss feeds and name parser.
2014-07-14 23:55:52 -07:00
echel0n
fefcfa0952 Fix for NameParser invalid show errors.
Fix for NameParserCache and RSSFeed Cache errors.
2014-07-14 22:53:32 -07:00
echel0n
79f923dc9c Fixed andidb scene exceptions to be called only on shows that are marked as anime.
Cleanup now performed after scene exception retrieval is performed on globals.

Fixed db type errors for name parser cache and rss feed cache.
2014-07-14 21:10:57 -07:00
echel0n
d02c0bd6eb Fixed issues with editing/saving custom scene exceptions.
Fixed charmap issues for anime show names.

Fixed issues with display show page and epCat key errors.

Fixed duplicate log messages for clearing provider caches.

Fixed issues with email notifier ep names not properly being encoded to UTF-8.

TVDB<->TVRAGE Indexer ID mapping is now performed on demand to be used when needed such as newznab providers can be searched with tvrage_id's and some will return tvrage_id's that later can be used to create show objects from for faster and more accurate name parsing, mapping is done via Trakt API calls.

Added stop event signals to schedualed tasks, SR now waits indefinate till task has been fully stopped before completing a restart or shutdown event.

NameParserCache is now persistent and stores 200 parsed results at any given time for quicker lookups and better performance, this helps maintain results between updates or shutdown/startup events.

Black and White lists for anime now only get used for anime shows as intended, performance gain for non-anime shows that dont need to load these lists.

Internal name cache now builds it self on demand when needed per show request plus checks if show is already in cache and if true exits routine to save time.

Schedualer and QueueItems classes are now a sub-class of threading.Thread and a stop threading event signal has been added to each.

If I forgot to list something it doesn't mean its not fixed so please test and report back if anything is wrong or has been corrected by this new release.
2014-07-14 19:00:53 -07:00
echel0n
0e3495d30f Fix for show parsing errors to be displayed via debug logs now instead as a warning. 2014-07-11 00:59:05 -07:00
echel0n
9dd679e30f Fix for anime showObj regex matching.
Fix for xbmc notifier.
2014-07-10 22:35:00 -07:00
echel0n
fe65ecd2c3 Fixed issues with searches for show specials causing SR to think its a entire season. 2014-07-08 21:13:43 -07:00
echel0n
74f73bcc34 New event queue system in place, currently handles shutdown and restart calls.
Fixed ctrl-c issues with new event queue system.
Added a sleep timer to the NameParser class to help lower cpu usage spikes.
2014-07-08 15:26:26 -07:00
echel0n
c8d899ad66 Removed maintance schedualer and moved the routines from it to happen before a search is started to ensure things are up to date and to stop waking up synology devices, regexes also made less greedy. 2014-07-07 14:30:27 -07:00
echel0n
f91569ec84 Fix for post-processing and parsing errors. 2014-07-06 15:06:19 -07:00
echel0n
dfc600893d Fix for SHOWQUEUE-REFRESH 2014-07-06 10:16:11 -07:00
echel0n
7a95b0bb14 Added new InvalidShowException to NameParser, Removed isGoodResult search check and now attached parsed result show objects and compare them against the show object we use to search with instead. 2014-07-06 06:11:04 -07:00
adam
ad68518e10 Add support for animes with a different series name per tvdb season 2014-07-05 20:42:54 +08:00
echel0n
20456fde6b Regex order of placement in list now taken into account when scoring matches. 2014-07-03 13:44:34 -07:00
echel0n
f0146f728e Lowered CPU usage even further, re-wrote daemonizer code for startups, removed misc unrequired functions from providers. 2014-07-03 07:07:07 -07:00
echel0n
a1cef0b958 Added in context to aid in garbage cleanup to help reduce memory usage. 2014-06-30 10:48:18 -07:00
echel0n
a16bf8ca2c Fix for anidb errors 2014-06-30 09:21:21 -07:00
echel0n
2c98a5a448 Fixed "show must be added to list", regexes now check if numbers following after the series name is a date or part of the series name to properly parse and return correct show object.
Fixes TVDB and TVRAGE cache_location variable.
2014-06-29 23:20:19 -07:00
echel0n
858951d31c Fix for H.264 issues related to regexes and matching for parsing release names. 2014-06-26 16:45:40 -07:00
echel0n
42e1994cba Fix show name matching, trys main show name pattern then if no show object is retrieved it attempts using the alternative pattern. 2014-06-24 18:57:05 -07:00
echel0n
f16ee09501 Updated regex for show series name matching, faster matching. 2014-06-24 18:42:03 -07:00
echel0n
7d2f7c8233 Fixed ImportError: cannot import name OrderedDict 2014-06-24 17:40:38 -07:00
echel0n
cc6e9aa0f5 Fixed compiled regex pattern ordering, fixes issues that where causing H.264 to be matched as S2E64 2014-06-24 06:48:00 -07:00
echel0n
fcd54c93d6 Fixed minor regex mistake in code. 2014-06-23 23:59:08 -07:00
echel0n
5c5b6f49e1 Fixed regex patterns for both show and release names.
Fixed post-processing loop issue.
2014-06-23 23:45:21 -07:00
echel0n
b0149cc65d Fix so that scene converting does not happening when performing naming pattern routines. 2014-06-22 13:06:20 -07:00
echel0n
688263bd62 Fix for missing code in Name Parser 2014-06-22 12:58:26 -07:00
echel0n
0573a8add6 Fix for NoneType name parsing issues from new test code.
Fix for h264/x264 matching as absolute number.
2014-06-22 12:25:54 -07:00
echel0n
b1c9b71846 Testing new faster method of obtaining show object via regex matching for series name during Name Parsing for results. 2014-06-22 11:33:58 -07:00
echel0n
7defffb4f1 Moved scene conversion routine in Name Parser to end so that it only converts the best result match and not every single one wasting time and cycles. 2014-06-22 10:27:00 -07:00
echel0n
3f6084fe4b Fixed Name Parser issues, incorrectly matched current regex used to parse results and anime patterns didn't match 1 to 3 digit numbers for absolute. 2014-06-21 18:01:14 -07:00
echel0n
ac9d78bc0f Name parser performance fixed, manual searches fixed. 2014-06-21 17:11:53 -07:00
echel0n
836722d6cd Added timer in to reduce cpu usage during release name parsing 2014-06-19 18:34:52 -07:00
echel0n
fcc91bedd9 NameParser now won't bother to proceed parsing release name results untill it finds a valid show object in the DB to confirm its a show in our list, naming patterns automatically bypass this restriction. 2014-06-19 18:13:07 -07:00
echel0n
4ef88961b5 NameParser now trys to obtain a show object first to use in determining the correct regex set to use when parsing release names 2014-06-19 17:26:36 -07:00
echel0n
489a181cdb Auto-reloads app on code changes automatically detected from git.
Fixed issues with basicauth/cookies and login page.
Parse results now displayed all the time.
2014-06-16 03:44:33 -07:00
echel0n
a9f142184a Fix for nonetype issues during parsing 2014-06-07 04:08:12 -07:00
echel0n
24dfbc3f15 Quality is now set during parsing of results.
Fixed more anime regex bugs.
Fixed Indexer API issues for anime shows and unicode problems.
2014-06-07 04:06:21 -07:00
echel0n
1e8f3e2883 Added ability for format anime naming from post-processing options.
Fixed regex issues for anime shows matching 720p as a absolute number.
Custom sports naming has been fixed to adhere to dates.
2014-06-07 01:17:12 -07:00
echel0n
dfe9619ddd Fix for SSL support, reverted back to CherryPy 3.23 as 3.30 is borked for SSL. 2014-06-05 21:24:43 -07:00
echel0n
4e83cbe6d1 Fixed naming issues and parsing issues. 2014-06-05 18:38:50 -07:00
echel0n
2da18e65ca Change code for returning highest scoring match to use generator to avoid overhead of sorting the list 2014-06-01 16:36:21 -07:00
echel0n
7047cf020e Fixed naming issues for episode naming patterns.
Name parser now score's all its possible matches and stores them to a list then once finished performing its matches it'll pick the highest scoring match and return it.
2014-06-01 16:25:02 -07:00
echel0n
99d129bd41 Fixes for anime regex matching 2014-05-31 22:39:24 -07:00
echel0n
925141da40 Fix for anime issues during post-processing, TypeError: object of type 'int' has no len() 2014-05-31 12:48:55 -07:00
echel0n
ba2a44b1d1 Fix for searches of anime shows with absolute numbering 2014-05-31 06:47:27 -07:00
echel0n
893574b2ed Reverted new regex changes, not compatible with enough platforms to warrent keeping. 2014-05-31 06:16:18 -07:00
echel0n
d7396896b5 Added in regex matching with fuzzy matching.
Shows now display Indexer absolute numbering.
Improved speed of parsing search results.
Fixed episode naming issues.
2014-05-31 03:35:11 -07:00
echel0n
05cca0dfe0 Fixed post-processing issues with shows being rejected and saying they didn't exist when infact they did.
Fixed a issue in our name parser code that would of resulted in searches failing completely.
2014-05-30 01:16:12 -07:00
echel0n
a92de48aec Added new show option that allows you to choose if you want to search via scene numbering or indexer numbering.
Scene numbers and scene absolute numbers now only display if prooper show options are selected.

Scene absolute numbers are now able to be set by user.

Fixed issues with user set scene numbers not correctly applying to episode objects.
2014-05-30 00:50:27 -07:00
Nils Vogels
7bf12460be PEP8 cleanups 2014-05-29 02:44:00 +02:00
echel0n
e009641804 SickRage now stores the XEM scene data to the main DB under tv_episodes for faster lookups and better linkages with epiosde objects, insures we have scene data on hand when we want it!
Adding functions to lookup scene season and ep info via scene absolute numbers.

We now try and create a show object from parsed release info before we consider it a valid parsed result to insure we even have the show in our show list, also used to validate anime releases.

Misc bug fixes here and there.
2014-05-28 14:16:03 -07:00
echel0n
34da3f53d8 Added Black and White list for release groups for anime shows.
Fixed anime show list splitter.

Added check for anime shows and providers so we don't perform searches with a provider that doesn't support the type of show genre we are searching.
2014-05-27 03:09:57 -07:00
echel0n
f7b11e1e98 Fixed issues with post-processing.
Fixed issue with priority post-processing, bug would allow 2nd attempt to go through even if priority settings were not selected.

Fixed issues with cache retrieval and storing of provider results, properly stored now with season and ep info converted to indexer numbering.

Fixed a bug that was caching unconverted scene numbered files for post-processing causing us to skip converting them when needed.
2014-05-26 03:42:34 -07:00
echel0n
9a3e7ab0a9 Added anime support with anidb support.
Added fanzub anime nzb provider.
Fixed NyaaTorrents anime provider.

This is in testing phase so bugs are to be expected.
2014-05-25 23:29:22 -07:00
echel0n
7391a6e454 App name change in code. 2014-05-23 05:37:22 -07:00
echel0n
a15db1719d Removed some re-dundant code from daily search.
Fixed up some entries in mede8er metadata provider.
Changed detection of non-season packs.
2014-05-20 08:08:44 -07:00
echel0n
ab8d9e6405 Fixed issues with queues.
Tweaked code to get more performance from it.
2014-05-19 18:04:23 -07:00
echel0n
c6b064de23 Fixed small typo causing scene numbering to indexer numbering issues 2014-05-19 06:57:20 -07:00
echel0n
66e499ab23 Fixes issues with daily searcher not snatching its results when it has any to snatch.
Fixes issues with not properly converting scene numbering eps to indexer numbering.
2014-05-19 06:08:16 -07:00
echel0n
a3e06b965f Added in CPU Throttling option under general config -> advanced.
Fixed issues with passwords and unicode chars.
Fixed issue with usenet_retention variable not being saved or set.
2014-05-17 04:40:26 -07:00
echel0n
f9052ca2b2 Fixes to help with brining down the cpu usage of SickRage 2014-05-17 02:27:17 -07:00
echel0n
415e0df536 Fix for air-by-date and sports shows when searching for full seasons.
Fix for rssupdater errors
2014-05-14 01:01:36 -07:00
echel0n
dd16da1a5f Fixed cache issues.
Fixed air-by-date issues
2014-05-13 08:44:31 -07:00
echel0n
f8035e800e Fix for air-by-date downloads.
Fix for backlog and manual searches.
2014-05-11 07:17:11 -07:00
echel0n
1398c38275 Fix for manual and backlog download/search issues.
Removed multi-threading as it was more problems then usefull for now.

Added in match & snatch, any quality from initial quality settings gets downloaded first and does not continue searching, if archive qualities exist it'll stop once it hits max quality from said list.
2014-05-11 05:51:39 -07:00
echel0n
2a4f8780e2 Fixed issues with multi-threading.
Fixed issues with snatching air-by-date shows.
Fixed issues with naming patterns.
Fixed issues with invalid literals.
Fixed issues with country codes missing and causing web errors.

Fixed so many issues I can't write them all done ... :)
2014-05-08 07:04:01 -07:00
echel0n
fc94243546 Fixes backlog and manual searches.
Fixes season pack and single/multi episode searches.
Fixes multi-threading issues.
Fixes incorrect status being reported for manual searches.
Fixes quality being returned as N/A all the time for torrents.
2014-05-07 00:50:49 -07:00
echel0n
8a61eb1e26 Added in some sleep timers to help improve overall cpu usage 2014-05-06 14:35:37 -07:00
echel0n
129a8c1d7e Added cache for rss feed items.
Fixed issues with searches
2014-05-04 05:05:27 -07:00
echel0n
d5f183c171 Major changes made to search code, tvcache code, and name parser 2014-05-03 02:23:26 -07:00
echel0n
09476224c5 Improved code for better performance of application memory and cpu usage. 2014-05-02 03:09:17 -07:00
echel0n
6a8bef76c9 Re-code of post-processing, insures the Indexer ID is correct so that shows don't get added with the incorrect Indexer info also no more needing to lookup said info from the Indexers making API calls so overall speed has increased as well.
Fixed issues with returning a show object when parsing release names into show names from our database.
2014-05-02 01:47:02 -07:00
echel0n
1c6b0807b0 Fixed backlog issues and improved cache and provider searches, this resolves issue #298 2014-05-01 21:53:34 -07:00
echel0n
eabd0d092f Fixes for air_by_date and sports shows
Fixes for sports regex matching patterns.
2014-05-01 20:03:44 -07:00
echel0n
3a60683327 Fixed issues with parsing release names and naming patterns including regex for sports is now more accurate then ever!
Added option under general settings to allow specifiying a default indexer to be used for adding newshows and existing shows (All, TVDB, TVRage)
2014-05-01 17:57:51 -07:00
echel0n
85a9a81f4e Fix for issue #290, Post-processing issues 2014-05-01 15:53:37 -07:00
echel0n
3cefc5be86 Fix for startup issue when using python 2.6 2014-05-01 04:38:05 -07:00
echel0n
071d51fcda Fixes for scene conversion and regexs 2014-05-01 00:18:52 -07:00
echel0n
7e800ff524 Fixed manual episode searches.
Corrected a issue where SB was being searched twice for the same show wasting cpu cycles.
2014-04-30 18:20:53 -07:00
echel0n
9d191f6999 Fixes for post-processing issues.
Improvements made to caches for overall performance boost and more accurate matches.

Misc bug fixes applied.
2014-04-30 15:16:31 -07:00
echel0n
a912140ec5 Code correction for scene conversion in Parsing cache 2014-04-30 05:21:16 -07:00
echel0n
08714357dd Fixed missing code. 2014-04-30 05:18:20 -07:00
echel0n
319ac2602f Fixed scene_numbering issues for shows that use scene numbers instead of TVDB numbering.
Fixed issues with local SB cache.

Fixed issues with sports naming patterns, we no longer treat sports as a airdate show and have created custom regex's to aid in finding sports related shows.
2014-04-30 05:10:13 -07:00
echel0n
a97dcad291 Fix for sports naming pattern issues, finally this is resolved!
Fixes issues for air-by-date shows as well.
2014-04-29 16:44:08 -07:00
echel0n
c330bbb386 Fixed issues with post-processing, we now perform the auto-detection of the indexer in a spot that doesn't require the post-processing to start all the way from the begining allowing for less processing time to take place.
Fixed more code relating to scene converting and sports event episodes/shows.

Post-processing now checks for indexer id in the cache as well as the other normal ways it did before.
2014-04-28 21:55:59 -07:00
echel0n
7f44a2cfad Fixed issues with finding propers to many keywords.
Fixed issues with scene numbering when searching for propers.
2014-04-28 18:25:27 -07:00
echel0n
43b6b4b594 Improved XEM scene numbering converting.
Fixed release naming and parsing.
Improved overall application performance and foorprint.
2014-04-28 17:12:06 -07:00
echel0n
5e38813a73 Added sports feature, acts just like air_by_date except allows us to control the date pattern to match events that air_by_date could not.
Custome sports naming patterns can be set now as well.

Fixed issues with FINDPROPERS.

Fixed issues with session connections.

Cleaned up code.
2014-04-28 02:15:29 -07:00
echel0n
5772de9eec Complete re-code of season/episode search code.
Switched from using standard requests to using sessions.
Fixed bug in speedcd that was preventing config from saving.
2014-04-27 03:31:54 -07:00
echel0n
e787ef8332 XEM Scene Numbering fixes.
Deepcopy thread.lock issue fixed.
Overall performance increased, searches faster and more accurate.
2014-04-26 03:37:40 -07:00
echel0n
dd58028ba6 Bugfix for indexerApi improperly returning list of indexers 2014-03-26 19:01:53 -07:00
echel0n
8004685d3f Re-wrote the indexerApi wrapper, was causing a bottlekneck
Fixed bug when show folder is deleted before being deleted from SB
New Show searches now confirm results have a valid firstaired date
2014-03-26 12:28:46 -07:00
echel0n
95d7d728e0 Re-write of Indexer API wrapper
Re-write of New Show seearch function
Re-write of Existing show search helper function for determining indexer/indexerid
Massive code cleanup and more bugs found and fixed
Indexer code fully modualized for future proofing
2014-03-24 22:57:24 -07:00
echel0n
10637f8f29 Code Clean up and regex fix for "no repeats" error (reverted from commit 8ecd5a196d) 2014-03-20 11:03:22 -07:00
echel0n
8ecd5a196d Code cleanup and regex fix for "no repeats" error 2014-03-20 10:51:59 -07:00
echel0n
1f178686cc Fixed regex pattern for sports events that were preventing searches from working.
Switched out urllib2 HTTP Handler for requests HTTP Handler in main getURL function in helpers module.

Fixed date parsing for sports in NameParser module.

Misc fixes and improvements throughout the code.
2014-03-15 18:01:12 -07:00
echel0n
f2bbe76271 Code improvements for the indexer API handler and a few code cleanups as well. 2014-03-11 22:28:30 -07:00
echel0n
bbf9491943 Code cleanup and bugfixes 2014-03-10 19:32:02 -07:00