Commit graph

192 commits

Author SHA1 Message Date
echel0n
636bbfa2de Fixes issues with scene exception updating when editing a show, should resolve problems with it duplicating scene exception name over and over again.
Reduced DB sleep timer to increase overall performance of application.

Improved generic queue code for threading.
2014-07-19 22:29:19 -07:00
echel0n
02c8b867c6 Fixed -RP release issues.
Removes .nzb and .torrent extensions from files for parsing purposes.
2014-07-19 15:23:01 -07:00
echel0n
5802fc372c Fix for naming pattern issues. 2014-07-19 13:31:31 -07:00
echel0n
14fd0daa6c Fix for nameparser error during PP 2014-07-19 06:53:06 -07:00
echel0n
3fd5f75180 Removed a sleep timer 2014-07-19 06:11:53 -07:00
echel0n
bf40e6bd98 Updated code to perform indexer id comparisons to confirm show is correctly choosen if we passed in a show object to test against. 2014-07-19 06:09:16 -07:00
echel0n
222f702f46 Skips to next regex if unable to create result.show 2014-07-19 05:15:48 -07:00
echel0n
09a3333399 Moved code out of series_name check for show object creation/checking. 2014-07-19 05:13:11 -07:00
echel0n
eff064f347 Accuracey and speed improved for nameparser. 2014-07-19 05:06:18 -07:00
echel0n
e0e10dd289 Improved name parser scoring 2014-07-18 17:44:06 -07:00
echel0n
c4a0f314fd Fixed name parsing result issues with improper regex patterns being used. 2014-07-18 11:47:19 -07:00
echel0n
579681386e Another test fix for anime PP issues 2014-07-18 00:03:29 -07:00
echel0n
9bef354899 Testing another fix for anime PP issues. 2014-07-17 23:54:58 -07:00
echel0n
546f7c00b4 Reverted persistent storage of nameparser cache, testing fix to prevent crashes possibly related to memory usage. 2014-07-15 15:01:23 -07:00
echel0n
89c8ed4372 Using unicode for name keys now in NameParser cache, resolves 8-byte error. 2014-07-15 11:51:40 -07:00
echel0n
c577ff2887 Reverted back to using Shove+SQLAlchemy for storing persistent object data to avoid any more DB corruption errors. 2014-07-15 11:40:40 -07:00
echel0n
2fec443c37 Forgot to add check if naming pattern was calling nameparser for previous commit. 2014-07-15 03:18:34 -07:00
echel0n
c3f6417f5f NameParser now gets episode/season numbers for anime shows using absolute numbers. 2014-07-15 03:11:54 -07:00
echel0n
7cbeef5ed0 Fixed invalid naming pattern error.
Fixed sports regexes.
Fixed name parsing issues.
2014-07-15 02:40:21 -07:00
echel0n
4a061d4dd2 AniDB now updates its xml lists daily.
Added writeback cache for both rss feeds and name parser.
2014-07-14 23:55:52 -07:00
echel0n
fefcfa0952 Fix for NameParser invalid show errors.
Fix for NameParserCache and RSSFeed Cache errors.
2014-07-14 22:53:32 -07:00
echel0n
79f923dc9c Fixed andidb scene exceptions to be called only on shows that are marked as anime.
Cleanup now performed after scene exception retrieval is performed on globals.

Fixed db type errors for name parser cache and rss feed cache.
2014-07-14 21:10:57 -07:00
echel0n
d02c0bd6eb Fixed issues with editing/saving custom scene exceptions.
Fixed charmap issues for anime show names.

Fixed issues with display show page and epCat key errors.

Fixed duplicate log messages for clearing provider caches.

Fixed issues with email notifier ep names not properly being encoded to UTF-8.

TVDB<->TVRAGE Indexer ID mapping is now performed on demand to be used when needed such as newznab providers can be searched with tvrage_id's and some will return tvrage_id's that later can be used to create show objects from for faster and more accurate name parsing, mapping is done via Trakt API calls.

Added stop event signals to schedualed tasks, SR now waits indefinate till task has been fully stopped before completing a restart or shutdown event.

NameParserCache is now persistent and stores 200 parsed results at any given time for quicker lookups and better performance, this helps maintain results between updates or shutdown/startup events.

Black and White lists for anime now only get used for anime shows as intended, performance gain for non-anime shows that dont need to load these lists.

Internal name cache now builds it self on demand when needed per show request plus checks if show is already in cache and if true exits routine to save time.

Schedualer and QueueItems classes are now a sub-class of threading.Thread and a stop threading event signal has been added to each.

If I forgot to list something it doesn't mean its not fixed so please test and report back if anything is wrong or has been corrected by this new release.
2014-07-14 19:00:53 -07:00
echel0n
0e3495d30f Fix for show parsing errors to be displayed via debug logs now instead as a warning. 2014-07-11 00:59:05 -07:00
echel0n
9dd679e30f Fix for anime showObj regex matching.
Fix for xbmc notifier.
2014-07-10 22:35:00 -07:00
echel0n
fe65ecd2c3 Fixed issues with searches for show specials causing SR to think its a entire season. 2014-07-08 21:13:43 -07:00
echel0n
74f73bcc34 New event queue system in place, currently handles shutdown and restart calls.
Fixed ctrl-c issues with new event queue system.
Added a sleep timer to the NameParser class to help lower cpu usage spikes.
2014-07-08 15:26:26 -07:00
echel0n
c8d899ad66 Removed maintance schedualer and moved the routines from it to happen before a search is started to ensure things are up to date and to stop waking up synology devices, regexes also made less greedy. 2014-07-07 14:30:27 -07:00
echel0n
f91569ec84 Fix for post-processing and parsing errors. 2014-07-06 15:06:19 -07:00
echel0n
dfc600893d Fix for SHOWQUEUE-REFRESH 2014-07-06 10:16:11 -07:00
echel0n
7a95b0bb14 Added new InvalidShowException to NameParser, Removed isGoodResult search check and now attached parsed result show objects and compare them against the show object we use to search with instead. 2014-07-06 06:11:04 -07:00
adam
ad68518e10 Add support for animes with a different series name per tvdb season 2014-07-05 20:42:54 +08:00
echel0n
20456fde6b Regex order of placement in list now taken into account when scoring matches. 2014-07-03 13:44:34 -07:00
echel0n
f0146f728e Lowered CPU usage even further, re-wrote daemonizer code for startups, removed misc unrequired functions from providers. 2014-07-03 07:07:07 -07:00
echel0n
a1cef0b958 Added in context to aid in garbage cleanup to help reduce memory usage. 2014-06-30 10:48:18 -07:00
echel0n
a16bf8ca2c Fix for anidb errors 2014-06-30 09:21:21 -07:00
echel0n
2c98a5a448 Fixed "show must be added to list", regexes now check if numbers following after the series name is a date or part of the series name to properly parse and return correct show object.
Fixes TVDB and TVRAGE cache_location variable.
2014-06-29 23:20:19 -07:00
echel0n
858951d31c Fix for H.264 issues related to regexes and matching for parsing release names. 2014-06-26 16:45:40 -07:00
echel0n
9f8c49ce88 Fixed issue with tvcache filling with duplicate data. 2014-06-26 03:20:07 -07:00
echel0n
9d8f695e5a Reverted previous changes made to regexes as no longer needed and started to cause false matches for h264 as a season and episode number result. 2014-06-25 22:03:26 -07:00
echel0n
42e1994cba Fix show name matching, trys main show name pattern then if no show object is retrieved it attempts using the alternative pattern. 2014-06-24 18:57:05 -07:00
echel0n
f16ee09501 Updated regex for show series name matching, faster matching. 2014-06-24 18:42:03 -07:00
echel0n
7d2f7c8233 Fixed ImportError: cannot import name OrderedDict 2014-06-24 17:40:38 -07:00
echel0n
cc6e9aa0f5 Fixed compiled regex pattern ordering, fixes issues that where causing H.264 to be matched as S2E64 2014-06-24 06:48:00 -07:00
echel0n
cec01405d8 Fix for release results x264 issue 2014-06-24 00:42:13 -07:00
echel0n
fcd54c93d6 Fixed minor regex mistake in code. 2014-06-23 23:59:08 -07:00
echel0n
5c5b6f49e1 Fixed regex patterns for both show and release names.
Fixed post-processing loop issue.
2014-06-23 23:45:21 -07:00
echel0n
b0149cc65d Fix so that scene converting does not happening when performing naming pattern routines. 2014-06-22 13:06:20 -07:00
echel0n
688263bd62 Fix for missing code in Name Parser 2014-06-22 12:58:26 -07:00
echel0n
0573a8add6 Fix for NoneType name parsing issues from new test code.
Fix for h264/x264 matching as absolute number.
2014-06-22 12:25:54 -07:00
echel0n
b1c9b71846 Testing new faster method of obtaining show object via regex matching for series name during Name Parsing for results. 2014-06-22 11:33:58 -07:00
echel0n
7defffb4f1 Moved scene conversion routine in Name Parser to end so that it only converts the best result match and not every single one wasting time and cycles. 2014-06-22 10:27:00 -07:00
echel0n
3f6084fe4b Fixed Name Parser issues, incorrectly matched current regex used to parse results and anime patterns didn't match 1 to 3 digit numbers for absolute. 2014-06-21 18:01:14 -07:00
echel0n
ac9d78bc0f Name parser performance fixed, manual searches fixed. 2014-06-21 17:11:53 -07:00
echel0n
a2a44eae85 Fix for anime regex's 'anime_and_normal' pattern, resolves issues with show-queue refreshes 2014-06-19 19:35:36 -07:00
echel0n
836722d6cd Added timer in to reduce cpu usage during release name parsing 2014-06-19 18:34:52 -07:00
echel0n
fcc91bedd9 NameParser now won't bother to proceed parsing release name results untill it finds a valid show object in the DB to confirm its a show in our list, naming patterns automatically bypass this restriction. 2014-06-19 18:13:07 -07:00
echel0n
4ef88961b5 NameParser now trys to obtain a show object first to use in determining the correct regex set to use when parsing release names 2014-06-19 17:26:36 -07:00
echel0n
489a181cdb Auto-reloads app on code changes automatically detected from git.
Fixed issues with basicauth/cookies and login page.
Parse results now displayed all the time.
2014-06-16 03:44:33 -07:00
echel0n
a9f142184a Fix for nonetype issues during parsing 2014-06-07 04:08:12 -07:00
echel0n
24dfbc3f15 Quality is now set during parsing of results.
Fixed more anime regex bugs.
Fixed Indexer API issues for anime shows and unicode problems.
2014-06-07 04:06:21 -07:00
echel0n
31ce517e8f Added 480p to be ignored for anime regexes when matching for absolute numbers. 2014-06-07 01:57:03 -07:00
echel0n
1e8f3e2883 Added ability for format anime naming from post-processing options.
Fixed regex issues for anime shows matching 720p as a absolute number.
Custom sports naming has been fixed to adhere to dates.
2014-06-07 01:17:12 -07:00
echel0n
dfe9619ddd Fix for SSL support, reverted back to CherryPy 3.23 as 3.30 is borked for SSL. 2014-06-05 21:24:43 -07:00
echel0n
4e83cbe6d1 Fixed naming issues and parsing issues. 2014-06-05 18:38:50 -07:00
echel0n
2da18e65ca Change code for returning highest scoring match to use generator to avoid overhead of sorting the list 2014-06-01 16:36:21 -07:00
echel0n
7047cf020e Fixed naming issues for episode naming patterns.
Name parser now score's all its possible matches and stores them to a list then once finished performing its matches it'll pick the highest scoring match and return it.
2014-06-01 16:25:02 -07:00
echel0n
99d129bd41 Fixes for anime regex matching 2014-05-31 22:39:24 -07:00
echel0n
925141da40 Fix for anime issues during post-processing, TypeError: object of type 'int' has no len() 2014-05-31 12:48:55 -07:00
echel0n
ba2a44b1d1 Fix for searches of anime shows with absolute numbering 2014-05-31 06:47:27 -07:00
echel0n
893574b2ed Reverted new regex changes, not compatible with enough platforms to warrent keeping. 2014-05-31 06:16:18 -07:00
echel0n
d7396896b5 Added in regex matching with fuzzy matching.
Shows now display Indexer absolute numbering.
Improved speed of parsing search results.
Fixed episode naming issues.
2014-05-31 03:35:11 -07:00
echel0n
05cca0dfe0 Fixed post-processing issues with shows being rejected and saying they didn't exist when infact they did.
Fixed a issue in our name parser code that would of resulted in searches failing completely.
2014-05-30 01:16:12 -07:00
echel0n
a92de48aec Added new show option that allows you to choose if you want to search via scene numbering or indexer numbering.
Scene numbers and scene absolute numbers now only display if prooper show options are selected.

Scene absolute numbers are now able to be set by user.

Fixed issues with user set scene numbers not correctly applying to episode objects.
2014-05-30 00:50:27 -07:00
Nils Vogels
7bf12460be PEP8 cleanups 2014-05-29 02:44:00 +02:00
echel0n
e009641804 SickRage now stores the XEM scene data to the main DB under tv_episodes for faster lookups and better linkages with epiosde objects, insures we have scene data on hand when we want it!
Adding functions to lookup scene season and ep info via scene absolute numbers.

We now try and create a show object from parsed release info before we consider it a valid parsed result to insure we even have the show in our show list, also used to validate anime releases.

Misc bug fixes here and there.
2014-05-28 14:16:03 -07:00
echel0n
34da3f53d8 Added Black and White list for release groups for anime shows.
Fixed anime show list splitter.

Added check for anime shows and providers so we don't perform searches with a provider that doesn't support the type of show genre we are searching.
2014-05-27 03:09:57 -07:00
echel0n
f7b11e1e98 Fixed issues with post-processing.
Fixed issue with priority post-processing, bug would allow 2nd attempt to go through even if priority settings were not selected.

Fixed issues with cache retrieval and storing of provider results, properly stored now with season and ep info converted to indexer numbering.

Fixed a bug that was caching unconverted scene numbered files for post-processing causing us to skip converting them when needed.
2014-05-26 03:42:34 -07:00
echel0n
9a3e7ab0a9 Added anime support with anidb support.
Added fanzub anime nzb provider.
Fixed NyaaTorrents anime provider.

This is in testing phase so bugs are to be expected.
2014-05-25 23:29:22 -07:00
echel0n
7391a6e454 App name change in code. 2014-05-23 05:37:22 -07:00
echel0n
a15db1719d Removed some re-dundant code from daily search.
Fixed up some entries in mede8er metadata provider.
Changed detection of non-season packs.
2014-05-20 08:08:44 -07:00
echel0n
ab8d9e6405 Fixed issues with queues.
Tweaked code to get more performance from it.
2014-05-19 18:04:23 -07:00
echel0n
c6b064de23 Fixed small typo causing scene numbering to indexer numbering issues 2014-05-19 06:57:20 -07:00
echel0n
66e499ab23 Fixes issues with daily searcher not snatching its results when it has any to snatch.
Fixes issues with not properly converting scene numbering eps to indexer numbering.
2014-05-19 06:08:16 -07:00
echel0n
a3e06b965f Added in CPU Throttling option under general config -> advanced.
Fixed issues with passwords and unicode chars.
Fixed issue with usenet_retention variable not being saved or set.
2014-05-17 04:40:26 -07:00
echel0n
f9052ca2b2 Fixes to help with brining down the cpu usage of SickRage 2014-05-17 02:27:17 -07:00
echel0n
415e0df536 Fix for air-by-date and sports shows when searching for full seasons.
Fix for rssupdater errors
2014-05-14 01:01:36 -07:00
echel0n
dd16da1a5f Fixed cache issues.
Fixed air-by-date issues
2014-05-13 08:44:31 -07:00
echel0n
f8035e800e Fix for air-by-date downloads.
Fix for backlog and manual searches.
2014-05-11 07:17:11 -07:00
echel0n
1398c38275 Fix for manual and backlog download/search issues.
Removed multi-threading as it was more problems then usefull for now.

Added in match & snatch, any quality from initial quality settings gets downloaded first and does not continue searching, if archive qualities exist it'll stop once it hits max quality from said list.
2014-05-11 05:51:39 -07:00
echel0n
fc58a44ba2 Fixed issues with post-processing including the web 500 error.
Fixed regex matching for sports.
2014-05-08 10:10:25 -07:00
echel0n
2a4f8780e2 Fixed issues with multi-threading.
Fixed issues with snatching air-by-date shows.
Fixed issues with naming patterns.
Fixed issues with invalid literals.
Fixed issues with country codes missing and causing web errors.

Fixed so many issues I can't write them all done ... :)
2014-05-08 07:04:01 -07:00
echel0n
fc94243546 Fixes backlog and manual searches.
Fixes season pack and single/multi episode searches.
Fixes multi-threading issues.
Fixes incorrect status being reported for manual searches.
Fixes quality being returned as N/A all the time for torrents.
2014-05-07 00:50:49 -07:00
echel0n
8a61eb1e26 Added in some sleep timers to help improve overall cpu usage 2014-05-06 14:35:37 -07:00
echel0n
129a8c1d7e Added cache for rss feed items.
Fixed issues with searches
2014-05-04 05:05:27 -07:00
echel0n
d5f183c171 Major changes made to search code, tvcache code, and name parser 2014-05-03 02:23:26 -07:00
echel0n
09476224c5 Improved code for better performance of application memory and cpu usage. 2014-05-02 03:09:17 -07:00
echel0n
6a8bef76c9 Re-code of post-processing, insures the Indexer ID is correct so that shows don't get added with the incorrect Indexer info also no more needing to lookup said info from the Indexers making API calls so overall speed has increased as well.
Fixed issues with returning a show object when parsing release names into show names from our database.
2014-05-02 01:47:02 -07:00
echel0n
1c6b0807b0 Fixed backlog issues and improved cache and provider searches, this resolves issue #298 2014-05-01 21:53:34 -07:00
echel0n
eabd0d092f Fixes for air_by_date and sports shows
Fixes for sports regex matching patterns.
2014-05-01 20:03:44 -07:00