Commit graph

194 commits

Author SHA1 Message Date
JackDandy
f782567fd1 Change provider SCC login process to use General Config/Advanced/Proxy host setting.
Change refactor SCC to use torrent provider simplification and PEP8.
2015-07-03 14:24:09 +01:00
JackDandy
47347884cb Fix fault matching air by date shows by using correct episode/season strings in find search results. 2015-06-09 15:43:54 +01:00
JackDandy
93c219d82e Add Rarbg torrent provider.
Note: The merging of all qualities into one category in API v2 mean more results likely to be cropped. The vendor switched to this method from their (imho, better) original of listing category numbers. It was suggested that clients add and maintain all possible search strings that signify as quality. However, this would still trigger misses, introduce other issues, plus add needless non-standard API complexity. Conclusion; as designed, SG will utilise other configured providers when this one fails to hit targets, this provider should not be configured as a sole provider.
2015-06-08 13:04:59 +01:00
JackDandy
56a3411649 Change refactor and code simplification for torrent providers. 2015-06-06 06:31:20 +01:00
Adam
7caef44bb9 Change to consolidate and tidy some provider code [part 2] 2015-04-18 13:17:47 +08:00
Adam
7477a79cb8 Change to consolidate and tidy some provider code 2015-04-18 10:28:44 +08:00
JackDandy
c16903bd73 Change "Daily" search to "Recent" search. 2015-01-07 19:54:18 +08:00
Supremicus
4c8c6b21d5 Change logos, text etc. branding to SickGear. 2014-11-12 20:56:40 +00:00
KontiSR
0d415fcc20 This is a first attempt of getting the season pack downloading to work.
Unfortunately some of the old code I modified is still not 100% clear to me.. so I can't really oversee if this will work. That's why I suggest, this should be extensively tested, before merging into master!

I broke backlog searching.. Should be working again.

Tested, and seems to be working fine!
2014-09-25 13:18:07 +02:00
adam
5ac3895600 Fixes daily search and speed improvements 2014-09-20 20:34:00 +08:00
KontiSR
4c8b100be9 Shouldn't be copy() but update().
Tested now, and at least the exception is gone.
2014-09-17 13:43:10 +02:00
KontiSR
4bfb271e8d Can't += dicts. Need to dict.copy()
Bug in master while doing daily search: https://sickrage.tv/forums/forum/help-support/bug-issue-reports/8358-unsupported-operand-type-s-for-dict-and-dict
2014-09-17 10:18:47 +02:00
echel0n
67bd1a9e98 Fix for daily searches and high cpu usage plus increases search speed 2014-09-15 01:28:11 -07:00
Adam
1790b3be7f Add TokyoToshokanProvider support 2014-09-12 19:54:49 +08:00
echel0n
8f6d014830 Fixed issues with cache results being used during searches 2014-09-07 02:41:21 -07:00
echel0n
2193a4bfd1 Fixed search issues regarding error about result attribute being referenced early 2014-09-07 02:08:24 -07:00
echel0n
20c0b4ea72 Fixed global name season error during searches 2014-09-06 22:25:01 -07:00
echel0n
59675f27ac Fixed failed download handling.
Improved search queue code.
2014-09-06 21:36:23 -07:00
echel0n
4af28657af Fixed TypeError: list indices must be integers, not list that occured during searches 2014-09-06 16:55:39 -07:00
djoole
159e8ceb7c Added the torrent provider for www.t411.me tracker 2014-09-06 02:16:04 +02:00
echel0n
ee458bd211 Fixed AttributeError: 'NoneType' object has no attribute 'is_scene' in scene_numbering code.
Show root dirs can not be set from general config menu.
Mass editing shows now has the ability to delete root dirs as well as edit them.
Daily search no longer is restricted to just 1 week of results for searching from which now allows for replacing lower quality downloads with higher quality ones if available.
RSS Cache is updated for each provider on demand now when performing manual, failed, backlog, or daily searches.
2014-08-30 01:47:00 -07:00
echel0n
bcffc09589 Replaced provider backlog only search option with 2 new options that allow you to enable daily searches and backlog searches individually per provider, default is enabled for both. 2014-08-28 22:16:25 -07:00
Adam
f43c214069 Fixes rejection of invalid torrent files 2014-08-26 12:57:40 +08:00
echel0n
4b6602797f Fix for newznab provider searches unicode issues 2014-08-23 14:40:13 -07:00
echel0n
be17ed122b Fix for air-by-date and sports shows issues with parsing results. 2014-08-22 00:21:37 -07:00
echel0n
8415b32fc6 Possible fix for failed to send torrent errors 2014-08-17 22:51:45 -07:00
adam
22f3a2e41b Consolidate more provider code
Fix tvtorrents issue

Remove old providers
2014-08-13 05:52:59 +08:00
echel0n
9761c6c6a3 Fixed issues with torrent blackhole download issues. 2014-07-30 21:31:54 -07:00
echel0n
e6c8982d2b Testing fix for torrent download issues from ezrss 2014-07-28 21:42:53 -07:00
echel0n
19a89d453c We now check if a torrent url links to a valid file before adding as a verified result to get snatched, this helps prevent issues when attempting to add torrent to client later on to find the url returned nothing resulting in a error. 2014-07-28 12:19:41 -07:00
echel0n
60205979a8 Merge pull request #667 from adam111316/anime_propers_3
Anime proper support
2014-07-27 07:17:55 -07:00
echel0n
9493a8f7e5 Added back in missing code for finding propers, was removed by mistake.
Fixed issue with torrent clients not snatching due to improper handling of torrent hashes/files.
2014-07-27 07:04:37 -07:00
Adam
fd9be53fcb Anime propers 2014-07-27 21:04:17 +08:00
echel0n
14c354b551 Added proxy support to Indexer APIs.
Provider getURL and downloadResult functions now removed and replaced with ones from helpers.py to help slim the code down plus allow more better control over request sessions.

Removed TVTumbler code.

Fixed HDBits provider.

Fixed config settings that were ment to be booleans but instead where set as str or int, should help resolve random html errors.

XEM Refresh check re-coded.

NameParser code for creating show object has been changed to only attempt at the very end once its found the bestMatch result, helps on resources and performance.
2014-07-27 03:59:21 -07:00
echel0n
0e5fbbc5c3 Fix for incorrect show snatches 2014-07-24 21:29:03 -07:00
echel0n
de5db9be64 Added ability to set a default indexer for trakt notifier used for adding shows from watch list so that SickRage knows what indexer to set the show as.
Indexer mapping now uses indexer api calls to gather its information and then stores it to a new table called indexer_mapping for instant lookups later on.

Fixed trakt related issues for adding new shows and syncing.

Centered items at bottom of pages to just look a little nicer and fit properly.
2014-07-23 22:07:01 -07:00
echel0n
3a2b67330c During backlog/manual/failed searches we now cache disgarded/ignored results pre-parsed for usage later on incase we end up setting a episode to wanted that matches said results, allows for maximum performance and helps limit the waste of resources used. 2014-07-21 23:00:58 -07:00
echel0n
899d03b5fe Fixed issue with appending UNNOWN qualities to provider results after being sorted. 2014-07-21 18:48:16 -07:00
echel0n
bf41ba59be Fixed sorting provider results by quality code, was causing a error. 2014-07-21 17:55:45 -07:00
echel0n
f340f9b073 Fix for sports shows. 2014-07-21 08:49:20 -07:00
echel0n
6f817c0c5c Quality sorting fixed for provider results.
Reverted newznab search strings being confined to just season till we can find a better way of correcting the issue with Usenet Crawler.
2014-07-21 08:38:56 -07:00
echel0n
39054d7810 Fix for validating episode data during provider result gathering. 2014-07-21 07:21:03 -07:00
echel0n
5ac99b8c5c Fix for extensions being stripped off by mistake made when adding in -RP fix from few commits ago. 2014-07-21 06:29:07 -07:00
echel0n
57cf86279b Places Quality UNKNOWN items from provider results at end of itemsList leaving order of sorted items highest to lowest. 2014-07-20 23:59:57 -07:00
echel0n
d6442e0685 Provider results get sorted by quality before filtering occures. 2014-07-20 23:43:52 -07:00
echel0n
af0ccd65cf Fixes for a few provider issues plus passing of search_mode variable. 2014-07-20 22:47:13 -07:00
echel0n
ff5107cfe2 Provider searches for backlog, manual, and failed have been re-worked to not hammer the providers so much plus perform alot faster. 2014-07-20 22:07:53 -07:00
echel0n
d02c0bd6eb Fixed issues with editing/saving custom scene exceptions.
Fixed charmap issues for anime show names.

Fixed issues with display show page and epCat key errors.

Fixed duplicate log messages for clearing provider caches.

Fixed issues with email notifier ep names not properly being encoded to UTF-8.

TVDB<->TVRAGE Indexer ID mapping is now performed on demand to be used when needed such as newznab providers can be searched with tvrage_id's and some will return tvrage_id's that later can be used to create show objects from for faster and more accurate name parsing, mapping is done via Trakt API calls.

Added stop event signals to schedualed tasks, SR now waits indefinate till task has been fully stopped before completing a restart or shutdown event.

NameParserCache is now persistent and stores 200 parsed results at any given time for quicker lookups and better performance, this helps maintain results between updates or shutdown/startup events.

Black and White lists for anime now only get used for anime shows as intended, performance gain for non-anime shows that dont need to load these lists.

Internal name cache now builds it self on demand when needed per show request plus checks if show is already in cache and if true exits routine to save time.

Schedualer and QueueItems classes are now a sub-class of threading.Thread and a stop threading event signal has been added to each.

If I forgot to list something it doesn't mean its not fixed so please test and report back if anything is wrong or has been corrected by this new release.
2014-07-14 19:00:53 -07:00
echel0n
0e3495d30f Fix for show parsing errors to be displayed via debug logs now instead as a warning. 2014-07-11 00:59:05 -07:00
echel0n
7a95b0bb14 Added new InvalidShowException to NameParser, Removed isGoodResult search check and now attached parsed result show objects and compare them against the show object we use to search with instead. 2014-07-06 06:11:04 -07:00
echel0n
a3a3777d33 Fixed blackAndWhitelist for anime release groups. 2014-07-06 04:12:16 -07:00
echel0n
f0146f728e Lowered CPU usage even further, re-wrote daemonizer code for startups, removed misc unrequired functions from providers. 2014-07-03 07:07:07 -07:00
echel0n
a1cef0b958 Added in context to aid in garbage cleanup to help reduce memory usage. 2014-06-30 10:48:18 -07:00
echel0n
e0eea79ec5 Fix for ABD and Sports shows issue with toordinal function. 2014-06-25 21:39:34 -07:00
echel0n
7e0bb651b2 Database now closes connection after each query and reconnects if closed to ensure no more connection and locked database problems.
Fixed more internal 500 errors.
2014-06-21 15:46:59 -07:00
echel0n
d00d55fdfc Modified DB code to close its connection if right after its finished with it, helps performance-wise and should resolve locked db issues as well. 2014-06-07 14:32:38 -07:00
echel0n
24dfbc3f15 Quality is now set during parsing of results.
Fixed more anime regex bugs.
Fixed Indexer API issues for anime shows and unicode problems.
2014-06-07 04:06:21 -07:00
echel0n
d7396896b5 Added in regex matching with fuzzy matching.
Shows now display Indexer absolute numbering.
Improved speed of parsing search results.
Fixed episode naming issues.
2014-05-31 03:35:11 -07:00
echel0n
f01c5852d4 Improved find propers code.
Backlog and manual searches now check cache first for search results.
2014-05-30 00:51:24 -07:00
echel0n
e009641804 SickRage now stores the XEM scene data to the main DB under tv_episodes for faster lookups and better linkages with epiosde objects, insures we have scene data on hand when we want it!
Adding functions to lookup scene season and ep info via scene absolute numbers.

We now try and create a show object from parsed release info before we consider it a valid parsed result to insure we even have the show in our show list, also used to validate anime releases.

Misc bug fixes here and there.
2014-05-28 14:16:03 -07:00
echel0n
34da3f53d8 Added Black and White list for release groups for anime shows.
Fixed anime show list splitter.

Added check for anime shows and providers so we don't perform searches with a provider that doesn't support the type of show genre we are searching.
2014-05-27 03:09:57 -07:00
echel0n
f7b11e1e98 Fixed issues with post-processing.
Fixed issue with priority post-processing, bug would allow 2nd attempt to go through even if priority settings were not selected.

Fixed issues with cache retrieval and storing of provider results, properly stored now with season and ep info converted to indexer numbering.

Fixed a bug that was caching unconverted scene numbered files for post-processing causing us to skip converting them when needed.
2014-05-26 03:42:34 -07:00
echel0n
9a3e7ab0a9 Added anime support with anidb support.
Added fanzub anime nzb provider.
Fixed NyaaTorrents anime provider.

This is in testing phase so bugs are to be expected.
2014-05-25 23:29:22 -07:00
echel0n
7391a6e454 App name change in code. 2014-05-23 05:37:22 -07:00
echel0n
fa11b4ef3a Removed some sleep timers to improve overall speed of sickrage. 2014-05-20 11:01:51 -07:00
echel0n
c6b064de23 Fixed small typo causing scene numbering to indexer numbering issues 2014-05-19 06:57:20 -07:00
echel0n
66e499ab23 Fixes issues with daily searcher not snatching its results when it has any to snatch.
Fixes issues with not properly converting scene numbering eps to indexer numbering.
2014-05-19 06:08:16 -07:00
echel0n
de20d13c61 Added per-provider option 'backlog only' which allows you to disclude any provider from the daily search but still use it for backlogs, currently working for torrents only and will add to nzb providers later on today.
Cleaned up details on search options for providers and made it look nicer
2014-05-18 09:39:30 -07:00
echel0n
c350c0fdf9 Fixed dupe issues with backlog searches.
Set cache to store results for 1 week and remove anything older then 1 week only if daily search has searched the results before hand.
2014-05-18 08:33:31 -07:00
echel0n
c65573a8d7 Re-wrote daily searcher to search for unaired and wanted episodes going back as far as 1 week, also moved it so it queue's its items now.
Cleaned up description of new per-provider season search options.
2014-05-18 05:59:42 -07:00
echel0n
55f27c4f40 rss cache updates and daily search have been joined into one function.
fixed more issues of missing vars causing saving of config issues.
2014-05-17 11:14:48 -07:00
echel0n
04213bebf2 Fixed bug that was causing issues with saving config.
Fixed bug that was causing searches to double up on there results.
2014-05-17 10:30:23 -07:00
echel0n
a3e06b965f Added in CPU Throttling option under general config -> advanced.
Fixed issues with passwords and unicode chars.
Fixed issue with usenet_retention variable not being saved or set.
2014-05-17 04:40:26 -07:00
echel0n
f9052ca2b2 Fixes to help with brining down the cpu usage of SickRage 2014-05-17 02:27:17 -07:00
echel0n
e96035ff4f Added per-provider options search mode and search fallback.
Search mode allows you to choose season packs only or episodes only which controls how backlogs search for data.

Search fallback if selected will attempt a 2nd search this time using the alternative search mode to see if it can get results if the previous attempt failed.

Provider settings are now read and stored dynamically instead of always having to retrieve them by there static names, this will allow for dropping in new provider modules easier to intergrate with existing options already present.

Fixed search code to not perform dupe searches by mistake.

Cache stores a list of shows we have rejected so that next time around we don't have to process them to know we don't like em.
2014-05-16 22:29:44 -07:00
echel0n
816a3d9572 Fixes season pack and episode only searches 2014-05-16 02:16:01 -07:00
echel0n
e309aa2cbf Fixed more unrequired search strings from being created and wasting our time doing duplicate searches 2014-05-15 22:40:49 -07:00
echel0n
4576ade4ce Fixed a issue that was causing multiple search strings to be created for the same season or episode during a search, this would of caused unrequired searches to be performed. 2014-05-15 22:16:35 -07:00
echel0n
e20adcfab8 Added daily searcher to check for and snatch daily new releases for current active watched shows. User settable interval can be found in search config menu plus forcing a daily search can be done from Manage Searches menu.
Fixed issues with subliminal subtitle downloader.
2014-05-14 21:16:46 -07:00
echel0n
d2b4ad526d Fix for sports air-by-date shows 2014-05-13 12:04:59 -07:00
echel0n
ed8de59e91 Fixed air-by-date issues with downloading a show that results in downloading the incorrect show afterwards. 2014-05-13 12:02:22 -07:00
echel0n
1d339b97f6 Fix for looping issue during backlog searches 2014-05-12 12:48:47 -07:00
echel0n
7c9e4b24d5 Fix for backlog and manual searches not being executed 2014-05-12 04:10:45 -07:00
echel0n
31297b9069 Added RSS Cache updater with user-settable interval from config section of web interface, updates the cache so that searches can be more instant when looking for snatches.
Updated backlog search code to re-set skipped or missed episodes to wanted.
2014-05-12 01:52:14 -07:00
echel0n
52efb6f43b Added incomplete indexer <-> scene mapping check 2014-05-11 15:24:02 -07:00
echel0n
7ce27b72f5 Fix for scene numbering issues 2014-05-11 12:50:34 -07:00
echel0n
aafe9ad522 Removed snatch queues to reduce memory footprint.
Fixed issue #527
2014-05-11 12:04:47 -07:00
echel0n
f8035e800e Fix for air-by-date downloads.
Fix for backlog and manual searches.
2014-05-11 07:17:11 -07:00
echel0n
e977750702 Merge branch 'origin/master'
Conflicts:
	sickbeard/__init__.py
2014-05-11 05:55:12 -07:00
echel0n
1398c38275 Fix for manual and backlog download/search issues.
Removed multi-threading as it was more problems then usefull for now.

Added in match & snatch, any quality from initial quality settings gets downloaded first and does not continue searching, if archive qualities exist it'll stop once it hits max quality from said list.
2014-05-11 05:51:39 -07:00
sammy2142
57737feb5c Adds Per Provider Seed Ratio 2014-05-10 12:50:07 +01:00
echel0n
2a4f8780e2 Fixed issues with multi-threading.
Fixed issues with snatching air-by-date shows.
Fixed issues with naming patterns.
Fixed issues with invalid literals.
Fixed issues with country codes missing and causing web errors.

Fixed so many issues I can't write them all done ... :)
2014-05-08 07:04:01 -07:00
echel0n
fc94243546 Fixes backlog and manual searches.
Fixes season pack and single/multi episode searches.
Fixes multi-threading issues.
Fixes incorrect status being reported for manual searches.
Fixes quality being returned as N/A all the time for torrents.
2014-05-07 00:50:49 -07:00
echel0n
8a61eb1e26 Added in some sleep timers to help improve overall cpu usage 2014-05-06 14:35:37 -07:00
echel0n
fb71c6139e Added in optional multi-threading for all search queues, can be set from General->Advanced config section.
Fixed issue #417 and #335
2014-05-06 04:29:38 -07:00
echel0n
b33e2be047 Fixes for backlog search.
Fixes for downloading the same episode twice.
Fixes for caches.
2014-05-05 06:26:02 -07:00
echel0n
235a5d0161 Fixes empty searchStrings and empty itemList issues if they happened. 2014-05-04 20:13:10 -07:00
echel0n
a5b72dea84 Fixes issues with findpropers and airdate.
Fixes issues with unhashable dict types.
Fixes issues with 100% CPU usage.
Fixes issues with RSS feed cache.
Fixes issues with scene numbering and converting back to indexer numbering.
Fixes issues with backlog searches.
Fixes issues with season pack searches.
Fixes issues with BTN.
2014-05-04 20:08:32 -07:00
Nils Vogels
b7aa62c553 More typo fixes :S 2014-05-05 00:53:53 +02:00
Nils Vogels
fca48bfe64 Fixing typo 2014-05-05 00:40:02 +02:00