Commit graph

150 commits

Author SHA1 Message Date
echel0n
59675f27ac Fixed failed download handling.
Improved search queue code.
2014-09-06 21:36:23 -07:00
echel0n
65eda93b2b Fixed high CPU usage during searches, adding conditional check to prevent un-needed name parsing of search results when search result was previously already parsed and checked during filtering of bad releases 2014-09-06 17:25:07 -07:00
echel0n
ee458bd211 Fixed AttributeError: 'NoneType' object has no attribute 'is_scene' in scene_numbering code.
Show root dirs can not be set from general config menu.
Mass editing shows now has the ability to delete root dirs as well as edit them.
Daily search no longer is restricted to just 1 week of results for searching from which now allows for replacing lower quality downloads with higher quality ones if available.
RSS Cache is updated for each provider on demand now when performing manual, failed, backlog, or daily searches.
2014-08-30 01:47:00 -07:00
echel0n
bcffc09589 Replaced provider backlog only search option with 2 new options that allow you to enable daily searches and backlog searches individually per provider, default is enabled for both. 2014-08-28 22:16:25 -07:00
garvinob
dce55b3dac Renamed bestSeasonNZB to bestSeasonResult
bestSeasonNZB is confusing in this context
we are dealing with results which can be
NZBs or Torrents
2014-08-24 18:47:06 +01:00
garvinob
94063db43e Fixed result content for Season Pack results
Added an extra check into the snatchEpisode method
so that the result.content data for a required
torrent is always downloaded if needed
2014-08-24 00:19:17 +01:00
echel0n
11150efab0 Filter out possible torrent links that would return a 404 http error 2014-08-17 22:21:37 -07:00
echel0n
f3073174ed Possible fix for failed to send torrent errors 2014-08-17 22:02:29 -07:00
echel0n
88d68cfe11 Possible fix for failed to send torrent errors 2014-08-17 21:40:18 -07:00
echel0n
e2d1178515 Fix for season pack searches 2014-08-17 18:36:21 -07:00
echel0n
0a936ea1ef Changed log message to be less confusing for torrents 2014-08-17 18:32:47 -07:00
David Waldhans
16ae4c1db7 Fixed search pattern for checking ignored and required words in release names 2014-08-10 13:56:55 +02:00
echel0n
19a89d453c We now check if a torrent url links to a valid file before adding as a verified result to get snatched, this helps prevent issues when attempting to add torrent to client later on to find the url returned nothing resulting in a error. 2014-07-28 12:19:41 -07:00
echel0n
9493a8f7e5 Added back in missing code for finding propers, was removed by mistake.
Fixed issue with torrent clients not snatching due to improper handling of torrent hashes/files.
2014-07-27 07:04:37 -07:00
echel0n
14c354b551 Added proxy support to Indexer APIs.
Provider getURL and downloadResult functions now removed and replaced with ones from helpers.py to help slim the code down plus allow more better control over request sessions.

Removed TVTumbler code.

Fixed HDBits provider.

Fixed config settings that were ment to be booleans but instead where set as str or int, should help resolve random html errors.

XEM Refresh check re-coded.

NameParser code for creating show object has been changed to only attempt at the very end once its found the bestMatch result, helps on resources and performance.
2014-07-27 03:59:21 -07:00
echel0n
012baeda0c Fix for no providers found error during searches. 2014-07-24 12:05:49 -07:00
echel0n
b16ff81478 Fixes for thread naming issues where provider names are getting stacked on top each other per loop iteration.
Fix for speedcd no json data issue.

Fix for DB upgrade syntax errors caused by previous commit.
2014-07-24 09:12:29 -07:00
echel0n
636bbfa2de Fixes issues with scene exception updating when editing a show, should resolve problems with it duplicating scene exception name over and over again.
Reduced DB sleep timer to increase overall performance of application.

Improved generic queue code for threading.
2014-07-19 22:29:19 -07:00
echel0n
c25da850ab Updated scene exception code for checking when last refreshed. 2014-07-19 04:52:55 -07:00
echel0n
d02c0bd6eb Fixed issues with editing/saving custom scene exceptions.
Fixed charmap issues for anime show names.

Fixed issues with display show page and epCat key errors.

Fixed duplicate log messages for clearing provider caches.

Fixed issues with email notifier ep names not properly being encoded to UTF-8.

TVDB<->TVRAGE Indexer ID mapping is now performed on demand to be used when needed such as newznab providers can be searched with tvrage_id's and some will return tvrage_id's that later can be used to create show objects from for faster and more accurate name parsing, mapping is done via Trakt API calls.

Added stop event signals to schedualed tasks, SR now waits indefinate till task has been fully stopped before completing a restart or shutdown event.

NameParserCache is now persistent and stores 200 parsed results at any given time for quicker lookups and better performance, this helps maintain results between updates or shutdown/startup events.

Black and White lists for anime now only get used for anime shows as intended, performance gain for non-anime shows that dont need to load these lists.

Internal name cache now builds it self on demand when needed per show request plus checks if show is already in cache and if true exits routine to save time.

Schedualer and QueueItems classes are now a sub-class of threading.Thread and a stop threading event signal has been added to each.

If I forgot to list something it doesn't mean its not fixed so please test and report back if anything is wrong or has been corrected by this new release.
2014-07-14 19:00:53 -07:00
echel0n
7a95b0bb14 Added new InvalidShowException to NameParser, Removed isGoodResult search check and now attached parsed result show objects and compare them against the show object we use to search with instead. 2014-07-06 06:11:04 -07:00
echel0n
75f69396d4 Reverted some changes. 2014-06-30 08:57:32 -07:00
echel0n
5e507b3849 More memory reductions and cleanups 2014-06-30 04:44:36 -07:00
echel0n
301f124cbb Fixed dailysearcher to only update the cache results for each provider once at start of the dailysearch routine instead of per-show which was wasting cycles and time. 2014-06-26 17:13:41 -07:00
echel0n
7e0bb651b2 Database now closes connection after each query and reconnects if closed to ensure no more connection and locked database problems.
Fixed more internal 500 errors.
2014-06-21 15:46:59 -07:00
echel0n
d73cc1cbbd Replaced cherrypy with tornado which helped resolve our memory leak issue. 2014-06-14 20:56:15 -07:00
echel0n
d00d55fdfc Modified DB code to close its connection if right after its finished with it, helps performance-wise and should resolve locked db issues as well. 2014-06-07 14:32:38 -07:00
echel0n
997896a540 Fix for transactionals and None Types in sql lists 2014-05-30 04:42:31 -07:00
echel0n
70e7f1bfce Fixed issues with scene numbering being overwritten by ep objects.
Converted more object saves to database to use transactionals, better performance.
2014-05-30 03:01:49 -07:00
echel0n
e009641804 SickRage now stores the XEM scene data to the main DB under tv_episodes for faster lookups and better linkages with epiosde objects, insures we have scene data on hand when we want it!
Adding functions to lookup scene season and ep info via scene absolute numbers.

We now try and create a show object from parsed release info before we consider it a valid parsed result to insure we even have the show in our show list, also used to validate anime releases.

Misc bug fixes here and there.
2014-05-28 14:16:03 -07:00
echel0n
34da3f53d8 Added Black and White list for release groups for anime shows.
Fixed anime show list splitter.

Added check for anime shows and providers so we don't perform searches with a provider that doesn't support the type of show genre we are searching.
2014-05-27 03:09:57 -07:00
echel0n
9a3e7ab0a9 Added anime support with anidb support.
Added fanzub anime nzb provider.
Fixed NyaaTorrents anime provider.

This is in testing phase so bugs are to be expected.
2014-05-25 23:29:22 -07:00
echel0n
7391a6e454 App name change in code. 2014-05-23 05:37:22 -07:00
echel0n
5c43787560 Fixed missing ui notification for snatched episodes. 2014-05-22 23:58:29 -07:00
echel0n
9cd9576232 Fix for Next Ep airdates.
Added check for hidden folders in post-processing.
Cleaned up daily search function.
2014-05-21 20:12:15 -07:00
echel0n
a15db1719d Removed some re-dundant code from daily search.
Fixed up some entries in mede8er metadata provider.
Changed detection of non-season packs.
2014-05-20 08:08:44 -07:00
echel0n
71604b5769 Fixed issue for season searches using episode only mode but fallback to season only mode, was small typo correction 2014-05-19 08:59:22 -07:00
echel0n
de20d13c61 Added per-provider option 'backlog only' which allows you to disclude any provider from the daily search but still use it for backlogs, currently working for torrents only and will add to nzb providers later on today.
Cleaned up details on search options for providers and made it look nicer
2014-05-18 09:39:30 -07:00
echel0n
f0d78dbfbb Merge branch 'origin/dev' 2014-05-18 08:58:04 -07:00
echel0n
6709ebdf12 Fixed issues with daily searcher 2014-05-18 08:57:07 -07:00
echel0n
c350c0fdf9 Fixed dupe issues with backlog searches.
Set cache to store results for 1 week and remove anything older then 1 week only if daily search has searched the results before hand.
2014-05-18 08:33:31 -07:00
echel0n
f8a8f4c5b4 Fixed issues in mede8er metadata module 2014-05-18 06:26:34 -07:00
echel0n
c65573a8d7 Re-wrote daily searcher to search for unaired and wanted episodes going back as far as 1 week, also moved it so it queue's its items now.
Cleaned up description of new per-provider season search options.
2014-05-18 05:59:42 -07:00
echel0n
905d2b4eaf Fix for possible infinitie loop in searches 2014-05-17 09:43:34 -07:00
echel0n
0b9b6228ae Fix for issues with fallback search option.
Fix for issues with passwords.
2014-05-17 03:01:09 -07:00
echel0n
e96035ff4f Added per-provider options search mode and search fallback.
Search mode allows you to choose season packs only or episodes only which controls how backlogs search for data.

Search fallback if selected will attempt a 2nd search this time using the alternative search mode to see if it can get results if the previous attempt failed.

Provider settings are now read and stored dynamically instead of always having to retrieve them by there static names, this will allow for dropping in new provider modules easier to intergrate with existing options already present.

Fixed search code to not perform dupe searches by mistake.

Cache stores a list of shows we have rejected so that next time around we don't have to process them to know we don't like em.
2014-05-16 22:29:44 -07:00
echel0n
816a3d9572 Fixes season pack and episode only searches 2014-05-16 02:16:01 -07:00
echel0n
e309aa2cbf Fixed more unrequired search strings from being created and wasting our time doing duplicate searches 2014-05-15 22:40:49 -07:00
echel0n
a39c881cb3 Complete re-write of backlog search.
Fixed air-by-date backlog searches.
2014-05-15 20:39:46 -07:00
echel0n
8ac8150eb3 Fixed issues with search results not being snatched when searching shows with custom quality settings.
Added option to force a RSS update under Manage searches.

Added status of rss updates and daily searches to be displayed at bottom of pages.
2014-05-15 14:43:57 -07:00
echel0n
eeb632fd0f Fix for search iteration issue 2014-05-14 15:28:44 -07:00
JackDandy
6988ffb82b PickBestResult x264 over xvid where both exist. 2014-05-14 13:53:12 +01:00
echel0n
93573abdc4 Fixes issues with possible duplicate downloads. 2014-05-13 19:19:28 -07:00
echel0n
734de67684 Improved manual, failed, and backlog searching. 2014-05-13 14:47:54 -07:00
echel0n
b8a499b3d3 Fix for manual and backlog searches to insure maximum results are returned 2014-05-13 13:38:32 -07:00
echel0n
5f8037530a Fix for when no best match is found. 2014-05-13 10:11:19 -07:00
echel0n
f78ed64878 Fix for failed downloads and improper storing of release name in db 2014-05-13 09:30:25 -07:00
echel0n
9301d29433 Improved performance of RSS Cache updater 2014-05-13 00:03:10 -07:00
echel0n
6dee243904 Season pack fix 1200 2014-05-12 12:58:55 -07:00
echel0n
651e71082e Fix for season pack searches ... ALL PROVIDERS! 2014-05-12 12:08:52 -07:00
echel0n
858ac3af18 Test #2000 for season pack fix for BTN 2014-05-12 11:57:26 -07:00
echel0n
b5890b2af7 Testing season pack fix for BTN 2014-05-12 10:49:59 -07:00
echel0n
72278cfcb2 Fix for failed downloads 2014-05-12 06:31:37 -07:00
Nils Vogels
40bce690cb Added error when trying to search but show info is missing 2014-05-12 13:55:56 +02:00
echel0n
694b210f2d Added code to insure no downloading of duplicates and that it downloads the highest quality from results returned by all providers 2014-05-11 12:39:20 -07:00
echel0n
41366dcba7 Code cleanup 2014-05-11 12:10:54 -07:00
echel0n
aafe9ad522 Removed snatch queues to reduce memory footprint.
Fixed issue #527
2014-05-11 12:04:47 -07:00
echel0n
e3bf97285c Fix for thread name 2014-05-11 08:10:57 -07:00
echel0n
cd91e2430f Fixed typo 2014-05-11 07:41:14 -07:00
echel0n
448a45cf40 Fix for complete season snatches.
Removed multi-threading option from general config
2014-05-11 07:40:24 -07:00
echel0n
e977750702 Merge branch 'origin/master'
Conflicts:
	sickbeard/__init__.py
2014-05-11 05:55:12 -07:00
echel0n
1398c38275 Fix for manual and backlog download/search issues.
Removed multi-threading as it was more problems then usefull for now.

Added in match & snatch, any quality from initial quality settings gets downloaded first and does not continue searching, if archive qualities exist it'll stop once it hits max quality from said list.
2014-05-11 05:51:39 -07:00
sammy2142
57737feb5c Adds Per Provider Seed Ratio 2014-05-10 12:50:07 +01:00
echel0n
2a4f8780e2 Fixed issues with multi-threading.
Fixed issues with snatching air-by-date shows.
Fixed issues with naming patterns.
Fixed issues with invalid literals.
Fixed issues with country codes missing and causing web errors.

Fixed so many issues I can't write them all done ... :)
2014-05-08 07:04:01 -07:00
echel0n
9084d7de19 Fixed issues with added new shows not showing any episodes.
Fixed issues with duplicate downloads of the same season/episode caused by multithreading.
2014-05-07 02:03:57 -07:00
echel0n
fc94243546 Fixes backlog and manual searches.
Fixes season pack and single/multi episode searches.
Fixes multi-threading issues.
Fixes incorrect status being reported for manual searches.
Fixes quality being returned as N/A all the time for torrents.
2014-05-07 00:50:49 -07:00
echel0n
fb71c6139e Added in optional multi-threading for all search queues, can be set from General->Advanced config section.
Fixed issue #417 and #335
2014-05-06 04:29:38 -07:00
Nils Vogels
b177c1ade2 Merging changes from Prinz23, PR#156 2014-05-06 00:48:28 +02:00
echel0n
b33e2be047 Fixes for backlog search.
Fixes for downloading the same episode twice.
Fixes for caches.
2014-05-05 06:26:02 -07:00
echel0n
a5b72dea84 Fixes issues with findpropers and airdate.
Fixes issues with unhashable dict types.
Fixes issues with 100% CPU usage.
Fixes issues with RSS feed cache.
Fixes issues with scene numbering and converting back to indexer numbering.
Fixes issues with backlog searches.
Fixes issues with season pack searches.
Fixes issues with BTN.
2014-05-04 20:08:32 -07:00
Nils Vogels
fde5ce4c58 Correcting typos in prefer_season_download feature 2014-05-05 00:20:23 +02:00
Nils Vogels
84120ee00e Option to prefer single episode releases over season releases:
- Added option "prefer_episode_releases" to config.ini. If a complete season of a show is added to the backlog this option will make sickbeard prefer single episode releases for that season over a comlete season release.

Backport of 1ec7c61023 into dev branch
2014-05-04 15:58:20 +02:00
echel0n
b349bab569 Fixes more issues that were still present for season pack searches and air-by-date shows. 2014-05-03 22:36:54 -07:00
echel0n
c29b29a7e7 Merge pull request #312 from WebSpider/dev-code_cleanup
Code cleanup
2014-05-03 05:24:15 -07:00
echel0n
d5f183c171 Major changes made to search code, tvcache code, and name parser 2014-05-03 02:23:26 -07:00
Nils Vogels
17171dba8b Simplifying expressions 2014-05-02 13:33:06 +02:00
echel0n
5a1823a15a Fixes a few more issues with backlog searches, relates to issue #298 2014-05-01 22:14:56 -07:00
echel0n
1c6b0807b0 Fixed backlog issues and improved cache and provider searches, this resolves issue #298 2014-05-01 21:53:34 -07:00
echel0n
f6cf80aa99 Fixed issue #221
Manual and Backlog searches now gather all the search results FIRST then loop through them filtering the bad ones out, this should improve overall speed of searching for downloads.
2014-04-30 21:09:03 -07:00
echel0n
319ac2602f Fixed scene_numbering issues for shows that use scene numbers instead of TVDB numbering.
Fixed issues with local SB cache.

Fixed issues with sports naming patterns, we no longer treat sports as a airdate show and have created custom regex's to aid in finding sports related shows.
2014-04-30 05:10:13 -07:00
echel0n
87b752b4e5 Re-coded the Indexer cache, cache lookups are only performed for existing shows and we don't add any cache entries unless we are Indexing the show in our database so we don't waste cpu cycles and memory.
Manual and backlog searches both search the cache first before even attempting to send a search request to a provider.

More bugs have been worked out.
2014-04-29 06:14:19 -07:00
echel0n
5e38813a73 Added sports feature, acts just like air_by_date except allows us to control the date pattern to match events that air_by_date could not.
Custome sports naming patterns can be set now as well.

Fixed issues with FINDPROPERS.

Fixed issues with session connections.

Cleaned up code.
2014-04-28 02:15:29 -07:00
echel0n
5772de9eec Complete re-code of season/episode search code.
Switched from using standard requests to using sessions.
Fixed bug in speedcd that was preventing config from saving.
2014-04-27 03:31:54 -07:00
echel0n
07cee09c83 Fix for reguired and prefered ignore words. 2014-04-25 23:33:02 -07:00
echel0n
c945726f05 Fixed subliminal issues.
Added ignore/required words option to bet set individually for each show.
Fixed issue with global ignore words not properly matching against releases.
Fixed issue with
2014-04-23 22:18:16 -07:00
echel0n
95d7d728e0 Re-write of Indexer API wrapper
Re-write of New Show seearch function
Re-write of Existing show search helper function for determining indexer/indexerid
Massive code cleanup and more bugs found and fixed
Indexer code fully modualized for future proofing
2014-03-24 22:57:24 -07:00
echel0n
10637f8f29 Code Clean up and regex fix for "no repeats" error (reverted from commit 8ecd5a196d) 2014-03-20 11:03:22 -07:00
echel0n
8ecd5a196d Code cleanup and regex fix for "no repeats" error 2014-03-20 10:51:59 -07:00
echel0n
f4a9987933 Added in a new feature called "Archive First Match", you can enable this feature from displayShow->editShow by using custom qualities and checking off "archive first match"
This feature will snatch and your episode based on matching ANY one of your archive quality choices on a first match basis then set its status to archived to prevent further snatch attempts.
2014-03-19 16:33:49 -07:00
echel0n
0d9fbc1ad7 Welcome to our SickBeard-TVRage Edition ...
This version of SickBeard uses both TVDB and TVRage to search and gather it's series data from allowing you to now have access to and download shows that you couldn't before because of being locked into only what TheTVDB had to offer.

Also this edition is based off the code we used in our XEM editon so it does come with scene numbering support as well as all the other features our XEM edition has to offer.

Please before using this with your existing database (sickbeard.db) please make a backup copy of it and delete any other database files such as cache.db and failed.db if present, we HIGHLY recommend starting out with no database files at all to make this a fresh start but the choice is at your own risk!

Enjoy!
2014-03-09 22:39:12 -07:00