Commit graph

146 commits

Author SHA1 Message Date
echel0n
7a95b0bb14 Added new InvalidShowException to NameParser, Removed isGoodResult search check and now attached parsed result show objects and compare them against the show object we use to search with instead. 2014-07-06 06:11:04 -07:00
echel0n
a3a3777d33 Fixed blackAndWhitelist for anime release groups. 2014-07-06 04:12:16 -07:00
echel0n
56e2c28bad SickRage now uses a internal name cache comprised of (showlist, scene exceptions, scene names) used to search and create show objects from which is needed for parsing search results.
Scene exceptions now uses a internal cache for scene exceptions and scene season exceptions, helps reduce overhead to DB and performs faster lookups when making scene exception requests.
2014-07-03 10:30:15 -07:00
echel0n
12ac388dc2 Fixed startup/restart/shutdown issues on Windows, Linux, FreeBSD platforms tested.
Fixed for updating issues.

Fixed high cpu and memory usage.
2014-07-02 11:51:14 -07:00
echel0n
9136df2ae5 RSS Feeds purges every 7 days now. 2014-06-30 12:02:45 -07:00
echel0n
7bff5a246f Fix for rss feeds clearcache 2014-06-30 11:57:16 -07:00
echel0n
a1cef0b958 Added in context to aid in garbage cleanup to help reduce memory usage. 2014-06-30 10:48:18 -07:00
echel0n
75f69396d4 Reverted some changes. 2014-06-30 08:57:32 -07:00
echel0n
5e507b3849 More memory reductions and cleanups 2014-06-30 04:44:36 -07:00
nielsenj
8f16fad1ec Added request headers param. 2014-06-29 20:50:12 -07:00
echel0n
0c57676aed Updated tornado source code.
Created custom class for rss feed parser.
2014-06-29 03:05:33 -07:00
echel0n
cafdc57b2c Testing fix for redirect issues and blank pages.
Fix for create pid issues.
Fix for creating index on tv provider cache tables.
2014-06-28 22:54:29 -07:00
echel0n
cfbb7678a9 Fixed duplicate tv cache issue. 2014-06-27 20:33:31 -07:00
echel0n
d091c3a138 Fixed SQL Syntax errors 2014-06-26 15:57:06 -07:00
echel0n
13cbffb6d4 Deletes duplicates found in tv provider cache before creating unique index for provider table or just performs cleanup of any duplicate record period. 2014-06-26 03:29:05 -07:00
echel0n
9f8c49ce88 Fixed issue with tvcache filling with duplicate data. 2014-06-26 03:20:07 -07:00
echel0n
e0eea79ec5 Fix for ABD and Sports shows issue with toordinal function. 2014-06-25 21:39:34 -07:00
echel0n
7e0bb651b2 Database now closes connection after each query and reconnects if closed to ensure no more connection and locked database problems.
Fixed more internal 500 errors.
2014-06-21 15:46:59 -07:00
Nils
166dffeb5a Merge pull request #582 from bikemike222/add_cookies_rss
Added cookie support to custom torrent provider
2014-06-09 00:20:37 +02:00
echel0n
1f180a5a05 Fix for closing cache connection early when needed. 2014-06-07 16:16:01 -07:00
echel0n
a1da7df12e Fixes for DB issues 2014-06-07 15:35:16 -07:00
echel0n
d00d55fdfc Modified DB code to close its connection if right after its finished with it, helps performance-wise and should resolve locked db issues as well. 2014-06-07 14:32:38 -07:00
echel0n
cec4ed573d Upgraded CherryPy libs to 3.3.0
Switched out sqlite3 libs in favour of SQLAlchemy v0.9, will gradually migrate dialects and scheme to be fully SQLAlchemy compliant for using there ORM with sessions instead of direct.

Fixed getEpisode function to stop making unrequired scene number conversions on already converted data thats available now from cache.
2014-06-04 18:28:59 -07:00
echel0n
277d630a6f Fixed issues with scene converting 2014-05-31 03:35:57 -07:00
echel0n
997896a540 Fix for transactionals and None Types in sql lists 2014-05-30 04:42:31 -07:00
echel0n
c5f933e4c8 Fixed app performance issues from recent upgrades.
Fixed issues with manual searches not working.

Moved misc routine tasks to a proper schedualed thread that runs every 1 hour for updating network timezones, scene exceptions, and trimming failed history.

Forced misc routine tasks at startup to complete first before anything else runs, critical since this does our scene exception updates and internal scene cache loading which is needed before searches begin.
2014-05-26 13:16:07 -07:00
echel0n
f7b11e1e98 Fixed issues with post-processing.
Fixed issue with priority post-processing, bug would allow 2nd attempt to go through even if priority settings were not selected.

Fixed issues with cache retrieval and storing of provider results, properly stored now with season and ep info converted to indexer numbering.

Fixed a bug that was caching unconverted scene numbered files for post-processing causing us to skip converting them when needed.
2014-05-26 03:42:34 -07:00
echel0n
9a3e7ab0a9 Added anime support with anidb support.
Added fanzub anime nzb provider.
Fixed NyaaTorrents anime provider.

This is in testing phase so bugs are to be expected.
2014-05-25 23:29:22 -07:00
Bike Mike
89c944ec94 Added cookie support to custom torrent provider 2014-05-25 19:19:45 +02:00
echel0n
7391a6e454 App name change in code. 2014-05-23 05:37:22 -07:00
echel0n
e09c4976a5 Removed internal cache update checks, cache updates will now perform at the interval setting time you set for daily searches. 2014-05-20 20:55:42 -07:00
echel0n
fa11b4ef3a Removed some sleep timers to improve overall speed of sickrage. 2014-05-20 11:01:51 -07:00
echel0n
66e499ab23 Fixes issues with daily searcher not snatching its results when it has any to snatch.
Fixes issues with not properly converting scene numbering eps to indexer numbering.
2014-05-19 06:08:16 -07:00
echel0n
c350c0fdf9 Fixed dupe issues with backlog searches.
Set cache to store results for 1 week and remove anything older then 1 week only if daily search has searched the results before hand.
2014-05-18 08:33:31 -07:00
echel0n
c65573a8d7 Re-wrote daily searcher to search for unaired and wanted episodes going back as far as 1 week, also moved it so it queue's its items now.
Cleaned up description of new per-provider season search options.
2014-05-18 05:59:42 -07:00
echel0n
a3e06b965f Added in CPU Throttling option under general config -> advanced.
Fixed issues with passwords and unicode chars.
Fixed issue with usenet_retention variable not being saved or set.
2014-05-17 04:40:26 -07:00
echel0n
f9052ca2b2 Fixes to help with brining down the cpu usage of SickRage 2014-05-17 02:27:17 -07:00
echel0n
25e2430820 Added code to check and confirm that a daily search was performed on previous cache results before we go ahead with clearing the cache and wasting results that could hold potential items to be snatched. 2014-05-15 00:20:00 -07:00
echel0n
1fcfa4c70a Improved caching results code, helps with daily searches. 2014-05-14 22:55:39 -07:00
echel0n
e20adcfab8 Added daily searcher to check for and snatch daily new releases for current active watched shows. User settable interval can be found in search config menu plus forcing a daily search can be done from Manage Searches menu.
Fixed issues with subliminal subtitle downloader.
2014-05-14 21:16:46 -07:00
echel0n
dd16da1a5f Fixed cache issues.
Fixed air-by-date issues
2014-05-13 08:44:31 -07:00
echel0n
9301d29433 Improved performance of RSS Cache updater 2014-05-13 00:03:10 -07:00
echel0n
31297b9069 Added RSS Cache updater with user-settable interval from config section of web interface, updates the cache so that searches can be more instant when looking for snatches.
Updated backlog search code to re-set skipped or missed episodes to wanted.
2014-05-12 01:52:14 -07:00
echel0n
1398c38275 Fix for manual and backlog download/search issues.
Removed multi-threading as it was more problems then usefull for now.

Added in match & snatch, any quality from initial quality settings gets downloaded first and does not continue searching, if archive qualities exist it'll stop once it hits max quality from said list.
2014-05-11 05:51:39 -07:00
echel0n
2a4f8780e2 Fixed issues with multi-threading.
Fixed issues with snatching air-by-date shows.
Fixed issues with naming patterns.
Fixed issues with invalid literals.
Fixed issues with country codes missing and causing web errors.

Fixed so many issues I can't write them all done ... :)
2014-05-08 07:04:01 -07:00
echel0n
fc94243546 Fixes backlog and manual searches.
Fixes season pack and single/multi episode searches.
Fixes multi-threading issues.
Fixes incorrect status being reported for manual searches.
Fixes quality being returned as N/A all the time for torrents.
2014-05-07 00:50:49 -07:00
echel0n
a5b72dea84 Fixes issues with findpropers and airdate.
Fixes issues with unhashable dict types.
Fixes issues with 100% CPU usage.
Fixes issues with RSS feed cache.
Fixes issues with scene numbering and converting back to indexer numbering.
Fixes issues with backlog searches.
Fixes issues with season pack searches.
Fixes issues with BTN.
2014-05-04 20:08:32 -07:00
echel0n
129a8c1d7e Added cache for rss feed items.
Fixed issues with searches
2014-05-04 05:05:27 -07:00
echel0n
5252cbb72c Fixes issues found in cache and with season pack searches 2014-05-04 00:10:49 -07:00
echel0n
9fc07617f1 Fix for NoneType object error 2014-05-03 03:41:56 -07:00
echel0n
cb4790a213 Typo fixed 2014-05-03 03:37:26 -07:00
echel0n
75c7fbf137 Fixes issues in tvcache 2014-05-03 03:36:57 -07:00
echel0n
d5f183c171 Major changes made to search code, tvcache code, and name parser 2014-05-03 02:23:26 -07:00
echel0n
3a60683327 Fixed issues with parsing release names and naming patterns including regex for sports is now more accurate then ever!
Added option under general settings to allow specifiying a default indexer to be used for adding newshows and existing shows (All, TVDB, TVRage)
2014-05-01 17:57:51 -07:00
echel0n
f6cf80aa99 Fixed issue #221
Manual and Backlog searches now gather all the search results FIRST then loop through them filtering the bad ones out, this should improve overall speed of searching for downloads.
2014-04-30 21:09:03 -07:00
echel0n
e6056c5745 Fix for adding existing shows. 2014-04-30 20:05:35 -07:00
echel0n
1f74488a38 Fix for showObj attribute error in cache 2014-04-30 19:10:46 -07:00
echel0n
7e800ff524 Fixed manual episode searches.
Corrected a issue where SB was being searched twice for the same show wasting cpu cycles.
2014-04-30 18:20:53 -07:00
echel0n
9d191f6999 Fixes for post-processing issues.
Improvements made to caches for overall performance boost and more accurate matches.

Misc bug fixes applied.
2014-04-30 15:16:31 -07:00
Nils
d595a9abfd Merge pull request #252 from WebSpider/dev-cache_typo
Typo in logging text, closes #251
2014-04-30 23:54:11 +02:00
Nils Vogels
316500b8e7 Fixing typo 2014-04-30 17:27:22 +02:00
echel0n
3f8729ef83 Added back in name cache but force it to only store entries if they have a valid Indexer ID otherwise disgard them. 2014-04-30 07:02:47 -07:00
echel0n
9384881241 Fixed issues with searching for air by date shows and sports.
Several bugfixes applied throughout the code along with cleanup performed.
2014-04-30 06:49:50 -07:00
echel0n
319ac2602f Fixed scene_numbering issues for shows that use scene numbers instead of TVDB numbering.
Fixed issues with local SB cache.

Fixed issues with sports naming patterns, we no longer treat sports as a airdate show and have created custom regex's to aid in finding sports related shows.
2014-04-30 05:10:13 -07:00
echel0n
19cf543693 Fix for indexerid issues with cache.
Fix for regex matching.
2014-04-29 15:14:03 -07:00
echel0n
e379d57376 Fix for showobj none type 2014-04-29 08:23:32 -07:00
echel0n
cc0296783b More cache fixes 2014-04-29 07:55:38 -07:00
echel0n
e10a725d27 Fix for None type in cache 2014-04-29 07:52:48 -07:00
echel0n
dbe7e019f6 Cache issue fixes.
Naming Pattern issues fixed.
Regex patterns cleaned up.
Misc bug fixes.
2014-04-29 07:44:13 -07:00
echel0n
87b752b4e5 Re-coded the Indexer cache, cache lookups are only performed for existing shows and we don't add any cache entries unless we are Indexing the show in our database so we don't waste cpu cycles and memory.
Manual and backlog searches both search the cache first before even attempting to send a search request to a provider.

More bugs have been worked out.
2014-04-29 06:14:19 -07:00
echel0n
dbee4b6dbf Fix for issues getting indexerID during cache updates 2014-04-28 23:04:32 -07:00
echel0n
c330bbb386 Fixed issues with post-processing, we now perform the auto-detection of the indexer in a spot that doesn't require the post-processing to start all the way from the begining allowing for less processing time to take place.
Fixed more code relating to scene converting and sports event episodes/shows.

Post-processing now checks for indexer id in the cache as well as the other normal ways it did before.
2014-04-28 21:55:59 -07:00
echel0n
ce0f452183 Fixes unicode issues with TVCache log message 2014-04-28 16:08:29 -07:00
echel0n
9425c1702d Added TVCache checks scene exceptions list to try and get Indexer ID 2014-04-28 16:04:12 -07:00
echel0n
3fbfed7d93 Fixes cache issues with lookups resulting in wasted cpu cycles.
Fixes issues with scene numbered releases not properly being converted before a cache lookup is performed and not being properly converted when returned from providers as a possible match for a show requested to be snatched.
2014-04-28 16:04:11 -07:00
echel0n
5e38813a73 Added sports feature, acts just like air_by_date except allows us to control the date pattern to match events that air_by_date could not.
Custome sports naming patterns can be set now as well.

Fixed issues with FINDPROPERS.

Fixed issues with session connections.

Cleaned up code.
2014-04-28 02:15:29 -07:00
echel0n
6967a8faef Code cleanup 2014-04-27 03:59:00 -07:00
echel0n
450d96e041 Fix for addCacheEntry 2014-04-25 22:42:40 -07:00
echel0n
6c9fb4b0bd Small text fix 2014-04-25 21:08:27 -07:00
echel0n
7a22f6c77a More RSS fixes 2014-04-25 18:49:38 -07:00
echel0n
3ee6d45fcd More updates for RSS feed code 2014-04-25 18:39:43 -07:00
echel0n
0e82c5f573 Added RSS feedparser lib to process custom torrent RSS feeds.
Adjusted code for custom RSS feed parsing now that feedparser does the parsing for us all we do is pull the data from the returned entries.
2014-04-25 16:41:47 -07:00
echel0n
8004685d3f Re-wrote the indexerApi wrapper, was causing a bottlekneck
Fixed bug when show folder is deleted before being deleted from SB
New Show searches now confirm results have a valid firstaired date
2014-03-26 12:28:46 -07:00
echel0n
3534574741 Fix for bug in comingEpisodes template not properly displaying 2014-03-25 21:15:10 -07:00
echel0n
95d7d728e0 Re-write of Indexer API wrapper
Re-write of New Show seearch function
Re-write of Existing show search helper function for determining indexer/indexerid
Massive code cleanup and more bugs found and fixed
Indexer code fully modualized for future proofing
2014-03-24 22:57:24 -07:00
echel0n
10637f8f29 Code Clean up and regex fix for "no repeats" error (reverted from commit 8ecd5a196d) 2014-03-20 11:03:22 -07:00
echel0n
8ecd5a196d Code cleanup and regex fix for "no repeats" error 2014-03-20 10:51:59 -07:00
echel0n
ce5053f25d Bunch of code upgrades and bugfixes 2014-03-20 01:15:22 -07:00
echel0n
f1e8a53856 Typo in tvcache fixed 2014-03-11 22:30:49 -07:00
echel0n
f2bbe76271 Code improvements for the indexer API handler and a few code cleanups as well. 2014-03-11 22:28:30 -07:00
echel0n
3e3e6d961d fix_checkdates_in_the_future (itofzo)
Fix lastBacklog date in the future after correcting system time
  Fix lastTime in the future after correcting system time (not updating cache)
2014-03-11 13:22:00 -07:00
echel0n
90cdf326b7 Bugfixes 2014-03-11 09:35:13 -07:00
echel0n
bbf9491943 Code cleanup and bugfixes 2014-03-10 19:32:02 -07:00
echel0n
6a4adceb26 Updates to auto post-processing code, additional code added to ensure indexer is always set to the correct value 2014-03-10 13:31:41 -07:00
echel0n
45ba1e815b Bugfixes for post processing code 2014-03-10 00:01:46 -07:00
echel0n
0d9fbc1ad7 Welcome to our SickBeard-TVRage Edition ...
This version of SickBeard uses both TVDB and TVRage to search and gather it's series data from allowing you to now have access to and download shows that you couldn't before because of being locked into only what TheTVDB had to offer.

Also this edition is based off the code we used in our XEM editon so it does come with scene numbering support as well as all the other features our XEM edition has to offer.

Please before using this with your existing database (sickbeard.db) please make a backup copy of it and delete any other database files such as cache.db and failed.db if present, we HIGHLY recommend starting out with no database files at all to make this a fresh start but the choice is at your own risk!

Enjoy!
2014-03-09 22:39:12 -07:00