Commit graph

136 commits

Author SHA1 Message Date
Adam
c1a199d698 Fix for attribute error when no newznab responses are available 2014-09-23 22:15:13 +08:00
echel0n
f54412fc3d Merge pull request #816 from KontiSR/fix_newznab_offset
Fix offset calculation. No more unnecessary (double) searches.
2014-09-19 20:54:29 -07:00
KontiSR
d0dac45315 Made improvements for searching for anime on newznab providers, who haven't straitened out there anime episode parsing.
Should provide more search result using for example: usenet-crawler, nZEDb, spotweb.

Newznab now also searches by q= querystring. Ommits the Ep.

Needed to cast ep (int) to str, for str concatenation

add searchstrings for searching newznab providers excluding the ep= paramater. I've added the episode to the q= param. querystring could look like: ?q=showname%2043
2014-09-19 16:17:49 +02:00
KontiSR
fd4e26795f Fix offset calculation. No more unnecessary (double) searches.
For anime shows: if no absolute numbering is available, use the default numbering.
2014-09-19 15:49:26 +02:00
echel0n
f211a7eccf Added sleep timer for proper finder code to prevent high CPU usage 2014-09-14 18:03:21 -07:00
echel0n
4fe3a96051 Possible fix for high CPU usage when doing NZB searches 2014-09-14 17:59:37 -07:00
Adam
b43248a644 Fixing more newznab issues sigh 2014-09-11 00:25:22 +08:00
adam111316
58cdb6ba5d Merge pull request #789 from adam111316/fix_newznab_backlog
Fixes backlog for newznab providers
2014-09-10 23:32:46 +08:00
Adam
5d1ae90565 Fixes backlog for newznab providers 2014-09-10 23:30:08 +08:00
KontiSR
3366108255 - Removed annoying alert message when failed to retrieve newsnab capabilities (categories)
- Added backend debug logging
2014-09-10 16:43:58 +02:00
echel0n
991a93991e Fixed newznab to search no more then 1000 results 2014-09-07 00:56:23 -07:00
echel0n
ba4b408af3 Improved newznab offset code 2014-09-07 00:48:09 -07:00
echel0n
ab16430b1a Improved newznab offset code 2014-09-07 00:44:48 -07:00
echel0n
a32de0d523 Merge pull request #769 from KontiSR/dev
Added gui for for choosing newznab (tv) categories
2014-09-05 19:16:46 -07:00
Adam
1317848782 Fix infinite loop with dognzb 2014-09-05 18:40:37 +08:00
Woodpaker
8b4bb3a5a5 Fixed some git conflicts 2014-09-01 18:29:52 +02:00
Woodpaker
000467cc73 * Added saving of changed newznab categories in backend.
Added gui for selecting categories from multiselect box.
Created some helper function in js, for dynamically modifying selects/options

Made results of function for retrieving newznab capabilities more generic. In that now always a valid json is returned with success,tv_categories,error

Added gui elements for retrieving and displaying newznab capabilities

Added backend functions for calling ajax /getNewznabCategories?name=yourNewznabProvider&url=https://newznabprovURL&key=YourApiKey
Returns json.dumps() with TV category capabilities of newznab provider. Is going to be used for new gui element in adding newsnab provider.
2014-09-01 17:57:52 +02:00
echel0n
ee458bd211 Fixed AttributeError: 'NoneType' object has no attribute 'is_scene' in scene_numbering code.
Show root dirs can not be set from general config menu.
Mass editing shows now has the ability to delete root dirs as well as edit them.
Daily search no longer is restricted to just 1 week of results for searching from which now allows for replacing lower quality downloads with higher quality ones if available.
RSS Cache is updated for each provider on demand now when performing manual, failed, backlog, or daily searches.
2014-08-30 01:47:00 -07:00
echel0n
ea66c2c41b Newznab providers now search by tvrage ID if available and show name incase tvrage ID doesnt return any results 2014-08-28 23:15:51 -07:00
echel0n
bcffc09589 Replaced provider backlog only search option with 2 new options that allow you to enable daily searches and backlog searches individually per provider, default is enabled for both. 2014-08-28 22:16:25 -07:00
adam111316
905b41c46a Fixes issues with newznab providers 2014-08-25 12:41:36 +08:00
echel0n
4b6602797f Fix for newznab provider searches unicode issues 2014-08-23 14:40:13 -07:00
echel0n
f65262e0e9 Fix for newznab provider searches 2014-08-22 23:22:46 -07:00
Adam
4b964b77e2 Support for newznab offset parameter - https://newznab.readthedocs.org/en/latest/misc/api/ 2014-08-20 16:02:55 +08:00
Supremicus
b5c703c893 Provider image fixes.
newznab.py - changed to use provider image from set gui interface (for
gui skin support).
rsstorrent.py - as per above, directory was wrong all together.
2014-08-08 09:17:31 +10:00
echel0n
b8b5947ae6 Fix for trakt.tv issues when adding/removing/syncing shows.
Fix for indexer mapper to return a result no matter what.
2014-07-30 16:33:28 -07:00
echel0n
de5db9be64 Added ability to set a default indexer for trakt notifier used for adding shows from watch list so that SickRage knows what indexer to set the show as.
Indexer mapping now uses indexer api calls to gather its information and then stores it to a new table called indexer_mapping for instant lookups later on.

Fixed trakt related issues for adding new shows and syncing.

Centered items at bottom of pages to just look a little nicer and fit properly.
2014-07-23 22:07:01 -07:00
echel0n
6f817c0c5c Quality sorting fixed for provider results.
Reverted newznab search strings being confined to just season till we can find a better way of correcting the issue with Usenet Crawler.
2014-07-21 08:38:56 -07:00
echel0n
7b54611361 Moved code for marking failed download successful out of loop.
Newznab providers now create season search strings for all searches as single ep search strings combined with using rage id numbers seems broken currently.
2014-07-21 06:44:01 -07:00
echel0n
af0ccd65cf Fixes for a few provider issues plus passing of search_mode variable. 2014-07-20 22:47:13 -07:00
echel0n
d02c0bd6eb Fixed issues with editing/saving custom scene exceptions.
Fixed charmap issues for anime show names.

Fixed issues with display show page and epCat key errors.

Fixed duplicate log messages for clearing provider caches.

Fixed issues with email notifier ep names not properly being encoded to UTF-8.

TVDB<->TVRAGE Indexer ID mapping is now performed on demand to be used when needed such as newznab providers can be searched with tvrage_id's and some will return tvrage_id's that later can be used to create show objects from for faster and more accurate name parsing, mapping is done via Trakt API calls.

Added stop event signals to schedualed tasks, SR now waits indefinate till task has been fully stopped before completing a restart or shutdown event.

NameParserCache is now persistent and stores 200 parsed results at any given time for quicker lookups and better performance, this helps maintain results between updates or shutdown/startup events.

Black and White lists for anime now only get used for anime shows as intended, performance gain for non-anime shows that dont need to load these lists.

Internal name cache now builds it self on demand when needed per show request plus checks if show is already in cache and if true exits routine to save time.

Schedualer and QueueItems classes are now a sub-class of threading.Thread and a stop threading event signal has been added to each.

If I forgot to list something it doesn't mean its not fixed so please test and report back if anything is wrong or has been corrected by this new release.
2014-07-14 19:00:53 -07:00
echel0n
f0146f728e Lowered CPU usage even further, re-wrote daemonizer code for startups, removed misc unrequired functions from providers. 2014-07-03 07:07:07 -07:00
echel0n
12ac388dc2 Fixed startup/restart/shutdown issues on Windows, Linux, FreeBSD platforms tested.
Fixed for updating issues.

Fixed high cpu and memory usage.
2014-07-02 11:51:14 -07:00
echel0n
a1cef0b958 Added in context to aid in garbage cleanup to help reduce memory usage. 2014-06-30 10:48:18 -07:00
echel0n
75f69396d4 Reverted some changes. 2014-06-30 08:57:32 -07:00
echel0n
5e507b3849 More memory reductions and cleanups 2014-06-30 04:44:36 -07:00
echel0n
61e1e5d2c2 Fix for __exit__ DB errors 2014-06-21 18:35:57 -07:00
Adam
5fd0a2a1f3 Fix for Newznab providers when searching for a show without a tvrage id we use the name of the show. If the show name is more than one word we are using a _ as our delimiter which works fine unless the NN provider uses sphinx.. as the underscore then is used as part of the show name.. thus we always get back no results. We should just use . as it works for both sphinx and non sphinx servers. Tested this out on nzbs.org / nzb.su (sphinx) / sbi (non sphinx). 2014-06-12 11:19:27 +08:00
echel0n
a1da7df12e Fixes for DB issues 2014-06-07 15:35:16 -07:00
echel0n
997896a540 Fix for transactionals and None Types in sql lists 2014-05-30 04:42:31 -07:00
echel0n
7e711c0665 Fix for find propers and newznab providers 2014-05-26 01:05:47 -07:00
echel0n
9a3e7ab0a9 Added anime support with anidb support.
Added fanzub anime nzb provider.
Fixed NyaaTorrents anime provider.

This is in testing phase so bugs are to be expected.
2014-05-25 23:29:22 -07:00
echel0n
7391a6e454 App name change in code. 2014-05-23 05:37:22 -07:00
echel0n
736cb7c738 Fixes issues with ABD shows searching for complete seasons and returning zero results. 2014-05-22 22:02:49 -07:00
echel0n
95adb131e1 Revert "Fix for findpropers and newznab providers"
This reverts commit cfa5d99066.
2014-05-21 12:08:08 -07:00
echel0n
cfa5d99066 Fix for findpropers and newznab providers 2014-05-20 22:50:56 -07:00
echel0n
8141d8a170 Fixed issues for custom RSS torrent providers 2014-05-20 20:22:48 -07:00
echel0n
fa11b4ef3a Removed some sleep timers to improve overall speed of sickrage. 2014-05-20 11:01:51 -07:00
Nils
621f790392 Merge pull request #573 from JackDandy/FixSearchNzbsOrg
Fix: Searching for propers/repacks at nzbs.org.
2014-05-19 19:03:06 +02:00
echel0n
c350c0fdf9 Fixed dupe issues with backlog searches.
Set cache to store results for 1 week and remove anything older then 1 week only if daily search has searched the results before hand.
2014-05-18 08:33:31 -07:00
Nils Vogels
da8e2e3d19 Path detection for icons was still in midgetspy format.
Changed paths to our gui
2014-05-18 01:17:16 +02:00
JackDandy
7e48e827f7 Fix: Searching for propers/repacks at nzbs.org.
If no results are found with the usual search URL, an alternate is tried.
2014-05-17 18:59:33 +01:00
echel0n
a3e06b965f Added in CPU Throttling option under general config -> advanced.
Fixed issues with passwords and unicode chars.
Fixed issue with usenet_retention variable not being saved or set.
2014-05-17 04:40:26 -07:00
echel0n
f9052ca2b2 Fixes to help with brining down the cpu usage of SickRage 2014-05-17 02:27:17 -07:00
echel0n
e96035ff4f Added per-provider options search mode and search fallback.
Search mode allows you to choose season packs only or episodes only which controls how backlogs search for data.

Search fallback if selected will attempt a 2nd search this time using the alternative search mode to see if it can get results if the previous attempt failed.

Provider settings are now read and stored dynamically instead of always having to retrieve them by there static names, this will allow for dropping in new provider modules easier to intergrate with existing options already present.

Fixed search code to not perform dupe searches by mistake.

Cache stores a list of shows we have rejected so that next time around we don't have to process them to know we don't like em.
2014-05-16 22:29:44 -07:00
echel0n
4576ade4ce Fixed a issue that was causing multiple search strings to be created for the same season or episode during a search, this would of caused unrequired searches to be performed. 2014-05-15 22:16:35 -07:00
echel0n
415e0df536 Fix for air-by-date and sports shows when searching for full seasons.
Fix for rssupdater errors
2014-05-14 01:01:36 -07:00
echel0n
31297b9069 Added RSS Cache updater with user-settable interval from config section of web interface, updates the cache so that searches can be more instant when looking for snatches.
Updated backlog search code to re-set skipped or missed episodes to wanted.
2014-05-12 01:52:14 -07:00
echel0n
1398c38275 Fix for manual and backlog download/search issues.
Removed multi-threading as it was more problems then usefull for now.

Added in match & snatch, any quality from initial quality settings gets downloaded first and does not continue searching, if archive qualities exist it'll stop once it hits max quality from said list.
2014-05-11 05:51:39 -07:00
echel0n
2a4f8780e2 Fixed issues with multi-threading.
Fixed issues with snatching air-by-date shows.
Fixed issues with naming patterns.
Fixed issues with invalid literals.
Fixed issues with country codes missing and causing web errors.

Fixed so many issues I can't write them all done ... :)
2014-05-08 07:04:01 -07:00
echel0n
fc94243546 Fixes backlog and manual searches.
Fixes season pack and single/multi episode searches.
Fixes multi-threading issues.
Fixes incorrect status being reported for manual searches.
Fixes quality being returned as N/A all the time for torrents.
2014-05-07 00:50:49 -07:00
echel0n
a5b72dea84 Fixes issues with findpropers and airdate.
Fixes issues with unhashable dict types.
Fixes issues with 100% CPU usage.
Fixes issues with RSS feed cache.
Fixes issues with scene numbering and converting back to indexer numbering.
Fixes issues with backlog searches.
Fixes issues with season pack searches.
Fixes issues with BTN.
2014-05-04 20:08:32 -07:00
echel0n
99da47464d Fix for rssfeed 2014-05-04 05:08:45 -07:00
echel0n
129a8c1d7e Added cache for rss feed items.
Fixed issues with searches
2014-05-04 05:05:27 -07:00
echel0n
b349bab569 Fixes more issues that were still present for season pack searches and air-by-date shows. 2014-05-03 22:36:54 -07:00
echel0n
dea826c3ba Fixed alot of issues pertaining to season pack searches and backlog searches in regards to returning accurate results or no results at all.
Fixed issue #335
2014-05-03 20:16:26 -07:00
echel0n
d5f183c171 Major changes made to search code, tvcache code, and name parser 2014-05-03 02:23:26 -07:00
echel0n
dfd8ead9f8 Fix for published_parsed errors 2014-04-30 22:17:54 -07:00
echel0n
9384881241 Fixed issues with searching for air by date shows and sports.
Several bugfixes applied throughout the code along with cleanup performed.
2014-04-30 06:49:50 -07:00
echel0n
319ac2602f Fixed scene_numbering issues for shows that use scene numbers instead of TVDB numbering.
Fixed issues with local SB cache.

Fixed issues with sports naming patterns, we no longer treat sports as a airdate show and have created custom regex's to aid in finding sports related shows.
2014-04-30 05:10:13 -07:00
echel0n
87b752b4e5 Re-coded the Indexer cache, cache lookups are only performed for existing shows and we don't add any cache entries unless we are Indexing the show in our database so we don't waste cpu cycles and memory.
Manual and backlog searches both search the cache first before even attempting to send a search request to a provider.

More bugs have been worked out.
2014-04-29 06:14:19 -07:00
echel0n
99bbd0649c Fix for debug logging on console.
Fix for RSS feeds for all providers.
2014-04-28 03:57:30 -07:00
echel0n
5e38813a73 Added sports feature, acts just like air_by_date except allows us to control the date pattern to match events that air_by_date could not.
Custome sports naming patterns can be set now as well.

Fixed issues with FINDPROPERS.

Fixed issues with session connections.

Cleaned up code.
2014-04-28 02:15:29 -07:00
echel0n
71ec47ae6b Fix for error code checking for Newznab providers. 2014-04-27 17:08:12 -07:00
echel0n
56a0a04a2c Fix for subtitles datetime issue
Code cleanup.
2014-04-27 15:16:43 -07:00
echel0n
b0ec12e421 Fixes issue with update frequency.
Fixes backlog search issues with newznab providers.
2014-04-27 05:13:46 -07:00
echel0n
5772de9eec Complete re-code of season/episode search code.
Switched from using standard requests to using sessions.
Fixed bug in speedcd that was preventing config from saving.
2014-04-27 03:31:54 -07:00
echel0n
8d4d1a21cd Fix for no status attribute error 2014-04-26 04:23:00 -07:00
echel0n
e787ef8332 XEM Scene Numbering fixes.
Deepcopy thread.lock issue fixed.
Overall performance increased, searches faster and more accurate.
2014-04-26 03:37:40 -07:00
echel0n
26e259c036 Fix for Newznab providers 2014-04-25 21:53:44 -07:00
echel0n
83bcc63683 More RSS cache fixes 2014-04-25 20:42:35 -07:00
echel0n
7a22f6c77a More RSS fixes 2014-04-25 18:49:38 -07:00
echel0n
3ee6d45fcd More updates for RSS feed code 2014-04-25 18:39:43 -07:00
echel0n
ad339a9b2e Multiple bugfixes for provider code 2014-04-22 01:02:43 -07:00
echel0n
95d7d728e0 Re-write of Indexer API wrapper
Re-write of New Show seearch function
Re-write of Existing show search helper function for determining indexer/indexerid
Massive code cleanup and more bugs found and fixed
Indexer code fully modualized for future proofing
2014-03-24 22:57:24 -07:00
echel0n
0d9fbc1ad7 Welcome to our SickBeard-TVRage Edition ...
This version of SickBeard uses both TVDB and TVRage to search and gather it's series data from allowing you to now have access to and download shows that you couldn't before because of being locked into only what TheTVDB had to offer.

Also this edition is based off the code we used in our XEM editon so it does come with scene numbering support as well as all the other features our XEM edition has to offer.

Please before using this with your existing database (sickbeard.db) please make a backup copy of it and delete any other database files such as cache.db and failed.db if present, we HIGHLY recommend starting out with no database files at all to make this a fresh start but the choice is at your own risk!

Enjoy!
2014-03-09 22:39:12 -07:00