Commit graph

630 commits

Author SHA1 Message Date
Adam
6179c8dfad Fix for torrent rss feeds not validating on add 2014-08-20 16:34:42 +08:00
Adam
4b964b77e2 Support for newznab offset parameter - https://newznab.readthedocs.org/en/latest/misc/api/ 2014-08-20 16:02:55 +08:00
adam
3bf102d160 Fixes speedcd provider issues 2014-08-18 16:49:14 +08:00
echel0n
8415b32fc6 Possible fix for failed to send torrent errors 2014-08-17 22:51:45 -07:00
dkboy
63dbe9e522 Update bitsoup.py
they've reorganized columns
2014-08-17 14:42:07 +12:00
Adam
96f918742a Fix for omgwtfnzb skipping: release error 2014-08-15 11:43:11 +08:00
adam
41931b33a9 Fixes Torrent Leech daily search URL
Fixes TV torrents daily search no results
2014-08-13 17:15:25 +08:00
adam
22f3a2e41b Consolidate more provider code
Fix tvtorrents issue

Remove old providers
2014-08-13 05:52:59 +08:00
echel0n
4d7d85e21b Merge pull request #704 from adam111316/hdbits_cache
Fix for HDbits tvcache issue
2014-08-10 21:37:02 -07:00
Adam
66f962f89b Fix for tpb ABD shows 2014-08-11 08:10:24 +08:00
Adam
e19f1ee53e Fix for HDbits tvcache issue 2014-08-11 07:59:56 +08:00
echel0n
318379522b Merge pull request #692 from Supremicus/dev
Provider image fixes.
2014-08-07 22:11:26 -07:00
echel0n
aa09e88d5f Merge pull request #689 from adam111316/tidy
Tidying provider code
2014-08-07 22:10:40 -07:00
Supremicus
b5c703c893 Provider image fixes.
newznab.py - changed to use provider image from set gui interface (for
gui skin support).
rsstorrent.py - as per above, directory was wrong all together.
2014-08-08 09:17:31 +10:00
Adam
6ad5ccf966 HDbits fix 2014-08-06 19:58:10 +08:00
Adam
4b3a680bb3 Tidy provider code 2014-08-06 01:38:16 +08:00
echel0n
1908c74e96 Merge pull request #679 from adam111316/nyaa_consolidation
Remove unnecessary code from nyaatorrents provider and PEP8
2014-08-03 00:14:11 -07:00
echel0n
76011d4653 Merge pull request #680 from adam111316/animezb_consolidation
Animezb tidy proper code and PEP8
2014-08-03 00:14:03 -07:00
echel0n
493f9af02e Merge pull request #681 from adam111316/fanzub_tidy
Tidy fanzub proper code and PEP8
2014-08-03 00:13:55 -07:00
Adam
74fa44d14e Tidy fanzub proper code and PEP8 2014-07-31 18:18:12 +08:00
Adam
f94b0085f0 Animezb tidy proper code and PEP8 2014-07-31 18:11:46 +08:00
Adam
4728e19edf Remove unnecessary code from nyaatorrents provider and PEP8 2014-07-31 17:45:51 +08:00
echel0n
dbc30c43cb Switched the following providers to use HTTPS connections instead of standard HTTP, more secure. 2014-07-30 22:02:45 -07:00
echel0n
9761c6c6a3 Fixed issues with torrent blackhole download issues. 2014-07-30 21:31:54 -07:00
echel0n
b8b5947ae6 Fix for trakt.tv issues when adding/removing/syncing shows.
Fix for indexer mapper to return a result no matter what.
2014-07-30 16:33:28 -07:00
echel0n
e6c8982d2b Testing fix for torrent download issues from ezrss 2014-07-28 21:42:53 -07:00
echel0n
19a89d453c We now check if a torrent url links to a valid file before adding as a verified result to get snatched, this helps prevent issues when attempting to add torrent to client later on to find the url returned nothing resulting in a error. 2014-07-28 12:19:41 -07:00
echel0n
60205979a8 Merge pull request #667 from adam111316/anime_propers_3
Anime proper support
2014-07-27 07:17:55 -07:00
echel0n
9493a8f7e5 Added back in missing code for finding propers, was removed by mistake.
Fixed issue with torrent clients not snatching due to improper handling of torrent hashes/files.
2014-07-27 07:04:37 -07:00
Adam
fd9be53fcb Anime propers 2014-07-27 21:04:17 +08:00
echel0n
b13e72e0a3 Moved code for cleaning up cache folder to seperate function located in helper.py.
Added call to cache folder cleanup during SickRage main init.

Changed a error message in rss feed class to a debug message for when url returns no data.

Moved indexer api cache files to be placed under cache folder subfolder indexers.

Moved rss feed cache files to be placed under cache folder subfolder rss.
2014-07-27 04:58:14 -07:00
echel0n
14c354b551 Added proxy support to Indexer APIs.
Provider getURL and downloadResult functions now removed and replaced with ones from helpers.py to help slim the code down plus allow more better control over request sessions.

Removed TVTumbler code.

Fixed HDBits provider.

Fixed config settings that were ment to be booleans but instead where set as str or int, should help resolve random html errors.

XEM Refresh check re-coded.

NameParser code for creating show object has been changed to only attempt at the very end once its found the bestMatch result, helps on resources and performance.
2014-07-27 03:59:21 -07:00
echel0n
0e5fbbc5c3 Fix for incorrect show snatches 2014-07-24 21:29:03 -07:00
echel0n
f47734446d Fixed further json issues with speedcd provider.
Fixed several providers and ssl cert verify issues.

Air-by-date shows now automatically get there respective season/episode numbers during release parsing.
2014-07-24 11:16:59 -07:00
echel0n
b16ff81478 Fixes for thread naming issues where provider names are getting stacked on top each other per loop iteration.
Fix for speedcd no json data issue.

Fix for DB upgrade syntax errors caused by previous commit.
2014-07-24 09:12:29 -07:00
echel0n
161226180f Cleaned up NyaaTorrents search code and fixed unicode issues. 2014-07-24 01:33:38 -07:00
echel0n
a697805923 Fixed NameParser to properly parse anime episodes that use normal season and episode naming conventions.
NameParser now properly creates absolute numbers from season/episode info or season/episode numbers from absolute info for anime shows. Removed scene convert routine and migrated the code into the parsing routine with a boolean to scene convert if needed.

Fixed NyaaTorrents issue with dict object errors.
2014-07-24 01:27:35 -07:00
echel0n
de5db9be64 Added ability to set a default indexer for trakt notifier used for adding shows from watch list so that SickRage knows what indexer to set the show as.
Indexer mapping now uses indexer api calls to gather its information and then stores it to a new table called indexer_mapping for instant lookups later on.

Fixed trakt related issues for adding new shows and syncing.

Centered items at bottom of pages to just look a little nicer and fit properly.
2014-07-23 22:07:01 -07:00
echel0n
3a2b67330c During backlog/manual/failed searches we now cache disgarded/ignored results pre-parsed for usage later on incase we end up setting a episode to wanted that matches said results, allows for maximum performance and helps limit the waste of resources used. 2014-07-21 23:00:58 -07:00
echel0n
a317ff61c2 Created a context manager wrapper for BeautifulSoup4 so that we can cleanup/clear tags/context on exit via WITH statements.
Fixed issues with torrent providers returning no results.
2014-07-21 21:26:58 -07:00
echel0n
899d03b5fe Fixed issue with appending UNNOWN qualities to provider results after being sorted. 2014-07-21 18:48:16 -07:00
echel0n
bf41ba59be Fixed sorting provider results by quality code, was causing a error. 2014-07-21 17:55:45 -07:00
echel0n
403c267953 Further improved memory handling of bs4 for torrent providers. 2014-07-21 16:01:46 -07:00
echel0n
4a29476415 Added code to perform disposal of bs4 class when finished as well as perform garbage collection afterwards, this fixed a memory leak issue SR was experiancing during backlog/manual/failed searches. 2014-07-21 15:16:04 -07:00
echel0n
f340f9b073 Fix for sports shows. 2014-07-21 08:49:20 -07:00
echel0n
6f817c0c5c Quality sorting fixed for provider results.
Reverted newznab search strings being confined to just season till we can find a better way of correcting the issue with Usenet Crawler.
2014-07-21 08:38:56 -07:00
echel0n
39054d7810 Fix for validating episode data during provider result gathering. 2014-07-21 07:21:03 -07:00
echel0n
7b54611361 Moved code for marking failed download successful out of loop.
Newznab providers now create season search strings for all searches as single ep search strings combined with using rage id numbers seems broken currently.
2014-07-21 06:44:01 -07:00
echel0n
5ac99b8c5c Fix for extensions being stripped off by mistake made when adding in -RP fix from few commits ago. 2014-07-21 06:29:07 -07:00
echel0n
57cf86279b Places Quality UNKNOWN items from provider results at end of itemsList leaving order of sorted items highest to lowest. 2014-07-20 23:59:57 -07:00
echel0n
d6442e0685 Provider results get sorted by quality before filtering occures. 2014-07-20 23:43:52 -07:00
echel0n
af0ccd65cf Fixes for a few provider issues plus passing of search_mode variable. 2014-07-20 22:47:13 -07:00
echel0n
ff5107cfe2 Provider searches for backlog, manual, and failed have been re-worked to not hammer the providers so much plus perform alot faster. 2014-07-20 22:07:53 -07:00
marseneault
662353e936 Add support for Bitsoup 2014-07-20 12:12:22 +08:00
Justin Nielsen
ad17b81560 Added TVTorrents.ro Provider
Missed some files

Removed seeders==0 as per request
2014-07-20 11:09:26 +08:00
echel0n
d02c0bd6eb Fixed issues with editing/saving custom scene exceptions.
Fixed charmap issues for anime show names.

Fixed issues with display show page and epCat key errors.

Fixed duplicate log messages for clearing provider caches.

Fixed issues with email notifier ep names not properly being encoded to UTF-8.

TVDB<->TVRAGE Indexer ID mapping is now performed on demand to be used when needed such as newznab providers can be searched with tvrage_id's and some will return tvrage_id's that later can be used to create show objects from for faster and more accurate name parsing, mapping is done via Trakt API calls.

Added stop event signals to schedualed tasks, SR now waits indefinate till task has been fully stopped before completing a restart or shutdown event.

NameParserCache is now persistent and stores 200 parsed results at any given time for quicker lookups and better performance, this helps maintain results between updates or shutdown/startup events.

Black and White lists for anime now only get used for anime shows as intended, performance gain for non-anime shows that dont need to load these lists.

Internal name cache now builds it self on demand when needed per show request plus checks if show is already in cache and if true exits routine to save time.

Schedualer and QueueItems classes are now a sub-class of threading.Thread and a stop threading event signal has been added to each.

If I forgot to list something it doesn't mean its not fixed so please test and report back if anything is wrong or has been corrected by this new release.
2014-07-14 19:00:53 -07:00
echel0n
09f53d3537 Filtering of torrents with 0 seeders is no longer forced, filtering now is done strictly by min seed and min leech user settins which can be set from search provider config settings. 2014-07-12 16:16:58 -07:00
echel0n
21cc92664f Fix for KickAss Torrents Invalid URL error. 2014-07-11 21:12:25 -07:00
echel0n
b7ab95996c Merge pull request #638 from adam111316/add_animezb_provider
Add animezb provider
2014-07-11 19:40:51 -07:00
echel0n
2d87de0fd8 Fix for search provider config page errors. 2014-07-11 14:57:49 -07:00
adam
923a58b2ab Add animezb provider 2014-07-12 01:21:56 +08:00
echel0n
aa74dfb68d Merge pull request #637 from marseneault/torrentbytes
Add TorrentBytes provider
2014-07-11 10:18:08 -07:00
echel0n
0e3495d30f Fix for show parsing errors to be displayed via debug logs now instead as a warning. 2014-07-11 00:59:05 -07:00
root
6304c5ed17 Add TorrentBytes provider 2014-07-10 10:15:44 -04:00
echel0n
e891e9d637 Fixed nextaired not found issues and fixed kat provider issues. 2014-07-09 09:01:12 -07:00
echel0n
f925488373 KickAss torrents now uses multiple urls to try from incase one goes down. 2014-07-09 01:26:45 -07:00
echel0n
15c7332277 Merge pull request #623 from nielsenj/customrssratio
Adds custom RSS provider ratio setting.
2014-07-08 09:53:07 -07:00
echel0n
7a95b0bb14 Added new InvalidShowException to NameParser, Removed isGoodResult search check and now attached parsed result show objects and compare them against the show object we use to search with instead. 2014-07-06 06:11:04 -07:00
echel0n
a3a3777d33 Fixed blackAndWhitelist for anime release groups. 2014-07-06 04:12:16 -07:00
echel0n
56e2c28bad SickRage now uses a internal name cache comprised of (showlist, scene exceptions, scene names) used to search and create show objects from which is needed for parsing search results.
Scene exceptions now uses a internal cache for scene exceptions and scene season exceptions, helps reduce overhead to DB and performs faster lookups when making scene exception requests.
2014-07-03 10:30:15 -07:00
echel0n
f0146f728e Lowered CPU usage even further, re-wrote daemonizer code for startups, removed misc unrequired functions from providers. 2014-07-03 07:07:07 -07:00
echel0n
36e12a5d4d Fix for hdtorrents uid issues. 2014-07-02 13:39:27 -07:00
echel0n
ddd9376faf Fix for torrentday uid issues. 2014-07-02 13:38:05 -07:00
echel0n
d6431570f1 TPB season pack searches fixed 2014-07-02 13:06:29 -07:00
echel0n
12ac388dc2 Fixed startup/restart/shutdown issues on Windows, Linux, FreeBSD platforms tested.
Fixed for updating issues.

Fixed high cpu and memory usage.
2014-07-02 11:51:14 -07:00
nielsenj
6d8e79c78a Adds custom RSS provider ratio setting.
Adds ratio setting to the custom RSS provider.
2014-06-30 22:48:49 -07:00
echel0n
a1cef0b958 Added in context to aid in garbage cleanup to help reduce memory usage. 2014-06-30 10:48:18 -07:00
echel0n
75f69396d4 Reverted some changes. 2014-06-30 08:57:32 -07:00
echel0n
5e507b3849 More memory reductions and cleanups 2014-06-30 04:44:36 -07:00
echel0n
0c57676aed Updated tornado source code.
Created custom class for rss feed parser.
2014-06-29 03:05:33 -07:00
echel0n
e0eea79ec5 Fix for ABD and Sports shows issue with toordinal function. 2014-06-25 21:39:34 -07:00
echel0n
61e1e5d2c2 Fix for __exit__ DB errors 2014-06-21 18:35:57 -07:00
echel0n
7e0bb651b2 Database now closes connection after each query and reconnects if closed to ensure no more connection and locked database problems.
Fixed more internal 500 errors.
2014-06-21 15:46:59 -07:00
echel0n
7ce409e90d Merge pull request #612 from JackDandy/port_fix_BTN_duplicate_search_params
Port:Fix BTN adding same search parameters multiple times.
2014-06-19 09:47:45 -07:00
echel0n
1fa8686422 Merge pull request #610 from JackDandy/port_fix_omgwtfnzbs_findPropers
Port:Fix omgwtfnzbs findPropers.
2014-06-19 09:46:58 -07:00
JackDandy
ff524fc7e4 Port:Fix omgwtfnzbs findPropers. 2014-06-19 16:37:29 +01:00
JackDandy
42f018bf06 Port:Fix BTN adding same search parameters multiple times. 2014-06-19 16:36:13 +01:00
fittysix
c5045d0f1e Add moderator to confirmed torrent posters
I think we can trust these guys :)
2014-06-18 07:04:16 -06:00
echel0n
98ff924b1c Fix for nullhandler issues for py2.6 users,
Fix for rsstorrents.
2014-06-17 08:46:07 -07:00
echel0n
d73cc1cbbd Replaced cherrypy with tornado which helped resolve our memory leak issue. 2014-06-14 20:56:15 -07:00
Adam
5fd0a2a1f3 Fix for Newznab providers when searching for a show without a tvrage id we use the name of the show. If the show name is more than one word we are using a _ as our delimiter which works fine unless the NN provider uses sphinx.. as the underscore then is used as part of the show name.. thus we always get back no results. We should just use . as it works for both sphinx and non sphinx servers. Tested this out on nzbs.org / nzb.su (sphinx) / sbi (non sphinx). 2014-06-12 11:19:27 +08:00
Nils
166dffeb5a Merge pull request #582 from bikemike222/add_cookies_rss
Added cookie support to custom torrent provider
2014-06-09 00:20:37 +02:00
echel0n
a1da7df12e Fixes for DB issues 2014-06-07 15:35:16 -07:00
echel0n
d00d55fdfc Modified DB code to close its connection if right after its finished with it, helps performance-wise and should resolve locked db issues as well. 2014-06-07 14:32:38 -07:00
echel0n
24dfbc3f15 Quality is now set during parsing of results.
Fixed more anime regex bugs.
Fixed Indexer API issues for anime shows and unicode problems.
2014-06-07 04:06:21 -07:00
echel0n
05dcdd72d7 Fix for air-by-date/sports/anime provider searches 2014-06-06 16:55:14 -07:00
echel0n
cab05efa64 Added anime search support and removed extra pipe symbole from search string. 2014-06-06 15:27:20 -07:00
echel0n
14201c71f3 Fixes issues with scene numbering being set to 0x0 after snatch is performed.
Fixes issues with KAT Provider sphinx error on searches.
2014-06-06 15:16:15 -07:00
echel0n
4df31bccee PublicHD removed till further notice. 2014-06-06 13:48:25 -07:00
Nils Vogels
0e989fe90f Limiting search to English-translated only (for now) 2014-06-02 00:05:07 +02:00
echel0n
d7396896b5 Added in regex matching with fuzzy matching.
Shows now display Indexer absolute numbering.
Improved speed of parsing search results.
Fixed episode naming issues.
2014-05-31 03:35:11 -07:00
echel0n
997896a540 Fix for transactionals and None Types in sql lists 2014-05-30 04:42:31 -07:00
echel0n
f01c5852d4 Improved find propers code.
Backlog and manual searches now check cache first for search results.
2014-05-30 00:51:24 -07:00
echel0n
e009641804 SickRage now stores the XEM scene data to the main DB under tv_episodes for faster lookups and better linkages with epiosde objects, insures we have scene data on hand when we want it!
Adding functions to lookup scene season and ep info via scene absolute numbers.

We now try and create a show object from parsed release info before we consider it a valid parsed result to insure we even have the show in our show list, also used to validate anime releases.

Misc bug fixes here and there.
2014-05-28 14:16:03 -07:00
echel0n
34da3f53d8 Added Black and White list for release groups for anime shows.
Fixed anime show list splitter.

Added check for anime shows and providers so we don't perform searches with a provider that doesn't support the type of show genre we are searching.
2014-05-27 03:09:57 -07:00
echel0n
f7b11e1e98 Fixed issues with post-processing.
Fixed issue with priority post-processing, bug would allow 2nd attempt to go through even if priority settings were not selected.

Fixed issues with cache retrieval and storing of provider results, properly stored now with season and ep info converted to indexer numbering.

Fixed a bug that was caching unconverted scene numbered files for post-processing causing us to skip converting them when needed.
2014-05-26 03:42:34 -07:00
echel0n
7e711c0665 Fix for find propers and newznab providers 2014-05-26 01:05:47 -07:00
echel0n
9a3e7ab0a9 Added anime support with anidb support.
Added fanzub anime nzb provider.
Fixed NyaaTorrents anime provider.

This is in testing phase so bugs are to be expected.
2014-05-25 23:29:22 -07:00
Bike Mike
89c944ec94 Added cookie support to custom torrent provider 2014-05-25 19:19:45 +02:00
echel0n
a350be339c Fix for issue causing issues loading and saving search providers 2014-05-23 09:35:01 -07:00
echel0n
7391a6e454 App name change in code. 2014-05-23 05:37:22 -07:00
echel0n
d37a992508 Fixes issue with trailing slash being appened to end of url when adding custom RSS torrent provider. 2014-05-22 22:36:48 -07:00
echel0n
736cb7c738 Fixes issues with ABD shows searching for complete seasons and returning zero results. 2014-05-22 22:02:49 -07:00
echel0n
95adb131e1 Revert "Fix for findpropers and newznab providers"
This reverts commit cfa5d99066.
2014-05-21 12:08:08 -07:00
echel0n
cfa5d99066 Fix for findpropers and newznab providers 2014-05-20 22:50:56 -07:00
echel0n
8141d8a170 Fixed issues for custom RSS torrent providers 2014-05-20 20:22:48 -07:00
echel0n
d6a942698a Fixes errors caused by duplicate newznab providers 2014-05-20 13:51:54 -07:00
echel0n
fa11b4ef3a Removed some sleep timers to improve overall speed of sickrage. 2014-05-20 11:01:51 -07:00
echel0n
9e1402057a Added in min seed and min leech options for torrent providers 2014-05-20 09:06:11 -07:00
echel0n
5f328eba5f Converted NZB providers to new dynamic config style format. 2014-05-19 19:14:06 -07:00
echel0n
3918917f7a HDBits fixed! DOn't question just say ... thankyou ;) 2014-05-19 14:25:33 -07:00
echel0n
f0bd8e5e4a Fixes issues with processTV failed downloads and HDBits auth info 2014-05-19 13:06:32 -07:00
echel0n
854de69683 Fixed find propers.
Added ability to force a find propers search.
2014-05-19 10:40:25 -07:00
Nils
621f790392 Merge pull request #573 from JackDandy/FixSearchNzbsOrg
Fix: Searching for propers/repacks at nzbs.org.
2014-05-19 19:03:06 +02:00
echel0n
2a5598ba0f Fixes issues with settings and newznab providers. 2014-05-19 08:22:18 -07:00
echel0n
c6b064de23 Fixed small typo causing scene numbering to indexer numbering issues 2014-05-19 06:57:20 -07:00
echel0n
e7931f0c7f Added Torrage.com as alternative site to Torcache.net 2014-05-19 06:27:38 -07:00
echel0n
66e499ab23 Fixes issues with daily searcher not snatching its results when it has any to snatch.
Fixes issues with not properly converting scene numbering eps to indexer numbering.
2014-05-19 06:08:16 -07:00
echel0n
de20d13c61 Added per-provider option 'backlog only' which allows you to disclude any provider from the daily search but still use it for backlogs, currently working for torrents only and will add to nzb providers later on today.
Cleaned up details on search options for providers and made it look nicer
2014-05-18 09:39:30 -07:00
echel0n
c350c0fdf9 Fixed dupe issues with backlog searches.
Set cache to store results for 1 week and remove anything older then 1 week only if daily search has searched the results before hand.
2014-05-18 08:33:31 -07:00
echel0n
c65573a8d7 Re-wrote daily searcher to search for unaired and wanted episodes going back as far as 1 week, also moved it so it queue's its items now.
Cleaned up description of new per-provider season search options.
2014-05-18 05:59:42 -07:00
Nils Vogels
215f0cdb46 Adding missing character in URL 2014-05-18 02:15:13 +02:00
Nils Vogels
da8e2e3d19 Path detection for icons was still in midgetspy format.
Changed paths to our gui
2014-05-18 01:17:16 +02:00
echel0n
55f27c4f40 rss cache updates and daily search have been joined into one function.
fixed more issues of missing vars causing saving of config issues.
2014-05-17 11:14:48 -07:00
JackDandy
7e48e827f7 Fix: Searching for propers/repacks at nzbs.org.
If no results are found with the usual search URL, an alternate is tried.
2014-05-17 18:59:33 +01:00
echel0n
04213bebf2 Fixed bug that was causing issues with saving config.
Fixed bug that was causing searches to double up on there results.
2014-05-17 10:30:23 -07:00
echel0n
0afdeb3c1f Added ability to disable daily search at startup.
Fixed search frequencies.
Changed HDBits to use requests json parser.
2014-05-17 09:18:50 -07:00
echel0n
12b8fc9990 Removed a extra space that may have caused issues in future 2014-05-17 06:55:58 -07:00
echel0n
67073d007e Fixes missing uid and hash vars 2014-05-17 05:13:05 -07:00
echel0n
a3e06b965f Added in CPU Throttling option under general config -> advanced.
Fixed issues with passwords and unicode chars.
Fixed issue with usenet_retention variable not being saved or set.
2014-05-17 04:40:26 -07:00
echel0n
f9052ca2b2 Fixes to help with brining down the cpu usage of SickRage 2014-05-17 02:27:17 -07:00
echel0n
5453c8c6df Fix for TPB proxy issues.
Fix for save config issues.
2014-05-16 23:38:00 -07:00
echel0n
e96035ff4f Added per-provider options search mode and search fallback.
Search mode allows you to choose season packs only or episodes only which controls how backlogs search for data.

Search fallback if selected will attempt a 2nd search this time using the alternative search mode to see if it can get results if the previous attempt failed.

Provider settings are now read and stored dynamically instead of always having to retrieve them by there static names, this will allow for dropping in new provider modules easier to intergrate with existing options already present.

Fixed search code to not perform dupe searches by mistake.

Cache stores a list of shows we have rejected so that next time around we don't have to process them to know we don't like em.
2014-05-16 22:29:44 -07:00
echel0n
816a3d9572 Fixes season pack and episode only searches 2014-05-16 02:16:01 -07:00
echel0n
e309aa2cbf Fixed more unrequired search strings from being created and wasting our time doing duplicate searches 2014-05-15 22:40:49 -07:00
echel0n
4576ade4ce Fixed a issue that was causing multiple search strings to be created for the same season or episode during a search, this would of caused unrequired searches to be performed. 2014-05-15 22:16:35 -07:00
echel0n
e20adcfab8 Added daily searcher to check for and snatch daily new releases for current active watched shows. User settable interval can be found in search config menu plus forcing a daily search can be done from Manage Searches menu.
Fixed issues with subliminal subtitle downloader.
2014-05-14 21:16:46 -07:00
echel0n
5645eecd9c Merge branch 'origin/dev' 2014-05-14 02:42:28 -07:00
echel0n
415e0df536 Fix for air-by-date and sports shows when searching for full seasons.
Fix for rssupdater errors
2014-05-14 01:01:36 -07:00
JackDandy
7f31c1e2c1 Fix one of the default providers to use SSL. 2014-05-14 01:43:01 +01:00
echel0n
d2b4ad526d Fix for sports air-by-date shows 2014-05-13 12:04:59 -07:00
echel0n
ed8de59e91 Fixed air-by-date issues with downloading a show that results in downloading the incorrect show afterwards. 2014-05-13 12:02:22 -07:00
iron8core
220b139bcc Add forgotten 'self' argument to _isSection 2014-05-13 13:19:03 +02:00
echel0n
1d339b97f6 Fix for looping issue during backlog searches 2014-05-12 12:48:47 -07:00
echel0n
858ac3af18 Test #2000 for season pack fix for BTN 2014-05-12 11:57:26 -07:00
echel0n
a5794a5347 Fix for BTN season pack searches 2014-05-12 09:35:40 -07:00
echel0n
7c9e4b24d5 Fix for backlog and manual searches not being executed 2014-05-12 04:10:45 -07:00
echel0n
31297b9069 Added RSS Cache updater with user-settable interval from config section of web interface, updates the cache so that searches can be more instant when looking for snatches.
Updated backlog search code to re-set skipped or missed episodes to wanted.
2014-05-12 01:52:14 -07:00
echel0n
52efb6f43b Added incomplete indexer <-> scene mapping check 2014-05-11 15:24:02 -07:00
echel0n
7ce27b72f5 Fix for scene numbering issues 2014-05-11 12:50:34 -07:00
echel0n
aafe9ad522 Removed snatch queues to reduce memory footprint.
Fixed issue #527
2014-05-11 12:04:47 -07:00
echel0n
f8035e800e Fix for air-by-date downloads.
Fix for backlog and manual searches.
2014-05-11 07:17:11 -07:00
echel0n
e977750702 Merge branch 'origin/master'
Conflicts:
	sickbeard/__init__.py
2014-05-11 05:55:12 -07:00
echel0n
1398c38275 Fix for manual and backlog download/search issues.
Removed multi-threading as it was more problems then usefull for now.

Added in match & snatch, any quality from initial quality settings gets downloaded first and does not continue searching, if archive qualities exist it'll stop once it hits max quality from said list.
2014-05-11 05:51:39 -07:00
sammy2142
57737feb5c Adds Per Provider Seed Ratio 2014-05-10 12:50:07 +01:00
echel0n
4f7c5481d2 Merge pull request #464 from iron8core/scc_fix_foreign_section
Fix downloading from foreign section of SceneAccess
2014-05-08 07:41:06 -07:00
echel0n
eb918ef362 Testing fix for charmap issues. 2014-05-08 07:27:57 -07:00
echel0n
2a4f8780e2 Fixed issues with multi-threading.
Fixed issues with snatching air-by-date shows.
Fixed issues with naming patterns.
Fixed issues with invalid literals.
Fixed issues with country codes missing and causing web errors.

Fixed so many issues I can't write them all done ... :)
2014-05-08 07:04:01 -07:00
iron8core
27fa146724 Fix downloading from foreign section 2014-05-08 15:02:53 +02:00
echel0n
fc94243546 Fixes backlog and manual searches.
Fixes season pack and single/multi episode searches.
Fixes multi-threading issues.
Fixes incorrect status being reported for manual searches.
Fixes quality being returned as N/A all the time for torrents.
2014-05-07 00:50:49 -07:00
Nils Vogels
3f719a4607 Convert TVDB to Indexerid 2014-05-06 23:51:06 +02:00
echel0n
8a61eb1e26 Added in some sleep timers to help improve overall cpu usage 2014-05-06 14:35:37 -07:00
echel0n
fb71c6139e Added in optional multi-threading for all search queues, can be set from General->Advanced config section.
Fixed issue #417 and #335
2014-05-06 04:29:38 -07:00
Nils Vogels
23b991e9c9 Fixes corner case where cookie could not be found 2014-05-06 10:30:33 +02:00
echel0n
b33e2be047 Fixes for backlog search.
Fixes for downloading the same episode twice.
Fixes for caches.
2014-05-05 06:26:02 -07:00
echel0n
c11c61e8cf Added backlog and proper searchers to HDBits 2014-05-05 00:39:20 -07:00
echel0n
2aa7706233 Fix for issue #375 TorrentDay and IPTorrents 2014-05-04 22:16:36 -07:00
echel0n
235a5d0161 Fixes empty searchStrings and empty itemList issues if they happened. 2014-05-04 20:13:10 -07:00
echel0n
a5b72dea84 Fixes issues with findpropers and airdate.
Fixes issues with unhashable dict types.
Fixes issues with 100% CPU usage.
Fixes issues with RSS feed cache.
Fixes issues with scene numbering and converting back to indexer numbering.
Fixes issues with backlog searches.
Fixes issues with season pack searches.
Fixes issues with BTN.
2014-05-04 20:08:32 -07:00
Nils Vogels
b7aa62c553 More typo fixes :S 2014-05-05 00:53:53 +02:00
Nils Vogels
fca48bfe64 Fixing typo 2014-05-05 00:40:02 +02:00
Nils Vogels
e475d2a22d Only walk lists if they are populated. 2014-05-04 23:20:04 +02:00
echel0n
99da47464d Fix for rssfeed 2014-05-04 05:08:45 -07:00
echel0n
129a8c1d7e Added cache for rss feed items.
Fixed issues with searches
2014-05-04 05:05:27 -07:00
echel0n
5252cbb72c Fixes issues found in cache and with season pack searches 2014-05-04 00:10:49 -07:00
echel0n
b349bab569 Fixes more issues that were still present for season pack searches and air-by-date shows. 2014-05-03 22:36:54 -07:00
echel0n
dea826c3ba Fixed alot of issues pertaining to season pack searches and backlog searches in regards to returning accurate results or no results at all.
Fixed issue #335
2014-05-03 20:16:26 -07:00
echel0n
a2a608ed85 Fix for issues downloading season packs and episodes and multiples of the same episode. 2014-05-03 16:56:01 -07:00
echel0n
7ca19b88d6 Fix for issue of downloading multiples of the same episode 2014-05-03 16:26:12 -07:00
echel0n
16441c0582 fix for issues #321 and 258 2014-05-03 05:22:50 -07:00
echel0n
6ee60d213a Fixes issue #325 2014-05-03 05:10:52 -07:00
echel0n
81a7a2b97f Typo corrected 2014-05-03 02:27:00 -07:00
echel0n
d5f183c171 Major changes made to search code, tvcache code, and name parser 2014-05-03 02:23:26 -07:00
Nils Vogels
2b2e2d484d Update SQL to match TVRage edition 2014-05-02 11:59:13 +02:00
echel0n
1c6b0807b0 Fixed backlog issues and improved cache and provider searches, this resolves issue #298 2014-05-01 21:53:34 -07:00
echel0n
eabd0d092f Fixes for air_by_date and sports shows
Fixes for sports regex matching patterns.
2014-05-01 20:03:44 -07:00
echel0n
3a60683327 Fixed issues with parsing release names and naming patterns including regex for sports is now more accurate then ever!
Added option under general settings to allow specifiying a default indexer to be used for adding newshows and existing shows (All, TVDB, TVRage)
2014-05-01 17:57:51 -07:00
echel0n
74c6bec150 Fix for issue #291 2014-05-01 14:37:53 -07:00
echel0n
071d51fcda Fixes for scene conversion and regexs 2014-05-01 00:18:52 -07:00
echel0n
dfd8ead9f8 Fix for published_parsed errors 2014-04-30 22:17:54 -07:00
echel0n
5ba99db64e Fix for issue #274, ebObj ref'd before assignment 2014-04-30 22:07:23 -07:00
echel0n
f6cf80aa99 Fixed issue #221
Manual and Backlog searches now gather all the search results FIRST then loop through them filtering the bad ones out, this should improve overall speed of searching for downloads.
2014-04-30 21:09:03 -07:00
echel0n
7e800ff524 Fixed manual episode searches.
Corrected a issue where SB was being searched twice for the same show wasting cpu cycles.
2014-04-30 18:20:53 -07:00
echel0n
9d191f6999 Fixes for post-processing issues.
Improvements made to caches for overall performance boost and more accurate matches.

Misc bug fixes applied.
2014-04-30 15:16:31 -07:00
echel0n
9384881241 Fixed issues with searching for air by date shows and sports.
Several bugfixes applied throughout the code along with cleanup performed.
2014-04-30 06:49:50 -07:00
echel0n
319ac2602f Fixed scene_numbering issues for shows that use scene numbers instead of TVDB numbering.
Fixed issues with local SB cache.

Fixed issues with sports naming patterns, we no longer treat sports as a airdate show and have created custom regex's to aid in finding sports related shows.
2014-04-30 05:10:13 -07:00
echel0n
5ef7a0fb30 Merge pull request #216 from iron8core/scc_fix_archive
Fix archive search and correct logging for foreign searches
2014-04-29 15:22:25 -07:00
echel0n
77bc5c7291 More fixes for strftime and findpropers 2014-04-29 08:16:17 -07:00
echel0n
87b752b4e5 Re-coded the Indexer cache, cache lookups are only performed for existing shows and we don't add any cache entries unless we are Indexing the show in our database so we don't waste cpu cycles and memory.
Manual and backlog searches both search the cache first before even attempting to send a search request to a provider.

More bugs have been worked out.
2014-04-29 06:14:19 -07:00
echel0n
c330bbb386 Fixed issues with post-processing, we now perform the auto-detection of the indexer in a spot that doesn't require the post-processing to start all the way from the begining allowing for less processing time to take place.
Fixed more code relating to scene converting and sports event episodes/shows.

Post-processing now checks for indexer id in the cache as well as the other normal ways it did before.
2014-04-28 21:55:59 -07:00
echel0n
872056cc5d Fixed issue of unknown attribute keyword 'show' 2014-04-28 17:18:30 -07:00
echel0n
43b6b4b594 Improved XEM scene numbering converting.
Fixed release naming and parsing.
Improved overall application performance and foorprint.
2014-04-28 17:12:06 -07:00
echel0n
3fbfed7d93 Fixes cache issues with lookups resulting in wasted cpu cycles.
Fixes issues with scene numbered releases not properly being converted before a cache lookup is performed and not being properly converted when returned from providers as a possible match for a show requested to be snatched.
2014-04-28 16:04:11 -07:00
echel0n
0ec4be65da Added in error 542 as requested 2014-04-28 11:46:35 -07:00
iron8core
0f395a636a Fix archive search and correct logging for foreign searches
Archive searches are now handled correctly
Fix debug logging for searches in foreign section
Include title fix from mr-oranges's PirateBay edition
2014-04-28 13:26:25 +02:00
echel0n
99bbd0649c Fix for debug logging on console.
Fix for RSS feeds for all providers.
2014-04-28 03:57:30 -07:00
echel0n
5e38813a73 Added sports feature, acts just like air_by_date except allows us to control the date pattern to match events that air_by_date could not.
Custome sports naming patterns can be set now as well.

Fixed issues with FINDPROPERS.

Fixed issues with session connections.

Cleaned up code.
2014-04-28 02:15:29 -07:00
echel0n
1d56ce7182 Fix for BTN provider 2014-04-27 19:51:15 -07:00
echel0n
896295b090 Fix for air-by-date shows 2014-04-27 17:16:09 -07:00
echel0n
71ec47ae6b Fix for error code checking for Newznab providers. 2014-04-27 17:08:12 -07:00
echel0n
28d39df816 Fix for air-by-date issues 2014-04-27 15:51:52 -07:00
echel0n
2a5cd9b02e Fix for exception error in TorrentLeech 2014-04-27 15:20:34 -07:00
echel0n
56a0a04a2c Fix for subtitles datetime issue
Code cleanup.
2014-04-27 15:16:43 -07:00
echel0n
29a5fe4cf5 Fix for FINDPROPERS 2014-04-27 14:45:43 -07:00
echel0n
35f70c7924 Fix for air-by-date and sports shows 2014-04-27 07:48:19 -07:00
echel0n
fb0339a274 Fix for sql mass add issues.
Fix for KAT and TPB providers.
Fix for Newznab providers.
2014-04-27 06:46:08 -07:00
echel0n
b0ec12e421 Fixes issue with update frequency.
Fixes backlog search issues with newznab providers.
2014-04-27 05:13:46 -07:00
echel0n
d8171acc97 Fix for backlog searches 2014-04-27 04:32:22 -07:00
echel0n
0ae27fa6e6 Fix for shows that are air-by-date 2014-04-27 03:40:50 -07:00
echel0n
5772de9eec Complete re-code of season/episode search code.
Switched from using standard requests to using sessions.
Fixed bug in speedcd that was preventing config from saving.
2014-04-27 03:31:54 -07:00
echel0n
18b781532c Fix for KAT provider 2014-04-26 15:20:52 -07:00
Nils Vogels
a5b85dcc1c Adding SpeedCD provider
Cherrypicking from mr-orange's fork
This is 30d8807d74

Closes #47
2014-04-26 15:48:37 +02:00
echel0n
8d4d1a21cd Fix for no status attribute error 2014-04-26 04:23:00 -07:00
echel0n
e787ef8332 XEM Scene Numbering fixes.
Deepcopy thread.lock issue fixed.
Overall performance increased, searches faster and more accurate.
2014-04-26 03:37:40 -07:00
echel0n
bf31077cc2 Fix for thread locking issues 2014-04-26 01:09:38 -07:00
echel0n
690e842bb1 Fix for SSL issues.
Fix for Download Station issues.
2014-04-26 00:09:00 -07:00
echel0n
26e259c036 Fix for Newznab providers 2014-04-25 21:53:44 -07:00
echel0n
754cc8e791 JSON parsed by requests lib instead of helper function 2014-04-25 20:58:24 -07:00
echel0n
83bcc63683 More RSS cache fixes 2014-04-25 20:42:35 -07:00
echel0n
7a22f6c77a More RSS fixes 2014-04-25 18:49:38 -07:00
echel0n
3ee6d45fcd More updates for RSS feed code 2014-04-25 18:39:43 -07:00
echel0n
a455bcb7c6 Fixes for RSS searches 2014-04-25 17:03:24 -07:00
echel0n
0e82c5f573 Added RSS feedparser lib to process custom torrent RSS feeds.
Adjusted code for custom RSS feed parsing now that feedparser does the parsing for us all we do is pull the data from the returned entries.
2014-04-25 16:41:47 -07:00
echel0n
ce9f079136 Fixes issues with RSS feeds not being parsed correctly. 2014-04-25 04:45:34 -07:00
echel0n
a74b12f519 Fixes issues with RSS feeds not being parsed correctly. 2014-04-25 04:43:24 -07:00
echel0n
0d90d01460 Fix for SSL issues 2014-04-25 04:25:22 -07:00
echel0n
dafff0281e Merge branch 'pulls/62' 2014-04-25 00:32:22 -07:00
Peter Maciocia
09b106ec6b remove duplicate variable 2014-04-24 17:19:38 +01:00
SickBeard Custom User
484dba0de8 proper settings for proxy 2014-04-24 17:01:20 +01:00
iron8core
d72966c203 Add support for more sections on SceneAccess
Add (hopfully fully functioning) support for non-scene and foreign sections
for SceneAccess provider.
2014-04-24 17:44:22 +02:00
SickBeard Custom User
aae27f36f6 use proxies 2014-04-24 16:04:41 +01:00
echel0n
94670f7f95 Updated our cache code.
Updated rsstorrents to not bother using requests sessions.
2014-04-22 23:24:08 -07:00
echel0n
984e5e101d Fixes for BTN provider 2014-04-22 14:58:48 -07:00
echel0n
ad14de3d9e Merge branch 'pulls/40' 2014-04-22 14:56:12 -07:00
tehspede
90620e47b8 Update scc.py 2014-04-23 00:43:54 +03:00
tehspede
5b713f0262 Update scc.py 2014-04-23 00:41:01 +03:00
tehspede
4eb9000676 Fixes error "Invalid username or password for SceneAccess Check your settings" 2014-04-23 00:29:03 +03:00
echel0n
77696cad66 Fix for rss torrent feeds, resolves issue #32 2014-04-22 03:13:44 -07:00
echel0n
ad339a9b2e Multiple bugfixes for provider code 2014-04-22 01:02:43 -07:00
echel0n
8c78b558b5 Fixes issue #30 2014-04-21 20:50:20 -07:00
echel0n
f2fb9076ad Fixes issue #25 2014-04-05 04:40:55 -07:00
echel0n
e171aa1c10 Conditional check bugfixes 2014-04-02 07:23:17 -07:00
echel0n
fb222902c1 Minor bugfixes and improvements 2014-04-01 23:29:46 -07:00
echel0n
23348e0bd0 Fixed bug for returning requests object exceptions 2014-04-01 22:44:47 -07:00
echel0n
684f1fd671 Added tvdbid and tvrageid support to BTN provider 2014-03-30 17:17:24 -07:00
echel0n
6da13f4272 Beautiful Soup 4.3.2 update 2014-03-28 12:53:43 -07:00
echel0n
049282ccb9 Improvements to PublicHD provider code 2014-03-27 22:59:45 -07:00
echel0n
95d7d728e0 Re-write of Indexer API wrapper
Re-write of New Show seearch function
Re-write of Existing show search helper function for determining indexer/indexerid
Massive code cleanup and more bugs found and fixed
Indexer code fully modualized for future proofing
2014-03-24 22:57:24 -07:00
echel0n
e3a843a823 Bugfix for scene numbering and kickass searches 2014-03-21 01:34:00 -07:00
echel0n
10637f8f29 Code Clean up and regex fix for "no repeats" error (reverted from commit 8ecd5a196d) 2014-03-20 11:03:22 -07:00
echel0n
8ecd5a196d Code cleanup and regex fix for "no repeats" error 2014-03-20 10:51:59 -07:00
echel0n
972833a7f6 Added Transaction for add/update/delete episodes and change episode status 2014-03-20 03:24:58 -07:00
echel0n
50911a1f0f Small typo corrected 2014-03-20 01:17:56 -07:00
echel0n
ce5053f25d Bunch of code upgrades and bugfixes 2014-03-20 01:15:22 -07:00
echel0n
fc24efb957 Fix for new feature "first match" 2014-03-18 07:03:02 -07:00
echel0n
dbaf9955cb Fixed issue with BTN provider.
Started to added in "archive on firstmatch" feature.
2014-03-18 06:50:13 -07:00
echel0n
146d9ba23b couple small bugfixes in code when it was expecting a string but got a integer instead well trying to create a search string for providers to use. 2014-03-16 04:57:59 -07:00
echel0n
1f178686cc Fixed regex pattern for sports events that were preventing searches from working.
Switched out urllib2 HTTP Handler for requests HTTP Handler in main getURL function in helpers module.

Fixed date parsing for sports in NameParser module.

Misc fixes and improvements throughout the code.
2014-03-15 18:01:12 -07:00
echel0n
90cdf326b7 Bugfixes 2014-03-11 09:35:13 -07:00
echel0n
0d9fbc1ad7 Welcome to our SickBeard-TVRage Edition ...
This version of SickBeard uses both TVDB and TVRage to search and gather it's series data from allowing you to now have access to and download shows that you couldn't before because of being locked into only what TheTVDB had to offer.

Also this edition is based off the code we used in our XEM editon so it does come with scene numbering support as well as all the other features our XEM edition has to offer.

Please before using this with your existing database (sickbeard.db) please make a backup copy of it and delete any other database files such as cache.db and failed.db if present, we HIGHLY recommend starting out with no database files at all to make this a fresh start but the choice is at your own risk!

Enjoy!
2014-03-09 22:39:12 -07:00