Commit graph

150 commits

Author SHA1 Message Date
JackDandy
0ead7771de Change improve the manage searches error stats UI and backend functions.
Add the improved error handling to torrent providers.
Change cache_db to always include db upgrade statements when running SG for the first time.
Change split newznab limit logic into a reusable function, hit_limit_update() and use in BTN prov.
Change tweak CSS to make things a little neater with button spacings.
Add the actual time when current limit will expire to the UI.
Change instead of terminology "errors", use "failures".
Change improve BTN error handling.
Change ensure provider name is output to log at times where it wasn't.
Change ensure failed request URLs and POST params are output to log.
Add time of last failure + type to should_skip log message.
Change code DRY and simplification for improved readability.
Change occurrences of "error" to "fail" for consistency.
Add tmr limit handling to omg and change log_failure_url level to warning.
Change log the failed URL when an API hit limit is reached.
Change "hit" to the more universally generic "tmr" - Too Many Requests.
Change Db columns containing "hit_" are renamed "tmr_"
2018-01-26 01:35:02 +00:00
Prinz23
f9cc6ed330 Add provider error table to page Manage/Media Search.
Add failure handling, skip provider for x hour(s) depending on count of failures.
Add detection of api hit limit reached.
Add failure count to omgwtfnzbs.
Change improve categories selection (manual search for example).
2018-01-25 20:48:24 +00:00
Prinz23
6da32a5ed0 Add log message for not found on indexer when adding a new show.
Fix upgrade once ARCHIVED setting by postProcessor.
Fix determination of is_first_best_match.
Change improve smart selection of categories in manual and failed search modes.
Change refactor wantedQuality into own function that can be used in multiple places.
Change improve error resistance in neededQualities class.
Add log warning message if wantedQuality or eps_aired_in_season is missing for search.
Add check backlogitem for wantedQuality and add if missing.
Add use wantedQuality list in wantEpisode.
Change don't use wantedQualities for multipart.
2017-12-27 03:14:20 +00:00
JackDandy
8d97f2664a Add ETTV and PotUK providers, fix BTScene and Lime. 2017-12-22 19:37:14 +00:00
JackDandy
22ce0203cf Add quality tag to archived items, improve displayShow/"Change selected episodes to".
Use to prevent "Update to" on those select episodes while preserving the downloaded quality.
Change group "Downloaded" status qualities into one section.
Add "Downloaded/with archived quality" to set shows as downloaded using quality of archived status.
Add "Archived with/downloaded quality" to set shows as archived using quality of downloaded status.
Add "Archived with/default (min. initial quality of show here)".
Change when settings/Post Processing/File Handling/Status of removed episodes/Set Archived is enabled, set status and quality accordingly.
Add downloaded and archived statuses to Manage/Episode Status.
Add quality pills to Manage/Episode Status.
Change Manage/Episode Status season output format to be more readable.
Change add SNATCHED_ANY and ARCHIVED, refactor accordingly.
2017-12-04 19:27:50 +00:00
Prinz23
05758bb75e Change overhaul handling of PROPERS/REPACKS/REAL.
Add restriction to allow only same release group for repacks.
Change try all episode names with 'real', 'repack', 'proper'.
Add flags table to store when one-off operations have been performed.
Change update history.tbl with action SNATCHED_PROPER on existing items.
Change save proper snatches as action SNATCHED_PROPER + quality into history.tbl
Add optional regex lib with fuzzy (errors ~20% of alpanum chars) for extra_info_no_name.
Add tip to search settings/media search about improved matching with optional regex library.
2017-10-30 22:21:55 +00:00
JackDandy
208c284e6b Merge branch 'master' into develop 2017-09-17 09:08:31 +01:00
JackDandy
6ae5491476 Fix provider nCore.
Change .torrent checker due to files created with qB 3.3.16 (affects nCore and NBL).
2017-09-17 09:06:26 +01:00
Prinz23
3e9a9095a6 Change make indexer lookup optional in NameParser, and deactivate during searches. 2017-07-21 22:39:08 +01:00
Prinz23
266c87f5f1 Change catch show update task errors.
Change tracebacks to ERROR.
Add scene_exceptions error handling with missing data.
Add exception catching and traceback logging in show_updater.
2017-06-15 01:37:28 +01:00
JackDandy
fc5e0df46c Merge branch 'master' into develop 2017-02-17 05:11:53 +00:00
JackDandy
d97bb7174d Remove Torrentshack.
Change improve provider title processing.
Change improve handling erroneous JSON responses.
Change improve find show with unicode characters.
Change improve result for providers Omgwtf, SpeedCD, Transmithenet, Zoogle.
Change validate .torrent files that contain optional header data.
Fix case where an episode status was not restored on failure.
Add raise log error if no wanted qualities are found.
Change add un/pw to Config/Media providers/Options for BTN API graceful fallback (can remove Api key for security).
Change only download torrent once when using blackhole.
Add Cloudflare module 1.6.8 (be0a536) to mitigate CloudFlare (IUAM) access validator.
Add Js2Py 0.43 (c1442f1) Cloudflare dependency.
Add pyjsparser 2.4.5 (cd5b829) Js2Py dependency.
2017-02-17 04:48:49 +00:00
Prinz23
b56ddd2eec Change skip episodes that have no wanted qualities.
Change download picked .nzb file on demand and not before.
2017-02-17 03:48:24 +00:00
JackDandy
14db6d12cc Add "Perform search tasks" to Config/Media Providers/Options.
Change improve clarity of enabled providers on Config/Media Providers.
2017-02-15 03:32:56 +00:00
Prinz23
87e608f277 Add scheduled backlog switch. 2017-02-15 00:51:52 +00:00
Prinz23
e071542b51 Change don't exclude "unknown" from search.
Fix UHD category select in Recent Search.
Change speed improvement in finding needed categories/qualities (sd, hd, uhd).
2016-11-14 01:50:25 +00:00
Prinz23
5adf5071d7 Change allow pp to replace files with a repack or proper of same quality.
Fix ensure downloaded eps are not shown on episode view.
Fix allow propers to pp when show marked upgrade once.
Fix never set episodes without airdate to wanted.
Various other fixes.
2016-10-01 11:27:25 +01:00
JackDandy
9d24ec109f Fix only replace initial quality releases from the upgrade to list. 2016-09-22 13:20:48 +01:00
Prinz23
d3a7f0ff5e Add smart logic to reduce api hits to newznab server types and improve how nzbs are downloaded.
Add newznab smart logic to avoid missing releases when there are a great many recent releases.
Change improve performance by using newznab server advertised capabilities.
Change config/providers newznab to display only non-default categories.
Change use scene season for wanted segment in backlog if show is scene numbering.
Change combine Manage Searches / Backlog Search / Limited and Full to Force.
Change consolidate limited and full backlog.
Change config / Search / Backlog search frequency to instead spread backlog searches over a number of days.
Change migrate minimum used value for search frequency into new minimum 7 for search spread.
Change restrict nzb providers to 1 backlog batch run per day.
Add to Config/Search/Unaired episodes/Allow episodes that are released early.
Add to Config/Search/Unaired episodes/Use specific api requests to search for early episode releases.
Add use related ids for newznab searches to increase search efficiency.
Add periodic update of related show ids.
Change terminology Edit Show/"Post processing" tab name to "Other".
Add advanced feature "Related show IDs" to Edit Show/Other used for finding episodes and TV info.
Add search info source image links to those that have zero id under Edit Show/Other/"Related show IDs".
Add "set master" button to Edit Show/Other/"Related show IDs" for info source that can be changed.
Change terminology displayShow "Indexers" to "Links" to cover internal and web links.
Change add related show info sources on displayShow page.
Change don't display "temporarily" defunct TVRage image link on displayShow pages unless it is master info source.
Change if a defunct info source is the master of a show then present a link on displayShow to edit related show IDs.
Change simplify the next backlog search run time display in the page footer.
Change try ssl when fetching data thetvdb, imdb, trakt, scene exception.
Change improve reliability to Trakt notifier by using show related id support.
Change improve config/providers newznab categories layout.
Change show loaded log message at start up and include info source.
Change if episode has no airdate then set status to unaired (was skipped).

Technical
Change move scene_exceptions table from cache.db to sickbeard.db.
Add related ids to show obj.
Add use of mapped indexer ids for newznab.
Add indexer to sql in wanted_eps.
Add aired in (scene) season for wanted episodes.
Add need_anime, need_sports, need_sd, need_hd, need_uhd to wanted episodes and added as parameter to update_providers.
Add fix for lib lockfile/mkdirlockfile.
Add set master TV info source logic.
Change harden ui input validation.
Add per action dialog confirmation.
Change to reload page under more events.
Change implement "Mark all added episodes Wanted to search for releases" when setting new info source.
2016-09-21 17:50:27 +01:00
JackDandy
05a9dc62f1 Add Torrentz2 provider.
Change handle when a torrent provider goes down and its urls are cleared.
Add handler for when rar files can not be opened during post processing.
2016-09-12 17:07:22 +01:00
JackDandy
c37ed638e4 Add qBitTorrent to Search Settings/Torrent Search.
Add "Test NZBGet" client to Search Settings/NZB Search/NZBGet.
2016-07-04 00:23:11 +01:00
JackDandy
eac69963f0 Change validate and improve specific Torrent provider connections, IPT, KAT, SCC, TPB, TB, TD, TT.
Change refactor cache for torrent providers to reduce code.
Change improve search category selection BMTV, FSH, FF, TB.
Change identify more SD release qualities.
Change update SpeedCD, MoreThan, TVChaosuk.
Add torrent provider HD4Free.
Remove torrent provider BitSoup.
Change only create threads for providers needing a recent search instead of for all enabled.
Add 4489 as experimental value to "Recent search frequency" to use provider freqs instead of fixed width for all.
Fix searching nzb season packs.
Change remove some logging cruft.
2016-06-08 01:55:13 +01:00
JackDandy
3bc0823670 Change improve management of Transmission config/Search/Torrent Search "Downloaded files location". 2016-03-11 19:07:22 +00:00
JackDandy
fcd2810351 Fix false +ve outcome from incorrect return value and fix nzbfile implementation.
Change refactor code.
2015-12-17 02:07:50 +00:00
JackDandy
052a1a9c38 Change position of parsed qualities to the start of log lines and add log detail to providers that POST. 2015-12-02 17:03:55 +00:00
JackDandy
43778d8edd Change providers, add some, remove one, fix a snatch issue, rework ignore/require words, refactor code.
Add BitMeTV torrent provider.
Add TVChaosUK torrent provider.
Add HD-Space torrent provider.
Add Shazbat torrent provider.
Remove Animenzb provider.
Change use tvdbid for searching usenet providers.
Change consolidate global and per show ignore and require words functions.
Change "Require word" title and notes on Config Search page to properly describe its functional logic.
Add "Reject Blu-ray M2TS releases" to BTN provider.
Add regular expression capability to ignore and require words by starting wordlist with "regex:".
Add list shows with custom ignore and require words under the global counterparts on the Search Settings page.
Fix failure to search for more than one selected wanted episode.
2015-12-02 01:31:50 +00:00
JackDandy
2051268891 Change refactor, PEP8, code convention cleanse for nzb/torrent code and remove newzbin remnants. 2015-07-15 19:19:39 +01:00
Adam
37496189f1 Change py2 exception clauses to py2/3 compatible clauses
Add py2/3 regression testing for exception clauses

Any new code added with old py2 style exceptions will now fail the travis test
2015-06-08 22:56:45 +08:00
JackDandy
1242481803 Change typo. 2015-06-04 23:09:36 +01:00
adam
d47ad5f332 Change to only rebuild namecache on show update instead of on every search
Add removal of old entries from namecache on show deletion
2015-05-26 09:33:58 +08:00
Adam
821e38adf7 Merge branch 'master' into develop 2015-05-25 11:06:09 +08:00
Adam
9d08b8ef8f Fix erroneous multiple downloads of torrent files which causes snatches to fail under certain conditions
Namely this fixes snatching with the IPtorrents provider. This issue is masked in develop as the requests library has been updated and fixes the error that is generated
2015-05-25 11:03:30 +08:00
JackDandy
9ad4b4cd30 Remove EZRSS provider. 2015-05-18 19:54:25 +01:00
JackDandy
ebdbf43d8b Merge pull request #321 from Prinz23/feature/AddSearchUnaired
Add Option to search for Unaired Episodes
2015-04-28 19:17:16 +01:00
Prinz23
8f69adaada Fix clearing provider cache 2015-04-25 16:48:15 +08:00
Prinz23
4ae30ab6ad Add option "Search for unaired episodes" to config/Search Settings
* Change reduce time to search recent result list by searching only once for a best result
* Fix replacing episodes that have a lower quality than what is selected in the initial and archive quality list
* Fix to include episodes marked Failed in the recent and backlog search processes
* Fix display of search status for an alternative release after episode is manually set to "Failed" on the Display Show page
* Change handle more varieties of media quality
* Change to prevent another scheduled search when one of the same type is already running
2015-04-24 20:45:45 +02:00
Adam
ee0dfbc357 Fix season pack search errors 2015-04-15 12:17:28 +08:00
JackDandy
c96dbf7ea6 Change to reduce the time taken to "Update shows" with show data.
Add "Enable IMDb info" option to config/General/Interface.
Change to not display IMDb info on UI when "Enable IMDb info" is disabled.
Change genre tags on displayShow page to link to IMDb instead of Trakt.
Change to reduce the time taken to "Update shows" with show data.
Change when IMDb info is updated...
a) stop updating the IMDb info during the scheduled daily update for every show.
b) update the IMDb info for a show after snatching an episode for it.
Develop changes...
Fix being able to actually turn IMDb off when it has been turned on.
Remove IMDb option from General Settings.
Change IMDb option to enable by default now the slow operation has been eliminated from process flows.
2015-03-14 15:09:39 +00:00
JackDandy
e6b7feef3d Change to simplify and reduce logging output of Recent-Search and Backlog processes. 2015-03-13 18:21:46 +00:00
adam
d1687dd401 Change layout of Recent Search code
Change naming of SEARCHQUEUE threads for shorter log lines
Fix Recent Search running status on Manage Searches page
2015-03-12 15:31:35 +08:00
JackDandy
692422cafa Change when picking a best result to only test items that have a size specifier against the failed history. 2015-02-15 02:47:46 +00:00
Supremicus
47da38a914 Logging message tweaks and minor PEP8 tweaks
* Change corrected spelling & better clarified various log messages
* Change minor PEP8 tweaks in sab.py
* Add api disabled error code for newznab providers
2015-02-08 12:59:10 +10:00
adam
ea99736939 Change anime release groups to in memory storage for lowered latency 2015-01-20 19:36:19 +08:00
JackDandy
c16903bd73 Change "Daily" search to "Recent" search. 2015-01-07 19:54:18 +08:00
Supremicus
4c8c6b21d5 Change logos, text etc. branding to SickGear. 2014-11-12 20:56:40 +00:00
KontiSR
0d415fcc20 This is a first attempt of getting the season pack downloading to work.
Unfortunately some of the old code I modified is still not 100% clear to me.. so I can't really oversee if this will work. That's why I suggest, this should be extensively tested, before merging into master!

I broke backlog searching.. Should be working again.

Tested, and seems to be working fine!
2014-09-25 13:18:07 +02:00
Adam
0aedf52997 Threads dailysearcher process for each provider. Allows dailysearcher to continue other operations without having to wait for providers with slow network operation 2014-09-22 13:41:29 +08:00
adam
5ac3895600 Fixes daily search and speed improvements 2014-09-20 20:34:00 +08:00
echel0n
627debcf88 Building of name cache executed now at start of searches to prevent building cache for show more then once when not needed 2014-09-15 02:46:08 -07:00
echel0n
67bd1a9e98 Fix for daily searches and high cpu usage plus increases search speed 2014-09-15 01:28:11 -07:00