Commit graph

219 commits

Author SHA1 Message Date
JackDandy
9d24ec109f Fix only replace initial quality releases from the upgrade to list. 2016-09-22 13:20:48 +01:00
Prinz23
d3a7f0ff5e Add smart logic to reduce api hits to newznab server types and improve how nzbs are downloaded.
Add newznab smart logic to avoid missing releases when there are a great many recent releases.
Change improve performance by using newznab server advertised capabilities.
Change config/providers newznab to display only non-default categories.
Change use scene season for wanted segment in backlog if show is scene numbering.
Change combine Manage Searches / Backlog Search / Limited and Full to Force.
Change consolidate limited and full backlog.
Change config / Search / Backlog search frequency to instead spread backlog searches over a number of days.
Change migrate minimum used value for search frequency into new minimum 7 for search spread.
Change restrict nzb providers to 1 backlog batch run per day.
Add to Config/Search/Unaired episodes/Allow episodes that are released early.
Add to Config/Search/Unaired episodes/Use specific api requests to search for early episode releases.
Add use related ids for newznab searches to increase search efficiency.
Add periodic update of related show ids.
Change terminology Edit Show/"Post processing" tab name to "Other".
Add advanced feature "Related show IDs" to Edit Show/Other used for finding episodes and TV info.
Add search info source image links to those that have zero id under Edit Show/Other/"Related show IDs".
Add "set master" button to Edit Show/Other/"Related show IDs" for info source that can be changed.
Change terminology displayShow "Indexers" to "Links" to cover internal and web links.
Change add related show info sources on displayShow page.
Change don't display "temporarily" defunct TVRage image link on displayShow pages unless it is master info source.
Change if a defunct info source is the master of a show then present a link on displayShow to edit related show IDs.
Change simplify the next backlog search run time display in the page footer.
Change try ssl when fetching data thetvdb, imdb, trakt, scene exception.
Change improve reliability to Trakt notifier by using show related id support.
Change improve config/providers newznab categories layout.
Change show loaded log message at start up and include info source.
Change if episode has no airdate then set status to unaired (was skipped).

Technical
Change move scene_exceptions table from cache.db to sickbeard.db.
Add related ids to show obj.
Add use of mapped indexer ids for newznab.
Add indexer to sql in wanted_eps.
Add aired in (scene) season for wanted episodes.
Add need_anime, need_sports, need_sd, need_hd, need_uhd to wanted episodes and added as parameter to update_providers.
Add fix for lib lockfile/mkdirlockfile.
Add set master TV info source logic.
Change harden ui input validation.
Add per action dialog confirmation.
Change to reload page under more events.
Change implement "Mark all added episodes Wanted to search for releases" when setting new info source.
2016-09-21 17:50:27 +01:00
JackDandy
05a9dc62f1 Add Torrentz2 provider.
Change handle when a torrent provider goes down and its urls are cleared.
Add handler for when rar files can not be opened during post processing.
2016-09-12 17:07:22 +01:00
JackDandy
48a27e57a0 Add detection of password protected rars with config/Post Processing/'Unpack downloads' enabled.
Change post process to cleanup filenames with config/Post Processing/'Unpack downloads' enabled.
Change post process to join incrementally named (i.e. file.001 to file.nnn) split files.
Change replace unrar2 lib with rarfile 3.0 and UnRAR.exe 5.40 beta 4 freeware.
Change post process "Copy" to delete redundant files after use.
2016-08-22 16:09:07 +01:00
JackDandy
22b520b517 Change improve debug log message for CloudFlare response that indicate website is offline. 2016-08-10 11:55:20 +01:00
JackDandy
ebdc154d56 Add config.ini file only setting "remove_filename_chars".
To initialise,
1) At General config page, press 'Save' then 'Shutdown' SG
2) Open config.ini in a text editor, find and edit remove_filename_chars = "" e.g. remove_filename_chars = "'"
3) Save config.ini and start SG. With the example given, the ' character will not appear in file names.
2016-06-14 23:24:44 +01:00
JackDandy
cb25fc2e03 Add Zooqle icon.
Change get url to also handle absolute redirects.
2016-06-14 00:22:28 +01:00
JackDandy
be9723e719 Add Zooqle torrent provider. 2016-06-13 19:50:44 +01:00
JackDandy
8ad380adea Add Bit-HDTV torrent provider. 2016-06-13 19:32:08 +01:00
JackDandy
09741bbf8c Add IMDb Watchlists to 'View' drop down on the 'Add from IMDb' page.
Add 5 decades of 'IMDb Popular' selections to 'View' drop down on 'Add from... Browse Shows'.
Add 'Other Services' to 'View' drop down on 'Add from... Browse Shows'.
Add enable, disable and delete public IMDb watchlists to Config/General/Interface with a default 'SickGear' list.
Change prevent duplicate show ids from presenting items on 'Add from... Browse Shows'.
Change add 'nocache' kwarg to helpers.getURL to facilitate non-cached requests.
2016-05-01 20:24:20 +01:00
JackDandy
4064b5183c Merge branch 'master' into develop 2016-03-16 18:36:33 +00:00
Prinz23
e55462f47b Fix ensures internal buffer of a downloaded file is written to disk. 2016-03-16 18:28:58 +00:00
Prinz23
50292eed3a Fix rare NameParser case where numeric episode name was parsed as episode number.
Change parse .nfo file for Add Existing page.
2016-03-06 00:58:34 +00:00
JackDandy
df4e61c661 Add Emby notifier to config/Notifications (thanks to Supremicus for the jumpstart) with a homebrew description. 2016-02-25 12:56:55 +00:00
JackDandy
a68f64327f Change overhaul Kodi notifier and tidy up config/notification/KodiNotifier ui.
Add passthru of param "post_json" to Requests() "json" in helpers.getURL.
2016-02-18 23:55:04 +00:00
Prinz23
6dd434fcba Add CPU throttling preset "Disabled" to config/General/Advanced Settings and centralise the function. 2016-02-11 19:25:35 +00:00
JackDandy
f24444b101 Fix handling non-numeric IMDb popular ratings. 2016-01-12 19:42:37 +00:00
JackDandy
5cda1fad65 Change get_size helper to also handle files. 2016-01-07 13:15:52 +00:00
JackDandy
fcd2810351 Fix false +ve outcome from incorrect return value and fix nzbfile implementation.
Change refactor code.
2015-12-17 02:07:50 +00:00
JackDandy
43778d8edd Change providers, add some, remove one, fix a snatch issue, rework ignore/require words, refactor code.
Add BitMeTV torrent provider.
Add TVChaosUK torrent provider.
Add HD-Space torrent provider.
Add Shazbat torrent provider.
Remove Animenzb provider.
Change use tvdbid for searching usenet providers.
Change consolidate global and per show ignore and require words functions.
Change "Require word" title and notes on Config Search page to properly describe its functional logic.
Add "Reject Blu-ray M2TS releases" to BTN provider.
Add regular expression capability to ignore and require words by starting wordlist with "regex:".
Add list shows with custom ignore and require words under the global counterparts on the Search Settings page.
Fix failure to search for more than one selected wanted episode.
2015-12-02 01:31:50 +00:00
Adam
1392d65254 Fix removal of non-release groups such that anime qualities are not trimmed from name 2015-11-28 19:34:39 +08:00
JackDandy
e37c9ba6d7 Add AniDb Random and Hot to Add Show page. 2015-11-16 12:02:09 +00:00
JackDandy
a574012c38 Change increase the scope and number of non release group text that is identified and removed. 2015-10-16 14:03:19 +01:00
Adam
3695766df4 Remove unnecessary call to indexers during nameparsing 2015-09-20 19:40:03 +08:00
JackDandy
cb0216c506 Change to allow file moving across partition. 2015-07-16 13:24:05 +01:00
JackDandy
2051268891 Change refactor, PEP8, code convention cleanse for nzb/torrent code and remove newzbin remnants. 2015-07-15 19:19:39 +01:00
JackDandy
f782567fd1 Change provider SCC login process to use General Config/Advanced/Proxy host setting.
Change refactor SCC to use torrent provider simplification and PEP8.
2015-07-03 14:24:09 +01:00
Adam
680491684d Change py2 file and reload functions to py2/3 compatible open and reload_module functions 2015-06-14 11:49:23 +08:00
Adam
a4cc931abc Change check_url function to use requests instead of httplib library 2015-06-13 19:55:54 +08:00
Adam
a3c717becd Change py2 print statements to py2/3 compatible functions 2015-06-09 19:33:03 +08:00
Adam
37496189f1 Change py2 exception clauses to py2/3 compatible clauses
Add py2/3 regression testing for exception clauses

Any new code added with old py2 style exceptions will now fail the travis test
2015-06-08 22:56:45 +08:00
JackDandy
fed5e11532 Change first run after install to set up the main db to the latest schema instead of upgrading.
Change don't create a backup from an initial zero byte main database file, PEP8 and code tidy up.
Change move the previous InitialSchema into migration_tests to preserve migration development.
2015-06-06 06:21:17 +01:00
JackDandy
f3b1487e00 Change handling of general HTTP error response codes to prevent issues.
Add handling for CloudFlare custom HTTP response codes.
2015-06-04 02:07:04 +01:00
JackDandy
9ad4b4cd30 Remove EZRSS provider. 2015-05-18 19:54:25 +01:00
Prinz23
2e711423b9 Add Search Queue Overview page
* Add expandable search queue details on the Manage Searches page
* Fix failed status episodes not included in next_episode search function
* Change prevent another show update from running if one is already running
* Change split Force backlog button on the Manage Searches page into: Force Limited, Force Full
* Change refactor properFinder to be part of the search
* Change improve threading of generic_queue, show_queue and search_queue
* Change disable the Force buttons on the Manage Searches page while a search is running
* Change disable the Pause buttons on the Manage Searches page if a search is not running
* Change scheduler forceRun
* Change staggered periods of testing and updating of all shows "ended" status up to 460 days
2015-05-10 17:22:54 +02:00
Adam
6a6f3d7ad8 Change helpers doctests to unittests 2015-05-09 20:47:20 +08:00
JackDandy
4f4858f4e4 Change to post process files ordered largest to smallest and tidied PP logging output.
Add "then trash subdirs and files" to the Process method "Move" on the manual post process page.
Add using show scene exceptions with post processing.
Change overhaul processTV into a thread safe class.
Change postProcessor and processTV to PEP8 standards.
Change overhaul Manual Post-Processing page in line with layout style and improve texts.
Change Force Processes enabled, only the largest video file of many will be processed instead of all files.
Change visual ui of Postprocessing results to match the logs and errors view.
Change remove ugly printing of episode object during PP seen in external apps like sabnzbd.
Change to streamline output toward actual work done instead of showing all vars.
Change pp report items from describing actions about to happen to instead detail the actual outcome of actions.
Add clarity to the output of a successful post process but with some issues rather than "there were problems".
Add a conclusive bottom line to the pp result report.
2015-05-08 04:18:30 +01:00
JackDandy
837265b6f6 Change no longer fetch xml and zip and adjust code inline with library updates. 2015-04-29 02:09:06 +01:00
Prinz23
8f69adaada Fix clearing provider cache 2015-04-25 16:48:15 +08:00
adam
2dab61478e Remove various unused code 2015-03-16 23:13:20 +08:00
JackDandy
e6b7feef3d Change to simplify and reduce logging output of Recent-Search and Backlog processes. 2015-03-13 18:21:46 +00:00
JackDandy
74d701e6da Change "Force Backlog" button for paused shows on Backlog Overview page to "Paused" indicator. 2015-03-10 22:57:39 +00:00
JackDandy
8f7193ee93 Change authentication credentials to display more securely on config pages. 2015-02-24 16:13:07 +00:00
Adam
87d46b2c3f Remove unused SickBeardURLOpener and AuthURLOpener classes 2015-02-24 15:02:20 +08:00
JackDandy
97429c084f Change overhaul UI of editShow and anime release groups, refactor and simplify code.
Change list order of option on the right of the displayShow page to be mostly inline with the order of options on editShow.
Change legend wording and text colour on the displayShow page.
Add output message if no release group results are available.
Add cleansing of text used in the processes to a add a show.
Add sorting of AniDB available group results.
Add error handling and related UI feedback to reflect result of AniDB communications.
Change description of config/search ignore and require words.
2015-02-21 22:34:20 +00:00
JackDandy
acafdbb16a Add proxy request url parsing to enforce netloc only matching which prevents false positives when url query parts contain FQDNs. 2015-02-11 00:19:37 +00:00
JackDandy
c720c0b913 Add support for a proxy host PAC url on the General Config/Advanced Settings page. 2015-02-10 14:22:12 +00:00
Supremicus
47da38a914 Logging message tweaks and minor PEP8 tweaks
* Change corrected spelling & better clarified various log messages
* Change minor PEP8 tweaks in sab.py
* Add api disabled error code for newznab providers
2015-02-08 12:59:10 +10:00
Adam
9b3fd0b7a9 Add TVRage network name standardization 2015-01-12 18:45:41 +08:00
adam
a419f53ca9 Fix port checking code preventing startup directly after a SG restart 2014-12-13 13:32:08 +08:00
JackDandy
e7b11c5f4b Fix article removal for sorting on Display Show, and API pages.
Remove Javascript regex boundary from Python regex.
2014-12-09 21:33:40 +00:00
adam
87c78b50b2 Revert "Merge pull request #19 from adam111316/feature/AddNetworkStandardization" 2014-12-07 21:22:42 +08:00
JackDandy
0dfe997ab3 Merge branch 'release/0.4.0' into develop 2014-11-27 03:51:01 +00:00
JackDandy
3cac799877 Fix article sorting for Coming Eps, Manage, Show List, and Trending Shows.
Increase article sorting strictness with a central helper function.
2014-11-27 03:34:41 +00:00
JackDandy
5f5080d3ab Merge branch 'release/0.4.0' into develop 2014-11-23 21:07:46 +00:00
Adam
7930cbcd80 Fix reduces time API endpoint Shows takes to return results.
Fix indexer mapper caching.
Fix tvrage API garbage collection.
2014-11-23 20:57:38 +00:00
Adam
a046729436 Add TVRage network name standardization 2014-11-23 22:16:23 +08:00
JackDandy
6da09b8db0 Change suppress HTTPS verification InsecureRequestWarning.
Suppress this potentially confusing warning because many sites use self-certified certificates.

Change a couple of lib references to be full paths.
2014-11-20 03:07:44 +00:00
Supremicus
4c8c6b21d5 Change logos, text etc. branding to SickGear. 2014-11-12 20:56:40 +00:00
JackDandy
0607b912d8 Add an anonymous redirect builder for external links.
Add anonymous redirect to external links on pages... Add Trending Show, Add Existing Shows, Add New Shows, Coming Episodes, Display Show, Config Notifications, Config Anime, Subtitle Providers, ASCII chart on General Config Advanced, links of newly created Usenet and Torrent providers.
Update xbmc link to Kodi at Config Notifications.
Fix irc protocol link to not use http protocol linkage on Config/Help and align lower right side column to the upper right side text.
2014-11-10 04:01:53 +00:00
Adam
560ffca7dd Make hardlink debug error more verbose 2014-10-13 23:20:44 +08:00
Adam
d8e52f2098 Fixes displayshow error for series with special characters 2014-10-03 07:34:09 +08:00
Adam
0822d15d36 Add sizing field on show page 2014-10-02 16:41:13 +08:00
echel0n
ee458bd211 Fixed AttributeError: 'NoneType' object has no attribute 'is_scene' in scene_numbering code.
Show root dirs can not be set from general config menu.
Mass editing shows now has the ability to delete root dirs as well as edit them.
Daily search no longer is restricted to just 1 week of results for searching from which now allows for replacing lower quality downloads with higher quality ones if available.
RSS Cache is updated for each provider on demand now when performing manual, failed, backlog, or daily searches.
2014-08-30 01:47:00 -07:00
Adam
72b0b04045 Halt post processing if lftp temporary files are detected 2014-08-11 18:29:28 +08:00
echel0n
3eed021200 Fixed issues where data needing to be posted was being sent via a GET instead of POST 2014-08-09 00:45:21 +00:00
echel0n
c658fe0f26 Fixed NoneType error when mapping indexers to show 2014-08-09 00:19:29 +00:00
adam
c4d5e480b5 Halt postprocessing if temporary btsync files are detected 2014-08-06 21:55:17 +08:00
echel0n
7c650d730c Switched a logger error to a logger debug 2014-07-30 18:59:52 -07:00
echel0n
b8b5947ae6 Fix for trakt.tv issues when adding/removing/syncing shows.
Fix for indexer mapper to return a result no matter what.
2014-07-30 16:33:28 -07:00
echel0n
534104b8b0 Changed how SickRage determins its branch version which will resolve issues with app switching back to master branch by mistke on startup. 2014-07-28 21:43:28 -07:00
echel0n
19a89d453c We now check if a torrent url links to a valid file before adding as a verified result to get snatched, this helps prevent issues when attempting to add torrent to client later on to find the url returned nothing resulting in a error. 2014-07-28 12:19:41 -07:00
echel0n
52010d9951 Fix for invalid torrent files causing NoneType errors. 2014-07-27 23:00:25 -07:00
echel0n
480199085e Fix for images in cache folder being deleted by cleaner routine. 2014-07-27 19:11:24 -07:00
echel0n
7dc89c084f Added ability to switch branches from general settings/advanced, will perform a forced checkout of whatever branch you choose and restart automatically.
Git updates are now forced to overwrite locale changes to avoid needing to manually stash uncommited changes before being able to proceed with a update.

Fixed indexer mapping when unable to locate show on indexer that we are trying to map to.
2014-07-27 11:39:02 -07:00
echel0n
f2a1331110 Skip cleaning images cache folder. 2014-07-27 05:34:03 -07:00
echel0n
b13e72e0a3 Moved code for cleaning up cache folder to seperate function located in helper.py.
Added call to cache folder cleanup during SickRage main init.

Changed a error message in rss feed class to a debug message for when url returns no data.

Moved indexer api cache files to be placed under cache folder subfolder indexers.

Moved rss feed cache files to be placed under cache folder subfolder rss.
2014-07-27 04:58:14 -07:00
echel0n
14c354b551 Added proxy support to Indexer APIs.
Provider getURL and downloadResult functions now removed and replaced with ones from helpers.py to help slim the code down plus allow more better control over request sessions.

Removed TVTumbler code.

Fixed HDBits provider.

Fixed config settings that were ment to be booleans but instead where set as str or int, should help resolve random html errors.

XEM Refresh check re-coded.

NameParser code for creating show object has been changed to only attempt at the very end once its found the bestMatch result, helps on resources and performance.
2014-07-27 03:59:21 -07:00
echel0n
f47734446d Fixed further json issues with speedcd provider.
Fixed several providers and ssl cert verify issues.

Air-by-date shows now automatically get there respective season/episode numbers during release parsing.
2014-07-24 11:16:59 -07:00
echel0n
e5ac585b6a Fix for webui becoming unresponsive when using SSL and possibly in other situations as well. 2014-07-23 23:36:44 -07:00
echel0n
de5db9be64 Added ability to set a default indexer for trakt notifier used for adding shows from watch list so that SickRage knows what indexer to set the show as.
Indexer mapping now uses indexer api calls to gather its information and then stores it to a new table called indexer_mapping for instant lookups later on.

Fixed trakt related issues for adding new shows and syncing.

Centered items at bottom of pages to just look a little nicer and fit properly.
2014-07-23 22:07:01 -07:00
echel0n
a317ff61c2 Created a context manager wrapper for BeautifulSoup4 so that we can cleanup/clear tags/context on exit via WITH statements.
Fixed issues with torrent providers returning no results.
2014-07-21 21:26:58 -07:00
echel0n
5ac99b8c5c Fix for extensions being stripped off by mistake made when adding in -RP fix from few commits ago. 2014-07-21 06:29:07 -07:00
dhellwich
aba5cc10d2 Fix for symlinking during Post-Processing
As described here: https://sickrage.tv/forums/forum/help-support/bug-issue-reports/5016-several-issues
2014-07-20 21:47:37 +02:00
echel0n
02c8b867c6 Fixed -RP release issues.
Removes .nzb and .torrent extensions from files for parsing purposes.
2014-07-19 15:23:01 -07:00
echel0n
14fd0daa6c Fix for nameparser error during PP 2014-07-19 06:53:06 -07:00
echel0n
9fe6b66475 Forgot to commit these 2014-07-19 06:10:02 -07:00
echel0n
d02c0bd6eb Fixed issues with editing/saving custom scene exceptions.
Fixed charmap issues for anime show names.

Fixed issues with display show page and epCat key errors.

Fixed duplicate log messages for clearing provider caches.

Fixed issues with email notifier ep names not properly being encoded to UTF-8.

TVDB<->TVRAGE Indexer ID mapping is now performed on demand to be used when needed such as newznab providers can be searched with tvrage_id's and some will return tvrage_id's that later can be used to create show objects from for faster and more accurate name parsing, mapping is done via Trakt API calls.

Added stop event signals to schedualed tasks, SR now waits indefinate till task has been fully stopped before completing a restart or shutdown event.

NameParserCache is now persistent and stores 200 parsed results at any given time for quicker lookups and better performance, this helps maintain results between updates or shutdown/startup events.

Black and White lists for anime now only get used for anime shows as intended, performance gain for non-anime shows that dont need to load these lists.

Internal name cache now builds it self on demand when needed per show request plus checks if show is already in cache and if true exits routine to save time.

Schedualer and QueueItems classes are now a sub-class of threading.Thread and a stop threading event signal has been added to each.

If I forgot to list something it doesn't mean its not fixed so please test and report back if anything is wrong or has been corrected by this new release.
2014-07-14 19:00:53 -07:00
echel0n
9a6be98f1f Fix for symlinking during Post-Processing 2014-07-12 15:10:10 -07:00
echel0n
8045976c15 Possible fix for error 500 in web gui when trying to get a show poster and showList is not yet been init'd 2014-07-06 07:48:51 -07:00
echel0n
56e2c28bad SickRage now uses a internal name cache comprised of (showlist, scene exceptions, scene names) used to search and create show objects from which is needed for parsing search results.
Scene exceptions now uses a internal cache for scene exceptions and scene season exceptions, helps reduce overhead to DB and performs faster lookups when making scene exception requests.
2014-07-03 10:30:15 -07:00
echel0n
cadb2dba72 Testing fix for post-processing and search issues. 2014-07-02 12:36:00 -07:00
echel0n
adb4715b3e Removed all scene exception memory caches, fetches data from DB now directly. 2014-06-30 04:09:55 -07:00
echel0n
0c57676aed Updated tornado source code.
Created custom class for rss feed parser.
2014-06-29 03:05:33 -07:00
echel0n
6c3f34fd8d Possible fix for EpisodeNotFoundByAbsoluteNumberException errors 2014-06-24 17:37:03 -07:00
echel0n
7fff3e0d63 Added zip extraction exception logging. 2014-06-24 17:02:19 -07:00
echel0n
92828eca54 Added error logging for backup zip creation. 2014-06-24 16:59:14 -07:00
echel0n
7e0bb651b2 Database now closes connection after each query and reconnects if closed to ensure no more connection and locked database problems.
Fixed more internal 500 errors.
2014-06-21 15:46:59 -07:00
echel0n
5f7b8465d0 Fixed issue with extractZip function. 2014-06-19 10:04:16 -07:00
echel0n
2b7df8e67d Added backup and restore feature, this allows you to backup your config.ini and sickbeard.db files into a zipfile and save it to a destination of your choice and as well you can restore the same zip file later on then perform a restart to have the changes take affect automatically. Backups are saved date/time stamped. 2014-06-19 07:31:44 -07:00