Commit graph

231 commits

Author SHA1 Message Date
JackDandy
4f4858f4e4 Change to post process files ordered largest to smallest and tidied PP logging output.
Add "then trash subdirs and files" to the Process method "Move" on the manual post process page.
Add using show scene exceptions with post processing.
Change overhaul processTV into a thread safe class.
Change postProcessor and processTV to PEP8 standards.
Change overhaul Manual Post-Processing page in line with layout style and improve texts.
Change Force Processes enabled, only the largest video file of many will be processed instead of all files.
Change visual ui of Postprocessing results to match the logs and errors view.
Change remove ugly printing of episode object during PP seen in external apps like sabnzbd.
Change to streamline output toward actual work done instead of showing all vars.
Change pp report items from describing actions about to happen to instead detail the actual outcome of actions.
Add clarity to the output of a successful post process but with some issues rather than "there were problems".
Add a conclusive bottom line to the pp result report.
2015-05-08 04:18:30 +01:00
adam
65ce53b289 Add custom show lists to home page 2015-05-02 16:34:30 +08:00
JackDandy
837265b6f6 Change no longer fetch xml and zip and adjust code inline with library updates. 2015-04-29 02:09:06 +01:00
Prinz23
4ae30ab6ad Add option "Search for unaired episodes" to config/Search Settings
* Change reduce time to search recent result list by searching only once for a best result
* Fix replacing episodes that have a lower quality than what is selected in the initial and archive quality list
* Fix to include episodes marked Failed in the recent and backlog search processes
* Fix display of search status for an alternative release after episode is manually set to "Failed" on the Display Show page
* Change handle more varieties of media quality
* Change to prevent another scheduled search when one of the same type is already running
2015-04-24 20:45:45 +02:00
JackDandy
86443c21ca Merge pull request #314 from JackDandy/feature/ChangeOnlyAddValidItemsToSaveDB
Change only add valid items to save to DB.
2015-03-29 15:33:39 +01:00
JackDandy
59e547fac3 Fix loading shows from the DB that have NULL IMDb id. 2015-03-29 15:25:34 +01:00
JackDandy
e5d4269c10 Change only add valid items to save to DB. 2015-03-29 12:20:29 +01:00
JackDandy
b4b1859a2e Add IMDb lookup to "Update" action on Manage/Mass Update page.
(Credit and thanks to Prinz23 for his initiating efforts)

Fix display indexer provided start year on the displayShow page when no IMDb data exists.
Fix display indexer provided genres on the displayShow page when no IMDb data exists.
Fix display IMDb indexer with correct IMDb id on the displayShow page only when IMDb data exists.
Fix to correctly display show runtime when available on the displayShow page.
Fix to correctly initialise IMDb id loaded from db.
Other misc IMDb related db fixes.
Fix saving of Sort By/Next Episode in Layout Poster on Show List page.
2015-03-28 17:43:32 +00:00
Adam
94d0ce3e44 Add show overview from indexers to the database 2015-03-23 11:05:19 +10:00
JackDandy
f663212a74 Change no longer stamp files where airdates are never.
Prevent media from being file stamped 1.1.2001 as the value of a never airdate is 1. This issue can present for season 0 specials.
2015-03-19 23:12:19 +00:00
JackDandy
58d5452dc3 Change to gracefully handle some "key not found" failures when TVDB or TVRage return "Not Found" during show updates. 2015-03-19 15:40:12 +00:00
vergessen
d0ccf9f27a Fix release group not recognised from manually downloaded filename. 2015-03-18 21:37:08 +00:00
JackDandy
09f5e0622d Add "Status of removed episodes" to apply (or not) a preferred status to episodes whose files are detected as removed.
"Archived" can now be set so that removed episodes still count toward download completion statistics. See setting on page config/Post Processing/File Handling.
Remove redundant "Skip remove detection" from the config/Post Processing/File Handling page
Change combos on this page to be all consistent.
Improve vertical alignment of the label text before drop down combos.
Change to highlight the current selected item in combos.
Fix some inconsistent CSS line spacing.
2015-03-17 17:12:30 +00:00
adam
2dab61478e Remove various unused code 2015-03-16 23:13:20 +08:00
JackDandy
c96dbf7ea6 Change to reduce the time taken to "Update shows" with show data.
Add "Enable IMDb info" option to config/General/Interface.
Change to not display IMDb info on UI when "Enable IMDb info" is disabled.
Change genre tags on displayShow page to link to IMDb instead of Trakt.
Change to reduce the time taken to "Update shows" with show data.
Change when IMDb info is updated...
a) stop updating the IMDb info during the scheduled daily update for every show.
b) update the IMDb info for a show after snatching an episode for it.
Develop changes...
Fix being able to actually turn IMDb off when it has been turned on.
Remove IMDb option from General Settings.
Change IMDb option to enable by default now the slow operation has been eliminated from process flows.
2015-03-14 15:09:39 +00:00
JackDandy
e6b7feef3d Change to simplify and reduce logging output of Recent-Search and Backlog processes. 2015-03-13 18:21:46 +00:00
JackDandy
97429c084f Change overhaul UI of editShow and anime release groups, refactor and simplify code.
Change list order of option on the right of the displayShow page to be mostly inline with the order of options on editShow.
Change legend wording and text colour on the displayShow page.
Add output message if no release group results are available.
Add cleansing of text used in the processes to a add a show.
Add sorting of AniDB available group results.
Add error handling and related UI feedback to reflect result of AniDB communications.
Change description of config/search ignore and require words.
2015-02-21 22:34:20 +00:00
Supremicus
47da38a914 Logging message tweaks and minor PEP8 tweaks
* Change corrected spelling & better clarified various log messages
* Change minor PEP8 tweaks in sab.py
* Add api disabled error code for newznab providers
2015-02-08 12:59:10 +10:00
JackDandy
d945bd18e4 Fix rename of excluded metadata. 2015-02-07 18:11:40 +00:00
adam
ea99736939 Change anime release groups to in memory storage for lowered latency 2015-01-20 19:36:19 +08:00
JackDandy
b92eecb41b Change airdateModifyStamp to handle hour that is "00:00". 2014-11-20 18:35:14 +00:00
Supremicus
4c8c6b21d5 Change logos, text etc. branding to SickGear. 2014-11-12 20:56:40 +00:00
JackDandy
ef4470bd78 Add send2trash, General Config/Send to trash, and catch show dir not found exception.
Add send2trash, a small package that sends files to the Trash (or Recycle Bin) natively and on all platforms. If send2trash is found not compatible, the user can use the default delete and manually delete failed send2trash files.
Add General Config/Misc/Send to trash for actions that involve removing shows and log rotation.
Add handling for the exception raised while deleting a show and show folder no longer exists.
2014-11-05 05:36:16 +00:00
JackDandy
d6950bc6f1 Fix exception raised when converting 12pm to 24hr format, also handles 12am.
Triggered when setting file modify time (e.g. during PP and also scheduled show updates).
2014-10-31 15:29:18 +00:00
Adam
dda6cfce57 Fixes errors occurring when a show folder is deleted outside of SickRage 2014-10-28 14:47:47 +08:00
Adam
4adad577c8 Fixes show folder not deleting if files remain in folder 2014-10-02 19:20:03 +08:00
adam
37f021feb6 Custom naming for anime 2014-09-29 19:40:16 +08:00
Adam
164724a63d Fixes error: SHOWUPDATER: local variable 'cur_indexerid' referenced before assignment 2014-09-28 10:16:22 +08:00
KontiSR
32a88cf105 Not skipping when self.status = None, but assigning empty string ''
Added addiontional check for checking of the self.status is filled with the show status. If not, debug message is generated and the show is not updated.
2014-09-24 15:49:50 +02:00
adam
5ac3895600 Fixes daily search and speed improvements 2014-09-20 20:34:00 +08:00
echel0n
3cb1c573a3 Fix for newznab provider settings not saving properly
Added new show option, delete now removes show from showlist and deletes from hard drive, remove will just remove show from showlist but leave files on hard drive untouched
2014-08-29 03:29:56 -07:00
echel0n
e44747ab49 Testing fix for s00e00 issue #2 2014-08-18 05:48:23 -07:00
echel0n
c0329159a0 Testing fix for s00e00 issues 2014-08-18 05:40:29 -07:00
Adam
fd9be53fcb Anime propers 2014-07-27 21:04:17 +08:00
echel0n
14c354b551 Added proxy support to Indexer APIs.
Provider getURL and downloadResult functions now removed and replaced with ones from helpers.py to help slim the code down plus allow more better control over request sessions.

Removed TVTumbler code.

Fixed HDBits provider.

Fixed config settings that were ment to be booleans but instead where set as str or int, should help resolve random html errors.

XEM Refresh check re-coded.

NameParser code for creating show object has been changed to only attempt at the very end once its found the bestMatch result, helps on resources and performance.
2014-07-27 03:59:21 -07:00
echel0n
f47734446d Fixed further json issues with speedcd provider.
Fixed several providers and ssl cert verify issues.

Air-by-date shows now automatically get there respective season/episode numbers during release parsing.
2014-07-24 11:16:59 -07:00
echel0n
de5db9be64 Added ability to set a default indexer for trakt notifier used for adding shows from watch list so that SickRage knows what indexer to set the show as.
Indexer mapping now uses indexer api calls to gather its information and then stores it to a new table called indexer_mapping for instant lookups later on.

Fixed trakt related issues for adding new shows and syncing.

Centered items at bottom of pages to just look a little nicer and fit properly.
2014-07-23 22:07:01 -07:00
echel0n
4a29476415 Added code to perform disposal of bs4 class when finished as well as perform garbage collection afterwards, this fixed a memory leak issue SR was experiancing during backlog/manual/failed searches. 2014-07-21 15:16:04 -07:00
echel0n
f340f9b073 Fix for sports shows. 2014-07-21 08:49:20 -07:00
echel0n
5ac99b8c5c Fix for extensions being stripped off by mistake made when adding in -RP fix from few commits ago. 2014-07-21 06:29:07 -07:00
echel0n
02c8b867c6 Fixed -RP release issues.
Removes .nzb and .torrent extensions from files for parsing purposes.
2014-07-19 15:23:01 -07:00
echel0n
39d9fc6434 Fix for renaming non-anime shows and absolute numberings being applied by mistake. 2014-07-19 12:50:08 -07:00
echel0n
7cbeef5ed0 Fixed invalid naming pattern error.
Fixed sports regexes.
Fixed name parsing issues.
2014-07-15 02:40:21 -07:00
echel0n
5fb3fe6797 Fix for absolute numbering issue during renaming of files for non-anime shows. 2014-07-15 00:24:58 -07:00
echel0n
d02c0bd6eb Fixed issues with editing/saving custom scene exceptions.
Fixed charmap issues for anime show names.

Fixed issues with display show page and epCat key errors.

Fixed duplicate log messages for clearing provider caches.

Fixed issues with email notifier ep names not properly being encoded to UTF-8.

TVDB<->TVRAGE Indexer ID mapping is now performed on demand to be used when needed such as newznab providers can be searched with tvrage_id's and some will return tvrage_id's that later can be used to create show objects from for faster and more accurate name parsing, mapping is done via Trakt API calls.

Added stop event signals to schedualed tasks, SR now waits indefinate till task has been fully stopped before completing a restart or shutdown event.

NameParserCache is now persistent and stores 200 parsed results at any given time for quicker lookups and better performance, this helps maintain results between updates or shutdown/startup events.

Black and White lists for anime now only get used for anime shows as intended, performance gain for non-anime shows that dont need to load these lists.

Internal name cache now builds it self on demand when needed per show request plus checks if show is already in cache and if true exits routine to save time.

Schedualer and QueueItems classes are now a sub-class of threading.Thread and a stop threading event signal has been added to each.

If I forgot to list something it doesn't mean its not fixed so please test and report back if anything is wrong or has been corrected by this new release.
2014-07-14 19:00:53 -07:00
echel0n
933fad20c7 Unable to parse filename errors are now set to show via DEBUG logs only to prevent unicode chars from causing misc beeping sounds ... 2014-07-10 23:44:36 -07:00
echel0n
e891e9d637 Fixed nextaired not found issues and fixed kat provider issues. 2014-07-09 09:01:12 -07:00
echel0n
d6225dd8d3 Updated next episode airdate function to be run once at startup and then each time after that with show update schedualer 2014-07-09 00:49:05 -07:00
echel0n
23239e0a5d NextEpisode sets episodes that dont return a next air date to todays date to help improve load times for home page. 2014-07-09 00:33:44 -07:00
echel0n
5237e70fb3 Updated nextepisode function to only perform db calls when nextaired date has been reached. 2014-07-09 00:15:27 -07:00
echel0n
dbe22b570b NextEpisode code modified to return the airdate ordinal instead of a ep object, faster. 2014-07-08 23:07:26 -07:00
echel0n
58788f52e5 Corrected API to work with new nextepisode function code changes. 2014-07-08 22:53:51 -07:00
echel0n
a085f0f538 Improved and faster nextepisode function, speeds up home page load times. 2014-07-08 22:42:56 -07:00
echel0n
79a1b1c31e Fix for root dir location not being saved or set correctly for shows.
Fix for mass update edits of shows, bwlist no longer gets updated during this process as its not required. You can not change your root dir even if location does not exist so long as you have create_missing_show_dirs=1 in your config set so that there be auto-created during the next post-processing of a episode.
2014-07-07 20:27:24 -07:00
echel0n
dfc600893d Fix for SHOWQUEUE-REFRESH 2014-07-06 10:16:11 -07:00
echel0n
7a95b0bb14 Added new InvalidShowException to NameParser, Removed isGoodResult search check and now attached parsed result show objects and compare them against the show object we use to search with instead. 2014-07-06 06:11:04 -07:00
echel0n
a1cef0b958 Added in context to aid in garbage cleanup to help reduce memory usage. 2014-06-30 10:48:18 -07:00
echel0n
75f69396d4 Reverted some changes. 2014-06-30 08:57:32 -07:00
echel0n
5e507b3849 More memory reductions and cleanups 2014-06-30 04:44:36 -07:00
echel0n
e0eea79ec5 Fix for ABD and Sports shows issue with toordinal function. 2014-06-25 21:39:34 -07:00
echel0n
c878c6d303 Shows now perform a dirty check to confirm if any records have been altered before trying to save to the DB, improves overall performance and speed of sickrage.
Browser does not get launched on restarts as a restarted check is performed now.
2014-06-23 20:25:20 -07:00
echel0n
7e0bb651b2 Database now closes connection after each query and reconnects if closed to ensure no more connection and locked database problems.
Fixed more internal 500 errors.
2014-06-21 15:46:59 -07:00
echel0n
fcc91bedd9 NameParser now won't bother to proceed parsing release name results untill it finds a valid show object in the DB to confirm its a show in our list, naming patterns automatically bypass this restriction. 2014-06-19 18:13:07 -07:00
JackDandy
bec213ee05 Port:Change setting status to UNAIRED for future episodes (GC-2397).
Only set status to UNAIRED if current status is SKIPPED, UNAIRED, UNKNOWN or WANTED, should prevent re-downloading of early releases that are already downloaded and deleted (status IGNORED) or archived.
2014-06-19 16:36:54 +01:00
JackDandy
1c487f92f9 Port:Fix not setting status if show location is missing but sickbeard.ADD_SHOWS_WO_DIR is set 2014-06-19 16:36:53 +01:00
echel0n
44358ef601 Reverted episode cache changes 2014-06-11 07:16:24 -07:00
echel0n
3384e2c51d Update tv.py
Removed weakref, caused issues with searching and downloads
2014-06-09 17:37:48 -07:00
echel0n
89ad4bccc3 Moved show season/episode cache to outside of the show class and turned it into a global to avoid circular ref that may memory leak. 2014-06-07 21:20:59 -07:00
echel0n
a1da7df12e Fixes for DB issues 2014-06-07 15:35:16 -07:00
echel0n
d00d55fdfc Modified DB code to close its connection if right after its finished with it, helps performance-wise and should resolve locked db issues as well. 2014-06-07 14:32:38 -07:00
echel0n
2c0f3a3dc3 Added thread locking for queues.
Fixed imdbinfo issues.
2014-06-07 11:36:26 -07:00
echel0n
cfcc35ebcc Upgraded IMDBpy and improved performance of it.
Fixed TVDB Indexer API issues.
2014-06-07 08:33:18 -07:00
echel0n
4784b4619f Fix for invalid literal for int() with base 10: 'NULL' 2014-06-07 05:42:50 -07:00
echel0n
24dfbc3f15 Quality is now set during parsing of results.
Fixed more anime regex bugs.
Fixed Indexer API issues for anime shows and unicode problems.
2014-06-07 04:06:21 -07:00
echel0n
1e8f3e2883 Added ability for format anime naming from post-processing options.
Fixed regex issues for anime shows matching 720p as a absolute number.
Custom sports naming has been fixed to adhere to dates.
2014-06-07 01:17:12 -07:00
echel0n
14201c71f3 Fixes issues with scene numbering being set to 0x0 after snatch is performed.
Fixes issues with KAT Provider sphinx error on searches.
2014-06-06 15:16:15 -07:00
echel0n
9e4ec2cfb8 Fix for importing existing shows being set to anime when there not anime shows causing parsing errors when trying to parse episode files from disk. Please perform a mass reset of shows marking the ones that are not anime so that this issue is fixed for when it does its next show refresh. 2014-06-04 19:47:40 -07:00
echel0n
1dc913824a Fix for startup issue due to dependant that was missing. 2014-06-04 18:38:14 -07:00
echel0n
cec4ed573d Upgraded CherryPy libs to 3.3.0
Switched out sqlite3 libs in favour of SQLAlchemy v0.9, will gradually migrate dialects and scheme to be fully SQLAlchemy compliant for using there ORM with sessions instead of direct.

Fixed getEpisode function to stop making unrequired scene number conversions on already converted data thats available now from cache.
2014-06-04 18:28:59 -07:00
echel0n
99d129bd41 Fixes for anime regex matching 2014-05-31 22:39:24 -07:00
echel0n
0ddcc3b58a Fix for show opt not in __init__ issues 2014-05-31 12:41:34 -07:00
echel0n
d7396896b5 Added in regex matching with fuzzy matching.
Shows now display Indexer absolute numbering.
Improved speed of parsing search results.
Fixed episode naming issues.
2014-05-31 03:35:11 -07:00
echel0n
997896a540 Fix for transactionals and None Types in sql lists 2014-05-30 04:42:31 -07:00
echel0n
70e7f1bfce Fixed issues with scene numbering being overwritten by ep objects.
Converted more object saves to database to use transactionals, better performance.
2014-05-30 03:01:49 -07:00
echel0n
f01c5852d4 Improved find propers code.
Backlog and manual searches now check cache first for search results.
2014-05-30 00:51:24 -07:00
echel0n
1abef89b29 Scene numbering now updates every 1 hour or is forced when needed so that searches always have up-to-date information before hand. 2014-05-30 00:51:06 -07:00
echel0n
a2439c8c64 Added ability to mass set shows to search by scene numbering. 2014-05-30 00:50:45 -07:00
echel0n
a92de48aec Added new show option that allows you to choose if you want to search via scene numbering or indexer numbering.
Scene numbers and scene absolute numbers now only display if prooper show options are selected.

Scene absolute numbers are now able to be set by user.

Fixed issues with user set scene numbers not correctly applying to episode objects.
2014-05-30 00:50:27 -07:00
echel0n
e1ee01579d Fixed issues with TVDB retrieving banners and posters.
Fixed unicode issues with Indexer API's
Fixed issues with scene numbering.
Fixed issues with black and white lists for anime shows when editing a show.
2014-05-29 06:27:05 -07:00
echel0n
2dcd26e69c Update imdbpy libs to v5.0
Fixed invalid indexer id issues for TVRage shows.

Fixed issues for getting posters and backdrops for TVRage shows.

We now convert XML straight to a dict object for Indexer APIs, improved overall performance api's

Fixed issues with TVRage shows and displaying genre's properly.
2014-05-28 23:09:38 -07:00
Nils Vogels
7bf12460be PEP8 cleanups 2014-05-29 02:44:00 +02:00
echel0n
e009641804 SickRage now stores the XEM scene data to the main DB under tv_episodes for faster lookups and better linkages with epiosde objects, insures we have scene data on hand when we want it!
Adding functions to lookup scene season and ep info via scene absolute numbers.

We now try and create a show object from parsed release info before we consider it a valid parsed result to insure we even have the show in our show list, also used to validate anime releases.

Misc bug fixes here and there.
2014-05-28 14:16:03 -07:00
echel0n
34da3f53d8 Added Black and White list for release groups for anime shows.
Fixed anime show list splitter.

Added check for anime shows and providers so we don't perform searches with a provider that doesn't support the type of show genre we are searching.
2014-05-27 03:09:57 -07:00
Nils Vogels
177dbc0f22 More namechanges 2014-05-26 23:32:47 +02:00
echel0n
9a3e7ab0a9 Added anime support with anidb support.
Added fanzub anime nzb provider.
Fixed NyaaTorrents anime provider.

This is in testing phase so bugs are to be expected.
2014-05-25 23:29:22 -07:00
echel0n
7391a6e454 App name change in code. 2014-05-23 05:37:22 -07:00
echel0n
9cd9576232 Fix for Next Ep airdates.
Added check for hidden folders in post-processing.
Cleaned up daily search function.
2014-05-21 20:12:15 -07:00
echel0n
ab8d9e6405 Fixed issues with queues.
Tweaked code to get more performance from it.
2014-05-19 18:04:23 -07:00
echel0n
a4c790eedc Fixes issues with skip removed files option.
Fixes issues with saving usenet providers.
2014-05-19 16:43:01 -07:00
echel0n
6709ebdf12 Fixed issues with daily searcher 2014-05-18 08:57:07 -07:00