Commit graph

652 commits

Author SHA1 Message Date
JackDandy
7041713650 Change pick up the stragglers late to the more security party. 2018-04-03 00:05:13 +01:00
JackDandy
980e05cc99 Change Hachoir can't support PY2 so backport their PY3 to prevent a need for system dependant external binaries like mediainfo.
Backported 400 revisions from rev 1de4961-8897c5b (2018-2014).
Move core/benchmark, core/cmd_line, core/memory, core/profiler and core/timeout to core/optional/*
Remove metadata/qt*

PORT: Version 2.0a3 (inline with 3.0a3 @ f80c7d5).
Basic Support for XMP Packets.
tga: improvements to adhere more closely to the spec.
pdf: slightly improved parsing.
rar: fix TypeError on unknown block types.
Add MacRoman win32 codepage.
tiff/exif: support SubIFDs and tiled images.
Add method to export metadata in dictionary.
mpeg_video: don't attempt to parse Stream past length.
mpeg_video: parse ESCR correctly, add SCR value.
Change centralise CustomFragments.
field: don't set parser class if class is None, to enable autodetect.
field: add value/display for CustomFragment.
parser: inline warning to enable tracebacks in debug mode.
Fix empty bytestrings in makePrintable.
Fix contentSize in jpeg.py to account for image_data blocks.
Fix the ELF parser.
Enhance the AR archive parser.
elf parser: fix wrong wrong fields order in parsing little endian section flags.
elf parser: add s390 as a machine type.
Flesh out mp4 parser.

PORT: Version 2.0a1 (inline with 3.0a1).
Major refactoring and PEP8.
Fix ResourceWarning warnings on files. Add a close() method and support for the context manager protocol ("with obj: ...") to parsers, input and output streams.
metadata: get comment from ZIP.
Support for InputIOStream.read(0).
Fix sizeGe when size is None.
Remove unused new_seekable_field_set file.
Remove parser Mapsforge .map.
Remove parser Parallel Realities Starfighter .pak files.
sevenzip: fix for newer archives.
java: update access flags and modifiers for Java 1.7 and update description text for most recent Java.
Support ustar prefix field in tar archives.
Remove file_system* parsers.
Remove misc parsers 3d0, 3ds, gnome_keyring, msoffice*, mstask, ole*, word*.
Remove program parsers macho, nds, prc.
Support non-8bit Character subclasses.
Python parser supports Python 3.7.
Enhance mpeg_ts parser to support MTS/M2TS.
Support for creation date in tiff.
Change don't hardcode errno constant.

PORT: 1.9.1
Internal Only: The following are legacy reference to upstream commit messages.
Relevant changes up to b0a115f8.
Use integer division.
Replace HACHOIR_ERRORS with Exception.
Fix metadata.Data: make it sortable.
Import fixes from e7de492.
PORT: Version 2.0a1 (inline with 3.0a1 @ e9f8fad).
Replace hachoir.core.field with hachoir.field
Replace hachoir.core.stream with hachoir.stream
Remove the compatibility module for PY1.5 to PY2.5.
metadata: support TIFF picture.
metadata: fix string normalization.
metadata: fix datetime regex Fix hachoir bug #57.
FileFromInputStream: fix comparison between None and an int.
InputIOStream: open the file in binary mode.
2018-03-28 00:43:11 +01:00
JackDandy
f213cd9ccc Merge branch 'master' into develop 2018-03-19 13:13:19 +00:00
JackDandy
9225c84016 Change remove dead tor caches and stop searching episodes that have a magnet saved.
Change AlphaRatio provider freeleech mode; prevent spoiling user ratio from ambiguous filtered results.

The AR "Freeleech" search filter has changed to additionally return "Timed" and "Expired" freeleech items. However, this change makes results ambiguous to the point that a ratio can be ruined if an item snatched is expired or expiring. Therefore, when freeleech mode is active for this provider, all except pure *freeleech* items are discarded from results.
2018-03-19 13:11:25 +00:00
JackDandy
2155d5205b Add showRSS torrent provider. 2018-03-19 13:09:01 +00:00
JackDandy
f1768f68e8 Merge branch 'master' into develop 2018-03-12 21:29:10 +00:00
JackDandy
3ea006912d Add DrunkenSlug usenet provider and fix PiSexy torrent provider. 2018-03-12 21:25:24 +00:00
JackDandy
8d9406d5fc Add choose to delete watched episodes from a list of played media at Kodi, Emby, and/or Plex.
Add episode watched state system that integrates with Kodi, Plex, and/or Emby, instructions at Shows/History/Layout/"Watched".
Add installable SickGear Kodi repository containing addon "SickGear Watched State Updater".
Change add Emby setting for watched state scheduler at Config/Notifications/Emby/"Update watched interval".
Change add Plex setting for watched state scheduler at Config/Notifications/Plex/"Update watched interval".
Add API cmd=sg.updatewatchedstate, instructions for use are linked to in layout "Watched" at /history.
Change history page table filter input values are saved across page refreshes.
Change history page table filter inputs, accept values like "dvd or web" to only display both.
Change history page table filter inputs, press 'ESC' key inside a filter input to reset it.
Add provider activity stats to Shows/History/Layout/ drop down.
Change move provider failures table from Manage/Media Search to Shows/History/Layout/Provider fails.
Change sort provider failures by most recent failure, and with paused providers at the top.
Change remove table form non-testing version 20007, that was reassigned.
2018-03-06 02:12:45 +00:00
JackDandy
275f4f157b Merge branch 'master' into develop 2018-02-23 22:15:55 +00:00
JackDandy
a08fb81b40 Fix sending notification on snatch or download to Kodi/Emby.
Fix config/notifications/Pushover priority selector.
Remove NZB.is and HD4Free providers.
2018-02-23 22:13:58 +00:00
Prinz23
8df50c6cdf Change remove some non-release group stuff from newnab results. 2018-02-02 04:25:37 +00:00
JackDandy
555a69597d Change TBy prov add UHD cat. 2018-01-30 17:38:46 +00:00
JackDandy
0ead7771de Change improve the manage searches error stats UI and backend functions.
Add the improved error handling to torrent providers.
Change cache_db to always include db upgrade statements when running SG for the first time.
Change split newznab limit logic into a reusable function, hit_limit_update() and use in BTN prov.
Change tweak CSS to make things a little neater with button spacings.
Add the actual time when current limit will expire to the UI.
Change instead of terminology "errors", use "failures".
Change improve BTN error handling.
Change ensure provider name is output to log at times where it wasn't.
Change ensure failed request URLs and POST params are output to log.
Add time of last failure + type to should_skip log message.
Change code DRY and simplification for improved readability.
Change occurrences of "error" to "fail" for consistency.
Add tmr limit handling to omg and change log_failure_url level to warning.
Change log the failed URL when an API hit limit is reached.
Change "hit" to the more universally generic "tmr" - Too Many Requests.
Change Db columns containing "hit_" are renamed "tmr_"
2018-01-26 01:35:02 +00:00
Prinz23
f9cc6ed330 Add provider error table to page Manage/Media Search.
Add failure handling, skip provider for x hour(s) depending on count of failures.
Add detection of api hit limit reached.
Add failure count to omgwtfnzbs.
Change improve categories selection (manual search for example).
2018-01-25 20:48:24 +00:00
JackDandy
4dea2ad022 Add config/general/web interface/send security headers (default enabled).
Change use bare minimum requests for all usenet_crawler search modes.
Change use RSS endpoint for usenet_crawler in cache mode.
Fix ensure remaining unicode shownames are correctly 'UTF-8' and url encoded.
Fix omgwtf test of invalid auth, issue when enabling propers, and updating cache.
Change refactor shownames list into reusable show_name_helper methods.
Add season specific naming exceptions to nzb + btn.
2018-01-25 19:49:28 +00:00
Prinz23
11dfd66efd Fix ensure url unicode shownames are correctly 'UTF-8' and urlencoded.
Refactor shownames list into generic provider method, reusable in multiple providers.
Add remove English at the end of release names (drunkenslug).
2018-01-25 16:14:39 +00:00
JackDandy
9ba8a206e3 Remove provider TorrentVault. 2018-01-16 01:11:46 +00:00
JackDandy
1cec88c5a2 Fix HD4Free provider. 2017-12-27 15:32:38 +00:00
Prinz23
6da32a5ed0 Add log message for not found on indexer when adding a new show.
Fix upgrade once ARCHIVED setting by postProcessor.
Fix determination of is_first_best_match.
Change improve smart selection of categories in manual and failed search modes.
Change refactor wantedQuality into own function that can be used in multiple places.
Change improve error resistance in neededQualities class.
Add log warning message if wantedQuality or eps_aired_in_season is missing for search.
Add check backlogitem for wantedQuality and add if missing.
Add use wantedQuality list in wantEpisode.
Change don't use wantedQualities for multipart.
2017-12-27 03:14:20 +00:00
JackDandy
8d97f2664a Add ETTV and PotUK providers, fix BTScene and Lime. 2017-12-22 19:37:14 +00:00
JackDandy
ad63608cad Change improve multi episode release search. 2017-12-13 01:41:34 +00:00
JackDandy
ab0f8576c9 Change simplify use of provider parameter scene/process_name. 2017-12-04 15:22:06 +00:00
JackDandy
47eab61c01 Add Blutopia torrent provider. 2017-12-04 13:42:33 +00:00
Prinz23
406c9ad6c6 Change reduce number of DB calls for extra_info_no_name.
Add parse repack, proper level to recent search flow.
2017-10-31 20:35:57 +00:00
Prinz23
05758bb75e Change overhaul handling of PROPERS/REPACKS/REAL.
Add restriction to allow only same release group for repacks.
Change try all episode names with 'real', 'repack', 'proper'.
Add flags table to store when one-off operations have been performed.
Change update history.tbl with action SNATCHED_PROPER on existing items.
Change save proper snatches as action SNATCHED_PROPER + quality into history.tbl
Add optional regex lib with fuzzy (errors ~20% of alpanum chars) for extra_info_no_name.
Add tip to search settings/media search about improved matching with optional regex library.
2017-10-30 22:21:55 +00:00
JackDandy
5299dd3702 Merge branch 'master' into develop 2017-10-25 16:14:01 +01:00
JackDandy
6edefc84ca Change improve TVChaos parser. 2017-10-25 16:10:57 +01:00
JackDandy
e35b67e06f Change enable TorrentBytes provider and improve handling of relative download links from providers. 2017-10-15 02:05:33 +01:00
JackDandy
cdc3a7c2df Merge branch 'master' into develop 2017-10-13 03:25:13 +01:00
JackDandy
ac98b3e202 Change improve handling of torrent auth failures. 2017-10-11 23:12:30 +01:00
JackDandy
a61d80c843 Merge branch 'master' into develop 2017-10-11 02:08:40 +01:00
JackDandy
d125563e2b Change improve PA torrent access. 2017-10-11 02:05:58 +01:00
JackDandy
208c284e6b Merge branch 'master' into develop 2017-09-17 09:08:31 +01:00
JackDandy
6ae5491476 Fix provider nCore.
Change .torrent checker due to files created with qB 3.3.16 (affects nCore and NBL).
2017-09-17 09:06:26 +01:00
JackDandy
253f2237cc Merge branch 'master' into develop 2017-08-26 18:20:00 +01:00
Prinz23
11d283910e Change prevent indexer specific release name parts from fudging search logic. 2017-08-26 18:15:06 +01:00
JackDandy
16d012cfb2 Add TorrentVault torrent provider. 2017-08-25 18:13:08 +01:00
JackDandy
64e12fd28a Add WorldOfP2P torrent provider. 2017-08-25 14:04:16 +01:00
JackDandy
1e4562a39d Add SceneHD torrent provider. 2017-08-24 12:36:23 +01:00
JackDandy
297c4a2785 Add MagnetDL torrent provider.
DRY refactor download_file with getURL.
2017-08-24 02:40:28 +01:00
JackDandy
92ef777f2b Merge branch 'master' into develop 2017-08-22 19:03:31 +01:00
JackDandy
d3f8be8c3d Change add a generic ping function, enabled by update_freq. 2017-08-22 18:16:25 +01:00
Prinz23
9d9dee175f Add optional start and stop ping threads, during start, shutdown and saving providers. 2017-08-22 18:16:24 +01:00
JackDandy
fa62eedfa7 Change improve ABD releases post processing.
Change add p2p 720HD tag to file name quality parse.
Change add month name support to uk date parse.
Change add short year support to uk date parse.
Change add part/pt number pairing with episode name from tv info source.
Fix fetch db history item in check_name.
2017-08-20 03:26:39 +01:00
Prinz23
33a36432d8 Change improve newnab autoselect categories.
Change add nzb.org BoxSD and BoxHD categories.
Change improve category exclude logic for newznab.
Change add WEB-DL category to autoselect categories for newznab.
Change comment out HEVC category parsing since it's not auto selected.
2017-08-19 15:53:59 +01:00
JackDandy
5203784f36 Merge branch 'master' into develop 2017-08-01 21:36:14 +01:00
JackDandy
cbe8b6b37c Remove provider SceneAccess. 2017-08-01 21:32:48 +01:00
Prinz23
3e9a9095a6 Change make indexer lookup optional in NameParser, and deactivate during searches. 2017-07-21 22:39:08 +01:00
JackDandy
873485f02e Merge branch 'master' into develop 2017-07-13 20:25:20 +01:00
JackDandy
9e32a1521d Fix "Server failed to return anything useful" when should be using cached .torrent file.
Fix displayShow 'Unaired' episode rows change state where appropriate.
Change displayShow to stop requiring an airdate for checkboxes.
2017-07-13 20:23:13 +01:00
Prinz23
09f511c710 Change only use newznab Api key if needed. 2017-07-12 11:56:48 +01:00
JackDandy
ea1ccbdc98 Merge branch 'master' into develop 2017-06-20 00:38:39 +01:00
JackDandy
62b68375d4 Change provider Bit-HDTV user/pass to cookie. 2017-06-20 00:35:25 +01:00
JackDandy
21c235e52c Merge branch 'master' into develop 2017-05-20 10:35:24 +01:00
JackDandy
99c3d768ff Remove provider Freshon.tv 2017-05-20 10:33:21 +01:00
Licensed User
b9b13fea8f Merge branch 'master' into develop 2017-05-17 22:10:35 +01:00
Licensed User
55085de52e Remove provider ExtraTorrent.
Change thexem tvrage mappings are deprecated, data fetch disabled.
2017-05-17 22:05:57 +01:00
JackDandy
a602da66fb Add Nyaa (.si) torrent provider. 2017-05-13 23:57:03 +01:00
JackDandy
3516f924cf Remove AlphaReign torrent provider. 2017-05-13 18:06:52 +01:00
JackDandy
9e55be196a Merge branch 'master' into develop 2017-05-05 16:37:16 +01:00
JackDandy
0072c3cc76 Fix multiple SpeedCD cookie. 2017-05-05 16:34:48 +01:00
JackDandy
324ff58184 Merge branch 'master' into develop 2017-05-04 00:44:25 +01:00
JackDandy
985bcf4244 Remove provider Nyaa.
Change improve RSS validation (particularly for anime).
Change improve support for legacy magnet encoding.
2017-05-04 00:40:47 +01:00
JackDandy
fd9cfaf950 Merge branch 'master' into develop 2017-05-02 17:11:55 +01:00
JackDandy
9c06895d1e Change provider Transmithe.net is now Nebulance. 2017-05-02 17:08:28 +01:00
JackDandy
44c44d9351 Merge branch 'master' into develop 2017-04-24 18:54:36 +01:00
JackDandy
8e9ec6c334 Change add filter for thetvdb show overview and remove SpeedCD 'inspeed_uid' cookie requirement. 2017-04-24 18:51:35 +01:00
JackDandy
1eb113ddde Merge branch 'master' into develop 2017-03-30 03:24:31 +01:00
JackDandy
aa45c2f81a Change search of SpeedCD, TVChaos and parse of TorrentDay. 2017-03-30 03:18:36 +01:00
JackDandy
b3f1f256f6 Merge branch 'master' into develop 2017-03-17 01:59:43 +00:00
JackDandy
c0fae0dac5 Change SpeedCD to cookie auth as username/password is not reliable.
Change Usenet-Crawler media provider icon.
2017-03-17 01:57:08 +00:00
JackDandy
c873a2da03 Merge branch 'master' into develop 2017-03-12 01:29:16 +00:00
JackDandy
74340d34f8 Change refactor client for Deluge 1.3.14 compatibility.
Change ensure IPT authentication is valid before use.
2017-03-12 01:24:47 +00:00
JackDandy
bfb13dfa35 Change NewznabProvider specifics on develop arising from hotfix 0.12.9. 2017-02-24 20:08:37 +00:00
JackDandy
231198ab72 Merge branch 'master' into develop 2017-02-24 19:57:28 +00:00
Prinz23
85ef0a6787 Fix issue saving custom NewznabProviders. 2017-02-24 19:43:45 +00:00
JackDandy
24a98d271c Merge branch 'master' into develop 2017-02-19 15:08:21 +00:00
JackDandy
a0fe23b4e8 Change BTN API hostname. 2017-02-19 15:04:18 +00:00
JackDandy
922e75d84e Add Skytorrents torrent provider. 2017-02-19 00:08:35 +00:00
JackDandy
cf7c4797b2 Add AlphaReign torrent provider. 2017-02-18 14:47:57 +00:00
JackDandy
c1a65301e7 Merge branch 'master' into develop 2017-02-17 15:00:55 +00:00
JackDandy
cf5f6e3891 Change accept lists in JSON responses.
Change do not log error for empty BTN un/pw in most cases.
Change BTN to only try API once when doing alternative name searches.
Change when API fails, warn users as a tip that they can configure un/pw.
2017-02-17 14:58:04 +00:00
JackDandy
fc5e0df46c Merge branch 'master' into develop 2017-02-17 05:11:53 +00:00
JackDandy
d97bb7174d Remove Torrentshack.
Change improve provider title processing.
Change improve handling erroneous JSON responses.
Change improve find show with unicode characters.
Change improve result for providers Omgwtf, SpeedCD, Transmithenet, Zoogle.
Change validate .torrent files that contain optional header data.
Fix case where an episode status was not restored on failure.
Add raise log error if no wanted qualities are found.
Change add un/pw to Config/Media providers/Options for BTN API graceful fallback (can remove Api key for security).
Change only download torrent once when using blackhole.
Add Cloudflare module 1.6.8 (be0a536) to mitigate CloudFlare (IUAM) access validator.
Add Js2Py 0.43 (c1442f1) Cloudflare dependency.
Add pyjsparser 2.4.5 (cd5b829) Js2Py dependency.
2017-02-17 04:48:49 +00:00
Prinz23
b56ddd2eec Change skip episodes that have no wanted qualities.
Change download picked .nzb file on demand and not before.
2017-02-17 03:48:24 +00:00
JackDandy
14db6d12cc Add "Perform search tasks" to Config/Media Providers/Options.
Change improve clarity of enabled providers on Config/Media Providers.
2017-02-15 03:32:56 +00:00
Prinz23
87e608f277 Add scheduled backlog switch. 2017-02-15 00:51:52 +00:00
JackDandy
3337e77466 Merge branch 'master' into develop 2017-01-16 17:21:59 +00:00
JackDandy
160f7a552b Change TD search URL and fix saving Media Providers when either Search NZBs/Torrent is disabled. 2017-01-16 16:52:37 +00:00
JackDandy
7e8eb3cef8 Merge branch 'master' into develop 2016-12-31 01:15:52 +00:00
JackDandy
a7f4915c2b Remove Wombles nzb provider. 2016-12-31 01:10:55 +00:00
Prinz23
02e24c6f8f Change recent search to use centralised title and URL parser for newznab. 2016-12-28 03:05:21 +00:00
JackDandy
77209d019a Merge branch 'master' into develop 2016-12-28 02:19:16 +00:00
JackDandy
5bdee041ed Add UK date format handling to name parser. 2016-12-28 01:47:50 +00:00
Prinz23
2b27e3bb74 Change don't fetch caps for disabled usenet providers. 2016-12-21 19:42:00 +00:00
JackDandy
0b5d90e83c Change Rarbg and IPT urls. 2016-12-21 16:13:09 +00:00
JackDandy
6fcf80c02d Add fanart to Episodes View, Display Show, Edit Show, and Media Renamer page.
Add "Maximum fanart image files per show to cache" to config General/Interface.
Add populate images when the daily show updater is run with a default maximum 3 images per show.
Change force full update in a show will replace existing images with new.
Add fanart livepanel to lower right of Episodes View and Display Show page.
Add highlight panel red until button is clicked a few times.
Add flick through multiple background images on Episodes View and Display Show page.
Add persistent move poster image to right hand side or hide on Display Show page (multi-click the eye).
Add persistent translucency of background images on Episodes View and Display Show page.
Add persistent fanart rating to avoid art completely, random display, random from a group, or display fave always.
Add persistent views of the show detail on Display Show page.
Add persistent views on Episodes View.
Add persistent button to collapse and expand card images on Episode View/Layout daybyday.
Add non persistent "Open gear" and "Full fanart" image views to Episodes View and Display Show page.
Add "smart" selection of fanart image to display on Episode view.
Change insert [!] and change text shade of ended shows in drop down show list on Display Show page.
Change button graphic for next and previous show of show list on Display Show page.
Add logic to hide some livepanel buttons until artwork becomes available or in other circumstances.
Add "(Ended)" where appropriate to show title on Display Show page.
Add links to fanart.tv where appropriate on Display Show page.
Change use tense for label "Airs" or "Aired" depending on if show ended.
Change display "No files" instead of "0 files" and "Upgrade once" instead of "End upgrade on first match".
Add persistent button to newest season to "Show all" episodes.
Add persistent button to all shown seasons to "Hide most" episodes.
Add button to older seasons to toggle "Show Season n" or "Show Specials" with "Hide..." episodes.
Add season level status counts next to each season header on display show page
Add sorting to season table headers on display show page
Add filename and size to quality badge on display show page, removed its redundant "downloaded" text
Remove redundant "Add show" buttons
Change combine the NFO and TBN columns into a single Meta column
Change reduce screen estate used by episode numbers columns
Change improve clarity of text on Add Show page.
Add "Reset fanart ratings" to show Edit/Other tab.
Add fanart usage to show Edit/Other tab.
Add fanart keys guide to show Edit/Other tab.
Change add placeholder tip to "Alternative release name(s)" on show Edit.
Change add placeholder tip to search box on shows Search.
Change hide Anime tips on show Edit when selecting its mutually exclusive options.
Change label "End upgrade on first match" to "Upgrade once" on show Edit.
Change improve performance rendering displayShow.
Add total episodes to start of show description (excludes specials if those are hidden).
Add "Add show" actions i.e. "Search", "Trakt cards", "IMDb cards", and "Anime" to Shows menu.
Add "Import (existing)" action to Tools menu.
Change SD quality from red to dark green, 2160p UHD 4K is red.
Change relocate the functions of Logs & Errors to the right side Tools menu -> View Log File.
Add warning indicator to the Tools menu in different colour depending on error count (green through red).
Change View Log error item output from reversed to natural order.
Change View Log add a typeface and some colour to improve readability.
Change View Log/Errors only display "Clear Errors" button when there are errors to clear.
Change improve performance of View Log File.
2016-12-16 21:03:14 +00:00
JackDandy
cb3de104fb Change PiSexy auth check. 2016-12-12 23:08:37 +00:00
JackDandy
6d51d48d81 Change IPT uri used for sanity check. 2016-12-12 02:30:44 +00:00
JackDandy
6f9fbcd927 Change torrent provider links for bts, et, rarbg, tpb. 2016-12-10 01:36:58 +00:00