Commit graph

232 commits

Author SHA1 Message Date
JackDandy
8d56c848b2 Change remove redundant torrent URLs and improve provider loader. 2018-08-24 23:27:05 +01:00
JackDandy
ffa6e4e9b3 Merge branch 'master' into develop 2018-06-01 16:01:37 +01:00
JackDandy
5ae24235f5 Change improve IPT and RarBG providers. 2018-06-01 15:55:33 +01:00
JackDandy
2f24a3c8e4 Merge branch 'master' into develop 2018-05-26 19:01:51 +01:00
JackDandy
0bfefa8121 Fix rare case recovery after a server has been down.
Change update pa provider URLs.
2018-05-26 18:01:09 +01:00
Prinz23
0644ec2e61 Change add blacklog search terms for anime PROPERS. 2018-05-26 17:16:40 +01:00
JackDandy
4cdcebb31d Merge branch 'master' into develop 2018-05-17 15:42:06 +01:00
JackDandy
84840e716b Fix authorisation issue affecting some providers. 2018-05-17 15:35:54 +01:00
JackDandy
aab67a45f7 Change consolidate provider filters into 'Only allow releases that are'.
Add provider filters, Only allow releases that are ...
  'scene releases (srrDB/predb listed)', 'or contain' text or regex,
  'non scene if no recent search results', 'non scene if no active search results',
  'not scene nuked', and 'nuked if no active search results'.

Add scene release checking to PROPER search task.
Change refactor core Proper functions.
Pep8 common tests.
2018-05-17 04:18:44 +01:00
JackDandy
17a42dc188 Merge branch 'master' into develop 2018-05-14 01:31:19 +01:00
JackDandy
366c5ed745 Fix SpeedCD. 2018-05-14 01:25:32 +01:00
JackDandy
e35375f5ef Change search only once per cycle for shows with multiple episodes that air on the same day. 2018-05-14 01:16:50 +01:00
JackDandy
3a27a78125 Add HDME torrent provider. 2018-05-08 18:43:24 +01:00
JackDandy
78c9c7dc5c Add Xspeeds torrent provider. 2018-04-28 16:06:30 +01:00
JackDandy
a6f7ab47e2 Merge branch 'master' into develop 2018-04-26 15:32:07 +01:00
JackDandy
208ddfb42a Change prefer modern html5lib over old to prevent display show issue on systems that fail to clean libs.
In rare cases, systems *fail* to remove the deprecated "_base.pyc" file (and probably others) in \lib\html5lib\treebuilders\. Therefore, the startup cleanup process will now list files that cannot be auto deleted - user must then manually delete files listed in "__README-DANGER.txt".
Change add un/pw for cookie support to improve SpeedCD torrent provider.
Change improve handling faults when downloading .torrent files.
Remove TorrentBytes provider.
Change remove redundant log messages for releases never to be cached removing <30% log spam
Change remove redundant log messages for items not found in cache removing <10% log spam
Pep8.
2018-04-26 01:46:53 +01:00
JackDandy
668c682310 Merge branch 'master' into develop 2018-04-19 14:16:43 +01:00
JackDandy
d9e03aa1fb Change improve searching torrent provider BTScene.
Change improve text for abandoned show IDs.
Change DRY refactor provider result creation.
Change catch failures to shutdown Emby socket.
2018-04-19 13:57:47 +01:00
JackDandy
0c276e81fb Merge branch 'master' into develop 2018-04-17 15:28:39 +01:00
JackDandy
aa0933209e Fix ETTV torrent provider. 2018-04-17 15:26:17 +01:00
JackDandy
980e05cc99 Change Hachoir can't support PY2 so backport their PY3 to prevent a need for system dependant external binaries like mediainfo.
Backported 400 revisions from rev 1de4961-8897c5b (2018-2014).
Move core/benchmark, core/cmd_line, core/memory, core/profiler and core/timeout to core/optional/*
Remove metadata/qt*

PORT: Version 2.0a3 (inline with 3.0a3 @ f80c7d5).
Basic Support for XMP Packets.
tga: improvements to adhere more closely to the spec.
pdf: slightly improved parsing.
rar: fix TypeError on unknown block types.
Add MacRoman win32 codepage.
tiff/exif: support SubIFDs and tiled images.
Add method to export metadata in dictionary.
mpeg_video: don't attempt to parse Stream past length.
mpeg_video: parse ESCR correctly, add SCR value.
Change centralise CustomFragments.
field: don't set parser class if class is None, to enable autodetect.
field: add value/display for CustomFragment.
parser: inline warning to enable tracebacks in debug mode.
Fix empty bytestrings in makePrintable.
Fix contentSize in jpeg.py to account for image_data blocks.
Fix the ELF parser.
Enhance the AR archive parser.
elf parser: fix wrong wrong fields order in parsing little endian section flags.
elf parser: add s390 as a machine type.
Flesh out mp4 parser.

PORT: Version 2.0a1 (inline with 3.0a1).
Major refactoring and PEP8.
Fix ResourceWarning warnings on files. Add a close() method and support for the context manager protocol ("with obj: ...") to parsers, input and output streams.
metadata: get comment from ZIP.
Support for InputIOStream.read(0).
Fix sizeGe when size is None.
Remove unused new_seekable_field_set file.
Remove parser Mapsforge .map.
Remove parser Parallel Realities Starfighter .pak files.
sevenzip: fix for newer archives.
java: update access flags and modifiers for Java 1.7 and update description text for most recent Java.
Support ustar prefix field in tar archives.
Remove file_system* parsers.
Remove misc parsers 3d0, 3ds, gnome_keyring, msoffice*, mstask, ole*, word*.
Remove program parsers macho, nds, prc.
Support non-8bit Character subclasses.
Python parser supports Python 3.7.
Enhance mpeg_ts parser to support MTS/M2TS.
Support for creation date in tiff.
Change don't hardcode errno constant.

PORT: 1.9.1
Internal Only: The following are legacy reference to upstream commit messages.
Relevant changes up to b0a115f8.
Use integer division.
Replace HACHOIR_ERRORS with Exception.
Fix metadata.Data: make it sortable.
Import fixes from e7de492.
PORT: Version 2.0a1 (inline with 3.0a1 @ e9f8fad).
Replace hachoir.core.field with hachoir.field
Replace hachoir.core.stream with hachoir.stream
Remove the compatibility module for PY1.5 to PY2.5.
metadata: support TIFF picture.
metadata: fix string normalization.
metadata: fix datetime regex Fix hachoir bug #57.
FileFromInputStream: fix comparison between None and an int.
InputIOStream: open the file in binary mode.
2018-03-28 00:43:11 +01:00
JackDandy
f213cd9ccc Merge branch 'master' into develop 2018-03-19 13:13:19 +00:00
JackDandy
9225c84016 Change remove dead tor caches and stop searching episodes that have a magnet saved.
Change AlphaRatio provider freeleech mode; prevent spoiling user ratio from ambiguous filtered results.

The AR "Freeleech" search filter has changed to additionally return "Timed" and "Expired" freeleech items. However, this change makes results ambiguous to the point that a ratio can be ruined if an item snatched is expired or expiring. Therefore, when freeleech mode is active for this provider, all except pure *freeleech* items are discarded from results.
2018-03-19 13:11:25 +00:00
JackDandy
8d9406d5fc Add choose to delete watched episodes from a list of played media at Kodi, Emby, and/or Plex.
Add episode watched state system that integrates with Kodi, Plex, and/or Emby, instructions at Shows/History/Layout/"Watched".
Add installable SickGear Kodi repository containing addon "SickGear Watched State Updater".
Change add Emby setting for watched state scheduler at Config/Notifications/Emby/"Update watched interval".
Change add Plex setting for watched state scheduler at Config/Notifications/Plex/"Update watched interval".
Add API cmd=sg.updatewatchedstate, instructions for use are linked to in layout "Watched" at /history.
Change history page table filter input values are saved across page refreshes.
Change history page table filter inputs, accept values like "dvd or web" to only display both.
Change history page table filter inputs, press 'ESC' key inside a filter input to reset it.
Add provider activity stats to Shows/History/Layout/ drop down.
Change move provider failures table from Manage/Media Search to Shows/History/Layout/Provider fails.
Change sort provider failures by most recent failure, and with paused providers at the top.
Change remove table form non-testing version 20007, that was reassigned.
2018-03-06 02:12:45 +00:00
JackDandy
0ead7771de Change improve the manage searches error stats UI and backend functions.
Add the improved error handling to torrent providers.
Change cache_db to always include db upgrade statements when running SG for the first time.
Change split newznab limit logic into a reusable function, hit_limit_update() and use in BTN prov.
Change tweak CSS to make things a little neater with button spacings.
Add the actual time when current limit will expire to the UI.
Change instead of terminology "errors", use "failures".
Change improve BTN error handling.
Change ensure provider name is output to log at times where it wasn't.
Change ensure failed request URLs and POST params are output to log.
Add time of last failure + type to should_skip log message.
Change code DRY and simplification for improved readability.
Change occurrences of "error" to "fail" for consistency.
Add tmr limit handling to omg and change log_failure_url level to warning.
Change log the failed URL when an API hit limit is reached.
Change "hit" to the more universally generic "tmr" - Too Many Requests.
Change Db columns containing "hit_" are renamed "tmr_"
2018-01-26 01:35:02 +00:00
Prinz23
f9cc6ed330 Add provider error table to page Manage/Media Search.
Add failure handling, skip provider for x hour(s) depending on count of failures.
Add detection of api hit limit reached.
Add failure count to omgwtfnzbs.
Change improve categories selection (manual search for example).
2018-01-25 20:48:24 +00:00
JackDandy
4dea2ad022 Add config/general/web interface/send security headers (default enabled).
Change use bare minimum requests for all usenet_crawler search modes.
Change use RSS endpoint for usenet_crawler in cache mode.
Fix ensure remaining unicode shownames are correctly 'UTF-8' and url encoded.
Fix omgwtf test of invalid auth, issue when enabling propers, and updating cache.
Change refactor shownames list into reusable show_name_helper methods.
Add season specific naming exceptions to nzb + btn.
2018-01-25 19:49:28 +00:00
Prinz23
11dfd66efd Fix ensure url unicode shownames are correctly 'UTF-8' and urlencoded.
Refactor shownames list into generic provider method, reusable in multiple providers.
Add remove English at the end of release names (drunkenslug).
2018-01-25 16:14:39 +00:00
JackDandy
ad63608cad Change improve multi episode release search. 2017-12-13 01:41:34 +00:00
JackDandy
ab0f8576c9 Change simplify use of provider parameter scene/process_name. 2017-12-04 15:22:06 +00:00
Prinz23
406c9ad6c6 Change reduce number of DB calls for extra_info_no_name.
Add parse repack, proper level to recent search flow.
2017-10-31 20:35:57 +00:00
Prinz23
05758bb75e Change overhaul handling of PROPERS/REPACKS/REAL.
Add restriction to allow only same release group for repacks.
Change try all episode names with 'real', 'repack', 'proper'.
Add flags table to store when one-off operations have been performed.
Change update history.tbl with action SNATCHED_PROPER on existing items.
Change save proper snatches as action SNATCHED_PROPER + quality into history.tbl
Add optional regex lib with fuzzy (errors ~20% of alpanum chars) for extra_info_no_name.
Add tip to search settings/media search about improved matching with optional regex library.
2017-10-30 22:21:55 +00:00
JackDandy
e35b67e06f Change enable TorrentBytes provider and improve handling of relative download links from providers. 2017-10-15 02:05:33 +01:00
JackDandy
64e12fd28a Add WorldOfP2P torrent provider. 2017-08-25 14:04:16 +01:00
JackDandy
92ef777f2b Merge branch 'master' into develop 2017-08-22 19:03:31 +01:00
JackDandy
d3f8be8c3d Change add a generic ping function, enabled by update_freq. 2017-08-22 18:16:25 +01:00
Prinz23
9d9dee175f Add optional start and stop ping threads, during start, shutdown and saving providers. 2017-08-22 18:16:24 +01:00
JackDandy
fa62eedfa7 Change improve ABD releases post processing.
Change add p2p 720HD tag to file name quality parse.
Change add month name support to uk date parse.
Change add short year support to uk date parse.
Change add part/pt number pairing with episode name from tv info source.
Fix fetch db history item in check_name.
2017-08-20 03:26:39 +01:00
Prinz23
3e9a9095a6 Change make indexer lookup optional in NameParser, and deactivate during searches. 2017-07-21 22:39:08 +01:00
JackDandy
873485f02e Merge branch 'master' into develop 2017-07-13 20:25:20 +01:00
JackDandy
9e32a1521d Fix "Server failed to return anything useful" when should be using cached .torrent file.
Fix displayShow 'Unaired' episode rows change state where appropriate.
Change displayShow to stop requiring an airdate for checkboxes.
2017-07-13 20:23:13 +01:00
JackDandy
324ff58184 Merge branch 'master' into develop 2017-05-04 00:44:25 +01:00
JackDandy
985bcf4244 Remove provider Nyaa.
Change improve RSS validation (particularly for anime).
Change improve support for legacy magnet encoding.
2017-05-04 00:40:47 +01:00
JackDandy
b3f1f256f6 Merge branch 'master' into develop 2017-03-17 01:59:43 +00:00
JackDandy
c0fae0dac5 Change SpeedCD to cookie auth as username/password is not reliable.
Change Usenet-Crawler media provider icon.
2017-03-17 01:57:08 +00:00
JackDandy
922e75d84e Add Skytorrents torrent provider. 2017-02-19 00:08:35 +00:00
JackDandy
c1a65301e7 Merge branch 'master' into develop 2017-02-17 15:00:55 +00:00
JackDandy
cf5f6e3891 Change accept lists in JSON responses.
Change do not log error for empty BTN un/pw in most cases.
Change BTN to only try API once when doing alternative name searches.
Change when API fails, warn users as a tip that they can configure un/pw.
2017-02-17 14:58:04 +00:00
JackDandy
fc5e0df46c Merge branch 'master' into develop 2017-02-17 05:11:53 +00:00
JackDandy
d97bb7174d Remove Torrentshack.
Change improve provider title processing.
Change improve handling erroneous JSON responses.
Change improve find show with unicode characters.
Change improve result for providers Omgwtf, SpeedCD, Transmithenet, Zoogle.
Change validate .torrent files that contain optional header data.
Fix case where an episode status was not restored on failure.
Add raise log error if no wanted qualities are found.
Change add un/pw to Config/Media providers/Options for BTN API graceful fallback (can remove Api key for security).
Change only download torrent once when using blackhole.
Add Cloudflare module 1.6.8 (be0a536) to mitigate CloudFlare (IUAM) access validator.
Add Js2Py 0.43 (c1442f1) Cloudflare dependency.
Add pyjsparser 2.4.5 (cd5b829) Js2Py dependency.
2017-02-17 04:48:49 +00:00