Commit graph

61 commits

Author SHA1 Message Date
Prinz23
0216658231 Add db.mass_upsert_sql
Example usage:
my_db = db.DBConnection()
cl = []
for i in list:
	cl.extend(db.mass_upsert_sql(
		'tablename',
		{'fieldname': 'some value'},
		{'where clause field(s)': 'value'}))
if cl:
	my_db.mass_action(cl)
2017-11-15 17:23:13 +00:00
Prinz23
05758bb75e Change overhaul handling of PROPERS/REPACKS/REAL.
Add restriction to allow only same release group for repacks.
Change try all episode names with 'real', 'repack', 'proper'.
Add flags table to store when one-off operations have been performed.
Change update history.tbl with action SNATCHED_PROPER on existing items.
Change save proper snatches as action SNATCHED_PROPER + quality into history.tbl
Add optional regex lib with fuzzy (errors ~20% of alpanum chars) for extra_info_no_name.
Add tip to search settings/media search about improved matching with optional regex library.
2017-10-30 22:21:55 +00:00
Prinz23
3bd392e671 Add count of failed show updates
Change add warning message to Display Show and Edit Show page if show no longer found at TV info source due to an ID change, the last successful date of show update with current ID is also displayed.
Add "Shows not found previously" to Manage/Show Processes Page to highlight which shows can adjust their show IDs in order to sustain TV info updates.
Add "Shows from defunct indexers" to Manage/Show Processes page to highlight which shows can be switched to a different default TV info source.
Shows not found on an indexer for over 7 days will only be retried once a week.
Change improve show not found detection in Tvdb_Api lib.
Change add tv_shows_not_found db table.
Change add cleanup of orphaned not found shows during startup.
Change add UI Notification when MasterID is not changed because a show with that ID already exists in DB.
2017-09-04 22:39:28 +01:00
JackDandy
9772e8e41f Merge branch 'master' into develop 2016-10-06 20:35:00 +01:00
JackDandy
4ed95b6659 Change ensure a cache.db table does exist on migration. 2016-10-06 20:07:06 +01:00
Prinz23
d3a7f0ff5e Add smart logic to reduce api hits to newznab server types and improve how nzbs are downloaded.
Add newznab smart logic to avoid missing releases when there are a great many recent releases.
Change improve performance by using newznab server advertised capabilities.
Change config/providers newznab to display only non-default categories.
Change use scene season for wanted segment in backlog if show is scene numbering.
Change combine Manage Searches / Backlog Search / Limited and Full to Force.
Change consolidate limited and full backlog.
Change config / Search / Backlog search frequency to instead spread backlog searches over a number of days.
Change migrate minimum used value for search frequency into new minimum 7 for search spread.
Change restrict nzb providers to 1 backlog batch run per day.
Add to Config/Search/Unaired episodes/Allow episodes that are released early.
Add to Config/Search/Unaired episodes/Use specific api requests to search for early episode releases.
Add use related ids for newznab searches to increase search efficiency.
Add periodic update of related show ids.
Change terminology Edit Show/"Post processing" tab name to "Other".
Add advanced feature "Related show IDs" to Edit Show/Other used for finding episodes and TV info.
Add search info source image links to those that have zero id under Edit Show/Other/"Related show IDs".
Add "set master" button to Edit Show/Other/"Related show IDs" for info source that can be changed.
Change terminology displayShow "Indexers" to "Links" to cover internal and web links.
Change add related show info sources on displayShow page.
Change don't display "temporarily" defunct TVRage image link on displayShow pages unless it is master info source.
Change if a defunct info source is the master of a show then present a link on displayShow to edit related show IDs.
Change simplify the next backlog search run time display in the page footer.
Change try ssl when fetching data thetvdb, imdb, trakt, scene exception.
Change improve reliability to Trakt notifier by using show related id support.
Change improve config/providers newznab categories layout.
Change show loaded log message at start up and include info source.
Change if episode has no airdate then set status to unaired (was skipped).

Technical
Change move scene_exceptions table from cache.db to sickbeard.db.
Add related ids to show obj.
Add use of mapped indexer ids for newznab.
Add indexer to sql in wanted_eps.
Add aired in (scene) season for wanted episodes.
Add need_anime, need_sports, need_sd, need_hd, need_uhd to wanted episodes and added as parameter to update_providers.
Add fix for lib lockfile/mkdirlockfile.
Add set master TV info source logic.
Change harden ui input validation.
Add per action dialog confirmation.
Change to reload page under more events.
Change implement "Mark all added episodes Wanted to search for releases" when setting new info source.
2016-09-21 17:50:27 +01:00
JackDandy
2d66e88585 Merge branch 'master' into develop 2016-09-13 21:01:10 +01:00
Prinz23
ea702379c3 Add rollback capability to undo database changes made during tests. 2016-09-13 20:50:35 +01:00
JackDandy
d0395dc9a8 Merge branch 'master' into develop 2016-06-20 03:09:42 +01:00
JackDandy
e79b7fcd93 Change improve importing show list sickbeard.db files. 2016-06-20 02:46:10 +01:00
JackDandy
eac69963f0 Change validate and improve specific Torrent provider connections, IPT, KAT, SCC, TPB, TB, TD, TT.
Change refactor cache for torrent providers to reduce code.
Change improve search category selection BMTV, FSH, FF, TB.
Change identify more SD release qualities.
Change update SpeedCD, MoreThan, TVChaosuk.
Add torrent provider HD4Free.
Remove torrent provider BitSoup.
Change only create threads for providers needing a recent search instead of for all enabled.
Add 4489 as experimental value to "Recent search frequency" to use provider freqs instead of fixed width for all.
Fix searching nzb season packs.
Change remove some logging cruft.
2016-06-08 01:55:13 +01:00
JackDandy
c0dc7ea5bc Fix for import of very rare db structure. 2016-03-17 12:41:04 +00:00
Prinz23
e55462f47b Fix ensures internal buffer of a downloaded file is written to disk. 2016-03-16 18:28:58 +00:00
Adam
37496189f1 Change py2 exception clauses to py2/3 compatible clauses
Add py2/3 regression testing for exception clauses

Any new code added with old py2 style exceptions will now fail the travis test
2015-06-08 22:56:45 +08:00
adam
65ce53b289 Add custom show lists to home page 2015-05-02 16:34:30 +08:00
Adam
24236eba6f Change provider cache storage structure
Add handling for failed cache database upgrades
2015-04-01 11:25:24 +08:00
JackDandy
b4b1859a2e Add IMDb lookup to "Update" action on Manage/Mass Update page.
(Credit and thanks to Prinz23 for his initiating efforts)

Fix display indexer provided start year on the displayShow page when no IMDb data exists.
Fix display indexer provided genres on the displayShow page when no IMDb data exists.
Fix display IMDb indexer with correct IMDb id on the displayShow page only when IMDb data exists.
Fix to correctly display show runtime when available on the displayShow page.
Fix to correctly initialise IMDb id loaded from db.
Other misc IMDb related db fixes.
Fix saving of Sort By/Next Episode in Layout Poster on Show List page.
2015-03-28 17:43:32 +00:00
Adam
94d0ce3e44 Add show overview from indexers to the database 2015-03-23 11:05:19 +10:00
Adam
742efdb805 Change database code to PEP8 standards 2015-03-02 17:50:12 +08:00
adam
7f5651bb41 Fix slow database operations (port from midgetspy/sickbeard) 2015-01-11 12:27:57 +08:00
adam
2af732c731 Fix duplicate entries in cache database 2014-12-14 12:12:00 +00:00
JackDandy
aa9346222e Fix SQL statements that have dynamic table names to use proper syntax. 2014-12-13 04:16:50 +00:00
Adam
f579b90d7c Add database migration code 2014-12-09 20:34:44 +08:00
Supremicus
4c8c6b21d5 Change logos, text etc. branding to SickGear. 2014-11-12 20:56:40 +00:00
adam
5ac3895600 Fixes daily search and speed improvements 2014-09-20 20:34:00 +08:00
echel0n
de5db9be64 Added ability to set a default indexer for trakt notifier used for adding shows from watch list so that SickRage knows what indexer to set the show as.
Indexer mapping now uses indexer api calls to gather its information and then stores it to a new table called indexer_mapping for instant lookups later on.

Fixed trakt related issues for adding new shows and syncing.

Centered items at bottom of pages to just look a little nicer and fit properly.
2014-07-23 22:07:01 -07:00
echel0n
6e613145b3 removed sleep timers from db code all together, overall speed increased. 2014-07-20 00:01:42 -07:00
echel0n
636bbfa2de Fixes issues with scene exception updating when editing a show, should resolve problems with it duplicating scene exception name over and over again.
Reduced DB sleep timer to increase overall performance of application.

Improved generic queue code for threading.
2014-07-19 22:29:19 -07:00
echel0n
a3a3777d33 Fixed blackAndWhitelist for anime release groups. 2014-07-06 04:12:16 -07:00
echel0n
56e2c28bad SickRage now uses a internal name cache comprised of (showlist, scene exceptions, scene names) used to search and create show objects from which is needed for parsing search results.
Scene exceptions now uses a internal cache for scene exceptions and scene season exceptions, helps reduce overhead to DB and performs faster lookups when making scene exception requests.
2014-07-03 10:30:15 -07:00
echel0n
75f69396d4 Reverted some changes. 2014-06-30 08:57:32 -07:00
echel0n
4575c58348 SQL Query performance gains added and memory footprint reduced. 2014-06-30 06:18:02 -07:00
echel0n
b19aafb807 Memory cleanup in sql db routines for mass actions. 2014-06-30 04:55:49 -07:00
echel0n
9f8c49ce88 Fixed issue with tvcache filling with duplicate data. 2014-06-26 03:20:07 -07:00
echel0n
f6c40d4b25 Fixed DB issues related to displaying plot details for show episodes. 2014-06-22 18:52:46 -07:00
echel0n
0599a89565 Fix for DB issues on new installs relating to database version checks. 2014-06-22 18:24:55 -07:00
echel0n
7e0bb651b2 Database now closes connection after each query and reconnects if closed to ensure no more connection and locked database problems.
Fixed more internal 500 errors.
2014-06-21 15:46:59 -07:00
echel0n
89ad4bccc3 Moved show season/episode cache to outside of the show class and turned it into a global to avoid circular ref that may memory leak. 2014-06-07 21:20:59 -07:00
echel0n
d00d55fdfc Modified DB code to close its connection if right after its finished with it, helps performance-wise and should resolve locked db issues as well. 2014-06-07 14:32:38 -07:00
echel0n
08d8beffa4 Misc fixes and code cleanups. 2014-06-07 05:36:50 -07:00
echel0n
fc7b28a8bc Automatic DB restores now done if upgrade fails due to corrupt DB or incorrect db numbering 2014-06-05 16:11:07 -07:00
echel0n
385bf3987e db locking issues fix 2014-06-05 12:59:17 -07:00
echel0n
26f30cacf5 db lock issues fix test 2014-06-05 12:52:30 -07:00
echel0n
d30060bf91 Fix for db locking issues 2014-06-05 09:22:54 -07:00
echel0n
f052848e52 Fix for sql rowcount error 2014-06-05 02:19:48 -07:00
echel0n
8fbd9155d3 fix for recent sql errors around connection object 2014-06-05 02:13:29 -07:00
echel0n
7e5cc8c673 Fix for coming soon episodes page.
Reverted sql -> sqlachemy changes, to soon and will be done in seperate branch.
2014-06-05 01:05:02 -07:00
echel0n
cec4ed573d Upgraded CherryPy libs to 3.3.0
Switched out sqlite3 libs in favour of SQLAlchemy v0.9, will gradually migrate dialects and scheme to be fully SQLAlchemy compliant for using there ORM with sessions instead of direct.

Fixed getEpisode function to stop making unrequired scene number conversions on already converted data thats available now from cache.
2014-06-04 18:28:59 -07:00
echel0n
7e91d3a600 Fix for scene_names table does not exist errors. 2014-06-03 23:52:55 -07:00
echel0n
997896a540 Fix for transactionals and None Types in sql lists 2014-05-30 04:42:31 -07:00