Jesse Bannon
77487aee86
[FEATURE] Simplify `video_tags` ( #661 )
...
* [FEATURE] Simplify ``video_tags``
* video tags old
* change for episode
* deprecation notice
2023-07-24 18:18:53 -07:00
Jesse Bannon
cc38db9c7a
[FEATURE] Simplify `music_tags` plugin ( #660 )
...
* [FEATURE] Simplify ``music_tags`` plugin
* docs
* more compatible
* check old format better
* better dict instantiate
2023-07-24 18:05:54 -07:00
Jesse Bannon
0cbd2af4d3
[FEATURE] embed_thumbnail plugin ( #659 )
...
* [REFACTOR] OptionsValidator + OptionsDictValidator
* more
* [FEATURE] Dedicated embed_thumbnail plugin
* tests
* fix test
* docs
* deprecation notices
* priority to run after file convert
* naming
* fixtures
2023-07-24 12:07:36 -07:00
Jesse Bannon
7e997f304d
[REFACTOR] OptionsValidator + OptionsDictValidator ( #657 )
...
* [REFACTOR] OptionsValidator + OptionsDictValidator
* more
2023-07-24 10:12:38 -07:00
Jesse Bannon
b8d1f1edbb
[FEATURE] Ability to change download archive name ( #643 )
2023-06-30 11:51:52 -07:00
Jesse Bannon
7a43b0a90b
[FEATURE] Add __value__ to subscription files to be able to create one-liner subs ( #641 )
...
* [FEATURE] Add __value__ to subscription files to create one-liner subs
* docs
2023-06-29 23:57:54 -07:00
Jesse Bannon
557854fc83
[FEATURE] release_date source variables ( #638 )
...
* [FEATURE] `release_date` source variables
* lint
2023-06-24 23:01:18 -07:00
Jesse Bannon
a8841bf150
[BUGFIX] Ignore extra data streams with -dn in ffmpeg ( #637 )
2023-06-24 15:42:29 -07:00
Jesse Bannon
134882a17d
[DOCS] Fix url + multi_url docs ( #635 )
2023-06-17 13:45:22 -07:00
Jesse Bannon
0f39b38dc3
[DOCS] Actionable message for file lock errors ( #634 )
...
* [DOCS] Actionable message for file lock errors"
* pylint
2023-06-17 13:42:36 -07:00
Jesse Bannon
acc7bb306b
[DOCS] Clean up match-filter plugin docs ( #633 )
2023-06-17 13:32:12 -07:00
Jesse Bannon
a993beff0e
[FEATURE] Ability to use overrides in regex plugin ( #631 )
...
* [FEATURE] Ability to use overrides in regex plugin
* lint
* more tests
* more docs
* docs
2023-06-17 13:02:35 -07:00
Jesse Bannon
ac5561cb2e
[FEATURE] Content rating override variable ( #626 )
...
* [FEATURE] Content rating override variable
* docs
2023-06-03 07:42:16 -07:00
Jesse Bannon
7816c2fe59
[BUGFIX] Add check_formats on download retry ( #623 )
2023-05-30 23:20:40 -07:00
costaht
465a290f8b
[BUGFIX] Add line break to transaction logs ( #622 )
...
* add line break to logs
* Update main.py
2023-05-27 22:03:45 -07:00
Alex Leahu
ac5080f273
[DOCS] Fix --update-with-info-json message ( #618 )
...
* Fix --update-with-info-json message
* Run black with --preview to fix pylint error
2023-05-22 18:43:12 -07:00
Jesse Bannon
ec447cfbd7
[FEATURE] exclude field in regex plugin ( #620 )
...
* [FEATURE] `exclude` field in regex plugin
* tests
* excludes doc
2023-05-22 10:23:00 -07:00
Jesse Bannon
2f1756dea7
[FEATURE] More tv show collection seasons ( #615 )
2023-05-19 09:05:51 -07:00
Jesse Bannon
0497f2b749
[FEATURE] Perform match-filter on download, not metadata pull ( #612 )
...
* [FEATURE] Apply match-filter on download instead of metadata
* correct ytdl_option ordering
* lint
* test that downloads
2023-05-18 09:52:24 -07:00
Jesse Bannon
38e64a5bd5
[FEATURE] Perform regex at both metadata and post-download ( #611 )
...
* [FEATURE] Perform regex at both metadata and post-download
* sadf
2023-05-17 22:33:42 -07:00
Jesse Bannon
a2f1a2ba94
[FEATURE] Add subscription_name override variable by default ( #599 )
...
* [FEATURE] Add `subscription_name` override variable by default
* docs for it
* lint
* only test non-cli video test
2023-04-28 19:36:20 -07:00
Jesse Bannon
d5d9978cdb
[BUGFIX] Fix splitting chapters extracted from comments ( #593 )
2023-04-19 19:27:27 -07:00
Jesse Bannon
e1242eaa61
[BUGFIX] Fix parsing chapters from comments ( #592 )
2023-04-19 18:44:25 -07:00
Jesse Bannon
1588725bb1
[BUGFIX] Fix Windows split by chapters not reading chapter titles correctly ( #591 )
2023-04-19 18:32:13 -07:00
catduckgnaf
9a5ee716cf
[BACKEND] Fix Plex MP4 ( #586 )
...
* Fix Plex MP4
No WebM, Best quality, No AV1 either
* Fixed because I am idiot
Forcing Plex to download only MP4 and 1080P. More efficient then downloading Webm and converting. Plex does not direct Play AV1 currently anyway.
* Plex Update
Default will get best video in H265 or H264, if neither are available, it will get next best video. All MP4, no limit on resolution.
Plex_tv_show_av1 will allow for absolute best possible resolution in any codec as long as its MP4, including Av1 which is not currently supported in Plex.
Without AV1 is considered default, for maximum compatibility at this time.
* EBUATK
Incorrect setting on Av1, fixed.
* Removed Av1 Preset
---------
Co-authored-by: catduckgnaf <128985786+cellardoor452@users.noreply.github.com>
2023-04-12 09:30:59 -07:00
Benjamin Hsieh
14c7865165
[FEATURE] channel_id source variable ( #575 )
2023-03-31 21:25:13 -07:00
Benjamin Hsieh
e1f2e37858
[FEATURE] creator_sanitized source variable ( #574 )
2023-03-31 20:47:44 -07:00
Jesse Bannon
fa6eae7423
[FEATURE] creator source variable ( #572 )
2023-03-31 15:37:06 -07:00
Jesse Bannon
1965bc0a40
[FEATURE] Multiple URLs supported for tv_show_by_date preset ( #568 )
...
* [BACKEND] Support empty urls for multi_url, add overrides for extra urls in tv_show_by_date preset
* need to check for missing urls in downloader
* use override in test
* docs about multi url
* wording
2023-03-30 09:28:32 -07:00
Jesse Bannon
c8de12833e
[BUGFIX] Read parent preset download strategy when partial validating ( #566 )
2023-03-28 20:35:07 -07:00
Jesse Bannon
4b9709aeab
[FEATURE] Configurable file_name_max_bytes ( #562 )
...
* config for max file size, need to move to defaults file
* wroking
2023-03-25 20:17:38 -07:00
Jesse Bannon
84cd611f89
[BUGFIX] File name too long with -thumb.jpg, upgrade docker alpine image ( #560 )
2023-03-24 11:15:54 -07:00
Jesse Bannon
70d81bf20f
[BACKEND] Mark entry as deleted if all entries deleted in update ( #559 )
...
* [BACKEND] Mark entry as deleted if all entries deleted in update
* make subtitles not found debug
2023-03-21 14:21:02 -07:00
Jesse Bannon
54b8b76034
[BACKEND] Handle case when collection url is missing from entry ( #558 )
...
* [BACKEND] Handle case when collection url is missing from entry
* hide experimental docs
2023-03-21 13:39:41 -07:00
Jesse Bannon
7385aac1ee
[FEATURE][EXPERIMENTAL] --update-with-info-json ( #557 )
...
* [FEATURE
] Reformat existing downloads
* working?!?!
* reformat in output dir
* close, need info json enabled by default
* asdfadsfsaf
* lint
* closer
* multi created variables do not exist for update command!
* info json downloader
* [REFACTOR] Shared plugin and download options class
* more refactoring
* lint
* put in initialize plugins
* changes
* [REFACTOR] simplify enhanced download archive
* working!
* in main
* simplified, many url tests working
* ready?
2023-03-21 08:05:08 -07:00
Jesse Bannon
baebd9cba7
[BUGFIX] Add timeout for bad ffmpeg image conversions ( #554 )
...
* [BUGFIX] Add timeout for bad ffmpeg image conversions
* add -y
* lint
2023-03-16 23:45:11 -07:00
Jesse Bannon
ecdae163f6
[FEATURE] tv_show_by_date preset to support multiple URLs ( #552 )
2023-03-16 20:25:10 -07:00
Jesse Bannon
ac2bb4c018
[REFACTOR] simplify enhanced download archive ( #551 )
2023-03-15 23:57:12 -07:00
Jesse Bannon
14ddd750d9
[REFACTOR] Shared OptionsValidator, downloader plugins ( #550 )
2023-03-15 23:06:55 -07:00
Jesse Bannon
52fdc9a213
[DOCKER] Add ubuntu docker image for device passthrough ( #545 )
2023-03-15 14:10:32 -07:00
Jesse Bannon
7c692cda6e
[REFACTOR] BaseDownloader ( #542 )
...
* [REFACTOR] BaseDownloader
* doh
* fix mock
2023-03-14 23:42:50 -07:00
Jesse Bannon
f4807aa9a4
[BUGFIX] Do not load YAML unless dict is returned ( #541 )
2023-03-14 23:06:51 -07:00
Jesse Bannon
e69933d525
[REFACTOR] Split metadata and download into two separate steps ( #540 )
2023-03-13 22:41:09 -07:00
Jesse Bannon
1922296c31
[REFACTOR] BaseDownloader class ( #539 )
2023-03-13 00:42:32 -07:00
Jesse Bannon
c546ce89df
[DOCS] Empty value docs for thumbnail + info json ( #535 )
2023-03-12 20:50:12 -07:00
Jesse Bannon
7502a76b99
[BACKEND] Enable info.json by default for TV show presets ( #534 )
2023-03-12 18:31:29 -07:00
Jesse Bannon
45244889ae
[FEATURE] chunk_initial_download preset ( #532 )
2023-03-10 19:18:37 -08:00
Jesse Bannon
f42973cf2f
[FEATURE] download_reverse in URL download strategy ( #531 )
...
* [FEATURE] download_reverse in URL download strategy
* doc fix
2023-03-10 16:13:02 -08:00
Jesse Bannon
0cd8df6e11
[BUGFIX] Fix extractor IDs in yt-dlp download archive ( #528 )
2023-03-10 12:48:53 -08:00
Jesse Bannon
11f00abaf6
[FEATURE] best_video_quality prebuilt preset ( #526 )
...
* [FEATURE] best_video_quality prebuilt preset
* common
2023-03-10 11:48:14 -08:00
Jesse Bannon
2d2fff9a40
[FEATURE] Prebuilt presets to include title in their filename ( #525 )
2023-03-10 10:30:35 -08:00
Jesse Bannon
f9318b9d07
[BUGFIX] Handle truncating file names if too long ( #524 )
...
* [BUGFIX] Handle truncating file names if too long
* always import os
* test fix
* fix for windows
* lint
2023-03-10 07:20:43 -08:00
Jesse Bannon
d46829b4ab
[BUGFIX] Properly align summary numbers ( #517 )
2023-03-08 18:35:03 -08:00
Jesse Bannon
ce877a32f9
[BUGFIX] Fix quiet log level not showing warning logs ( #516 )
2023-03-08 16:30:42 -08:00
Jesse Bannon
91e9fe7602
[FEATURE] Add summary to console output ( #515 )
2023-03-08 15:34:58 -08:00
Jesse Bannon
fddf3d3088
[FEATURE] Ability to suppress or write transaction log to file ( #514 )
2023-03-08 13:32:07 -08:00
Jesse Bannon
fd1934b821
[BUGFIX] Create persist log directory if it does not exist ( #513 )
2023-03-08 10:12:52 -08:00
Jesse Bannon
648027204f
[FEATURE] Persisted subscription logs ( #512 )
2023-03-08 00:17:11 -08:00
Jesse Bannon
e6a9b3ca0b
[BUILD] New yt-dlp version ( #503 )
2023-03-03 17:21:51 -08:00
Jesse Bannon
3c6fd0b4e8
[BUGFIX] Fix global options not working after sub ( #500 )
...
* [BACKEND] Error if arg after positional arg
* working
* dry-run default
* remove unused code
2023-03-03 11:07:11 -08:00
Jesse Bannon
7d7777c119
[REFACTOR] init ffmpeg paths in config initialize function ( #501 )
...
* [REFACTOR] init ffmpeg paths in config initialize function
* init within init
2023-03-03 10:56:18 -08:00
Jesse Bannon
7b7a4f8ab1
[BACKEND] Add --version arg ( #499 )
2023-03-02 19:32:11 -08:00
Jesse Bannon
896a9e2073
[BACKEND] Reset debug log on every subscription ( #497 )
2023-03-02 18:57:13 -08:00
Jesse Bannon
628c0f1f43
[BACKEND] Add more collection seasons ( #498 )
2023-03-02 18:33:25 -08:00
Jesse Bannon
5d40d02eb3
[BACKEND] Make break message debug level and more clear ( #496 )
2023-03-02 13:01:01 -08:00
Jesse Bannon
6146762571
[DOCS] readthedocs makeover ( #493 )
2023-03-01 23:45:16 -08:00
Jesse Bannon
265dae105d
[DOCS] More verbose error when ffmpeg/ffprobe not found ( #491 )
2023-03-01 23:40:39 -08:00
Jesse Bannon
7cfd14ed71
[DOCS] Add ffmpeg path docs ( #487 )
2023-03-01 09:41:34 -08:00
Jesse Bannon
798bbbc62c
[BACKEND] Windows support ( #476 )
2023-02-28 17:07:03 -08:00
Jesse Bannon
a2808fa7fe
[BACKEND] Properly sanitize recursive variables ( #477 )
...
* [BACKEND] Properly sanitize recursive variables
* lint
* update tests
2023-02-25 09:35:41 -08:00
Jesse Bannon
c153185b33
[DOCKER] Relax ffmpeg version requirement ( #465 )
2023-02-22 09:53:24 -08:00
Jesse Bannon
1423142d07
[RELEASE] Fix commit count issue in release post ( #460 )
2023-02-20 19:46:51 -08:00
Jesse Bannon
c39393e69a
[RELEASE] Package ytdl-sub to PyPI ( #457 )
...
* post only if > 0
* since todays date
* pypi workflow
* test token
* fix test
* long description
* simpler names
* more simple
* no test pypi in master
* publish only on master
2023-02-20 16:39:33 -08:00
Jesse Bannon
2231bd43c8
[BACKEND] Set __version__ as date, dynamically update it in make ( #456 )
...
* [BACKEND] Set python __version__ as date, dynamically update it in make
* set version dynamically
* keep empty
* git ignore __init__
* keep init
* keep
* fix unit test
2023-02-20 14:18:30 -08:00
Jesse Bannon
251cd541ec
[BACKEND] File lock directory config parameter ( #455 )
...
* [BACKEND] File lock directory config parameter
* [BACKEND] File lock directory config parameter
2023-02-20 14:05:19 -08:00
Jesse Bannon
741e4825a9
[DOCS] Automatic sanitized override variable docs ( #453 )
...
* [DOCS] Automatic sanitized override variable docs
* formatting
2023-02-20 11:01:43 -08:00
Jesse Bannon
9b90c367a5
[DOCS] Better error message for strict override variable fields ( #452 )
...
* [DOCS] Better error message for strict override variable fields
* fix unit test
2023-02-20 10:57:40 -08:00
Jesse Bannon
4ba41c757c
[BACKEND] More verbose logging when breaking ( #450 )
...
* [BACKEND] More verbose logging when breaking
* make thumbnail id a debugger log
* mock for info log
* info
2023-02-20 10:50:04 -08:00
Jesse Bannon
17e5ca3904
[DOCS] Lowest date_range granularity is day ( #451 )
2023-02-20 10:40:28 -08:00
Jesse Bannon
73094e79bb
[FEATURE] Plex sanitized title and uid. Add into prebuilt preset ( #449 )
...
* [FEATURE] Plex sanitized title and uid. Add into prebuilt preset
* update fixtures, add fixture test
* lint
2023-02-20 10:19:44 -08:00
Joshua M. Boniface
69df95e0e9
[BACKEND] Always perform copy/delete on OSError ( #446 )
...
* Always perform copy/delete on OSError
Extends the fix in #400 to handle all potential OSError errno values and
attempt a copy/delete in all cases. For example, a combination
cross-device move and a permissions change would throw errno 1 instead
of errno 18, which wasn't caught here. Instead of messing with
individual errno numbers, just always attempt a copy/delete and let
those throw their own exceptions if they don't work either.
* Remove unused os_error_exc variable
2023-02-19 21:06:48 -08:00
Jesse Bannon
3106861a42
[BACKEND] Additional filtering on root parent search ( #445 )
...
* [BACKEND] Additional filtering on root parent search
* update failing test
2023-02-17 23:32:02 -08:00
Jesse Bannon
e5b5c5e638
[BACKEND] Bandcamp e2e test, update music example ( #393 )
...
* [BUGFIX] Fix missing contains function when checking entries
* remove children func
* [BACKEND] Bandcamp e2e test, update music example
* WIP
* combine soundcloud and all music into music_audio config
* sc fixtures
* updated tests and examples
* bandcamp e2e test
* regen off
* remove url validators
* use bandcamp artist url for more parent coverage
* lint
2023-01-14 16:48:27 -08:00
Jesse Bannon
c828ca5978
[BUGFIX] Fix TV show collection season thumbnail path for Plex ( #419 )
2023-01-14 16:46:40 -08:00
Jesse Bannon
32f1398d60
[BUGFIX] Fix playlist season thumbnails not appearing ( #416 )
2023-01-13 14:05:56 -08:00
Jesse Bannon
ab52ebbfe5
[DOCS] Extractor args example for english metadata ( #415 )
2023-01-13 13:59:24 -08:00
Jesse Bannon
30c77565bc
[BACKEND] Add playlist_uploader_sanitized var ( #414 )
2023-01-13 10:47:43 -08:00
Jesse Bannon
6020f27f12
[BACKEND] Better error message for music_tags recieving a video ( #413 )
...
* [BACKEND] Better error message for music_tags recieving a video
* test and better message
2023-01-13 10:25:17 -08:00
Jesse Bannon
c95c0f6aa4
[DOCS] Document additional backslash for regex ( #412 )
...
* [DOCS] Document additional backslash for regex
* double-backslash
2023-01-11 22:51:01 -08:00
Jesse Bannon
d9584dca63
[DOCS] Add popular ytdl_options to docs ( #411 )
2023-01-11 22:14:29 -08:00
Jesse Bannon
053042b4b9
[BACKEND] Purge youtube + soundcloud download strategies ( #408 )
...
* [BACKEND] Purge youtube + soundcloud download strategies
* update unit tests
* fix missing for ffmpeg;
* try update
2023-01-11 22:05:50 -08:00
Jesse Bannon
c84496910f
[BUGFIX] Cross-device patch for ffmpeg file writes ( #407 )
2023-01-10 14:19:45 -08:00
Jesse Bannon
c3d9d45c18
[BUGFIX] Invalid cross-device link workaround ( #400 )
2023-01-04 15:34:26 -08:00
Jesse Bannon
beaa34a367
[BUGFIX] Fix entry missing __contains__ function ( #392 )
...
* [BUGFIX] Fix missing contains function when checking entries
* remove children func
* Update failing hash
2022-12-13 00:23:16 -08:00
Jesse Bannon
c47b504cb4
[BUGFIX] Clear working directory before starting any downloads ( #382 )
...
* [BUGFIX] Clear working directory before starting any downloads
* update fixture
* fix prebuilt tests
* check if dir exists before del in fixture
2022-11-30 15:34:17 -08:00
Jesse Bannon
c8c66b5660
[BUGFIX] Create dir before converting channel thumbnails ( #381 )
2022-11-30 15:06:56 -08:00
Jesse Bannon
96e741c71d
[BACKEND] Proactively clean working directory ( #379 )
...
* fix playlist last thumbnail move to copy
* playlist working
* channel working
* working directory getting cleaned
* working dir e2e fixture
* cleanup files in any case
* clean up if pre-split returns None
2022-11-30 10:36:13 -08:00
Jesse Bannon
8dd57beebc
[BACKEND] Pass deep copy of ytdl_options to yt-dlp ( #376 )
2022-11-27 23:40:44 -08:00
Jesse Bannon
92c9988987
[BACKEND] Reduce memory footprint ( #375 )
...
* [BACKEND] Reduce memory footprint
* entry refactor
2022-11-27 22:38:50 -08:00
Jesse Bannon
001d516c56
[BACKEND] Fetch thumbnails after first downloaded entry ( #368 )
2022-11-27 00:20:14 -08:00
Jesse Bannon
9f5ee153b7
[BACKEND] Add URL thumbnail download timeout ( #367 )
2022-11-26 23:44:40 -08:00
Jesse Bannon
954dc0f3ee
[FEATURE] Add better download progress ( #366 )
2022-11-26 23:33:14 -08:00
Jesse Bannon
a77885f4de
[FEATURE] Match filters plugin ( #365 )
2022-11-26 22:32:19 -08:00
Jesse Bannon
2f792f774c
[FEATURE] Add custom ffmpeg post-processing ( #364 )
2022-11-26 14:56:34 -08:00
Jesse Bannon
2edfffcc5f
[FEATURE] Include description in prebuilt TV show presets by default ( #360 )
2022-11-24 20:31:36 -08:00
Jesse Bannon
ead5620c5c
[FEATURE] Add mp3 id3v2.4 multi-tag support ( #356 )
...
* [FEATURE] Add mp3 id3v2.4 multi-tag support
* docs
* fix new docker issue
* update fixture
2022-11-24 00:56:23 -08:00
Jesse Bannon
5d9fe2eaae
[BUGFIX] Set multi-value music tags as a list with single value ( #349 )
...
* [BUGFIX] Set multi-value music tags as a list with single value
* update fixtures
2022-11-21 14:11:55 -08:00
Jesse Bannon
ffaf07d628
[FEATURE] Add support to scrape chapters from comments ( #347 )
...
* [FEATURE] Add support to scrape chapters from comments
* tested for comments
* remove timestamps file
* change order of docstrings
2022-11-21 11:19:17 -08:00
Jesse Bannon
70c78dc109
[FEATURE] Embed thumbnails into audio files as cover art ( #345 )
...
* [FEATURE] Embed thumbnails into audio files as cover art
* lint
* fix ytdl options
2022-11-19 23:36:15 -08:00
Jesse Bannon
20bec0c664
[BUGFIX] Fix split_by_chapter download archive not working ( #344 )
2022-11-19 23:08:59 -08:00
Jesse Bannon
5705a28842
[FEATURE] Add ytdl-sub view URL to view source variables ( #340 )
...
* [FEATURE] Add `ytdl-sub view URL` to view source variables
* update file path
2022-11-19 16:56:45 -08:00
Jesse Bannon
ed08b2f591
asdf ( #336 )
2022-11-16 14:04:40 -08:00
Jesse Bannon
978dc36713
[BACKEND] Optimize metadata fetching ( #335 )
...
* [BACKEND] Do not fetch unnecessary metadata when grabbing .info.json files"
* update with more optimized ytdl options
2022-11-16 12:54:18 -08:00
Jesse Bannon
26b6ed0add
[BUGFIX] Fix multiple top-level parents issue ( #325 )
2022-11-14 23:01:34 -08:00
Jesse Bannon
8d154cc242
[BACKEND] Have Plex TV show preset try to download mp4 ( #324 )
2022-11-14 22:09:28 -08:00
Jesse Bannon
efb8ed5666
[DOCS] Warn if using deprecated download strategy ( #321 )
2022-11-13 14:08:34 -08:00
Jesse Bannon
10b58264ea
[BACKEND] Update music video example with url download strategy ( #312 )
...
* [DOCS] document file __preset__
* [REFACTOR] Use `download` type in examples
* TODO: download strategy docs, validate fixtures, fix playlist test
* playlist fixed, fixtures look good
* download strategy docs, fix tests
* better docs
* lint
* yt fixed
* split chapters fixed
* fix video
* better docs
* lint
2022-11-11 08:54:07 -08:00
Jesse Bannon
7458814a36
[DOCS] document file __preset__ ( #311 )
2022-11-06 17:00:42 -08:00
Jesse Bannon
255805c871
[REFACTOR] Rename source/collection to url/multi_url ( #310 )
2022-11-06 17:00:26 -08:00
Jesse Bannon
da22c9a608
[REFACTOR] Rename generic download source to download ( #309 )
...
* [REFACTOR] Rename `generic` download source to `download`
* no change to download strategy
2022-11-06 16:24:06 -08:00
Jesse Bannon
032acdbb6e
[BUGFIX] Fix latest ep thumbnail showing as TV show poster ( #304 )
2022-10-30 22:54:46 -07:00
Jesse Bannon
44ec463ab3
[BACKEND] More strict validation for config files ( #301 )
2022-10-26 00:00:36 -07:00
Jesse Bannon
3e4a995f6e
[DOCS] Fix file_convert yaml example
2022-10-22 22:10:55 -07:00
Jesse Bannon
1de5014c2f
[BUGFIX] Fix collection urls using wrong variables ( #297 )
2022-10-20 21:57:36 -07:00
Jesse Bannon
6fbed2e4b0
[BACKEND] Make dry-run log message ( #295 )
2022-10-16 23:00:31 -07:00
Jesse Bannon
1f4ac3e70f
[BACKEND] Debug log subscription as yaml to reproduce ( #294 )
2022-10-16 22:41:56 -07:00
Jesse Bannon
86c7e7b84e
[BUGFIX] Retry downloading entry thumbnail if missing ( #293 )
2022-10-16 22:25:59 -07:00
Jesse Bannon
6125fd0efb
[FEATURE] Add subscription yaml file preset __preset__ and apply to all presets in the file ( #292 )
2022-10-15 23:19:54 -07:00
Jesse Bannon
4ce3d9e9fb
[REFACTOR] Clean up prebuilt presets ( #291 )
...
* [REFACTOR] Clean up prebuilt presets
* prebuilt class
2022-10-15 16:59:43 -07:00
Jesse Bannon
fcdcb509c4
[BACKEND] Move more logic into subscription ( #283 )
2022-10-14 16:53:53 -07:00
Jesse Bannon
dbe71bb1c7
[BUGFIX] Fix split_by_chapters tests, refactor ytdl option file ( #278 )
2022-10-08 00:20:12 -07:00
Jesse Bannon
4ddaf72ae1
[DOCS] file_convert plugin ( #276 )
...
* [DOCS] file_convert plugin
* better docs
* lint
2022-10-07 22:46:07 -07:00
Jesse Bannon
cfc2e916aa
[BACKEND] Include genre override for tv shows ( #277 )
2022-10-07 22:23:07 -07:00
Jesse Bannon
9883907bf0
[BUGFIX] Use yt-dlp remuxer instead of our own ( #275 )
...
* [BUGFIX] Use yt-dlps remuxer instead of our own
* docstring
2022-10-07 17:16:54 -07:00
Jesse Bannon
ed7015296c
[BUGFIX] break_on_existing for tv presets, break_on_reject only when after is supplied ( #273 )
2022-10-06 12:21:37 -07:00
Jesse Bannon
5b8ee7f2de
[FEATURE] download_index source variable, new tv presets ( #271 )
2022-10-05 12:08:43 -07:00
Jesse Bannon
dc7b47d29b
[BACKEND] copy codecs, only change container ( #269 )
2022-10-03 16:42:40 -07:00
Jesse Bannon
a8b8762f49
[BACKEND] prebuilt player bases, make plex convert webm to mp4 ( #268 )
2022-10-03 15:44:44 -07:00
Jesse Bannon
9f6b3d4647
[FEATURE] file_convert plugin ( #267 )
2022-10-03 15:19:24 -07:00
Jesse Bannon
713f55bb3c
[BUGFIX] Fix episode id, Kodi/Jellyfin presets to set video tags ( #266 )
2022-10-03 09:18:35 -07:00
Jesse Bannon
d90dc795f6
[HOTFIX] kodi_safe preset included in wheel
2022-10-01 23:05:10 -07:00
Jesse Bannon
5b9a5dae50
[FEATURE] Prebuilt presets ( #264 )
2022-10-01 22:41:36 -07:00
Jesse Bannon
6d52177104
[BACKEND] upload_date_index source variables ( #261 )
...
* [BACKEND] `upload_date_index` source variables
* len
2022-09-30 22:41:06 -07:00
Jesse Bannon
897ea52e33
[BACKEND] Separate directory files in transaction log ( #260 )
2022-09-30 13:59:43 -07:00
Jesse Bannon
cd9a094e2c
[BACKEND] epoch and playlist_index_reversed variables ( #257 )
2022-09-29 15:39:53 -07:00
Jesse Bannon
7d29b72010
[BACKEND] uid_sanitized variable ( #256 )
2022-09-29 00:33:57 -07:00
Jesse Bannon
4b6add06e1
[BUGFIX] Fix nested parents with multiple parents ( #255 )
2022-09-29 00:09:56 -07:00
Jesse Bannon
06dffdb763
[BACKEND] Have generic url be overrides string formatter ( #254 )
2022-09-28 15:03:02 -07:00
Jesse Bannon
427d6e30fd
Revert "[FEATURE] Merged output directory nfo support ( #249 )" ( #253 )
...
This reverts commit a970fb9d06 .
2022-09-28 14:09:00 -07:00
Jesse Bannon
aeca125c2e
[BACKEND] generic.source download strategy ( #252 )
2022-09-28 12:32:50 -07:00
Jesse Bannon
e2faffd59c
[DOCS] Fix playlist thumbnail docs ( #251 )
2022-09-28 00:17:18 -07:00
Jesse Bannon
839192059b
[FEATURE] Add playlist thumbnail support ( #250 )
2022-09-27 23:48:18 -07:00
Jesse Bannon
a970fb9d06
[FEATURE] Merged output directory nfo support ( #249 )
2022-09-27 22:40:39 -07:00
Jesse Bannon
ebdd6c8aec
[BACKEND] Only have single entry type ( #248 )
2022-09-27 20:17:10 -07:00
Jesse Bannon
8edca7af36
[BACKEND] Do not default when building parent kwargs ( #247 )
2022-09-27 18:39:29 -07:00
Jesse Bannon
32577bbad5
[BACKEND] Expose raw playlist_index and playlist_count to all download strategies ( #245 )
2022-09-27 17:17:56 -07:00
Jesse Bannon
101df95251
[BACKEND] Remove break_on_reject default on youtube chanel ( #244 )
2022-09-27 17:03:00 -07:00
Jesse Bannon
1486acb421
[BACKEND] Parallelize tests, remove track and artist source variables ( #246 )
2022-09-27 16:51:42 -07:00
Jesse Bannon
3d0ade1141
[BACKEND] Collection thumbnail support ( #241 )
2022-09-18 11:16:25 -07:00
Jesse Bannon
3db6a543cf
[CLEANUP] Remove unused functions ( #240 )
2022-09-17 11:43:33 -07:00
Jesse Bannon
64d4be0a42
[BACKEND] output_directory_nfo_tags to support source vars ( #239 )
2022-09-17 11:11:37 -07:00
Jesse Bannon
46c14bd842
[BACKEND] uploader variables ( #238 )
2022-09-17 09:04:49 -07:00
Jesse Bannon
3ace86435d
[BACKEND] Defined kwarg strings. Add playlist/source description variable ( #237 )
2022-09-17 08:09:09 -07:00
Jesse Bannon
c66e5b72f3
[BACKEND] Add source and playlist variables to every entry ( #236 )
2022-09-16 22:56:56 -07:00
Jesse Bannon
892c5f5e6f
[BACKEND] Use generic collection download for every playlist strategy ( #233 )
2022-09-15 09:47:37 -07:00
Jesse Bannon
3894625479
[BACKEND] Remove split_video download strategy ( #232 )
2022-09-14 22:03:44 -07:00
Jesse Bannon
c08ea64b5a
[BACKEND] Add generic.collection download strategy, use it for soundcloud, youtube channel/playlist ( #230 )
2022-09-14 15:36:14 -07:00
Jesse Bannon
c33eed5a64
[BUGFIX] Fix source vars containing variable-like syntax ( #231 )
2022-09-14 08:36:56 -07:00
Jesse Bannon
c9f0300b39
[BACKEND] EntryParent class, use it to make downloaders more generic ( #229 )
2022-09-10 22:50:27 -07:00
Jesse Bannon
c7e9380fe0
[BACKEND] Refactor entry classes ( #228 )
2022-09-10 14:46:03 -07:00
Jesse Bannon
5488501bed
[BACKEND] File lock working directory to prevent multiple instances from polluting it ( #227 )
2022-09-08 23:41:09 -07:00
Jesse Bannon
d0cbd57a7f
[BUGFIX] Fix preset ordering ( #226 )
2022-09-08 15:43:09 -07:00
Jesse Bannon
2c86d640a4
[FEATURE] Have notion of modified files. Do not include files that have not changed ( #225 )
2022-09-08 12:24:46 -07:00
Jesse Bannon
4b6c79caef
[FEATURE] Add webpage_url source variable ( #224 )
2022-09-08 09:54:57 -07:00
Jesse Bannon
f24860c729
[BUGFIX] Properly sanitize override variables after it is resolved ( #223 )
...
* [BUGFIX] Properly sanitize override variables after it is resolved
* fixtures
2022-09-08 07:47:55 -07:00
Jesse Bannon
4b2e6e1169
[FEATURE] Set break_on_reject: True when using date_range plugin ( #221 )
2022-09-07 15:30:16 -07:00
Jesse Bannon
819bddc9d0
[FEATURE] Support duplicate NFO keys ( #220 )
2022-09-07 14:06:13 -07:00
Jesse Bannon
6383d133dc
[BUGFIX] Retry channel image downloads, continue if it fails ( #218 )
2022-09-06 16:12:28 -07:00
Jesse Bannon
3e801c56eb
[BUGFIX] Fix overrides failing validation in datetime vars ( #209 )
2022-09-02 14:41:51 -07:00
Jesse Bannon
2f4a2a4726
[BUGFIX] Fix extract info with retry issue with deleting download archive ( #208 )
2022-09-02 00:10:37 -07:00
Jesse Bannon
ffb45f6eb5
[BUGFIX] Handle source_uploader when it is empty ( #207 )
2022-09-02 00:06:44 -07:00
Jesse Bannon
6d84e52467
[FEATURE] Add multiple preset inheritance ( #204 )
2022-09-01 10:43:07 -07:00
Jesse Bannon
5782445366
[FEATURE] Add ability for downloaders to add new override variables. Add source_title, source_uploader, and source_description for YouTube channels and playlists ( #203 )
2022-09-01 00:25:01 -07:00
Jesse Bannon
ca0ac787b0
[FEATURE] Ability to write .info.json files ( #201 )
2022-08-29 22:50:42 -07:00
Jesse Bannon
99925836f3
[BACKEND] Add warning for using deprecated youtube.channel date range ( #200 )
2022-08-28 11:26:43 -07:00
Jesse Bannon
73be77c500
[FEATURE] date_range plugin, supports Override variables ( #199 )
2022-08-28 11:09:11 -07:00
Jesse Bannon
9ea1be4c5f
[FEATURE] NFO/XML attribute support ( #198 )
2022-08-28 00:56:51 -07:00
Jesse Bannon
d79e94e7e6
[BACKEND] Use native xml library, remove dicttoxml ( #196 )
2022-08-27 15:01:14 -07:00
Jesse Bannon
61c5a22933
[REFACTOR] Move chapter timestamps support into chapter plugin, remove from youtube.video ( #193 )
...
Introduces breaking changes to youtube.video.chapter_timestamps. Please use chapters.embed_chapter_timestamps instead to embed timestamps into a video
2022-08-26 23:08:53 -07:00
Jesse Bannon
553862fdad
[FEATURE] Add day_of_year variables ( #195 )
2022-08-24 09:59:34 -07:00
Jesse Bannon
e09a2c0ed8
[DOCS] Fix subtitles example ( #194 )
2022-08-23 23:59:23 -07:00
Jesse Bannon
9b224b7fc6
[FEATURE] Add reversed date variables ( #192 )
2022-08-23 22:32:41 -07:00
Jesse Bannon
f8386daadd
[DOCS] Fix nfo plugin names ( #187 )
2022-08-19 09:18:35 -07:00
Jesse Bannon
790c65859a
[FEATURE] Add split_by_chapters plugin ( #184 )
2022-08-18 23:24:03 -07:00
Jesse Bannon
c443d2e295
[BUGFIX] Fix truncated year source variable ( #185 )
2022-08-18 17:57:27 -07:00
Jesse Bannon
2a666ef70b
[FEATURE] Chapters plugin with SponsorBlock support ( #178 )
2022-08-15 17:01:03 -07:00
Jesse Bannon
871c051aa8
[FEATURE] Audio extract plugin ( #177 )
2022-08-14 10:10:10 -07:00
Jesse Bannon
064dca40b2
[BUGFIX] Subtitles for channel + playlist downloads ( #176 )
...
* subtitle fix for playlists
* download channel vids as singles
* no regen tests
2022-08-13 15:47:26 -07:00
Jesse Bannon
9a7a34f3d0
[FEATURE] Video tags plugin to embed metadata into video files ( #173 )
2022-08-13 09:53:55 -07:00
Jesse Bannon
1f09398ad5
[FEATURE] Subtitles support via Subtitles plugin ( #169 )
2022-08-12 09:58:08 -07:00
Jesse Bannon
bcf45f7f7e
[REFACTOR] Use JSON files instead of hard-coded classes for expected downloads ( #165 )
...
* Expected download summaries WIP
* jesse/fix-tests
* working
* tests passing
* remove fixture usage
* fix ignore md5 logic
2022-08-10 12:16:38 -07:00
Jesse Bannon
3e60f7d1da
[BACKEND] Do not write download archive file if no files changed ( #161 )
...
* [BACKEND] Do not write download archive file if no files changed
* ensure empty log for playlists
* test dl args
* test main completely
2022-08-07 15:02:02 -07:00
Jesse Bannon
47a46265cf
[FOLLOWUP] Actually process YT channels and playlists ascending ( #160 )
...
* actually sort
* use playlist_index instead
2022-08-06 22:40:45 -07:00
Jesse Bannon
8033b1a44c
[BACKEND] Download descending, process ascending for YouTube channels and playlists ( #159 )
2022-08-06 22:02:18 -07:00
Jesse Bannon
034855fbc4
[FEATURE+BUGFIX] Add kodi_safe arg for NFO plugins, support YT shorts ( #157 )
2022-08-05 16:53:36 -07:00
Jesse Bannon
5244b7c939
[DOCS] Clean up source variable readthedocs section ( #152 )
2022-08-04 17:34:06 -07:00
Jesse Bannon
b28ef2365b
[BACKEND] Allow more nesting for source + override variables ( #150 )
2022-08-04 14:42:20 -07:00
Jesse Bannon
b3883de7c4
[DOCS] Remove download_individually params from readthedocs ( #147 )
2022-08-04 11:28:48 -07:00
Jesse Bannon
c6e6f8e275
[BUG] Fix channel artwork error if not specified ( #146 )
2022-08-04 11:28:34 -07:00
Jesse Bannon
e3d6245aeb
[BUG] Prevent ytdl-sub args being specified as dl args ( #139 )
...
* [BUG] Prevent ytdl-sub args being specified as dl args
* refactor fail
2022-08-01 15:40:52 -07:00
Jesse Bannon
2fde8f69c3
[BUG] Fix log-level not respected by loggers ( #138 )
...
* [BUG] Fix log-level not respected by loggers
* _main
* fix mocking
2022-08-01 14:45:01 -07:00
Jesse Bannon
9fd97beca3
[BACKEND|BUG] Retry downloads with missing files ( #137 )
...
* [BACKEND|BUG] Retry downloads with missing files
* fix if statement, rename channel test file
2022-08-01 12:39:23 -07:00
Jesse Bannon
258b519f85
[BUG] Fix merge_playlist ordering ( #136 )
2022-07-31 23:23:13 -07:00
Jesse Bannon
23fce80db1
[BUG] Fix chapter metadata ordering ( #131 )
2022-07-30 21:59:02 -07:00
Jesse Bannon
09bc12c815
[FEATURE] Option to add chapters to YouTube videos via timestamps file ( #130 )
2022-07-30 15:52:20 -07:00
Maria Mozgunova
6056e662e6
[BACKEND] Do the match and extraction in one function
2022-07-29 07:26:27 -07:00
Jesse Bannon
232b1ac75a
[BACKEND] Improve info logger messages ( #129 )
2022-07-29 00:03:02 -07:00
Maria Mozgunova
287ac821dc
[FEATURE] List support for ytdl-sub dl ( #125 )
...
* List support for ytdl-sub dl (#103 )
* Add test and amend docstrings
2022-07-27 09:52:25 -07:00
Jesse Bannon
962b26d1ec
[BACKEND] Allow list validators to support length-1 lists without defining a yaml list ( #126 )
2022-07-26 09:10:51 -07:00
Jesse Bannon
d292ab0510
[BACKEND] Remove individual_download parameter from youtube channel + playlist ( #119 )
2022-07-22 08:46:05 -07:00
Jesse Bannon
72442ab846
[BACKEND] Download and process Soundcloud tracks individually ( #117 )
2022-07-22 00:09:08 -07:00
Jesse Bannon
ce25f4d28c
[BACKEND] info log download titles as they appear ( #115 )
...
* [BACKEND] info log download titles as they appear
* complete if exception
2022-07-21 23:00:17 -07:00
Jesse Bannon
99cbcb8243
[BUGFIX] Fix missing Soundcloud album tracks ( #116 )
2022-07-21 22:59:58 -07:00
Jesse Bannon
079994c003
[BUGFIX] Remove description from Soundcloud source variables ( #114 )
...
* [BUGFIX] Remove description from Soundcloud source variable
* update unit tests
2022-07-20 22:41:42 -07:00
Philipp Rintz
12a857bf9a
[BUGFIX] Fix youtube url validator for channels without 'c', 'channel' or 'user' ( #109 )
...
* Fix youtube url validator for channels without 'c', 'channel' or 'user'
* Fix linter errors
2022-07-18 11:48:23 -07:00
Jesse Bannon
c1aa973120
[BACKEND] Avoid thumbnail downloads when possible ( #105 )
2022-07-17 23:12:46 -07:00
Jesse Bannon
f66596d1a7
[BACKEND] Move files from working to output directory instead of copying ( #104 )
...
* [BACKEND] Move files from working to output directory instead of copying
* still copy split video thumbnails
2022-07-17 22:43:49 -07:00
Jesse Bannon
605de74697
[FEATURE] download_individually for youtube playlists ( #102 )
2022-07-17 22:02:50 -07:00
Jesse Bannon
8e35c1674b
[FEATURE] download_individually for Youtube channel ( #101 )
2022-07-17 18:17:00 -07:00
jbannon
2b0e7e0e4f
[DOCS|HOTFIX] Fix regex match docs
2022-07-17 21:17:40 +00:00
Jesse Bannon
53adbbcb22
[FEATURE] Regex capture and filtering on source variables plugin ( #100 )
...
* actually working
* changed plugin format. Need unit tests, documentation, update e2e to filter
* refactor plugin name, matching now working
* description work in progress, need more intricate testing
* tests looks good, regenerate output
* e2e tested, need more failure tests, no dupe variable names, add docs
* unit tests passing again
* more fail tests
* updated with name, default, better docs
* sanitized vars created
2022-07-16 23:39:46 -07:00
Jesse Bannon
119a0c212f
[BACKEND] Add regex validators ( #97 )
...
* [BACKEND] Add regex validators
2022-07-10 17:47:55 -07:00
jbannon
4134903299
[RELEASE] 0.2.0
2022-07-06 06:13:11 +00:00
Jesse Bannon
a0b46c0982
Add --dry-run summary ( #92 )
...
* tests updated with new class
* fix nfo tags, no tests only manual inspection
* txt
* dry-run output tested
* readability
* all tests now have files except rolling recent
* better
* almost fixed
* updated txt files w/indents
* files updated, looking good
* rolling recent dry-run test
* Print in main
2022-07-05 22:51:23 -07:00
Maka0
cb31156b42
Added QEMU/buildx to Github Actions to build multiarch containers ( #84 )
...
* Updated docker to use buildx Buildkit
* Updated github actions to include QEMU/buildx to build multiarch containers
* Removed packages after build is done
* Updated documentation to set the correct default thumbnail file name
* Parallel jobs (#1 )
Implemented parallel docker builds on Github Actions
* Updated default config file in Docker container
* Replaced Pillow with ffmpeg for thumbnail converting (and updated documentation to change the default thumbnail to -thumb.jpg) (#2 )
* Swapped Pillow for ffmpeg for thumbnail conversion
* Further changed default thumbname to include "-thumb" (Kodi needs this to pick up the thumbnail image)
* Added ffmpeg bitexact for reproducability
* Removed extra packages needed for Pillow
* Updated ref check (#3 )
* Fixed formatting on if statement for deploy job
Co-authored-by: Maka0 <bas@oddens.net>
2022-07-04 01:17:04 -07:00
Jesse Bannon
607ad9f9de
[REFACTOR] Move downloaders to separate files ( #91 )
2022-07-02 21:48:41 -07:00
Jesse Bannon
9df40497e2
Add --dry-run argument logic ( #82 )
...
* dry-run huge refactor
* small fixes, all tests passing
* file handler, transaction log, metadata
* dry-run actually dry running
* working tests, still have more
* Everything passing besides channel
* fix youtube channel thumbnail issue, need to fix fixtures on test
* lint 10, channel tests passing. Need dry-run for split and merge video
* all tests passing, lint 10, should test dry-run arg
2022-07-02 11:24:46 -07:00
Jesse Bannon
e5b925fb57
Fix error where download archive does not exist from no downloads ( #83 )
2022-06-30 09:14:14 -07:00
Jesse Bannon
4447f456d5
Validate all preset StringFormatValidators on init ( #79 )
...
* fast fail
* update error msg in test
2022-06-28 09:34:30 -07:00
Jesse Bannon
cb6dc8e034
Add youtube.download_strategy: "merge_playlist" ( #77 )
...
* begin
* chapters class, trying to add chapter splitting and general ffmpeg metadata creation
* working split video
* so very close
* test passing, is reproducible
* lint fixed
* fix docs
* track no longer used in example
* if, then del
* multiple values
* github hash
2022-06-26 15:18:07 -07:00
Jesse Bannon
1620c3a42d
youtube.download_strategy split_video ( #76 )
...
* youtube.download_strategy split_video
* almost working, need to deal with track_title and other overwrites
* working test
* ci ffmpeg
* sudo -f
* fix code block
2022-06-18 23:12:10 -07:00
Jesse Bannon
ee6706334f
ytdl_options defaults for each download strategy (#72 )
...
* `ytdl_options` defaults for each download strategy
* fix docker, fix defaults getting added, add debugger test
* test playlist as well
* fix with hack
* fix full channel test
* existing
2022-06-14 00:03:01 -07:00
Jesse Bannon
3d7595cda9
Configurable log levels ( #71 )
2022-06-08 23:01:31 -07:00
Jesse Bannon
a79fcaa25b
Use URLs instead of IDs for sources ( #70 )
...
* youtube video url
* WIP, channel /user/ and /c/ should be valid
* unit tests passing
* soundcloud artist url
* soundcloud username
* break configs with name change
* Update all yamls with urls
* update all docs
* more negative url tests
2022-06-05 16:19:08 -07:00
Jesse Bannon
e111ae53f5
Add aliases for ytdl-sub dl ( #68 )
...
* Add aliases for `ytdl-sub dl`
* error tests
2022-06-04 16:58:50 -07:00
Jesse Bannon
4994e3685e
mkv bugfix from ffmpeg ( #57 )
...
* mkv bug from ffmpeg
* always have working directory with entry
2022-05-30 18:45:00 -07:00
Jesse Bannon
8b336e6fb0
Always convert thumbnails to jpg ( #51 )
...
* always use jpg
* fix unit test
* update readme and configs
2022-05-30 09:59:25 -07:00
Jesse Bannon
a6cf9c3a11
Add soundcloud discography example w/test ( #49 )
...
* example sc yaml
* discography test
* json sort_keys
2022-05-30 00:25:41 -07:00
Jesse Bannon
a80a834924
Umask support, fix overrides formatter variable error message ( #46 )
...
* umask support, fix error message
* fix error location
* make pylint disable area smaller, remove int
2022-05-28 00:28:54 -07:00
Jesse Bannon
ec1cc534ea
Yaml error handling ( #45 )
2022-05-27 22:14:50 -07:00