archive
/
yt-dlp
mirror of https://github.com/yt-dlp/yt-dlp
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
22,874 Commits
3 Branches
100 Tags
130 MiB
master
release
gh-pages
2021.01.07
2021.01.07-1
2021.01.08
2021.01.09
2021.01.10
2021.01.12
2021.01.14
2021.01.16
2021.01.20
2021.01.24
2021.01.24-1
2021.01.29
2021.02.04
2021.02.09
2021.02.15
2021.02.19
2021.02.24
2021.03.01
2021.03.03
2021.03.03.2
2021.03.07
2021.03.15
2021.03.21
2021.03.24
2021.03.24.1
2021.04.03
2021.04.11
2021.04.22
2021.05.11
2021.05.20
2021.06.01
2021.06.08
2021.06.09
2021.06.23
2021.07.07
2021.07.21
2021.07.24
2021.08.02
2021.08.10
2021.09.01
2021.09.02
2021.09.25
2021.10.09
2021.10.10
2021.10.22
2021.11.10
2021.11.10.1
2021.12.01
2021.12.25
2021.12.27
2022.01.21
2022.02.03
2022.02.04
2022.03.08
2022.03.08.1
2022.04.08
2022.05.18
2022.06.22
2022.06.22.1
2022.06.29
2022.07.18
2022.08.08
2022.08.14
2022.08.18.36
2022.08.19
2022.09.01
2022.10.04
2022.11.11
2023.01.02
2023.01.06
2023.02.17
2023.03.03
2023.03.04
2023.06.21
2023.06.22
2023.07.06
2023.09.24
2023.10.07
2023.10.13
2023.11.14
2023.11.16
2023.12.30
2024.03.10
2024.04.09
2024.05.26
2024.05.27
2024.07.01
2024.07.02
2024.07.07
2024.07.08
2024.07.09
2024.07.16
2024.07.25
2024.08.01
2024.08.06
2024.09.27
2024.10.07
2024.10.22
2024.11.04
2024.11.18
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from 'release'
${ noResults }
Commit Graph

470 Commits (release)

Author SHA1 Message Date
pukkandan 0468a3b325
[jsinterp] Improve separating regex 
Fixes https://github.com/yt-dlp/yt-dlp/issues/4635#issuecomment-1273974909
 2 years ago
Matthew 867c66ff97
[extractor/youtube] Extract concurrent view count for livestreams (#5152) 
Adds new field `concurrent_view_count`
Closes https://github.com/yt-dlp/yt-dlp/issues/4843

Authored by: coletdjnz
 2 years ago
Lesmiscore 4d37720a0c
[extractor/youtube] Download `post_live` videos from start (#5091) 
* The fragments are generated as a `LazyList`. So only the required formats are expanded during download, but all fragment lists are printed/written in infojson.
* The m3u8 formats which cannot be downloaded from start are not extracted by default, but can be enabled with an extractor-arg. The extractor-arg `include_live_dash` is renamed to `include_incomplete_formats` to account for this new use-case.

Closes #1564
Authored by: Lesmiscore, pukkandan
 2 years ago
pukkandan a057779d5e
[cleanup] Minor fixes 
Closes #5129, Closes #4982
 2 years ago
pukkandan 7a32c70d13
[cleanup] Fix flake8 and minor refactor 
Issues from ab029d7e92, 1fb53b946c
 2 years ago
pukkandan 709ee21417
[extractor/youtube] Do not warn on duplicate chapters 
Eg: vYbaM8w8yzw
 2 years ago
pukkandan 1fb53b946c
[extractor/youtube:tab] Improve continuation items extraction 2 years ago
pukkandan 1dd18a8808
[extractor/YoutubeShortsAudioPivot] Support `source` URLs 
`ytshortsap:` is no longer needed
 2 years ago
pukkandan 0a5095fe8d
[extractor/youtube:tab] Support `reporthistory` page 
Closes #4929
 2 years ago
coletdjnz 0ca0f88121
[extractor/heise] Fix extractor (#5029) 
Fixes https://github.com/yt-dlp/yt-dlp/issues/1520
Authored by: coletdjnz
 2 years ago
coletdjnz 80eb0bd9b9
[extractor/youtube] Add support for Shorts audio pivot feed (#4932) 
This feed shows Shorts using the audio of a given video. 

ytshortsap: prefix can be used as a shortcut until YouTube
implements an official view. 

Closes #4911
Authored by: coletdjnz
 2 years ago
coletdjnz c26f9b991a
[extractor/youtube] Support changing extraction language (#4470) 
Adds `--extractor-args youtube:lang=<supported lang code>` extractor arg to prefer translated fields (e.g. title and description) of that language, if available, for all YouTube extractors. See README or error message for list of supported language codes.

Closes https://github.com/yt-dlp/yt-dlp/issues/387

Authored by: coletdjnz
 2 years ago
coletdjnz 3ffb2f5bea
[extractor/youtube] Fix video like count extraction 
Support new combined button layout
Authored by: coletdjnz
 2 years ago
pukkandan 17ffed1842
[docs] Improvements 
* Move detailed installation instructions to https://github.com/yt-dlp/yt-dlp/wiki/Installation
* Link to wiki where applicable
* Fix some mistakes. Closes #4853, Closes #4855, Closes #4852
* Improve some error messages
 2 years ago
pukkandan 7c6eb424d3
[extractor/youtube] Detect `lazy-load-for-videos` embeds 
Closes #4812
 2 years ago
pukkandan 05deb747bb
[jsinterp] Fix escape in regex 2 years ago
pukkandan b505e8517a
[extractor/youtube] Fallback regex for nsig code extraction 2 years ago
coletdjnz 1ff88b7aec
[extractor/youtube] Add `no-youtube-prefer-utc-upload-date` compat option (#4771) 
This option reverts 992f9a730b and 17322130a9 to prefer the non-UTC upload date in microformats.

Authored by: coletdjnz, pukkandan
 2 years ago
pukkandan da4db748fa
[utils] Add `deprecation_warning` 
See https://github.com/yt-dlp/yt-dlp/pull/2173#issuecomment-1097021515
 2 years ago
pukkandan d81ba7d491
[jsinterp, extractor/youtube] Minor fixes 2 years ago
pukkandan c4b2df872d
[jsinterp] Fix `_separate` 
Ref: https://github.com/yt-dlp/yt-dlp/issues/4635#issuecomment-1231126941
 2 years ago
Samantaz Fox 224b5a35f7
[extractor/youtube] Update iOS Innertube clients (#4792) 
Authored by: SamantazFox
 2 years ago
coletdjnz 50ac0e5416
[extractor/youtube] Use device-specific user agent (#4770) 
Thwart latest fingerprinting attempt (see https://github.com/iv-org/invidious/issues/3230#issuecomment-1226887639)

Authored by: coletdjnz
 2 years ago
pukkandan 5e01315aa1
[cache, extractor/youtube] Invalidate old cache 2 years ago
pukkandan 992dc6b486
[jsinterp] Implement timeout 
Workaround for #4716
 2 years ago
pukkandan b25cac650f
[extractor/youtube] Fix bug in format sorting 2 years ago
pukkandan 90a1df305b
[test] Fix test_youtube_signature 2 years ago
pukkandan a831c2ea90
[cleanup] Misc 2 years ago
pukkandan 25836db6be
[extractor/youtube] Add fallback to phantomjs 
Related #4635
 2 years ago
pukkandan 580ce00782
[youtube] Improve signature caching 
and refactor related functions
 2 years ago
pukkandan f6ca640b12
[jsinterp] Fix for youtube player 1f7d5369 
Closes #4635 again
 2 years ago
pukkandan 3ce2933693
[youtube] Fix error reporting of "Incomplete data" 
Related: #4669
 2 years ago
pukkandan 5c6d2ef9d1
[youtube] Improve format sorting for IOS formats 
When no itag/resolution is available for reference, use the closest resolution
 2 years ago
Lesmiscore 62b58c0936
[docs] Consistent use of `e.g.` (#4643) 
Authored by: Lesmiscore
 2 years ago
pukkandan 8f53dc44a0
[jsinterp] Handle new youtube signature functions 
Closes #4635
 2 years ago
pukkandan 7e798d725e
[extractor] Fix format sorting of `channels` 2 years ago
coletdjnz c7dcf0b31e
[extractor/youtube] Add `androidSdkVersion` parameter to Android Innertube clients 
Required to prevent YouTube returning a bad player response in some cases.

See: https://github.com/yt-dlp/yt-dlp/pull/4593, https://github.com/TeamNewPipe/NewPipe/issues/8713, https://github.com/iv-org/invidious/issues/3230, https://github.com/Tyrrrz/YoutubeExplode/issues/647

Authored by: coletdjnz
 2 years ago
pukkandan a416623436
[extractor/youtube] Extract more format info 2 years ago
coletdjnz a3e9642116
[extractor/youtube] Prevent redirect to unwanted videos (#4593) 
Example: https://www.youtube.com/watch?v=aQvGIIdgFDM

Authored by: coletdjnz
 2 years ago
coletdjnz a0c830f488
[extractor/youtube] Bump Innertube client versions 
YouTube may be requiring new versions soon. See https://github.com/iv-org/invidious/issues/3230, https://github.com/TeamNewPipe/NewPipe/issues/8713

Authored by: coletdjnz
 2 years ago
pukkandan be5c1ae862
Standardize retry mechanism (#1649) 
* [utils] Create `RetryManager`
* Migrate all retries to use the manager
* [extractor] Add wrapper methods for convenience
* Standardize console messages for retries
* Add `--retry-sleep` for extractors
 2 years ago
pukkandan bfd973ece3 [extractors] Use new framework for existing embeds (#4307) 
`Brightcove` is difficult to migrate because it's subclasses may depend
on the signature of the current functions. So it is left as-is for now

Note: Tests have not been migrated
 2 years ago
pukkandan f2e8dbcc00 [extractor, test] Basic framework for embed tests (#4307) 
and split download tests so they can be more easily run in CI

Authored by: coletdjnz
 2 years ago
lazypete365 e325a21a1f
[extractor/youtube] Add `live_status=post_live` (#4495) 
Related: https://github.com/yt-dlp/yt-dlp/issues/1564
Authored by: lazypete365
 2 years ago
pukkandan 31b532a1f2
[cleanup] Misc 2 years ago
pukkandan c646d76f67
[webvtt, extractor/youtube] Extract auto-subs from livestream VODs 
Closes #4130

Authored by: pukkandan, fstirlitz
 2 years ago
pukkandan 07b47084ba
[extractor/youtube] Parse translated subtitles only when requested 
Closes #4274
 2 years ago
pukkandan 693f060040
[youtube,twitch] Allow waiting for channels to become live 
Closes #2597
 2 years ago
ftk 45e8a04e48
[extractor/youtube] More metadata for storyboards (#4334) 
Authored by: ftk
 2 years ago
pukkandan a3fb1ca5ab
[extractor/youtube] Fix duration check for post-live manifestless mode 2 years ago
Andrew 12a1b2254d
[extractor/youtube, cleanup] Fix tests (#4293) 
Authored by: sheerluck
 2 years ago
pukkandan a3976e0760
Improve chapter sanitization 2 years ago
pukkandan ae61d108dd
[cleanup] Misc cleanup 2 years ago
crazymoose77756 962ffcf89c
[cleanup] Fix some typos (#4194) 
Authored by: crazymoose77756
 2 years ago
pukkandan 14f25df2b6
[compat] Remove deprecated functions from core code 2 years ago
pukkandan ac66811112
[compat] Remove more functions 
Removing any more will require changes to a large number of extractors
 2 years ago
Brett824 06cc8f103b
[extractor/youtube] Mark videos as fully watched (#4146) 
* Also fixes videos appearing as shorts in watch history

Closes #2555
Authored by: Brett824
 2 years ago
pukkandan 9809740ba5
[extractor, cleanup] Reduce direct use of `_downloader` 2 years ago
pukkandan 471d0367c7
[youtube:clips] Support downloading clips 
Closes #2543
 2 years ago
pukkandan a70635b8a1
[cleanup, utils] Don't use kwargs for `format_field` 2 years ago
pukkandan 0df111a371
[youtube] Extract `comment_count` from webpage 
Closes #4091
 2 years ago
coletdjnz 4ce05f5759
[extractor/youtube] Fix live chat for videos with content warning 
Fixes #4051
Authored by: coletdjnz
 3 years ago
pukkandan 56ba69e4c9
[cleanup] Misc fixes 
Closes #4027
 3 years ago
coletdev 2ae778b8fc
[extractor/youtube] Add `innertube_host` and `innertube_key` extractor args (#3916) 
Allows user to override Innertube API host or key for all requests
Authored by: coletdjnz
 3 years ago
MMM 36195c4461
[dash] Show fragment count with `--live-from-start` (#3493) 
Authored by: flashdagger
 3 years ago
coletdjnz 65141660ab
[extractor/youtube] Fix bug in b7c47b7438 
Closes #3997

Authored by: coletdjnz
 3 years ago
pukkandan b7c47b7438
[extractor] Add `_search_json` 
All fetching of JSON objects should eventually be done with this function
but only `youtube` is being refactored for now
 3 years ago
pukkandan 1890fc6389
[cleanup] Misc fixes 
Cherry-picks from: #3498, #3947
Related: #3949, https://github.com/yt-dlp/yt-dlp/issues/1839#issuecomment-1140313836
Authored by: pukkandan, flashdagger, gamer191
 3 years ago
coletdev c7a7baaa13
[extractor/youtube] Fix `:ytnotifications` extractor (#3775) 
Still some issues, see https://github.com/yt-dlp/yt-dlp/pull/3775

Authored by: coletdjnz
 3 years ago
pukkandan 6b0b0a289a
[extractor/youtube:tab] Detect `videoRenderer` in `_post_thread_continuation_entries` 3 years ago
coletdjnz ee27297f82
[extractor/youtube] Fix initial player response extraction 
Authored by: pukkandan, coletdjnz
 3 years ago
pukkandan 0fe51254cb
[extractor/youtube] Bring back `_extract_chapters_from_description` 
Closes #3886
 3 years ago
pukkandan 52023f1291
[extractor/youtube] Make signature extraction non-fatal 
and reduce verbosity of it's warning

Closes #3882
 3 years ago
pukkandan 829bbd1d05
[youtube] Add warning for PostLiveDvr 
Closes #3746, Related #1564
 3 years ago
pukkandan 2762dbb17e
[compat] Add `functools.cached_property` 3 years ago
pukkandan 2414649192
[cleanup] Misc cleanup 3 years ago
Jordan Weatherby d1c4f6d4da
[youtube] Added piped instance urls (#3714) 
Closes #3661
Authored by: JordanWeatherby
 3 years ago
pukkandan 82d020804d
[extractor] Use classmethod/property where possible 
and refactor lazy extractors accordingly.

This reduces the need to create extractor instances
 3 years ago
pukkandan 0f06bcd759
[cleanup] Minor fixes (See desc) 
* [youtube] Fix `--youtube-skip-dash-manifest`
* [build] Use `$()` in `Makefile`. Closes #3684
* Fix bug in 385ffb467b
* Fix bug in 43d7f5a5d0
* [cleanup] Remove unnecessary `utf-8` from `str.encode`/`bytes.decode`
* [utils] LazyList: Expose unnecessarily "protected" attributes
and other minor cleanup
 3 years ago
pukkandan 91e5e839d3
[youtube] Deprioritize format 22 
Reduces chance of encountering #3372
 3 years ago
coletdev 6e634cbe42
[youtube] Add YoutubeStoriesIE (#3362) 
Get channel stories with `ytstories:<channel UCID>`

Authored-by: coletdjnz
 3 years ago
pukkandan bfec31bec8
[youtube] De-prioritize auto-generated thumbnails 
Closes #3112
 3 years ago
pukkandan 1d485a1a79
[cleanup] Misc fixes 
Closes #3565, https://github.com/yt-dlp/yt-dlp/issues/3514#issuecomment-1105944364
 3 years ago
pukkandan 0a41f331cc
[doc] Minor improvements 
Closes #3518, Closes #3560
 3 years ago
pukkandan 19a0394044
[cleanup] Misc cleanup and refactor (#2173) 3 years ago
coletdjnz affc4fefea
[youtube] Fix episode metadata extraction 3 years ago
pukkandan f82711587c
[cleanup] Sort imports 
Using https://github.com/PyCQA/isort

    isort -m VERTICAL_HANGING_INDENT --py 36 -l 80 --rr -n --tc .
 3 years ago
pukkandan 86e5f3ed2e
[cleanup] Upgrade syntax 
Using https://github.com/asottile/pyupgrade

1. `__future__` imports and `coding: utf-8` were removed
2. Files were rewritten with `pyupgrade --py36-plus --keep-percent-format`
3. f-strings were cherry-picked from `pyupgrade --py36-plus`

Extractors are left untouched (except removing header) to avoid unnecessary merge conflicts
 3 years ago
krichbanana ca5300c7ed
[youtube] Add `:ytnotifications` extractor (#3347) 
Authored by: krichbanana
 3 years ago
pukkandan a25bca9f89
[youtube, cleanup] Minor refactoring 
Authored by: coletdjnz, pukkandan
 3 years ago
coletdev 61d3665d9d
[youtube] Fix uploader for collaborative playlists (#3332) 
Authored by: coletdjnz
 3 years ago
pukkandan a44ca5a470
[cleanup] Misc fixes 
Closes https://github.com/yt-dlp/yt-dlp/pull/3213, Closes https://github.com/yt-dlp/yt-dlp/pull/3117

Related: https://github.com/yt-dlp/yt-dlp/issues/3146#issuecomment-1077323114, https://github.com/yt-dlp/yt-dlp/pull/3277#discussion_r841019671, a825ffbffa (commitcomment-68538986), https://github.com/yt-dlp/yt-dlp/issues/2360, 5fa3c9a88f (r70393519), 5fa3c9a88f (r70393254)
 3 years ago
pukkandan a17526e427
[youtube:tab] Minor improvements (See desc) 
* Support shorts on channel homepage
* Extract thumbnail of OLAK playlists
 3 years ago
coletdev ad210f4fd4
[youtube:search] Support hashtag entries (#3265) 
Authored-by: coletdjnz
 3 years ago
David e7870111e8
[YouTube] Add new age-gate bypass (#3233) 
Closes #3182
Authored by: zerodytrash, pukkandan
 3 years ago
coletdev 1c1b2f96ae
[youtube:tab] Fix duration extraction for shorts (#3171) 
Related: https://github.com/TeamNewPipe/NewPipe/issues/8034
Authored-by: coletdjnz
 3 years ago
pukkandan 1235d333ab
[youtube] Fix auto-translated automatic captions 
d49669acad only covered ASR

Closes #2956
 3 years ago
pukkandan 18e4940825
[youtube] Add extractor-arg to skip auto-translated subs 3 years ago
shirt 727029c508
[youtube] Detect DRM better 
Authored by: shirt-dev
 3 years ago
coletdev fd2ad7cb24
[youtube:tab] Return shorts url if video is a short (#3168) 
Allows filtering out shorts from feeds with `--match-filter`
Closes #3165
Authored-by: coletdjnz
 3 years ago
pukkandan ae72962643
[youtube] Try embedded client variants before agegate 
agegate variants appears to be broken, but don't remove them for the time-being
 3 years ago
pukkandan 52efa4b312
[extractor] Add `_perform_login` function (#2943) 
* Adds new functions `_initialize_pre_login` and `_perform_login` as part of the extractor API
* Adds `ie.supports_login` to the public API
 3 years ago
pukkandan e4b98809cf
[youtube] Fix pagination of `membership` tab 3 years ago
pukkandan a1b2d84360
[youtube] Avoid false positives when detecting damaged formats 
Closes #3083
 3 years ago
coletdjnz 5dbc77df26
[youtube:api] Prefer minified JSON response 
Authored-by: coletdjnz
 3 years ago
coletdev b3edc8068e
[downloader/mhtml] Fix fragments with absolute urls (#3044) 
Authored-by: coletdjnz
 3 years ago
coletdev 17322130a9
[youtube] Improve video upload date handling (#3029) 
* Don't prefer UTC upload date for past live streams/premieres
* Improve regex (fixes a regression)

Authored-by: coletdjnz
 3 years ago
pukkandan ff91cf7483
[utils] Add `get_first` 3 years ago
pukkandan a405b38f20
[youtube] Further de-prioritize 3gp format 3 years ago
pukkandan 08d30158ec
[cleanup, docs] Misc cleanup 
Closes #2828, closes #2734, closes #2802, closes #2937
 3 years ago
coletdev 992f9a730b
[youtube] Prefer UTC upload date for videos (#2223) 
Except for live/scheduled streams/premieres. 
Closes #1881
Related: #2402 
Authored-by: coletdjnz
 3 years ago
pukkandan d49669acad
[youtube] Fix automatic captions 
Closes #2956
 3 years ago
pukkandan e48b3875ec
Revert 2e4cacd038 
Closes #2923
 3 years ago
coletdev 7c219ea601
[youtube:tab] Follow redirect to regional channel (#2884) 
Closes #2694
Authored by: coletdjnz
 3 years ago
Lesmiscore (Naoya Ozaki) a539f06570
[downloader/fragment] Improve `--live-from-start` for YouTube livestreams (#2870) 3 years ago
pukkandan 1108613f02
[youtube:tab] Reject webpage data if redirected to home page 
Closes #2660
 3 years ago
pukkandan a30a6ed3e4
[youtube:tab] Add `approximate_date` extractor-arg 3 years ago
Lesmiscore a7d4acc018
[youtube] Escape possible `$` in `_extract_n_function_name` regex 3 years ago
pukkandan 0ad92dfb18
[youtube] De-prioritize potentially damaged formats 
Closes #2823
 3 years ago
pukkandan 2e4cacd038
[youtube] Fix intermittent failure of embed-based age-gate bypass 3 years ago
MinePlayersPE c571b3a6ab
[youtube] Fix n-sig extraction for phone player JS (#2816) 
Authored by: MinePlayersPE
 3 years ago
coletdev 60f393e48b
[youtube] Ensure subtitle urls are absolute (#2765) 
Closes #2755

Authored by: coletdjnz
 3 years ago
pukkandan ab6df717d1
[youtube] Differentiate descriptive audio by language code 
Related: #2677
 3 years ago
pukkandan 0c8d9e5fec
[youtube] Label original auto-subs 
Closes #2655
 3 years ago
pukkandan 84bbc54599
[youtube:search] Add tests 3 years ago
coletdjnz af5c1c553e
[youtube] Fix search extractor 
Regression introduced in 16aa9ea41d. Closes #2628
Authored-by: coletdjnz
 3 years ago
pukkandan 455a15e2dc
[cleanup,docs] Minor fixes 
Closes #2541, #2484
 3 years ago
pukkandan 182bda88e8
[youtube, cleanup] Misc fixes and cleanup 3 years ago
pukkandan 16aa9ea41d [youtube] Add extractor `YoutubeMusicSearchURLIE` 
Closes #2568
 3 years ago
pukkandan 48416bc4a8
[youtube] Fix n-sig for player e06dea74 3 years ago
coletdjnz 87e8e8a7d0
[youtube:api] Do not use seek when reading HTTPError response 
Authored-by: coletdjnz
 3 years ago
pukkandan 6970b6005e
[cleanup] Minor fixes 
Closes #2334
 3 years ago
pukkandan e0ddbd02bd
[cleanup] Use format_field where applicable 3 years ago
coletdjnz 6c73052c0a
[youtube] Extract channel subscriber count (#2399) 
Closes #2350
* Adds `channel_follower_count` field
Authored-by: coletdjnz
 3 years ago
coletdjnz 396a76f7bf
[youtube] Enforce UTC (#2402) 
and [utils] use `utcnow` in `datetime_from_str`

Related: #2223 
Authored by: coletdjnz
 3 years ago
coletdjnz 301d07fc4b
[youtube:tab] Extract channel banner (#2400) 
Closes #2237
Authored by: coletdjnz
 3 years ago
krichbanana 64f36541c9
[youtube:tab] Raise error on tab redirect (#2318) 
Closes #2306
Authored by: krichbanana, coletdjnz
 3 years ago
pukkandan 66f7c6a3e0
[youtube] Do not return `upload_date` for playlists 
Closes #2349
Partially reverts #1018
Re-opens #1883
 3 years ago
pukkandan 596379e260
[youtube] Make invalid storyboard URL non-fatal 
Closes #2382
 3 years ago
pukkandan b6ce9bb038
[youtube] Detect live-stream embeds 
Closes #2380
 3 years ago
Unit 193 4c968755fc
[PornHub,YouTube] Refresh onion addresses (#2272) 
Authored by: unit193
 3 years ago
pukkandan 976ae3eabb
[youtube] Update tests 3 years ago
coletdjnz f0d785d3ed
[youtube:tab] Extract more playlist metadata (#2069) 
* Add fields modified_date, modified_timestamp
* Add field playlist_count
* [youtube:tab] Extract view_count, playlist_count, modified_date

Authored by: coletdjnz, pukkandan
 3 years ago
coletdjnz 18c7683d27
[youtube:api] Update Innertube clients (#2163) 
* Updated iOS clients to support 60fps formats (see: https://github.com/TeamNewPipe/NewPipeExtractor/issues/680#issuecomment-1002724558)
* General update of versions and keys of other clients
 Authored-by: coletdjnz
 3 years ago
pukkandan 185bf31070
[youtube] End `live-from-start` properly when stream ends with 403 
Closes #2089
 3 years ago
coletdjnz a709d87335
[youtube:tab] Extract video thumbnails from playlist (#2096) 
closes #1184
Co-Authored-by: coletdjnz, pukkandan
 3 years ago
The Hatsune Daishi adbc4ec4bb
[dash,youtube] Download live from start to end (#888) 
* Add option `--live-from-start` to enable downloading live videos from start
* Add key `is_from_start` in formats to identify formats (of live videos) that downloads from start
* [dash] Create protocol `http_dash_segments_generator` that allows a function to be passed instead of fragments
* [fragment] Allow multiple live dash formats to download simultaneously
* [youtube] Implement fragment re-fetching for the live dash formats
* [youtube] Re-extract dash manifest every 5 hours (manifest expires in 6hrs)
* [postprocessor/ffmpeg] Add `FFmpegFixupDuplicateMoovPP` to fixup duplicated moov atoms

Known issue: Ctrl+C doesn't work on Windows when downloading multiple formats

Closes #1521
Authored by: nao20010128nao, pukkandan
 3 years ago
coletdjnz f3aa3c3f98
[youtube:tab] Extract more metadata from feeds/channels/playlists (#1018) 
Parse relative time text, extract live, upcoming status, availability and channel id from feeds/channels/playlists (where applicable). 
Closes #1883
Authored-by: coletdjnz
 3 years ago
pukkandan 37e57a9fd4
[youtube:tab] Ignore query when redirecting channel to playlist 
and cleanup of related code
Closes #2046
 3 years ago
pukkandan 39ca3b5c7f
[extractor] Standardize `_live_title` 3 years ago
coletdjnz 46383212b3
[youtube:comments] Add more options for limiting number of comments extracted (#1626) 
Extends `max_comments` extractor arg to support `max-parents,max-replies,max-replies-per-thread`.
Authored-by: coletdjnz
 3 years ago
pukkandan ff9f925b63
[test/download] Add more fields 3 years ago
pukkandan 5f7cb91ae9
[youtube] Fix `ytsearchdate` 
Related: #1851
 3 years ago
pukkandan b29165267f
[youtube] Decrypt n-sig for URLs with `ratebypass` 
Closes #1796
 3 years ago
pukkandan a61fd4cf6f
[youtube:search_url] Add playlist/channel support 
Closes #1213, #1214
 3 years ago
pukkandan a6213a4925
[cleanup,youtube] Reorganize Tab and Search extractor inheritances 3 years ago
pukkandan dd2a987d3f
[tests] Fix tests 3 years ago
pukkandan 9222c38182
[cleanup] Minor cleanup 
Closes #1696, Closes #1673
 3 years ago
pukkandan 720c309932
[youtube] Add storyboard formats 
Closes: #1553, https://github.com/ytdl-org/youtube-dl/issues/9868
Related: https://github.com/ytdl-org/youtube-dl/pull/14951
 3 years ago
coletdjnz d0d012d4e7
[youtube] Add `default` player client (#1685) 
Authored-by: coletdjnz
 3 years ago
pukkandan e339d25a0d
[youtube] Minor improvement to format sorting 3 years ago
pukkandan c586f9e8de
[cleanup] minor fixes 3 years ago
pukkandan aa9369a2d8
[cleanup] Minor improvements to error and debug messages 3 years ago
Ryan Hendrickson d9190e4467
[youtube] Add Invidious list for playlists/channels (#1567) 
Authored by: rhendric
 3 years ago
pukkandan 34921b4345
[utils] Add `join_nonempty` 3 years ago
pukkandan c18d4482b1
[youtube] Fix sorting for some videos 3 years ago
pukkandan a4211baff5
[cleanup] Minor cleanup 3 years ago
pukkandan d89257f398
[youtube] Remove unnecessary no-playlist warning 3 years ago
pukkandan a0bb6ce58d
[youtube] refactor itag processing 3 years ago
pukkandan 404f611f1c
[youtube] Fix throttling by decrypting n-sig (#1437) 3 years ago
pukkandan fccf502118
[youtube] Populate `thumbnail` with the best "known" thumbnail 
Closes #402, Related: https://github.com/yt-dlp/yt-dlp/issues/340#issuecomment-950290624
 3 years ago
pukkandan 96565c7e55
[cleanup] Add keyword automatically to SearchIE descriptions 
and some minor cleanup of docs
 3 years ago
pukkandan 49a57e70a9
[cleanup] misc 3 years ago
pukkandan 176f1866cb
Add HDR information to formats 3 years ago
pukkandan e820fbaa6f
Do not verify thumbnail URLs by default 
Partially reverts cca80fe611 and 0ba692acc8

Unless `--check-formats` is specified, this causes yt-dlp to return incorrect thumbnail urls.
See https://github.com/yt-dlp/yt-dlp/issues/340#issuecomment-877909966, #402

But the overhead in general use is not worth it

Closes #694, #725
 3 years ago
pukkandan 24b0a72b30
[cleanup] Remove broken youtube login code 3 years ago
coletdjnz aae16f6ed9
[youtube:comments] Fix comment section not being extracted in new layouts (#1324) 
Co-authored-by: coletdjnz, pukkandan
 3 years ago
pukkandan 580d3274e5 [youtube] Expose different formats with same itag 3 years ago
pukkandan ecdc9049c0
[YouTube] Add auto-translated subtitles 
Closes #1245
 3 years ago
pukkandan a2160aa45f
[extractor] Generalize `getcomments` implementation 3 years ago
pukkandan cc16383ff3
[extractor] Simplify search extractors 3 years ago
coletdjnz ac56cf38a4
[youtube:tab] Fallback to API when webpage fails to download (#1122) 
and add some extractor_args to force this mode
Authored by: coletdjnz
 3 years ago
pukkandan 1276a43a77
[youtube] Fix non-fatal errors in fetching player 3 years ago
pukkandan e6f21b3d92
[docs,cleanup] Some minor refactoring and improve docs 3 years ago
coletdjnz 99e9e001de
[youtube] Cleanup authentication code (#786) 
Authored by: coletdjnz
 3 years ago
pukkandan 5e3f2f8fc4
[youtube] Return full URL instead of just ID 3 years ago
pukkandan 3cd786dbd7
[youtube] Warn when trying to download clips 3 years ago
coletdjnz b6de707d13
[youtube] Improvements to JS player extraction (See desc) (#860) 
* fallback player url extraction when it fails to be extracted from the webpage
* don't download js player unnecessarily for clients that don't require it
* try to extract js player url from any additional client configs
* ability to skip the js player usage/download using `player_skip=js`
* ability to skip the initial webpage download using `player_skip=webpage`

known issue:
* authentication for multi-channel accounts and multi-account cookies may not work correctly if the webpage or client configs are skipped
*  formats from the web client requiring signature decryption will be skipped if player js extraction is skipped

Authored by: coletdjnz
 3 years ago
pukkandan 526d74ec5a
[cleanup] Misc 3 years ago
coletdjnz c0ac49bcca
[youtube] Retry on 'Unknown Error' (#854) 
and do not repeat unimportant alerts

Closes #839
Authored by: coletdjnz
 3 years ago
pukkandan a7429aa9fa
[youtube] Fix subtitle names 3 years ago
pukkandan c311988d19
[youtube] Improve 26e8e04454 
The streams of the same itag may have slightly different size/bitrate
 3 years ago
pukkandan 26e8e04454
[youtube] Prefer audio stream that YouTube considers default 
Fixes: https://github.com/ytdl-org/youtube-dl/issues/29864
Related: https://github.com/clsid2/mpc-hc/issues/1268
 3 years ago
coletdjnz 0bb1bc1b10
[youtube] Remove annotations and deprecate `--write-annotations` (#765) 
Closes #692 
Authored by: coletdjnz
 3 years ago
pukkandan 88acdbc269
[extractor] Better error message for DRM (#729) 
Closes #636
 3 years ago
Tom-Oliver Heidel 9b5fa9ee7c
[youtube] Add av01 itags to known formats list (#747) 
Authored by: blackjack4494
 3 years ago
pukkandan 3fb4e21b38
[lazy_extractors] Fix `suitable` and add flake8 test 3 years ago
pukkandan 4dfbf8696b
[utils] Add `parse_qs` 3 years ago
pukkandan 8fc54b1230
[youtube] Add `shorts` to `_VALID_URL` 
Normally the generic extractor will redirect the URL,
but the cookies consent screen may sometimes appear instead

Closes #752
 3 years ago
pukkandan 5ad28e7ffd
[extractor] Common function `_match_valid_url` 3 years ago