Simon Sawicki
f9fb3ce86e
[cleanup] Misc ( #8598 )
...
Authored by: bashonly, pukkandan, seproDev, Grub4K
Co-authored-by: bashonly <bashonly@protonmail.com>
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>
Co-authored-by: sepro <4618135+seproDev@users.noreply.github.com>
11 months ago
Pandey Ganesha
6b5d93b0b0
[ie/youtube] Fix `like_count` extraction ( #8763 )
...
Closes #8759
Authored by: Ganesh910
12 months ago
pukkandan
044886c220
[ie/youtube] Return empty playlist when channel/tab has no videos
...
Closes #8634
12 months ago
OIRNOIR
6a9c7a2b52
[ie/youtube] Support cf.piped.video ( #8514 )
...
Authored by: OIRNOIR
Closes #8457
1 year ago
bashonly
bb5a54e6db
[ie/youtube] Improve detection of faulty HLS formats ( #8646 )
...
Closes #7747
Authored by: bashonly
1 year ago
sepro
1732eccc0a
[core] Parse `release_year` from `release_date` ( #8524 )
...
Closes #7263
Authored by: seproDev
1 year ago
Simon Sawicki
b012271d01
[cleanup] Misc ( #8510 )
...
Authored by: bashonly, coletdjnz, dirkf, gamer191, seproDev, Grub4K
1 year ago
bashonly
fd8fcf8f4f
Revert 39abae2354
...
The iOS client is not subject to integrity checks and is likely to be a more stable choice going forward
Authored by: bashonly
1 year ago
bashonly
ef79d20dc9
[ie/youtube] Check newly uploaded iOS HLS formats ( #8336 )
...
Closes #7747
Authored by: bashonly
1 year ago
bashonly
39abae2354
[ie/youtube] Deprioritize iOS client formats ( #8337 )
...
Authored by: bashonly
1 year ago
bashonly
b634ba742d
[cleanup] Misc ( #8338 )
...
Authored by: bashonly, gamer191
1 year ago
Simon Sawicki
feebf6d02f
[ie/youtube] Fix bug with `--extractor-retries inf` ( #8328 )
...
Authored by: Grub4K
1 year ago
bashonly
03e85ea99d
[ie/youtube] Fix `heatmap` extraction ( #8299 )
...
Closes #8189
Authored by: bashonly
1 year ago
coletdjnz
eb5bdbfa70
[ie/youtube] Raise a warning for `Incomplete Data` instead of an error ( #8238 )
...
Closes https://github.com/yt-dlp/yt-dlp/issues/8206
Adds `raise_incomplete_data` extractor arg to revert this behaviour and raise an error.
Authored by: coletdjnz
Co-authored-by: Simon Sawicki <contact@grub4k.xyz>
1 year ago
bashonly
5ca095cbcd
[cleanup] Misc ( #8182 )
...
Closes #7796 , Closes #8028
Authored by: barsnick, sqrtNOT, gamer191, coletdjnz, Grub4K, bashonly
1 year ago
coletdjnz
378ae9f9fb
[ie/youtube] Fix consent cookie ( #7774 )
...
Fixes #7594
Authored by: coletdjnz
1 year ago
coletdjnz
546b2c28a1
[ie/youtube] Fix `player_params` arg being converted to lowercase
...
Fix bug in ba06d77a31
Authored by: coletdjnz
1 year ago
coletdjnz
ba06d77a31
[ie/youtube] Add `player_params` extractor arg ( #7719 )
...
Authored by: coletdjnz
1 year ago
coletdjnz
3d2623a898
[compat, networking] Deprecate old functions ( #2861 )
...
Authored by: coletdjnz, pukkandan
1 year ago
coletdjnz
1ba6fe9db5
[ie/youtube:tab] Detect looping feeds ( #6621 )
...
Closes https://github.com/yt-dlp/yt-dlp/issues/5555
Note: the first page may still be repeated, however this is better than nothing.
Authored by: coletdjnz
1 year ago
pukkandan
94ed638a43
[ie/youtube] Avoid false DRM detection ( #7396 )
...
Some master manifests contain a mix of DRM and non-DRM formats
1 year ago
pukkandan
337734d4a8
[cleanup] Misc
1 year ago
coletdjnz
90db9a3c00
[extractor/youtube:stories] Remove ( #7459 )
...
YouTube killed them
https://web.archive.org/web/20230630153050/https://support.google.com/youtube/thread/217640760
1 year ago
coletdjnz
4dc4d8473c
[extractor/youtube] Ignore incomplete data for comment threads by default ( #7475 )
...
For both `--ignore-errors` and `--ignore-errors only_download`. Pass `--no-ignore-errors` to not ignore.
Closes https://github.com/yt-dlp/yt-dlp/issues/7474
Authored by: coletdjnz
1 year ago
coletdjnz
fcbc9ed760
[extractor/youtube:tab] Support shorts-only playlists ( #7425 )
...
Fixes https://github.com/yt-dlp/yt-dlp/issues/7424
Authored by: coletdjnz
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>
1 year ago
pukkandan
d949c10c45
[extractor/youtube] Process `post_live` over 2 hours
1 year ago
pukkandan
58786a10f2
[extractor/youtube] Add extractor-arg `formats`
...
Closes #7417
1 year ago
Simon
89bed01374
[extractor/youtube] Fix comments' `is_favorited` ( #7390 )
...
Authored by: bbilly1
Closes #7389
1 year ago
pukkandan
cd810afe2a
[extractor/youtube] Improve nsig function name extraction
1 year ago
Berkan Teber
71dc18fa29
[extractor/youtube] Improve description parsing performance ( #7315 )
...
* The parsing is skipped when not needed
* The regex is improved by simulating atomic groups with lookaheads
Authored by: pukkandan, berkanteber
1 year ago
pukkandan
1e75d97db2
[extractor/youtube] Add `ios` to default clients used
...
* IOS is affected neither by 403 or by nsig so helps mitigate them preemptively
* IOS also has higher bit-rate "premium" formats though they are not labeled as such
1 year ago
pukkandan
81ca451480
[extractor/youtube] Workaround 403 for android formats
...
Ref: https://github.com/TeamNewPipe/NewPipe/issues/9038#issuecomment-1289756816
1 year ago
pukkandan
ad54c9130e
[cleanup] Misc
...
Closes #6288 , Closes #7197 , Closes #7265 , Closes #7353 , Closes #5773
Authored by: mikf, freezboltz, pukkandan
1 year ago
pukkandan
97afb093d4
[extractor/youtube] Ignore wrong fps of some formats
1 year ago
pukkandan
51a07b0dca
[extractor/youtube] Prioritize premium formats
...
Closes #7283
1 year ago
pukkandan
ff9b0e071f
[extractor/youtube] Determine audio language using automatic captions
1 year ago
coletdjnz
8213ce28a4
[extractor/youtube] Extract `channel_is_verified` ( #7213 )
...
Authored by: coletdjnz
1 year ago
pukkandan
14a14335b2
[extractor/youtube] Misc cleanup
...
Authored by: coletdjnz
1 year ago
coletdjnz
2fb35f6004
[extractor/youtube] Support shorter relative time format ( #7191 )
...
See: https://github.com/TeamNewPipe/NewPipeExtractor/issues/1067
Authored by: coletdjnz
2 years ago
coletdjnz
c35448b7b1
[extractor/youtube] Extract more metadata for comments ( #7179 )
...
Adds new comment fields:
* `author_url` - The url to the comment author's page
* `author_is_verified` - Whether the author is verified on the platform
* `is_pinned` - Whether the comment is pinned to the top of the comments
Closes https://github.com/yt-dlp/yt-dlp/issues/5411
Authored by: coletdjnz
2 years ago
coletdjnz
18f8fba7c8
[extractor/youtube] Fix continuation loop with no comments ( #7148 )
...
Deep check the response for incomplete data.
Authored by: coletdjnz
2 years ago
coletdjnz
93e12ed76e
[extractor/youtube] Extract uploader metadata for feed/playlist items
...
Fixes https://github.com/yt-dlp/yt-dlp/issues/7104
Authored by: coletdjnz
2 years ago
Audrey
5caf30dbc3
[extractor/youtube] Extract `heatmap` data ( #7100 )
...
Closes #3888
Authored by: tntmod54321
2 years ago
pukkandan
4823ec9f46
Update to ytdl-commit-d1c6c5
...
[YouTube] [core] Improve platform debug log, based on yt-dlp
d1c6c5c4d6
Except:
* 6ed34338285f722d0da312ce0af3a15a077a3e2a [jsinterp] Add short-cut evaluation for common expression
* There was no performance improvement when tested with https://github.com/ytdl-org/youtube-dl/issues/30641
* e8de54bce50f6f77a4d7e8e80675f7003d5bf630 [core] Handle `/../` sequences in HTTP URLs
* We plan to implement this differently
2 years ago
kangalio
69a40e4a7f
[extractor/youtube:music:search_url] Extract title ( #7102 )
...
Authored by: kangalio
Closes #7095
2 years ago
coletdjnz
447afb9eaa
[extractor/youtube] Support podcasts and releases tabs
...
Closes https://github.com/yt-dlp/yt-dlp/issues/6893
Authored by: coletdjnz
2 years ago
coletdjnz
7666b93604
[extractor/youtube] Define strict uploader metadata mapping ( #6384 )
...
New mapping:
```
channel -> channel name
channel_id -> UCID
channel_url -> UCID channel url
uploader -> channel name (same as channel field)
uploader_id -> @handle
uploader_url -> @handle channel url
```
Authored by: coletdjnz
2 years ago
pukkandan
c6786ff3ba
[extractor/youtube] Revert default formats to `https`
2 years ago
coletdjnz
141a8dff98
[extractor/youtube] Fix comment loop detection for pinned comments ( #6714 )
...
Pinned comments may repeat a second time - this is expected.
Fixes https://github.com/yt-dlp/yt-dlp/issues/6712
Authored by: coletdjnz
2 years ago
Nicholas Defranco
071670cbea
[extractor/youtube] Fix parsing `comment_count` ( #6523 )
...
Closes #5849
Authored by: nick-cd
2 years ago
coletdjnz
607510b9f2
[extractor/youtube] Handle incomplete initial data from watch page ( #6510 )
...
Authored by: coletdjnz
2 years ago
pukkandan
e389d172b6
Fix 2a23d92d9e
...
Closes #6517
2 years ago
pukkandan
2a23d92d9e
[extractor/youtube] Construct fragment list lazily
...
Building fragment list for all formats take significant time for large videos
2 years ago
pukkandan
86cb922118
[extractor/youtube] Add extractor-arg `include_duplicate_formats`
2 years ago
Lesmiscore
c795c39f27
[extractor/youtube] Add client name to `format_note` when `-v` ( #6254 )
...
Authored by: Lesmiscore, pukkandan
2 years ago
pukkandan
c9abebb851
[extractor/youtube] Bypass throttling for `-f17`
...
and related cleanup
Thanks @AudricV for the finding
2 years ago
pukkandan
392389b7df
[cleanup] Misc
2 years ago
mushbite
22ccd5420b
[extractor/rutube] Extract chapters from description ( #6345 )
...
Authored by: mushbite
2 years ago
coletdjnz
7f51861b18
[extractor/youtube] Detect and break on looping comments ( #6301 )
...
Fixes https://github.com/yt-dlp/yt-dlp/issues/6290
Authored by: coletdjnz
2 years ago
pukkandan
5b28cef72d
[cleanup] Misc
2 years ago
pukkandan
31e183557f
[extractor/youtube] Extract channel `view_count` when `/about` tab is passed
2 years ago
pukkandan
f34804b2f9
[extractor/youtube] Fix 5038f6d713
...
* [fragment] Fix `request_data`
* [youtube] Don't use POST for now. It may be easier to break in future
Authored by: bashonly, coletdjnz
2 years ago
pukkandan
5038f6d713
[extractor/youtube] Construct dash formats with `range` query
...
Closes #6369
2 years ago
pukkandan
a538772969
[cleanup] Misc
...
Closes #5897
2 years ago
bashonly
c61cf091a5
[extractor/youtube] `uploader_id` includes `@` with handle
...
Authored by: bashonly
2 years ago
bashonly
149eb0bbf3
[extractor/youtube] Fix `uploader_id` extraction
...
Closes #6247
Authored by: bashonly
2 years ago
Bruno Guerreiro
78a78fa74d
[extractor/youtube] Add hyperpipe instances ( #6020 )
...
Authored by: Generator
2 years ago
Roland Hieber
05799a48c7
[extractor/youtube] Update invidious and piped instances ( #6030 )
...
Authored by: rohieb
2 years ago
Simon Sawicki
6839ae1f6d
[utils] `traverse_obj`: Fix more bugs
...
and cleanup uses of `default=[]`
Continued from b1bde57bef
2 years ago
pukkandan
b032ff0f03
[extractor/youtube] Handle `consent.youtube`
2 years ago
pukkandan
dad2210c0c
[extractor/youtube] Support `/live/` URL
2 years ago
mzhou
253ac4ba6a
[extractor/youtube] Retry manifest refresh for live-from-start ( #5670 )
...
Avoids ending download early when live stream is temporarily offline.
Best used with somewhat large `--retry-sleep extractor:` and `--extractor-retries`
Authored by: mzhou
2 years ago
pukkandan
08e29b9f1f
[cleanup] Misc
...
Closes #5576 , closes #5887
2 years ago
pukkandan
9bb856998b
[extractor/youtube] Extract DRC formats
2 years ago
Matthew
c733555106
[extractor/youtube:tab] Extract metadata from channel items ( #5569 )
...
Authored by: coletdjnz
2 years ago
pukkandan
71eb82d1b2
[extractor/youtube] Subtitles cannot be translated to `und`
...
Closes #5674
2 years ago
Bnyro
bc87dac75f
[extractor/youtube] Add `piped.video` ( #5571 )
...
Closes #5518
Authored by: Bnyro
2 years ago
pukkandan
9f14daf22b
[extractor] Deprecate `_sort_formats`
2 years ago
pukkandan
6368e2e639
[cleanup] Misc
...
Closes #5541
2 years ago
pukkandan
a4894d3e25
[extractor/youtube] Consider language in format de-duplication
2 years ago
pukkandan
171a31dbe8
[extractor] Add a way to distinguish IEs that returns only videos
2 years ago
pukkandan
a8c754cc00
[extractor/youtube] Fix bug in handling of music URLs
...
Bug in bd7e919a75
Closes #5502
2 years ago
pukkandan
08270da5c3
[extractor/youtube] Fix `ytuser:`
2 years ago
pukkandan
bd7e919a75
[extractor/youtube:tab] Improvements to tab handling ( #5487 )
...
* Better handling of direct channel URLs - See https://github.com/yt-dlp/yt-dlp/pull/5439#issuecomment-1309322019
* Prioritize tab id from URL slug - Closes #5486
* Add metadata for the wrapping playlist
* Simplify redirect for music playlists
2 years ago
Matthew
e72e48c53f
[extractor/youtube] Ignore incomplete data error for comment replies ( #5490 )
...
When --ignore-errors is used.
Closes https://github.com/yt-dlp/yt-dlp/issues/4669
Authored by: coletdjnz
2 years ago
Matthew
0cf643b234
[extractor/youtube] Differentiate between no and disabled comments ( #5491 )
...
`comments` and `comment_count` will be set to None, as opposed to
an empty list and 0, respectively.
Fixes https://github.com/yt-dlp/yt-dlp/issues/5068
Authored by: coletdjnz, pukkandan
2 years ago
Matthew
4dc23a8051
[extractor/youtube:tab] Fix video metadata from tabs ( #5489 )
...
Closes #5488
Authored by: coletdjnz
2 years ago
Matthew
86973308cd
[extractor/youtube:tab] Update tab handling for redesign ( #5439 )
...
Closes #5432 , #5430 , #5419
Authored by: coletdjnz, pukkandan
2 years ago
Bruno Guerreiro
e14ea7fbd9
[extractor/youtube] Update piped instances ( #5441 )
...
Closes #5286
Authored by: Generator
2 years ago
Matthew
6141346d18
[extractor/youtube] Update playlist metadata extraction for new layout ( #5376 )
...
Fixes https://github.com/yt-dlp/yt-dlp/issues/5373
Authored by: coletdjnz
2 years ago
pukkandan
2e30b46fe4
[extractor/youtube] Improve chapter parsing from description
...
Closes #5448
2 years ago
nosoop
9da6612b0f
[extractor/youtube] Fix `duration` for premieres ( #5382 )
...
Closes #5378
Authored by: nosoop
2 years ago
coletdjnz
e63faa101c
[extractor/youtube] Fix `live_status` extraction for playlist videos
...
Regression in 867c66ff97
Authored by: coletdjnz
2 years ago
bsun0000
5318156f1c
[extractor/youtube] Mark videos as fully watched
...
Closes #2555
Authored by: bsun0000
2 years ago
pukkandan
d5d1df8afd
[cleanup Misc
...
Closes #5162
2 years ago
pukkandan
6678a4f0b3
[extractor/youtube] Fix live_status
...
Bug in 4d37720a0c
2 years ago
pukkandan
5225df50cf
[extractor/youtube:tab] Let `approximate_date` return timestamp
2 years ago
pukkandan
0468a3b325
[jsinterp] Improve separating regex
...
Fixes https://github.com/yt-dlp/yt-dlp/issues/4635#issuecomment-1273974909
2 years ago
Matthew
867c66ff97
[extractor/youtube] Extract concurrent view count for livestreams ( #5152 )
...
Adds new field `concurrent_view_count`
Closes https://github.com/yt-dlp/yt-dlp/issues/4843
Authored by: coletdjnz
2 years ago
Lesmiscore
4d37720a0c
[extractor/youtube] Download `post_live` videos from start ( #5091 )
...
* The fragments are generated as a `LazyList`. So only the required formats are expanded during download, but all fragment lists are printed/written in infojson.
* The m3u8 formats which cannot be downloaded from start are not extracted by default, but can be enabled with an extractor-arg. The extractor-arg `include_live_dash` is renamed to `include_incomplete_formats` to account for this new use-case.
Closes #1564
Authored by: Lesmiscore, pukkandan
2 years ago