Commit Graph

2053 Commits (cb794ee010c88c6dddb3a38608114f6bc0e4a3a0)

Author SHA1 Message Date
pukkandan f0c9fb9682
[utils] `Popen`: Refactor to use contextmanager
Fixes https://github.com/yt-dlp/yt-dlp/issues/3531#issuecomment-1156223597
2 years ago
pukkandan 560738f34d
[extractor] Import `_ALL_CLASSES` lazily
This significantly speeds up `import yt_dlp` in the absence of `lazy_extractors`
2 years ago
pukkandan 99d10bf607
[cleanup, extractor] Rename `extractors.py` to `_extractors.py`
This should be considered part of the next commit,
but is separated so that `git` can detect the renaming better
2 years ago
Evan Spensley 145c5a83a8
[extractor/GoogleDrive] Add folder extractor (#4009)
Closes #3388
Authored by: evansp, pukkandan
2 years ago
pukkandan 2cb1982043
[utils] `locked_file`: Fix for PyPy on Windows 2 years ago
pukkandan fccf90e7f3
Fix bug in 56ba69e4c9 2 years ago
pukkandan d32f30ac48
Add `--no-update`
Closes #4060
2 years ago
pukkandan e3aae45a6f
[extractor/zdf] Fix bug in 62b2b736e7
Closes #4061
2 years ago
pukkandan f3c0c77304
[extractor] Handle `json_ld` with multiple `@type`s
Closes: #4022
2 years ago
pukkandan 79e591b59b
[extractor/rumble] Detect JS embed
Closes #4064
2 years ago
pukkandan 21a73e9f39
[extractor/generic] Revert e6ae51c123
85553414ae made it unnecessary
2 years ago
coletdjnz 4ce05f5759
[extractor/youtube] Fix live chat for videos with content warning
Fixes #4051
Authored by: coletdjnz
2 years ago
Lesmiscore 2523702718
[extractor/tver] Fix bug in 6837633a4a
This corrects a mistake in 64fa820ccf
Authored by: Lesmiscore
Closes #4054
2 years ago
pukkandan 55baa67c7c
[extractor/jwplatform] Look for `data-video-jw-id`
Closes #3821
2 years ago
pukkandan 64fa820ccf
[cleanup] Misc fixes (see desc)
* [tvver] Fix bug in 6837633a4a - Closes #4054
* [rumble] Fix tests - Closes #3976
* [make] Remove `cat` abuse - Closes #3989
* [make] Revert #3684 - Closes #3814
* [utils] Improve `get_elements_by_class` - Closes #3993
* [utils] Inherit `Namespace` from `types.SimpleNamespace`
* [utils] Use `re.fullmatch` for matching filters
* [jsinterp] Handle quotes in `_separate`
* [make_readme] Allow overshooting last line

Authored by: pukkandan, kwconder, MrRawes, Lesmiscore
2 years ago
pukkandan 56ba69e4c9
[cleanup] Misc fixes
Closes #4027
2 years ago
Aurélien Grosdidier d05460e5fe
[extractor/FranceCulture] Fix extractor (#3874)
Closes #3742
Authored by: aurelg, pukkandan
2 years ago
ping 14c3a98049
[extractor/naver] Add `navernow` extractor (#3866)
Authored by: ping
2 years ago
Elyse e0a4a3d5bf
[extractor/freetv] Add extractor (#3587)
Closes #3486
Authored by: elyse0
2 years ago
Elyse 62b2b736e7
[extractor/zdf] Improve format sorting (#4040)
Closes #4020

Authored by: elyse0
2 years ago
Lesmiscore 6837633a4a
[extractor/tver] Fix extractor (#4033)
Authored by: Lesmiscore
2 years ago
coletdev 2ae778b8fc
[extractor/youtube] Add `innertube_host` and `innertube_key` extractor args (#3916)
Allows user to override Innertube API host or key for all requests
Authored by: coletdjnz
2 years ago
Ashish Gupta c82a4a8fce
[extractor/atscaleconfevent] Add extractor (#3971)
Closes #3961
Authored by: Ashish0804
2 years ago
vkorablin 6e7c9201cd
[extractor/ccc] Extract view_count (#3939)
Authored by: vkorablin
2 years ago
Angel Toloza bde0132e15
[extractor/southpark] Add `southpark.lat` extractor (#4008)
Authored by: darkxex
2 years ago
pukkandan 233ad894d3
[update] Use `.git` folder to distinguish `source`/`unknown`
This is not perfect, but is good enough for how we use this information

Closes #3994
2 years ago
Daniel Lindholm 0d6bafbfa7
[expressen] Fix extractor (#4006)
Authored by: aejdl
2 years ago
MMM 36195c4461
[dash] Show fragment count with `--live-from-start` (#3493)
Authored by: flashdagger
2 years ago
coletdjnz 65141660ab
[extractor/youtube] Fix bug in b7c47b7438
Closes #3997

Authored by: coletdjnz
2 years ago
Christoph Moench-Tegeder dec30912a7
[cookies] Detect profiles for cygwin/BSD (#3975)
Closes #3370
Authored by: moench-tegeder
2 years ago
pukkandan 5ec1b6b716
Add option `--download-sections` to download video partially
Closes #52, Closes #3932
2 years ago
pukkandan e0ab98541c
[ExtractAudio] Allow conditional conversion
Closes #1715
2 years ago
pukkandan 35faefee5d
[ExtractAudio, cleanup] Refactor 2 years ago
pukkandan b7c47b7438
[extractor] Add `_search_json`
All fetching of JSON objects should eventually be done with this function
but only `youtube` is being refactored for now
2 years ago
pukkandan 00bbc5f177
[ThumbnailsConvertor] Allow conditional conversion
Closes #3970
2 years ago
Lesmiscore 0bea4fd807
[extractor/0000studio] Add extractors (#3959)
Authored by: Lesmiscore
2 years ago
ischmidt20 b5770743fe
[extractor/espn] Add `WatchESPN` extractor (#2283)
Authored by: ischmidt20, pukkandan
2 years ago
pukkandan 1890fc6389
[cleanup] Misc fixes
Cherry-picks from: #3498, #3947
Related: #3949, https://github.com/yt-dlp/yt-dlp/issues/1839#issuecomment-1140313836
Authored by: pukkandan, flashdagger, gamer191
2 years ago
pukkandan c4910024f3
[extractor] Fix bug in 617f658b7e
While the function signature don't enforce it, some IEs that override
`_download_webpage_handle` assume all optional arguments to be keyword-only

Closes #3954
2 years ago
coletdev c7a7baaa13
[extractor/youtube] Fix `:ytnotifications` extractor (#3775)
Still some issues, see https://github.com/yt-dlp/yt-dlp/pull/3775

Authored by: coletdjnz
2 years ago
siddharth ravikumar e50c3500b4
[extractor/npr] Use stream url from json-ld (#3455)
Closes #1934
Authored by: r5d
2 years ago
pukkandan 09d02ea429
[extractor] Fix bug in f95b9dee45
Closes #3951
2 years ago
sqrtNOT ac05fb9338
[extractor/niconico:series] Fix extractor (#3935)
Authored by: sqrtNOT
2 years ago
pukkandan 28786529dc
[extractor/dropout] Login is not mandatory
Workaround for #3931
2 years ago
pukkandan 6b0b0a289a
[extractor/youtube:tab] Detect `videoRenderer` in `_post_thread_continuation_entries` 2 years ago
pukkandan f95b9dee45
[extractor] Add dev option `--load-pages` 2 years ago
pukkandan 617f658b7e
[extractor, cleanup] Refactor `_download_...` methods 2 years ago
pukkandan 8a7f6d7a15
Do not print progress to `stderr` with `-q`
It is arguable how this "should" behave, but since progress is always
written to stdout in older yt-dl/p, we should keep it as-is

Bug in cf4f42cb97
Closes #3844
2 years ago
Lesmiscore 9c0412cf6b
[extractor/vevo] Fix extractor (#3921)
Authored by: Lesmiscore
2 years ago
gamer191 84131d0351
[extractor/animelab] Remove extractor (#3922)
https://www.animelab.com/sunset

Authored by: gamer191
2 years ago
Lesmiscore 1cd6cba306
[extractor/PokemonSoundLibrary] Remove extractor (#3918)
Authored by: Lesmiscore
2 years ago
Lesmiscore 661e7253a2
[extractor/iwara:user] Make paging better (#3901)
Authored by: Lesmiscore
2 years ago
Lesmiscore 222a230871
[extractor/common] Recognize `src` attribute from HTML5 media elements (#3899)
Authored by: Lesmiscore
3 years ago
coletdjnz ee27297f82
[extractor/youtube] Fix initial player response extraction
Authored by: pukkandan, coletdjnz
3 years ago
Stefan Borer ee164987c7
[extractor/playsuisse] Add extractor (#845)
Authored by: sbor23, pukkandan
3 years ago
pukkandan 0fe51254cb
[extractor/youtube] Bring back `_extract_chapters_from_description`
Closes #3886
3 years ago
pukkandan 52023f1291
[extractor/youtube] Make signature extraction non-fatal
and reduce verbosity of it's warning

Closes #3882
3 years ago
mozbugbox 5bbe631e04
[extractor/duboku] Fix for hostname change (#3891)
Authored by: mozbugbox
3 years ago
coletdev 2c6dcb65fb
[utils] Send HTTP/1.1 ALPN extension (#3889)
Some servers may reject requests if not sent (e.g. fingerprinting)

Fixes #3878

Authored by: coletdjnz
3 years ago
miseran 520876fa09
[extractor/zattoo] Fix live streams (#3812)
Authored by: miseran
3 years ago
pukkandan 0bf9dc1e35
Fix bug in 8a82af3511 3 years ago
pukkandan 829bbd1d05
[youtube] Add warning for PostLiveDvr
Closes #3746, Related #1564
3 years ago
pukkandan 8a82af3511
[cleanup] Misc fixes and cleanup
Closes #3780, Closes #3853, Closes #3850
3 years ago
pukkandan 8246f8402b
[spotify:show] Fix extractor
Closes #3768
3 years ago
pukkandan 6b9e832db7
`--config-location -` to provide options interactively 3 years ago
monnef d2ff2c91bb
[curiositystream] Get `auth_token` from cookie (#3836)
Closes #3753
Authored by: mnn
3 years ago
m4tu4g 7879e79d11
[bloomberg] Change playback endpoint (#3857)
Closes #3787
Authored by: m4tu4g
3 years ago
Lesmiscore 8a3e7b1c95
[yahoo:gyao] Fix extractor
This fixes 400 error for /title/ URLs.
3 years ago
pukkandan d9473db78a
[ModifyChapters] Fix repeated removal of small segments
Closes #3846
3 years ago
pukkandan 11233f2afd
[downloader, cleanup] Refactor `report_progress`
Closes #3790
3 years ago
pukkandan 3a85e9cee9
[ffmpeg] Check version lazily
Closes #3830
3 years ago
pukkandan c4a62b99f6
Fix bug in 23326151c4 3 years ago
pukkandan b5899f4f19
[build, cleanup] Refactor
Closes #3835, #3837
3 years ago
Felix S 92922fe7f9
[rumble] Extract subtitles (#3823)
Closes #3132
Authored by: fstirlitz
3 years ago
pukkandan c487cf0010
[cleanup] Misc 3 years ago
pukkandan 415f8d51a8
Ensure pre-processor errors do not block video download
Closes #2875
3 years ago
pukkandan ca6d59d2c1
Fix `--simulate --max-downloads`
Bug in c3e6ffba53
Closes #3815
3 years ago
pukkandan 1a8cc83735
Bugfix for 3a408f9d19 3 years ago
pukkandan 2762dbb17e
[compat] Add `functools.cached_property` 3 years ago
pukkandan 666c36d58d
Bugfix for 23326151c4 3 years ago
adamanldo 854b0d325e
[StreamCZ] Fix extractor (#3789)
Closes #3579
Authored by: dirkf, adamanldo
3 years ago
Elyse 79c318937b
[ina] Fix extractor (#3807)
Closes #2463
Authored by: elyse0
3 years ago
Jeff Huffman 88d62206b4
[crunchyroll:beta] Fix extractor after API change (#3801)
Closes #2052
Authored by: Burve, tejing1
3 years ago
pukkandan e79969b242
Return an error code if update fails
Closes #3802
3 years ago
pukkandan 53973b4d2c
[utils] Fix bug in 0b9c08b47b
* Cache of `supports_terminal_sequences` must be reset after enabling VT mode
* and move `windows_enable_vt_mode` to utils to avoid cyclic imports
3 years ago
pukkandan b801cd7179
[tiktok] Detect embeds
Closes #3799
3 years ago
pukkandan 0b9c08b47b
[utils] Improve performance using `functools.cache`
Closes #3786
3 years ago
pukkandan 2f97cc615b
[utils] `ISO3166Utils`: Add `EU` and `AP`
Fixes https://github.com/yt-dlp/yt-dlp/pull/3302#discussion_r875528517
3 years ago
pukkandan 2dd5a2e3a1
[doc, cleanup] Re-indent "Usage and Options" section 3 years ago
pukkandan 23326151c4
Add option --retry-sleep (#3059)
Closes #2852
3 years ago
pukkandan 9e49146352
Add option `--alias` 3 years ago
github-actions 926ccc84ef [version] update
Created by: pukkandan

:ci skip all
3 years ago
pukkandan 21633673c3
[cleanup] Minor fixes 3 years ago
pukkandan 80e8493ee7
[utils] `is_html`: Handle double BOM
Closes #2885
3 years ago
pukkandan aedaa455d9
[vimeo] Fix extractors
Closes #3037, Closes #2858, Closes #2880, Closes #3712
May also fix #3602, #3360
3 years ago
pukkandan d6bf1161db
[generic] Refactor `_extract_rss`
Closes #3738
3 years ago
pukkandan 7896214c42
Bugfix for 591bb9d355
Closes #3769
3 years ago
pukkandan 5792c950bf
[compat] Implement `compat.imghdr`
Python 3.11 deprecates `imghdr` module
3 years ago
pukkandan 591bb9d355
Fix color in `-q -F`
and convert `ydl._out_files`/`ydl._allow_colors` to `Namespace`

Closes #3761
3 years ago
coletdjnz 5faf6528fb
[http] Fix bug in retrying on read timeout in py < 3.10
socket.timeout is not an alias of TimeoutError in py < 3.10
Fixes bug in a2e77303e3
Authored-by: coletdjnz
3 years ago
pukkandan 0fa7d2c8e4
Bugfix for 2414649192 3 years ago
pukkandan b2a2d91310
[adobepass] Allow cookies for authenticating MSO
Possible workaround for #1034
3 years ago
pukkandan 490110c543
`--max-downloads` should obey `--break-per-input` 3 years ago
pukkandan 2414649192
[cleanup] Misc cleanup 3 years ago
pukkandan 5d5c0f7e99
[Hotstar] Bugfix for a1ddaa899c
Closes #3595
3 years ago
Dzmitry Neviadomski 3ac7b66047
[goodgame] Add extractor (#3686)
Authored by: nevack
3 years ago
P-reducible c9b2b368b3
[rokfin:search] Add extractor (#2992)
Authored by: P-reducible, pukkandan
3 years ago
pukkandan e037c405ad
[rokfin] Implement login (#2992)
Authored by: P-reducible, pukkandan
3 years ago
Conner 4bf72cc1c9
[Podchaser] Add extractors (#3665)
Authored by; connercsbn
3 years ago
Elyse 25f0e68f97
[wat] Fix extraction of multi-language videos and subtitles (#3739)
Closes #982, closes #1683
Authored by: elyse0
3 years ago
Elyse 3358f89361
[adn] Update AES key (#3743)
Closes #2002
Authored by: elyse0
3 years ago
Henrik Heimbuerger f3b3fe16af
[nebula] Add support for subscriptions (#3719)
Closes #3609 
Authored by: hheimbuerger
3 years ago
Jordan Weatherby d1c4f6d4da
[youtube] Added piped instance urls (#3714)
Closes #3661
Authored by: JordanWeatherby
3 years ago
pukkandan 82d020804d
[extractor] Use classmethod/property where possible
and refactor lazy extractors accordingly.

This reduces the need to create extractor instances
3 years ago
Filip Hedman 7ddbf09c25
[DRTV] Improve `_VALID_URL` (#3708)
Authored by: vertan
3 years ago
pukkandan 2e4585da92
[cookies] Throttle progress-bar
Closes #3710
3 years ago
pukkandan 8dcce6a89c
[extractor] Document netrc machines
Closes #3169
3 years ago
pukkandan 494f52308b
[FixupM3u8] Obey `--hls-prefer-mpegts`
Closes #3697
3 years ago
pukkandan 3d38b2d6d0
Fix `--date today`
Closes #3704
3 years ago
pukkandan 3a408f9d19
Show name of downloader in verbose log
Closes #3703
3 years ago
pukkandan d76fa1f3d4
[cookies] Allow `cookiefile` to be a text stream
Closes #3674
3 years ago
pukkandan fe1daad3cb
Bugfix for 59f943cd50
Fixes: 59f943cd50 (commitcomment-73251597)
3 years ago
pukkandan 0f06bcd759
[cleanup] Minor fixes (See desc)
* [youtube] Fix `--youtube-skip-dash-manifest`
* [build] Use `$()` in `Makefile`. Closes #3684
* Fix bug in 385ffb467b
* Fix bug in 43d7f5a5d0
* [cleanup] Remove unnecessary `utf-8` from `str.encode`/`bytes.decode`
* [utils] LazyList: Expose unnecessarily "protected" attributes
and other minor cleanup
3 years ago
ca-za d239db0306
[toggo] Improve `_VALID_URL` (#3689)
Authored by: ca-za
3 years ago
pukkandan 385ffb467b
[wistia] Fix `_VALID_URL`
Closes #2866
Authored by: dirkf
3 years ago
Evan Spensley 5f8ea7e0d8
[Jamendo] Extract more metadata (#3672)
Authored by: evansp
3 years ago
pukkandan d7a1aa00c6
Run `FFmpegFixupM3u8PP` for live-streams if needed
Closes #3669
3 years ago
MMM 5747d4f4e8
[kaltura] Update API calls (#3657)
Authored by: flashdagger
3 years ago
Lesmiscore 1f8b4ab733
[radiko] Fix extractor (#3655)
Authored by: Lesmiscore
3 years ago
pukkandan d4736fdb43
Remove warning for videos with an empty title 3 years ago
pukkandan 895aeb71d7
[toggo] Fix `_VALID_URL`
Closes #2610
3 years ago
pukkandan 4f28b537d9
Allow use of weaker ciphers with `--legacy-server-connect`
Closes #2043
3 years ago
pukkandan 6b70527f9d
[cleanup, zingmp3] Refactor extractors 3 years ago
Teemu Ikonen a0fe51d562
[ruutu] Support hs.fi embeds (#3547)
Authored by: tpikonen, pukkandan
3 years ago
diegorodriguezv bd18c5d170
[cleanup, tmz] Update tests (#3654)
Authored by: diegorodriguezv
3 years ago
Ha Tien Loi 54044decd0
[ZingMp3] Add chart and user extractors (#3423)
Authored by: hatienl0i261299
3 years ago
Ha Tien Loi 89f383c4ee
[gronkh] Add playlist extractors (#3337)
Closes #3300
Authored by: hatienl0i261299
3 years ago
pukkandan 91e5e839d3
[youtube] Deprioritize format 22
Reduces chance of encountering #3372
3 years ago
FestplattenSchnitzel 10fa2471fc
[VideocampusSachsen] Improve extractor (#3604)
Authored by: FestplattenSchnitzel
3 years ago
i6t ff4d7860d5
[iwara] Add playlist extractors (#3639)
Authored by: i6t
3 years ago
rand-net 4f7a98c565
[KhanAcademy] Fix extractor (#3462)
Authored by: rand-net
3 years ago
Lesmiscore b58f8d8f2c
[TVer] Improve extraction (#3634)
Authored by: Lesmiscore
3 years ago
Ha Tien Loi f963b7ab18
[Likee] Add extractor (#3625)
Closes #3603
Authored by: hatienl0i261299
3 years ago
pukkandan 86925f6334
[Fifa] Sort formats
Closes #3632
3 years ago
m4tu4g 468f104ce7
[masters] Add extractor (#3358)
Closes #3240
Authored by: m4tu4g
3 years ago
Bricio cbc6ee10da
[Fifa] Add Extractor (#3414)
Closes #3408
Authored by: Bricio
3 years ago
nyuszika7h 6ef5ad9e29
[trovo] Update to new API (#3509)
Closes #3457
Authored by: nyuszika7h
3 years ago
coletdev bb58c9ed5c
Add support for SSL client certificate authentication (#3435)
Adds `--client-certificate`, `--client-certificate-key`, `--client-certificate-password`

Authored-by: coletdjnz
Co-authored-by: df <fieldhouse@gmx.net>
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>
3 years ago
coletdev afac4caa7d
Fix redirect HTTP method handling (#3577)
Authored by: coletdjnz
3 years ago
HE7086 b4f536626a
[BilibiliLive] Add extractor (#3406)
Authored by: HE7086, pukkandan
3 years ago