Commit Graph

2795 Commits (3588be59cee429a0ab5c4ceb2f162298bb44147d)

Author SHA1 Message Date
Simon Sawicki 6839ae1f6d
[utils] `traverse_obj`: Fix more bugs
and cleanup uses of `default=[]`

Continued from b1bde57bef
2 years ago
LeoniePhiline c0cd13fb1c
[extractor/vimeo] Fix `playerConfig` extraction (#6203)
Authored by: bashonly, LeoniePhiline
Closes #6149
2 years ago
Ha Tien Loi f14c233348
[extractor/DouyuTV]: Use new API (#6074)
Authored by: hatienl0i261299
2 years ago
pukkandan 768a001781
[compat_utils] Simplify `EnhancedModule` 2 years ago
pukkandan acb1042a9f
[devscripts] Provide pyinstaller hooks
Closes #6185
2 years ago
Stefan Lobbenmeier f40e32fb1a
[extractor/servus] Rewrite extractor (#6036)
Closes #1076, closes #4240, closes #2748, closes #1045, closes #1498
Authored by: FrankZ85, Ashish0804, StefanLobbenmeier

Co-authored-by: FrankZ85 <43293037+FrankZ85@users.noreply.github.com>
2 years ago
bashonly e61acb40b2
[extractor/wrestleuniverse] Add extractors (#6158)
Authored by bashonly, Grub4K
Closes #6120

Co-authored-by: Simon Sawicki <contact@grub4k.xyz>
2 years ago
bashonly 7e68567e50
[downloader/hls] Allow extractors to provide AES key (#6158)
and related cleanup

Authored by: bashonly, Grub4K

Co-authored-by: Simon Sawicki <contact@grub4k.xyz>
2 years ago
JChris246 f7efe6dc95
[extractor/pornez] Handle relative URLs in iframe (#6171)
Authored by: JChris246
Closes #6162
2 years ago
Simon Sawicki b1bde57bef
[utils] `traverse_obj`: Fix several behavioral problems
See #6180 for further info

Authored by: Grub4K
2 years ago
pukkandan 88426d9446
[compat_utils] Improve `passthrough_module` 2 years ago
pukkandan f6a765ceb5
[dependencies] Standardize `Cryptodome` imports 2 years ago
pukkandan 754c84e2e4
Support module level `__bool__` and `property` 2 years ago
pukkandan 7aefd19afe
Make `title` completely non-fatal
Ref: https://github.com/yt-dlp/yt-dlp/pull/6158#discussion_r1096984349
2 years ago
Felix Yan fbbb5508ea
[extractor/huya] Support HD streams (#6172)
Authored by: felixonmars
2 years ago
OMEGA_RAZER c77df98b1a
[extractor/reddit] Support user posts (#6173)
Authored by: OMEGARAZER
2 years ago
Jeroen Jacobs d27bde9883
[extractor/GoPlay] Use new API (#6151)
Authored by: jeroenj
Closes #6032
2 years ago
sepro 0fe87a8730
[extractor/zdf] Use android API endpoint for UHD downloads (#6150)
Authored by: seproDev
2 years ago
Matumo 3b161265ad
[extractor/niconico] Add support for like history (#5705)
Authored by: Matumo, pukkandan
2 years ago
chio0hai 389896df85
[extractor/txxx] Add extractors (#5240)
Authored by: chio0hai
Closes #5021
2 years ago
pukkandan b032ff0f03
[extractor/youtube] Handle `consent.youtube` 2 years ago
pukkandan dad2210c0c
[extractor/youtube] Support `/live/` URL 2 years ago
Jasper Rebane 9cfdbcbf3f
[extractor/freesound] Workaround invalid URL in webpage (#6147)
Authored by: rebane2001
Closes #6146
2 years ago
lauren n. liberda 7543c9c99b
[extractor/twitter] Fix graphql extraction on some tweets (#6075)
Authored by: selfisekai
2 years ago
Simon Sawicki acacb57c7e [extractor/rumble] Fix format sorting
Closes #6119
Authored by: pukkandan
2 years ago
Simon Sawicki 776995bc10
[utils] `traverse_obj`: Various improvements
- Add `set` key for transformations/filters
- Add `re.Match` group names
- Fix behavior for `expected_type` with `dict` key
- Raise for filter function signature mismatch in debug

Authored by: Grub4K
2 years ago
pukkandan 8b008d6254
[jsinterp] Support `if` statements
Closes #6131
2 years ago
Lesmiscore 83c4970e52
[utils] Fix `time_seconds` to use the provided TZ (#6118)
Authored by: Lesmiscore, Grub4K

Fixes https://github.com/yt-dlp/yt-dlp/pull/6056
2 years ago
bashonly 8aa0bd5d10
[extractor/generic] Avoid catastrophic backtracking in KVS regex
Authored by: bashonly
2 years ago
Simon Sawicki 37e325b92f [utils] Use local kernel32 for file locking on Windows
Ref: https://github.com/ytdl-org/youtube-dl/issues/21545

Authored by: Grub4K
2 years ago
pukkandan 59d7de0da5
Fix `--concat-playlist`
Closes #6080
2 years ago
pukkandan 88d8928bf7
[plugins] Fix zip search paths
Closes #6011
2 years ago
bashonly 176a068cde
[extractor/nbc] Fix XML parsing
Python 3.7 compat bug in cb73b8460c
Authored by: bashonly
2 years ago
bashonly 5ab3534d44
[extractor/slideslive] Fix slides and chapters/duration (#6024)
* Fix slides/thumbnails extraction
* Extract duration to fix issues w/ `--embed-chapters`, `--split-chapters`
* Add `InfoExtractor._extract_mpd_vod_duration` method
* Expand applicability of `InfoExtractor._parse_m3u8_vod_duration` method
Authored by: bashonly
2 years ago
bashonly cb73b8460c
[extractor/nbc] Fix `NBC` and `NBCStations` extractors (#6033)
Improve `InfoExtractor._parse_smil_formats` extension detection
Closes #6019
Authored by: bashonly
2 years ago
bashonly 7481998b16
[extractor/drtv] Fix bug in ab4cbef (#6034)
Fixes bug in ab4cbef ab4cbeff00
Closes #5993
Authored by: bashonly
2 years ago
pukkandan 87ebab0615
[extractor/embedly] Embedded links may be for other extractors
Bug in bfd973ece3
Closes #5987
2 years ago
Marek Hudik 355d781bed
[extractor/rozhlas] Add extractor RozhlasVltavaIE (#5951)
Authored by: amra
2 years ago
github-actions 7287ab92f6 [version] update
Created by: pukkandan

:ci skip all :ci run dl
2 years ago
pukkandan edfc7725b1
[cleanup] Misc 2 years ago
JChris246 b382c1fc6a
[xanimu] Add extractor (#5969)
Authored by: JChris246
Closes #5810
2 years ago
Christoph Flathmann 8a6b167723
[extractor/crunchyroll:show] Add `language` to entries (#5687)
Authored by: Chrissi2812
2 years ago
mzhou 253ac4ba6a
[extractor/youtube] Retry manifest refresh for live-from-start (#5670)
Avoids ending download early when live stream is temporarily offline.
Best used with somewhat large `--retry-sleep extractor:` and `--extractor-retries`

Authored by: mzhou
2 years ago
George Schizas 84e0e33a19
[extractor/reddit] Add subreddit as `channel_id` (#5685)
Authored by: gschizas
Closes #5684
2 years ago
Frederik Nordahl Jul Sabroe ab4cbeff00
[extractor/drtv] Add series extractors (#5644)
Authored by: FrederikNS
Closes #3567
2 years ago
Simon Sawicki 773c272d66
Fix config locations (#5933)
Bug in 8e40b9d1ec
Closes #5953

Authored by: Grub4k, coletdjnz, pukkandan
2 years ago
Jacob Truman c3366fdfd0
[extractor/nbc] Update graphql query (#5952)
Closes #5918
Authored by: jacobtruman
2 years ago
Simon Sawicki 5be214abed
[update] Fix updater file removal on windows (#5970)
Reverts 2fb0f85868
Closes #5632
Authored by: Grub4K
2 years ago
HobbyistDev d37422f1db
[extractor/biliIntl] Add fallback to `video_data` (#5971)
Authored by: HobbyistDev
2 years ago
JC-Chung 933ed882e9
[extractor/tiktok] Add `TikTokLive` extractor (#5637)
Closes #3698
Authored by: JC-Chung
2 years ago
HobbyistDev a1d9aca338
[extractor/aitube] Add extractor (#5946)
Closes #5627
Authored by: HobbyistDev
2 years ago
HobbyistDev 91d54e9b99
[extractor/volejtv] Add extractor (#5943)
Authored by: HobbyistDev
Closes #5883
2 years ago
HobbyistDev 76c3ceccfb
[extractor/biliintl] Add `/media` to `VALID_URL` (#5939)
Authored by: HobbyistDev
2 years ago
pukkandan ad68b16a1e
[downloader/aria2c] Disable native progress
Closes #5931, closes #5928, Re-opens #2038
2 years ago
pukkandan f079514957
[utils] `windows_enable_vt_mode`: Better error handling
Closes #5927
2 years ago
pukkandan d80ca5deaa
[utils] `mimetype2ext`: weba is not standard
Fix bug in fbb7383306, 2647c933b8
Closes #5935
2 years ago
OndrejBakan 1a3cd8ec35
[extractor/joj] Fix extractor (#5934)
Authored by: OndrejBakan, pukkandan
2 years ago
github-actions 990dd7b00f [version] update
Created by: pukkandan

:ci skip all :ci run dl
2 years ago
pukkandan 08e29b9f1f
[cleanup] Misc
Closes #5576, closes #5887
2 years ago
pukkandan 8e174ba7de
[docs] Improvements
Closes #5846, closes #5774
2 years ago
bashonly 05997b6e98
[extractor/generic] Decode unicode-escaped embed URLs (#5919)
Authored by: bashonly
Closes #5854
2 years ago
Simon Sawicki 32a84bcf4e
Update to ytdl-commit-195f22f6
[generic] Improve KVS (etc) extraction
195f22f679

Closes #3716
Authored by: Grub4k, pukkandan
2 years ago
Matthew 8300774c4a
Add `--enable-file-urls` (#5917)
Closes https://github.com/yt-dlp/yt-dlp/issues/3675

Authored by: coletdjnz
2 years ago
bashonly d7f9871469
[extractor/iqiyi] Fix `Iq` JS regex (#5922)
Closes #5702
Authored by: bashonly
2 years ago
bashonly 13f930abc0
[extractor/fifa] Fix Preplay extraction (#5921)
Closes #5839
Authored by: dirkf
2 years ago
bashonly b23b503e22
[extractor/odnoklassniki] Extract subtitles (#5920)
Closes #5744
Authored by: bashonly
2 years ago
Matthew e756f45ba0
Improve handling for overriding extractors with plugins (#5916)
* Extractors replaced with plugin extractors now show in debug output
* Better testcase handling
* Added documentation
Authored by: coletdjnz, pukkandan
2 years ago
Lesmiscore 8c53322cda
[downloader/aria2c] Native progress for aria2c via RPC (#3724)
Authored by: Lesmiscore, pukkandan

Closes #2038
2 years ago
pukkandan 193fb150b7
Fix bug in 119e40ef64 2 years ago
pukkandan 26fdfc3704
[extractor/biliintl:series] Make partial download of series faster 2 years ago
pukkandan 78d25e0b7c
[extractor/embedly] Handle vimeo embeds
Closes #3360
2 years ago
pukkandan 2a06bb4eb6
Add `--compat-options 2021,2022`
Use these to guard against future compat changes. This allows devs to
change defaults and make other potentially breaking changes more easily.
If you need everything to work exactly as-is, put this in your config
2 years ago
pukkandan 88fb942577
Add message when there are no subtitles/thumbnails
Closes #5551
2 years ago
pukkandan 1cdda32998
[utils] `get_exe_version`: Detect broken executables
Authored by: dirkf, pukkandan
Closes #5561
2 years ago
coletdjnz 3e01ce744a
[extractor/generic] Use `Accept-Encoding: identity` for initial request
The existing comment seems to imply this was the desired behavior from the beginning.

Partial fix for https://github.com/yt-dlp/yt-dlp/issues/5855, https://github.com/yt-dlp/yt-dlp/issues/5851, https://github.com/yt-dlp/yt-dlp/issues/4748
2 years ago
Matthew 8e40b9d1ec
Improve plugin architecture (#5553)
to make plugins easier to develop and use:
* Plugins are now loaded as namespace packages.
* Plugins can be loaded in any distribution of yt-dlp (binary, pip, source, etc.).
* Plugin packages can be installed and managed via pip, or dropped into any of the documented locations.
* Users do not need to edit any code files to install plugins.
* Backwards-compatible with previous plugin architecture.

As a side-effect, yt-dlp will now search in a few more locations for config files.

Closes https://github.com/yt-dlp/yt-dlp/issues/1389

Authored by: flashdagger, coletdjnz, pukkandan, Grub4K
Co-authored-by: Marcel <flashdagger@googlemail.com>
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>
Co-authored-by: Simon Sawicki <accounts@grub4k.xyz>
2 years ago
pukkandan 2fb0f85868
[update] Workaround #5632 2 years ago
Stel Abrego a0e526ed4d
[extractor/bandcamp] Add `album_artist` (#5537)
Closes #5536 
Authored by: stelcodes
2 years ago
pukkandan 8d1ddb0805
[extractor/udemy] Fix lectures that have no URL and detect DRM
Closes #5662
2 years ago
pukkandan 9bb856998b
[extractor/youtube] Extract DRC formats 2 years ago
pukkandan fbb7383306
Add `weba` to known extensions 2 years ago
pukkandan ec54bd43f3
Fix bug in writing playlist info-json
Closes #4889
2 years ago
pukkandan f74371a97d
[extractor/bilibili] Fix `--no-playlist` for anthology
Closes #5797
2 years ago
ChillingPepper d5f043d127
[utils] js_to_json: Fix bug in f55523c (#5771)
Authored by: ChillingPepper, pukkandan
2 years ago
pukkandan fe74d5b592
Let `--parse/replace-in-metadata` run at any post-processing stage
Closes #5808, #456
2 years ago
pukkandan 119e40ef64
Add pre-processor stage `video`
Related: #456, #5808
2 years ago
pukkandan 4455918e7f
[extractor/stv] Detect DRM
Closes #5320
2 years ago
Anant Murmu efa944f4bc
[cleanup] Use `random.choices` (#5800)
Authored by: freezboltz
2 years ago
nosoop e107c2b8cf
[extractor/soundcloud] Support user permalink (#5842)
Closes #5841
Authored by: nosoop
2 years ago
Lesmiscore ca2f6e14e6
[extractor/BiliLive] Fix extractor
- Remove unnecessary group in `_VALID_URL`
- This extractor always returns livestreams
2 years ago
bashonly c1edb853b0
[extractor/kick] Add extractor (#5736)
Closes #5722
Authored by: bashonly
2 years ago
bashonly 2647c933b8
[extractor/wistia] Improve extension detection (#5415)
Closes #5053
Authored by: bashonly, Grub4k, pukkandan
2 years ago
bashonly 53006b35ea
[extractor/amazon] Add `AmazonReviews` extractor (#5857)
Closes #5766
Authored by: bashonly
2 years ago
bashonly 4b183d4962
[extractor/videoken] Add extractors (#5824)
Closes #5818
Authored by: bashonly
2 years ago
bashonly 3d667e0047
[extractor/slideslive] Support embeds and slides (#5784)
Authored by: bashonly, Grub4K, pukkandan
2 years ago
Sam 9a9006ba20
[extractor/twitcasting] Fix videos with password (#5894)
Closes #5888
Authored by: bashonly, Spicadox
2 years ago
HobbyistDev 153e88a751
[extractor/netverse] Add `NetverseSearch` extractor (#5838)
Authored by: HobbyistDev
2 years ago
JChris246 9fcd8ad1f2
[extractor/spankbang] Fix extractor (#5791)
Authored by: JChris246
Closes #5731
2 years ago
monnef 6b71d186dd
[extractor/curiositystream] Fix auth (#5730)
Authored by: mnn
2 years ago
lkw123 074b2fae90
[extractor/kankanews] Add extractor (#5729)
Authored by: synthpop123
2 years ago
Kurt Bestor 06a9d68eb8
[extractor/youku] Fix extractor (#5622)
Closes #4456
Authored by: KurtBestor
2 years ago
Damiano Amatruda a4d6ead30f
[extractor/ciscowebex] Support password-protected videos (#5601)
Authored by: damianoamatruda
2 years ago
lauren n. liberda d1b5f3d79c
[extractor/polskieradio] Adapt to next.js redesigns (#5416)
Authored by: selfisekai
2 years ago
lauren n. liberda da8d2de208
[extractor/cda] Support premium and misc improvements (#5529)
* Fix cache for non-ASCII key
* Improve error messages
* Better UA for fingerprint bypass

Authored by: selfisekai
2 years ago
chris 15e9e578c0
[extractor/ArteTV] Extract chapters (#5879)
Authored by: iw0nderhow, bashonly
2 years ago
Bobscorn 0ef3d47027
[extractor/beatbump] Add extractors (#5304)
Authored by: Bobscorn, pukkandan
Closes #4653
2 years ago
barsnick 247c8dd4f5
[extractor/urplay] Support for audio-only formats (#4606)
Closes #4605
Authored by: barsnick
2 years ago
HobbyistDev 032f22020c
[extractor/trtcocuk] Add extractor (#5009)
Closes #2635
Authored by: HobbyistDev
2 years ago
pukkandan 4af47a0003
Fix 9012d20b23 2 years ago
pukkandan 9012d20b23
[extractor/mixch] Support `--wait-for-video` 2 years ago
Giulio Muscarello d61ef7f343
[extractor/ARD] Add vtt subtitles (#5835)
Authored by: CapacitorSet
2 years ago
skbeh 1c226ccdd4
[extractor/bilibili] Improve `_VALID_URL` (#5820)
Authored by: skbeh
2 years ago
pukkandan 8791e78ccc
Fix `original_url` in playlists 2 years ago
pukkandan 69f5fe45b9
[FFmpegVideoConvertor] Add `gif` to `--recode-video` 2 years ago
pukkandan 0b5546c723
[extractor] Let `_extract_format` functions obey `--ignore-no-formats` 2 years ago
bashonly 1fc089143c
[extractor/reddit] Extract crossposted media (#5801)
Closes #5798
Authored by: bashonly
2 years ago
Lesmiscore 5424dbaf91
Deprioritize HEVC-over-FLV formats (#5823)
Authored by: Lesmiscore
2 years ago
Matthew c733555106
[extractor/youtube:tab] Extract metadata from channel items (#5569)
Authored by: coletdjnz
2 years ago
HobbyistDev 81388c0954
[extractor/oneplace] Add OnePlacePodcast extractor (#5549)
Closes #5543
Authored by: HobbyistDev
2 years ago
Denis df10bad267
[extractor/rutube] Support private videos (#5761)
Authored by: mexus
2 years ago
HobbyistDev f0f3fa028b
[extractor/netverse] Extract comments (#5568)
Authored by: HobbyistDev
2 years ago
HobbyistDev 22697a84f6
[extractor/europarl] Add EuroParlWebstream Extractor (#5547)
Authored by: HobbyistDev
Closes #4933
2 years ago
HobbyistDev 3ac5476430
[extractor/nosnl] Add support for /video (#5590)
Authored by: HobbyistDev
2 years ago
HobbyistDev e318b5b87a
[extractor/airtv] Add extractor (#5533)
Authored by: HobbyistDev
Closes #5132
2 years ago
bashonly f549b18512
[extractor/pinterest] Fix extractor (#5739)
Closes #1772
Authored by: bashonly
2 years ago
bashonly 7c5e1701f6
[extractor/foxsports] Fix extractor (#5719)
Closes #5714
Authored by: bashonly
2 years ago
bashonly 16bed382fd
[extractor/twitter] Heed `--no-playlist` for multi-video tweets (#5757)
Closes #5752
Authored by: bashonly, Grub4K
2 years ago
bashonly 3cf50fa8e9
[downloader/ffmpeg] Fix headers for video+audio formats (#5659)
Authored by: bashonly, Grub4K
2 years ago
bashonly f69b0554eb
[extractor/slideslive] Fix extractor (#5737)
Closes #1532
Authored by: bashonly, Grub4K
2 years ago
pukkandan e74a3c6dcc
[extractor/hotstar] Improve format metadata 2 years ago
pukkandan 7108221662
Add `ac4` to known codecs
Note: ffmpeg does not currently support this format

Related #5738
2 years ago
nixxo 10dc85924a
[extractor/mediaset] Better embed detection and error messages (#5664)
Authored by: nixxo
2 years ago
Vita b05f0a50e0
[extractor/yle_areena] Support restricted videos (#5735)
* and improve metadata

Closes #5734
Authored by: docbender
2 years ago
Elyse 3d79ebc8b7
[extractor/mediastream] Add extractor (#5640)
Closes #5532, closes #4431, closes #4425
Authored by: elyse0, HobbyistDev

Co-authored-by: HobbyistDev <tesutonihon4@gmail.com>
2 years ago
pukkandan b44cd29851
[jsinterp] Escape regex that looks like nested set
Closes #5749
2 years ago
milkknife 85a802969e
[extractor/webcamerapl] Add extractor (#5715)
Authored by: milkknife
2 years ago
nixxo 72f96c5566
[extractor/la7] Improve extractor (#5538)
Authored by: nixxo
Closes #5360
2 years ago
MMM 839e2a62ae
[extractor/rumble] Add RumbleIE extractor (#5515)
Closes #2846
Authored by: flashdagger
2 years ago
HobbyistDev 28b8f57b4b
[extractor/noice] Add NoicePodcast extractor (#5621)
Authored by: HobbyistDev
2 years ago
lkw123 dfc186d422
[extractor/xiami] Remove extractors (#5711)
Authored by: synthpop123
2 years ago
David Turner 42ec478fc4
[extractor/plutotv] Fix videos with non-zero start (#5745)
Authored by: digitall
2 years ago
pukkandan 7991ae57a8
[extractor/sibnet] Separate from VKIE
Fixes bfd973ece3 (commitcomment-91834251)
2 years ago
pukkandan 935bac1e4d
Fix `--cookies-from-browser` CLI parsing
Closes #5716
2 years ago
bashonly c4cbd3bebd
[extractor/tiktok] Update `_VALID_URL`, add `api_hostname` arg (#5708)
Closes #5706
Authored by: bashonly
2 years ago
pukkandan c53a18f016
[utils] windows_enable_vt_mode: Proper implementation
Authored by: Grub4K
2 years ago
pukkandan 71df9b7fd5
[cleanup] Misc 2 years ago
Benjamin Ryan c9f5ce5118
[extractor/tiktok] Update API hostname (#5690)
Closes #5688
Authored by: redraskal
2 years ago
bashonly ddf1e22d48
[extractor/swearnet] Fix description bug (#5681)
Bug in 049565df2e
Closes #5643
Authoried by: bashonly
2 years ago
bashonly 0e96b408b9
[extractor/reddit] Extract video embeds in text posts (#5677)
Closes #5612
Authored by: bashonly
2 years ago
bashonly ba72399723
[extractor/tiktok] Fix subs, `DouyinIE`, improve `_VALID_URL` (#5676)
Closes #5665, Closes #2267
Authored by: bashonly
2 years ago