Commit Graph

2580 Commits (1fc089143c79b02b8373ae1d785d5e3a68635d4d)

Author SHA1 Message Date
Lesmiscore c7e4ab278a
[extractor/niconico] Always use HTTPS for requests
This prevents MITM attacks from malicious parties like insane ISPs

Closes #5469
2 years ago
pukkandan e9ce4e9250
[extractor/foxnews] Add `FoxNewsVideo` extractor
Closes #5133
2 years ago
pukkandan 5da08bde9e
[extractor/vlive] Extract `release_timestamp`
Closes #5424
2 years ago
pukkandan ff48fc04d0
[update] Use error code 100 for update errors
This error code was previously used for
"Exiting to finish update", but is no longer used

Closes #5198
2 years ago
pukkandan 46d09f8707
[cleanup] Lint and misc cleanup 2 years ago
pukkandan db4678e448
Update to ytdl-commit-de39d128
[extractor/ceskatelevize] Back-port extractor from yt-dlp
de39d1281c

Closes #5361, Closes #4634, Closes #5210
2 years ago
zulaport a349d4d641
[extractor/stripchat] Fix hostname for HLS stream (#5445)
Closes #5227 
Authored by: zulaport
2 years ago
Matthew ac8e69dd32
Do not backport Python 3.10 SSL configuration for LibreSSL (#5464)
Until further investigation.

Fixes regression in 5b9f253fa0

Authored by: coletdjnz
2 years ago
bashonly 96b9e9cf62
[extractor/telegram] Add playlist support and more metadata (#5358)
Authored by: bashonly, bsun0000
2 years ago
Jeff Huffman cb1553e966
[extractor/crunchyroll] Beta is now the only layout (#5294)
Closes #5292
Authored by: tejing1
2 years ago
Alex Karabanov 0d2a0ecac3
[extractor/listennotes] Add extractor (#5310)
Closes #5262
Authored by: lksj, pukkandan
2 years ago
changren-wcr c94df4d19d
[extractor/qingting] Add extractor (#5329)
Closes #5323
Authored by: changren-wcr, bashonly
2 years ago
lauren 728f4b5c2e
[extractor/tvp] Update extractors (#5346)
Closes #5328
Authored by: selfisekai
2 years ago
Kevin Wood 8c188d5d09
[extractor/redgifs] Refresh auth token for 401 (#5352)
Closes #5351
Authored by: endotronic, pukkandan
2 years ago
Bruno Guerreiro e14ea7fbd9
[extractor/youtube] Update piped instances (#5441)
Closes #5286
Authored by: Generator
2 years ago
Richard Gibson 7053aa3a48
[extractor/epoch] Support videos without data-trailer (#5387)
Closes #5359
Authored by: gibson042, pukkandan
2 years ago
HobbyistDev 049565df2e
[extractor/swearnet] Add extractor (#5371)
Authored by: HobbyistDev
2 years ago
CrankDatSouljaBoy cc1d3bf96b
[extractor/deuxm] Add extractors (#5388)
Authored by: CrankDatSouljaBoy
2 years ago
Matthew 5b9f253fa0
Backport SSL configuration from Python 3.10 (#5437)
Partial fix for https://github.com/yt-dlp/yt-dlp/pull/5294#issuecomment-1289363572, https://github.com/yt-dlp/yt-dlp/issues/4627

Authored by: coletdjnz
2 years ago
nixxo d715b0e413
[extractor/skyit] Fix extractors (#5442)
Closes #5392
Authored by: nixxo
2 years ago
Matthew 6141346d18
[extractor/youtube] Update playlist metadata extraction for new layout (#5376)
Fixes https://github.com/yt-dlp/yt-dlp/issues/5373

Authored by: coletdjnz
2 years ago
MMM 59a0c35865
[extractor/lbry] Authenticate with cookies (#5435)
Closes #5431
Authored by: flashdagger
2 years ago
Lesmiscore da9a60ca0d
[extractor/twitcasting] Fix `data-movie-playlist` extraction (#5453)
Authored by: Lesmiscore
2 years ago
sam 0d113603ac
[extractor/oftv] Add extractors (#5134)
Closes #5017
Authored by: DoubleCouponDay
2 years ago
pukkandan 2e30b46fe4
[extractor/youtube] Improve chapter parsing from description
Closes #5448
2 years ago
bashonly 68a9a450d4
[extractor/genius] Add extractors (#5221)
Closes #5209
Authored by: bashonly
2 years ago
sam ed13a772d7
[extractor/bbc] Support onion domains (#5211)
Authored by: DoubleCouponDay
2 years ago
lauren 78545664bf
[extractor/agora] Add extractors (#5101)
Authored by: selfisekai
2 years ago
pukkandan f72218c199
[extractor/bitchute] Simplify extractor (#5066)
* Check alternate domains when a URL does not work
* Obey `--no-check-formats`
* Remove webseeds (doesnt seem to exist anymore)

Authored by: flashdagger, pukkandan

Co-authored-by: Marcel <flashdagger@googlemail.com>
2 years ago
James Woglom 58fb927ebd
[kaltura] Support playlists (#4986)
Authored by: jwoglom, pukkandan
2 years ago
pukkandan 62b8dac490
[extractor] Improve `_generic_title` 2 years ago
Lesmiscore 682b4524bf
[extractor/japandiet] Add extractors (#5368)
Authored by: Lesmiscore
2 years ago
nosoop 9da6612b0f
[extractor/youtube] Fix `duration` for premieres (#5382)
Closes #5378
Authored by: nosoop
2 years ago
coletdjnz e63faa101c
[extractor/youtube] Fix `live_status` extraction for playlist videos
Regression in 867c66ff97

Authored by: coletdjnz
2 years ago
pukkandan 497074f044
Write API params in debug head 2 years ago
pukkandan c90c5b9bdd
[extractor/bilibili] Add chapters and misc cleanup (#4221)
Authored by: lockmatrix, pukkandan
2 years ago
Locke ad97487606
[extractor/bilibili] Fix BilibiliIE and Bangumi extractors (#4945)
Closes #1878, #4071, #4397
Authored by: lockmatrix, pukkandan
2 years ago
HobbyistDev e091fb92da
[extractor/mlb] Add `MLBArticle` extractor (#4832)
Closes #3475
Authored by: HobbyistDev
2 years ago
Alex Karabanov c9bd65185c
[extractor/zenyandex] Fix extractors (#3750, #5268)
Closes #3736
Authored by:  lksj, puc9, pukkandan

Co-authored-by: puc9 <51006296+puc9@users.noreply.github.com>
2 years ago
bashonly c66ed4e2e5
[extractor/americastestkitchen] Fix extractor (#5343)
Fix `_VALID_URL` and season extraction

Closes #5343
Authored by: bashonly
2 years ago
pukkandan 2530b68d44
[extractor/iprima] Make json+ld non-fatal
Closes #5318

Authored by: bashonly
2 years ago
m4tu4g 385adffcf5
[extractor/zee5] Improve `_VALID_URL` (#5316)
Authored by: m4tu4g
2 years ago
pukkandan 0c908911f9
[extractor/redgifs] Fix extractors
Superseeds f47cf86eff

Closes #5311

Authored by: bashonly
2 years ago
m4tu4g c13a301a94
[extractor/zeenews] Add extractor (#5289)
Closes #4967 
Authored by: m4tu4g, pukkandan
2 years ago
pukkandan f47cf86eff
[extractor/redgifs] Fix extractors
Closes #5202, closes #5216
2 years ago
Simon Sawicki 7a26ce2641
[extractor/twitter] Add Spaces extractor and GraphQL API (#5247, #4864)
Closes #1605, Closes #5233, Closes #1249

Authored by: Grub4K, nixxo, bashonly, pukkandan

Co-authored-by: bashonly <88596187+bashonly@users.noreply.github.com>
Co-authored-by: nixxo <nixxo@protonmail.com>
2 years ago
bashonly 3639df54c3
[extractor/paramountplus] Update API token (#5285)
Closes #5273
Authored by: bashonly
2 years ago
Anant Murmu a4713ba96d
[extractor/voot] Improve `_VALID_URL` (#5283)
Authored by: freezboltz
2 years ago
bsun0000 5318156f1c
[extractor/youtube] Mark videos as fully watched
Closes #2555
Authored by: bsun0000
2 years ago
pukkandan d5d1df8afd
[cleanup Misc
Closes #5162
2 years ago
pukkandan cd5df121f3
[SponsorBlock] Relax duration check for large segments 2 years ago
pukkandan a7ddbc0475
[ModifyChapters] Handle the entire video being marked for removal
Closes #5238
2 years ago
pukkandan 8fab23301c
[SponsorBlock] Obey `--retry-sleep extractor` 2 years ago
pukkandan 1338ae3ba3
[SponsorBlock] Add `type` field 2 years ago
Ajay Ramachandran 63c547d71c
[SponsorBlock] Support `chapter` category (#5260)
Authored by: ajayyy, pukkandan
2 years ago
pukkandan 814bba3933
[downloader/fragment] HLS download can continue without first fragment
Closes #5274
2 years ago
cruel-efficiency 2576d53a31
Fix end time of clips (#5255)
Closes #5256
Authored by: cruel-efficiency
2 years ago
Matthew 217753f4aa
[extractor/YoutubeWebArchive] Improve metadata extraction (#4968)
Closes https://github.com/yt-dlp/yt-dlp/issues/4574

Authored by: coletdjnz
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>
2 years ago
Vitaly Khabarov 42a44f01c3
[extractor/Fox] Extract thumbnail (#5243)
Closes #1679
Authored by: vitkhab
2 years ago
pukkandan 9b9dad119a
[outtmpl] Ensure ASCII in json and add option for Unicode
Closes #5236
2 years ago
Matthew 6dca2aa66d
[extractor/generic:quoted-html] Add extractor (#5213)
Extracts embeds from escaped HTML within `data-html` attribute.
Related: https://github.com/ytdl-org/youtube-dl/issues/21294, https://github.com/yt-dlp/yt-dlp/pull/5121

Authored by: coletdjnz
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>
2 years ago
pukkandan 6678a4f0b3
[extractor/youtube] Fix live_status
Bug in 4d37720a0c
2 years ago
pukkandan d51b2816e3
[extractor/iq] Increase phantomjs timeout
Closes #5161
2 years ago
lauren 34f00179db
[extractor/cda]: Support login through API (#5100)
Authored by: selfisekai
2 years ago
pukkandan 5225df50cf
[extractor/youtube:tab] Let `approximate_date` return timestamp 2 years ago
pukkandan 94dc8604dd
Do more processing in `--flat-playlist` 2 years ago
Simon Sawicki a71b812f53
[utils] `js_to_json`: Improve escape handling (#5217)
Authored by: Grub4K
2 years ago
sam c6989aa3ae
[extractor/aeon] Add extractor (#5205)
Closes #1653
Authored by: DoubleCouponDay
2 years ago
pukkandan a79bf78397
[extractor/tnaflix] Fix 09c127ff83
Closes #5188
2 years ago
sam 82fb2357d9
[extractor/twitter] Add onion site to `_VALID_URL` (#5208)
See #3053
Authored by: DoubleCouponDay
2 years ago
Simon Sawicki 13b2ae29c2
[extractor/twitter] Support multi-video posts (#5183)
Closes #5157, Closes #5147
Authored by: Grub4K
2 years ago
Simon Sawicki 36069409ec
[cookies] Improve `LenientSimpleCookie` (#5195)
Closes #5186 
Authored by: Grub4K
2 years ago
pukkandan 0468a3b325
[jsinterp] Improve separating regex
Fixes https://github.com/yt-dlp/yt-dlp/issues/4635#issuecomment-1273974909
2 years ago
pukkandan d509c1f5a3
[utils] `strftime_or_none`: Workaround Python bug on Windows
CLoses #5185
2 years ago
schnusch 2c98d99818
[extractors/podbayfm] Add extractor (#4971)
Authored by: schnusch
2 years ago
bashonly 226c0f3a54
[extractor/sbs] Improve `_VALID_URL` (#5193)
Closes #5045
Authored by: bashonly
2 years ago
pukkandan ade1fa70cb
[extractor/generic] Separate embed extraction into own function (#5176) 2 years ago
Matthew 4c9a1a3ba5
[extractor/wordpress:mb.miniAudioPlayer] Add embed extractor (#5087)
Closes https://github.com/yt-dlp/yt-dlp/issues/4994

Authored by: coletdjnz
2 years ago
Simon Sawicki 1d55ebabc9
[extractor/common] Fix `json_ld` type checks (#5145)
Closes #5144, #5143
Authored by: Grub4K
2 years ago
tkgmomosheep f324fe8c59
[extractor/viu] Support subtitles of on-screen text (#5173)
Authored by: tkgmomosheep
2 years ago
HobbyistDev 866f037344
[extractor/nos.nl] Add extractor (#4822)
Closes #4649
Authored by: HobbyistDev
2 years ago
Marenga 5d14b73491
[VK] Fix playlist URLs (#4930)
Closes #2825
Authored by: the-marenga
2 years ago
Teemu Ikonen 540236ce11
[extractor/screen9] Add extractor (#5137)
Authored by: tpikonen
2 years ago
Simon Sawicki 7b0127e1e1
[utils] `traverse_obj`: Allow `re.Match` objects (#5174)
Authored by: Grub4K
2 years ago
Simon Sawicki f99bbfc983
[utils] `traverse_obj`: Always return list when branching (#5170)
Fixes #5162
Authored by: Grub4K
2 years ago
bashonly 3b55aaac59
[extractor/tubitv] Better DRM detection (#5171)
Closes #5128
Authored by: bashonly
2 years ago
bashonly 2e565f5bca
[extractor/reddit] Add fallback format (#5165)
Closes #5160
Authored by: bashonly
2 years ago
Noah e02e6d86db
[embedthumbnail] Fix thumbnail name in mp3 (#5163)
Authored by: How-Bout-No
2 years ago
Matthew 867c66ff97
[extractor/youtube] Extract concurrent view count for livestreams (#5152)
Adds new field `concurrent_view_count`
Closes https://github.com/yt-dlp/yt-dlp/issues/4843

Authored by: coletdjnz
2 years ago
bashonly f03940963e
[extractor/dplay] Add MotorTrendOnDemand extractor (#5151)
Closes #5141
Authored by: bashonly
2 years ago
Sergey 09c127ff83
[extractor/Tnaflix] Fix for HTTP 500 (#5150)
Closes #5107
Authored by: SG5
2 years ago
pukkandan aebb4f4ba7
Fix for formats=None
Fixes: https://github.com/yt-dlp/yt-dlp/pull/4965#issuecomment-1267682512
2 years ago
invertico bf2e1ec67a
[extractor/livestreamfails] Support posts (#5139)
Authored by: invertico
2 years ago
pukkandan 1305b659ef
[extractor/detik] Avoid unnecessary extraction 2 years ago
github-actions 57fb88093e [version] update
Created by: pukkandan

:ci skip all :ci run dl
2 years ago
gamer191 304ad45a9b
[cleanup] Misc (#5044)
Authored by: gamer191, pukkandan
2 years ago
coletdjnz 34859e4b32
[extractor/onenewsnz] Add extractor (#5088)
Authored by: coletdjnz
2 years ago
columndeeply 143a2ccab3
[extractor/prankcast] Add extractor (#4774)
Authored by: columndeeply, HobbyistDev
2 years ago
coletdjnz 1e0daeb314
[extractor/24tv.ua] Add extractors (#5121)
Closes #4287
Authored by: coletdjnz
2 years ago
HobbyistDev 7f5b3cb8b3
[extractor/booyah] Add extractor (#4834)
Closes #4583
Authored by: HobbyistDev, elyse0
2 years ago
jhwgh1968 c53e5cf59f
[extractor/redgifs] Fix extractor (#4892)
Closes #4805
Authored by: jhwgh1968
2 years ago
HobbyistDev c7f540ea1e
[extractor/detik] Generalize extractors (#4899)
Authored by: HobbyistDev, coletdjnz
2 years ago
Locke 12f153a827
[extractor/BilibiliSpace] Fix extractor, better error message (#5043)
Closes #5038
Authored by: lockmatrix
2 years ago
Bobscorn 0d887f273a
[extractor/IsraelNationalNews] Add extractor (#5089)
Closes #4019
Authored by: Bobscorn
2 years ago
Lesmiscore 4d37720a0c
[extractor/youtube] Download `post_live` videos from start (#5091)
* The fragments are generated as a `LazyList`. So only the required formats are expanded during download, but all fragment lists are printed/written in infojson.
* The m3u8 formats which cannot be downloaded from start are not extracted by default, but can be enabled with an extractor-arg. The extractor-arg `include_live_dash` is renamed to `include_incomplete_formats` to account for this new use-case.

Closes #1564
Authored by: Lesmiscore, pukkandan
2 years ago
bashonly dd4411aac2
[extractor/nfl] Fix extractor (#5130)
Closes #1708
Authored by: bashonly
2 years ago
Livia Medeiros 1d77d8ce07
[extractor/holodex] Fix `_VALID_URL` (#4948)
Authored by: LiviaMedeiros
2 years ago
pukkandan a057779d5e
[cleanup] Minor fixes
Closes #5129, Closes #4982
2 years ago
coletdjnz 7474e4531e
[extractor/AmazonStore] Fix JSON extraction (#5111)
Fixes https://github.com/yt-dlp/yt-dlp/issues/5110

Authored by: coletdjnz
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>
2 years ago
coletdjnz d3a3d7f0cc
[extractor/JWPlatform] Fix extractor (#5112)
Fix bitrate and filesize extraction and support embeds with unquoted urls.

Related: #5106 

Authored by: coletdjnz
2 years ago
bashonly 8671f995cc
[extractor/paramountplus] Better DRM detection (#5126)
Closes #5119
Authored by: bashonly
2 years ago
bashonly 4a61501db9
[extractor/anvato] Fix extractor and refactor (#5074)
Authored by: bashonly
2 years ago
m4tu4g 7244895bde
[extractor/zee5] Fix `_VALID_URL` (#5124)
Closes #4612
Authored by: m4tu4g
2 years ago
sam 177662e0f2
[extractor/MicrosoftEmbed] Add extractor (#5082)
Closes #2638
Authored by: DoubleCouponDay
2 years ago
Fabi019 f48ab881f6
[extractor/bundesliga] Add extractor (#5094)
Closes #2339
Authored by: Fabi019
2 years ago
zenerdi0de eb2d9504b9
[extractor/tennistv] Fix timestamp (#5085)
Authored by: zenerdi0de
2 years ago
Nitish Kumar 8a04054647
[extractor/hrfensehen] Fix extractor (#5096)
Authored by: snapdgn
2 years ago
pukkandan 8b7fb8b60d
[extractor] Make search_json able to parse lists
Now `contains_pattern` can be set to `\[.+\]`
2 years ago
Teemu Ikonen a83333c432
[extractor/iltalehti] Add extractor (#5117)
Authored by: tpikonen
2 years ago
Dhruv 573a98d6f0
[extractor/bongacams] Update `_VALID_URL` (#5104)
Closes #5075
Authored by: 0xGodspeed
2 years ago
std-move af7a5eef2f
[downloader/aria2c] Fix filename containing leading whitespace (#5099)
Similar to eb55bad5a0, but for fragmented downloads
Authored by: std-move
2 years ago
Itachi 576faf00b2
[extractor/Mxplayer] Fix extractor (#4966)
Closes #4946
Authored by: itachi-19
2 years ago
nixxo 81b6102d20
[downloader/ism] Support ec-3 codec (#5004)
Closes #296
Authored by: nixxo
2 years ago
tobi1805 acf306d1f9
[extractor/tv2] Support new url format (#5063)
Closes #4973
Authored by: tobi1805
2 years ago
HobbyistDev 20a7304e4c
[extractor/unscripted] Add extractor (#5008)
Closes #4903
Authored by: HobbyistDev
2 years ago
Simon Sawicki 2e0f8d4f6e
[extractor/yandexvideopreview] Update _VALID_URL (#5084)
Closes #5065
Authored by: Grub4K
2 years ago
HobbyistDev 7e378287c4
[extractor/malltv] Fix video_id extraction (#4883)
Closes #4870
Authored by: HobbyistDev
2 years ago
Mehavoid 9cc5aed990
[extractor/trovo] Fix extractors (#4880)
Authored by: Mehavoid
Closes #4878
2 years ago
Elyse 48f535f5f8
[extractor/tencent] Add Iflix extractor (#4829)
Closes #4823
Authored by: elyse0
2 years ago
Teemu Ikonen 8dbad2a439
[extractor/audioboom] Support direct URLs and refactor (#4803)
Authored by: tpikonen, pukkandan
2 years ago
bashonly 11398b922c
[extractor/nbc] Add NBCStations extractor (#5077)
Closes #4571
Authored by: bashonly
2 years ago
Simon Sawicki dfea94f8f6
[extractor/crunchyroll:beta] Improve handling of hardsubs (#5041)
Closes #3397
Authored by: Grub4K
2 years ago
coletdjnz f1aae71568
[extractor/rcs] Fix embed extraction
Fixes https://github.com/yt-dlp/yt-dlp/issues/5076

Authored by: coletdjnz
2 years ago
Anant Murmu a5642f2c4a
[extractor/zee5] Generate device ids (#5062)
Closes #4937
Authored by: freezboltz
2 years ago
Julien Hadley Jack 10e2eb4f81
[extractor/ondemandkorea] Update `jw_config` regex (#5040)
Authored by: julien-hadleyjack
2 years ago
coletdjnz c9eba8075f
[extractor/wordpress:playlist] Add generic embed extractor (#5012)
Fixes https://github.com/yt-dlp/yt-dlp/issues/4955

Authored by: coletdjnz
2 years ago
Fabi019 9d69c4e4b4
[extractor/BerufeTV] Add extractor (#4921)
Closes #4632
Authored by: Fabi019
2 years ago
Timendum 292fdad297
[extractor/dplay:italy] Add default authentication (#5056)
Closes #2950

Authored by: Timendum
2 years ago
Kyle Anthony Williams c04cc2e28e
[extractor/soundcloud:search] More metadata in `--flat-playlist` (#4965)
Authored by: SuperSonicHub1
2 years ago
pukkandan 7a32c70d13
[cleanup] Fix flake8 and minor refactor
Issues from ab029d7e92, 1fb53b946c
2 years ago
pukkandan 709ee21417
[extractor/youtube] Do not warn on duplicate chapters
Eg: vYbaM8w8yzw
2 years ago
pukkandan 1fb53b946c
[extractor/youtube:tab] Improve continuation items extraction 2 years ago
pukkandan 1dd18a8808
[extractor/YoutubeShortsAudioPivot] Support `source` URLs
`ytshortsap:` is no longer needed
2 years ago
pukkandan 0a5095fe8d
[extractor/youtube:tab] Support `reporthistory` page
Closes #4929
2 years ago
pukkandan 0f60ba6e65
[extractor] Improve json+ld extraction
Related #5035
2 years ago
Simon Sawicki 1534aba865
[extractor/artetv] Remove duplicate stream urls (#5047)
Closes #4510
Authored by: Grub4K
2 years ago
coletdjnz 0ca0f88121
[extractor/heise] Fix extractor (#5029)
Fixes https://github.com/yt-dlp/yt-dlp/issues/1520
Authored by: coletdjnz
2 years ago
pukkandan 0500ee3d81
Don't download entire video when no matching `--download-sections` 2 years ago
pukkandan 46a5b335e7
[cookies] Let `_get_mac_keyring_password` fail gracefully
Closes #4915
2 years ago
pukkandan 914491b8e0
[utils] `Popen.run`: Fix default return in binary mode 2 years ago