Commit Graph

1886 Commits (5b28cef72db3b531680d89c121631c73ae05354f)

Author SHA1 Message Date
cgrigis 89e4d86171
[extractor/arte] Bug fix (#4769)
Closes #4768
Authored by: cgrigis
2 years ago
Shreyas Minocha a1af516259
[extractor/screencastomatic] Support `--video-password` (#4761)
Authored by: shreyasminocha
2 years ago
pukkandan 1d64a59547
[extractor/vimeo:user] Fix _VALID_URL
Closes #4758
2 years ago
pukkandan e5458d1d88
Fix lazy extractor bug in fe7866d0ed
and add test

Fixes https://github.com/yt-dlp/yt-dlp/pull/3234#issuecomment-1225347071
2 years ago
pukkandan 2516cafb28
Fix bug in fe7866d0ed 2 years ago
pukkandan fe7866d0ed
Add option `--use-extractors`
Deprecates `--force-generic-extractor`

Closes #3234, Closes #2044

Related: #4307, #1791
2 years ago
pukkandan 13db4e7b9e
[extractor/mixcloud] All formats are audio-only
Closes #4740
2 years ago
Joshua Lochner 07275b708b
[extractor/medaltv] Fix extraction (#4739)
Authored by: xenova
2 years ago
Elyse b85703d11a
[extractor/rtbf] Fix jwt extraction (#4738)
Closes #4683
Authored by: elyse0
2 years ago
pukkandan 992dc6b486
[jsinterp] Implement timeout
Workaround for #4716
2 years ago
pukkandan 8d1ad6378f
[extractor/BiliBiliSearch] Don't sort by date
Related #4682
2 years ago
pukkandan 2d1019542a
[extractor/BiliBiliSearch] Fix infinite loop
Closes #4682
2 years ago
pukkandan b25cac650f
[extractor/youtube] Fix bug in format sorting 2 years ago
pukkandan 90a1df305b
[test] Fix test_youtube_signature 2 years ago
pukkandan 0a6b4b82e9
[extractor/uktv] Improve _VALID_URL
Closes #4707
Authored by: dirkf
2 years ago
pukkandan 1704c47ba8
[extractor/bitchute] Mark errors as expected
Closes #4685
2 years ago
pukkandan a831c2ea90
[cleanup] Misc 2 years ago
bashonly 8a3da4c68c
[extractor/instagram] Fix bugs in 7d3b98be4c (#4701)
Authored by: bashonly
2 years ago
nixxo 4d37d4a77c
[extractor/rai] Minor fix (#4700)
Closes #4691, #4690
2 years ago
bashonly 7d3b98be4c
[extractor/instagram] Fix extraction (#4696)
Closes #4657, #4532, #4475
Authored by: bashonly, pritam20ps05
2 years ago
Elyse 2b3e43e247
[extractor/rtbf] Fix stream extractor (#4671)
Closes #4656
Authored by: elyse0
2 years ago
Alexander Seiler f60ef66371
[extractor/zattoo] Fix Zattoo resellers (#4675)
Closes #4630
Authored by: goggle
2 years ago
pukkandan 25836db6be
[extractor/youtube] Add fallback to phantomjs
Related #4635
2 years ago
pukkandan 587021cd9f
[phantomjs] Add function to execute JS without a DOM
Authored by: MinePlayersPE, pukkandan
2 years ago
pukkandan 580ce00782
[youtube] Improve signature caching
and refactor related functions
2 years ago
ChillingPepper 2f1a299c50
[extractor/SovietsCloset] Fix extractor (#4688)
Closes #4200 
Authored by: ChillingPepper
2 years ago
pukkandan f6ca640b12
[jsinterp] Fix for youtube player 1f7d5369
Closes #4635 again
2 years ago
pukkandan 3ce2933693
[youtube] Fix error reporting of "Incomplete data"
Related: #4669
2 years ago
pukkandan 5c6d2ef9d1
[youtube] Improve format sorting for IOS formats
When no itag/resolution is available for reference, use the closest resolution
2 years ago
pukkandan 1e4fca9a87
[cleanup] Misc 2 years ago
pukkandan 48732becfe
Fix bug in 1155ecef29 2 years ago
masta79 ef6342bd07
[extractor/toggo] Improve `_VALID_URL` (#4663)
Authored by: masta79
2 years ago
ischmidt20 e183bb8c9b
[extractor/MLB] New extractor (#4586)
Authored by: ischmidt20
2 years ago
HobbyistDev 7695f5a0a7
[extractor/moview] Add extractor (#4607)
Authored by: HobbyistDev
2 years ago
Ben Welsh cb7cc448c0
[extractor/truth] Add extractor (#4609)
Closes #3865
Authored by: palewire
2 years ago
bashonly 63be30e3e0
[extractor/facebook] Add reel support (#4660)
Closes #4039 
Authored by: bashonly
2 years ago
Ben Welsh 43cf982ac3
[extractor/parler] Add extractor (#4616)
Authored by: palewire
2 years ago
nixxo 7e82397441
[extractor/rai] Misc fixes (#4600)
Authored by: nixxo
2 years ago
Aldo Ridhoni 66c4afd828
[extractor/doodstream] Add `wf` domain (#4648)
Authored by: aldoridhoni
2 years ago
Lesmiscore 62b58c0936
[docs] Consistent use of `e.g.` (#4643)
Authored by: Lesmiscore
2 years ago
pukkandan 8f53dc44a0
[jsinterp] Handle new youtube signature functions
Closes #4635
2 years ago
Jacob Truman 1cddfdc52b
[extractor/aenetworks] Add formats parameter (#4645)
Closes #4047
Authored by: jacobtruman
2 years ago
coletdjnz cea4b857f0
[patreon] Ignore erroneous media attachments (#4638)
Fixes https://github.com/yt-dlp/yt-dlp/issues/4608
Authored by: coletdjnz
2 years ago
shirt ffcd62c289
[extractor/tubitv] Extract additional formats (#4646)
Authored by: shirt-dev
2 years ago
pukkandan 5da42f2b9b
[extractor/crunchyroll] Improve `_VALID_URL`s
Closes #4633
2 years ago
pukkandan 1155ecef29
[extractor/zattoo] Fix resellers
Fixes #4630
2 years ago
pukkandan 7e798d725e
[extractor] Fix format sorting of `channels` 2 years ago
pukkandan 16d4535abc
Update to ytdl-commit-adb5294
[aenetworks] Update _THEPLATFORM_KEY and _THEPLATFORM_SECRET
adb5294177
2 years ago
Elyse 2a5e5477bc
[extractor/redbee] Unify and update extractors (#4479)
Closes #4443
Authored by: elyse0
2 years ago
Eren Kemer e251986cbe
[extractor/harpodeon] Add extractor (#4540)
Closes #4450
Authored by: eren-kemer
2 years ago
coletdjnz c7dcf0b31e
[extractor/youtube] Add `androidSdkVersion` parameter to Android Innertube clients
Required to prevent YouTube returning a bad player response in some cases.

See: https://github.com/yt-dlp/yt-dlp/pull/4593, https://github.com/TeamNewPipe/NewPipe/issues/8713, https://github.com/iv-org/invidious/issues/3230, https://github.com/Tyrrrz/YoutubeExplode/issues/647

Authored by: coletdjnz
2 years ago
Djeson 298d9c0e89
[extractor/ninegag] Extract uploader (#4597)
Closes #4587
Authored by: DjesonPV
2 years ago
pukkandan a416623436
[extractor/youtube] Extract more format info 2 years ago
pukkandan b8ed0f15d4
[extractor] Add field `audio_channels` 2 years ago
pukkandan 22b22b7d5c
[extractor/WASDTV:record] Fix `_VALID_URL` 2 years ago
HobbyistDev 1f6b90ed8d
[extractor/tviplayer] Improve `_VALID_URL` (#4585)
Closes #4578
Authored by: HobbyistDev
2 years ago
coletdjnz a3e9642116
[extractor/youtube] Prevent redirect to unwanted videos (#4593)
Example: https://www.youtube.com/watch?v=aQvGIIdgFDM

Authored by: coletdjnz
2 years ago
pukkandan 43aebb7db4
Bugfix for bfd973ece3
`_extract_embed_urls` is not a list

Closes #4581
2 years ago
Yash Kumar 061a17abd3
[extractor/FIFA] Change API endpoint (#4577)
Closes #4566
Authored by: yashkc2025, Bricio
2 years ago
HobbyistDev d380fc1614
[extractor/kompas] Add extractor (#4562)
Authored by: HobbyistDev
2 years ago
HobbyistDev ad26f15a06
[extractor/vidio] Support embed link (#4564)
Authored by: HobbyistDev
2 years ago
Bojidar Qnkov aeaf905e22
[extractor/NovaPlay] Fix extractor (#4415)
Closes #4439
Authored by: Bojidarist
2 years ago
Jeff Huffman f62f553d46
[extractor/crunchyroll:beta] Use streams API (#4555)
Closes #4452
Authored by: tejing1
2 years ago
pukkandan 4080efeb01
[extractor/vimeo] Bugfix in bfd973ece3 2 years ago
Jeff Huffman b99ba3df09
[extractor/crunchyroll:beta] Extract timestamp and fix tests (#4535)
Closes #4533
Authored by: tejing1
2 years ago
coletdjnz a0c830f488
[extractor/youtube] Bump Innertube client versions
YouTube may be requiring new versions soon. See https://github.com/iv-org/invidious/issues/3230, https://github.com/TeamNewPipe/NewPipe/issues/8713

Authored by: coletdjnz
2 years ago
Galiley d8657ff76f
[extractor/xfileshare] Add Referer (#4494)
Authored by: Galiley
2 years ago
pukkandan 5770293d25
[extractor/orf:radio] Rewrite extractors
Closes #4522
2 years ago
pukkandan 0647d9251f
Minor bugfixes 2 years ago
pukkandan be5c1ae862
Standardize retry mechanism (#1649)
* [utils] Create `RetryManager`
* Migrate all retries to use the manager
* [extractor] Add wrapper methods for convenience
* Standardize console messages for retries
* Add `--retry-sleep` for extractors
2 years ago
pukkandan bfd973ece3 [extractors] Use new framework for existing embeds (#4307)
`Brightcove` is difficult to migrate because it's subclasses may depend
on the signature of the current functions. So it is left as-is for now

Note: Tests have not been migrated
2 years ago
pukkandan 1e8fe57e5c [extractor] Support multiple archive ids for one video (#4307)
Closes #4352
2 years ago
pukkandan f14a2d8382 [extractor/html5] Separate into own extractor (#4307)
Closes #4291

Authored by: coletdjnz, pukkandan
2 years ago
pukkandan 5fff2e576f [extractor/camtasia] Separate into own extractor (#4307)
Authored by: coletdjnz
2 years ago
pukkandan f2e8dbcc00 [extractor, test] Basic framework for embed tests (#4307)
and split download tests so they can be more easily run in CI

Authored by: coletdjnz
2 years ago
pukkandan 8f97a15d1c [extractor] Framework for embed detection (#4307) 2 years ago
nixxo 47304e07dc
[extractor/rai] Add raisudtirol extractor (#4524)
Closes #4206
Authored by: nixxo
2 years ago
Lesmiscore 565a4c5944
[extractor/YahooJapanNews] Fix extractor (#4480)
Authored by: Lesmiscore
2 years ago
pukkandan 2ebe6fefbe
[extractor/yandexmusic] Extract higher quality format
Closes #4512
2 years ago
Juhmer Tena e1bd953f45
[extractor/angel] Add extractor (#4410)
Closes #1243
Authored by: AxiosDeminence
2 years ago
sqrtNOT 98a60600b2
[extractors/holodex] Add extractor (#4434)
Closes #726 
Authored by: sqrtNOT, pukkandan
2 years ago
lazypete365 e325a21a1f
[extractor/youtube] Add `live_status=post_live` (#4495)
Related: https://github.com/yt-dlp/yt-dlp/issues/1564
Authored by: lazypete365
2 years ago
pukkandan 31b532a1f2
[cleanup] Misc 2 years ago
pukkandan c646d76f67
[webvtt, extractor/youtube] Extract auto-subs from livestream VODs
Closes #4130

Authored by: pukkandan, fstirlitz
2 years ago
pukkandan 07b47084ba
[extractor/youtube] Parse translated subtitles only when requested
Closes #4274
2 years ago
ischmidt20 2eae7d507c
[extractor/ESPN] Extract duration (#4499)
Authored by: ischmidt20
2 years ago
mpeter50 1cdf69c57e
[extractor/twitch] Extract chapters for single chapter VODs (#4453)
Closes #4421 
Authored by: mpeter50
2 years ago
Galiley b6cd135ac2
[extractor/doodstream] Support more domains (#4493)
Authored by: Galiley
2 years ago
Anant Murmu befcac11a0
[extractor/stripchat] Fix _VALID_URL (#4491)
Closes https://github.com/yt-dlp/yt-dlp/issues/4486

Authored by: freezboltz
2 years ago
haobinliang 7f71cee020
[extractor/cloudflarestream] Fix video_id padding (#4384)
Fixes https://github.com/ytdl-org/youtube-dl/issues/26640

Authored by: haobinliang
2 years ago
Elyse db5f248204
[extractor/ina] Improve extractor (#4487)
Closes #4419
Authored by: elyse0
2 years ago
coletdjnz 871a8929bc
[extractor/archiveorg] Improve handling of formats (#4461)
* Ignore private formats if not logged in (fixes https://github.com/yt-dlp/yt-dlp/issues/3832)
* Prefer original formats
* Support mpg formats

Authored by: coletdjnz, pukkandan
2 years ago
ajj8 edebb65170
[extractor/bbc] Fix news articles (#4472)
Authored by: ajj8
2 years ago
pukkandan f640e42ffa
[extractor/arte] Fix title extraction
Fixes: https://github.com/yt-dlp/yt-dlp/pull/3302#issuecomment-1197568420
2 years ago
Mehavoid 59f63c8f0f
[extractor/vk] Fix extractor (#4128)
Closes #4437
Authored by: Mehavoid
2 years ago
ping bfbb5a1bb1
[extractor/NaverNow] Change endpoint (#4457)
Authored by: ping
2 years ago
Felix S 051d6b450c
[extractor/arte] Move to v2 API (#3302)
Closes #3622, #3502, #3086

Authored by: fstirlitz, pukkandan
2 years ago
HobbyistDev 67685a541d
[extractor/tempo] Add extractor (#4463)
Authored by: HobbyistDev
2 years ago
pukkandan 964b5493a4
Bugfix for f1042989c1 2 years ago
pukkandan f1042989c1
[crunchyroll] Fix language code in _VALID_URLs
Closes #4451
2 years ago
ischmidt20 e2884db36a
[extractor/Go] Extract timestamp (#4186)
Authored by: ischmidt20
2 years ago
winterbird-code 2c646fe42c
[extractor/hidive] Fix cookie login when netrc is also given (#4447)
Closes #3336

Authored by: winterbird-code
2 years ago
pukkandan 693f060040
[youtube,twitch] Allow waiting for channels to become live
Closes #2597
2 years ago
Burve 7d0f6f0c45
[extractor/Crunchyroll] Handle missing metadata correctly (#4405)
Closes #4399

Authored by pukkandan, Burve
2 years ago
Sipherdrakon 26bafe7028
[extractor/dplay] Add MotorTrend extractor (#4446)
Authored by: Sipherdrakon
2 years ago
nixxo 0cd2810379
[extractor/rai] Fix RaiNews extraction (#4380)
Authored by: nixxo

Closes #3911
2 years ago
m4tu4g 0f7247f88e
[extractor/zee5] Update Device ID (#4423)
Closes #4378

Authored by: m4tu4g
2 years ago
sqrtNOT 2dc4970e08
[extractor/tubi] Exclude playlists from playlist entries (#4416)
Closes #4409 

Authored by: sqrtNOT
2 years ago
coletdev 4f08e58655
[extractor/patreon] Fix and improve extractors (#4398)
* Add workaround for 403s - Fixes https://github.com/yt-dlp/yt-dlp/issues/3631
* Support m3u8 post file videos - Fixes https://github.com/yt-dlp/yt-dlp/issues/2277
* Raise useful error messages - Fixes https://github.com/yt-dlp/yt-dlp/issues/2914
* `--write-comments` support

Authored by: coletdjnz, pukkandan
2 years ago
sqrtNOT dcbf7394ab
[vgtv] Support tv.vg.no (#4404)
Closes #4400 
Authored by: sqrtNOT
2 years ago
Bricio c40f327a16
[extractor/globo:article] Remove false positives (#4396)
Authored by: Bricio
2 years ago
pukkandan b79f9e302d
`--compat-option no-live-chat` should disable danmaku
Closes #4387
2 years ago
Lesmiscore bc83b4b06c
[extractor/AbemaTVTitle] Implement paging (#4376)
Authored by: Lesmiscore
2 years ago
pukkandan 6929b41a21
Remove Python 3.6 support
Closes #3764
2 years ago
pukkandan c6e07cf1e1
[cleanup] Misc 2 years ago
pukkandan ce7f6aa660
Fix bug in 2aab569f1c
Closes #4371
2 years ago
pukkandan 1765c6039e
[extractor/MangoTV] Fix subtitle languages
Closes #4315
2 years ago
pukkandan fbb888a3d5
[extractor/BiliIntl] Fix subtitle extraction
Closes #4359
Authored by: MinePlayersPE
2 years ago
Elyse 2aab569f1c
[extractor/wetv] Add extractors (#4330)
Closes #1115
Authored by: elyse0
2 years ago
Ehtisham Sabir 2e2c60c4ba
[extractor/wikimedia] Add extractor (#4314)
Based on https://github.com/ytdl-org/youtube-dl/pull/30796
Authored by: EhtishamSabir, pukkandan
2 years ago
HobbyistDev 306770819e
[extractor/Netverse] Improve playlist extractor (#3854)
Authored by: HobbyistDev
2 years ago
chris dfa6661e0f
[extractor/rtvsl] Add extractor (#2586)
Authored by: iw0nderhow, pukkandan
2 years ago
sqrtNOT 956f1cf805
[extractor/philharmoniedeparis] Fix extractor (#4367)
Closes #4297
Authored by: sqrtNOT
2 years ago
sqrtNOT 129dfa5f45
[extractor/WSJArticle] Fix video id extraction (#4268)
Closes #4249
Authored by: sqrtNOT
2 years ago
pukkandan 3df6a603e4
[extractor/WatchESPN] Improve _VALID_URL
Closes #4362
Authored by: dirkf, IONECarter
2 years ago
Pritam Das e3e606de12
[extractor/instagram] Fix post/story extractors (#4074)
Closes #4343, #3077, #2736, #3002
Authored by: pritam20ps05, pukkandan
2 years ago
Ferdinand Bachmann 49afc1d84a
[extractor/TubeTuGraz] Add extractor (#2397)
Based on https://github.com/ytdl-org/youtube-dl/pull/26778
Authored by: Ferdi265, pukkandan
2 years ago
pukkandan 6edf28081f
[extractor] Passthrough `errnote=False` to parsing 2 years ago
HobbyistDev 5f2da312fa
[extractor/rtl.lu] Add extractor (#4222)
Closes #1721
Authored by: HobbyistDev
2 years ago
Tim Weber eb2333bce1
[extractor/StarTrek] Add extractor (#4191)
Authored by: scy
2 years ago
u-spec-png 660c0c4efd
[extractor/Trovo] Fix extractor (#4208)
Authored by: u-spec-png
2 years ago
Locke fe588ce8ef
[extractor/acfun] Add extractors (#4228)
Closes #3545
Authored by: lockmatrix
2 years ago
HobbyistDev 26b92a919d
[extractor/tviplayer] Add extractor (#4281)
Closes #2134
Authored by: HobbyistDev
2 years ago
HobbyistDev 8f47b39b27
[extractor/detik] Add extractor (#4284)
Closes #4283
Authored by: HobbyistDev
2 years ago
llamasblade 2f1b7afe32
[extractor/hytale] Add extractor (#4326)
Authored by: llamasblade, pukkandan
2 years ago
Locke dd634acd71
[extractor/Ximalaya] Fix extractors (#4339)
Authored by: lockmatrix
2 years ago
HobbyistDev cbd4f237b4
[extractor/cellebrite] Add extractor (#4333)
Closes #4014
Authored by: HobbyistDev
2 years ago
ftk 418bbfd722
[extractor/twitch] Support storyboards for VODs (#4342)
Authored by: ftk
2 years ago
ftk 45e8a04e48
[extractor/youtube] More metadata for storyboards (#4334)
Authored by: ftk
2 years ago
Dosychev Peter 4e7f375c94
[extractor/theholetv] Add extractor (#4325)
Authored by: dosy4ev
2 years ago
pukkandan 56b5b832bf
[extractor/crunchyroll] Improve _VALID_URL
<http://www.crunchyroll.com/series/GR24PVM76/nichijou-my-ordinary-life>
should be handled by Generic

Closes #4322
2 years ago
HobbyistDev 65ea4cba29
[extractor/mocha] Add extractor (#4213)
Closes https://github.com/yt-dlp/yt-dlp/issues/3752
Authored by: HobbyistDev
2 years ago
Misael Aguayo 17a23f0930
[extractor/syvdk] Add extractor (#4250)
Closes https://github.com/yt-dlp/yt-dlp/issues/4077
Authored by: misaelaguayo
2 years ago
pukkandan a3fb1ca5ab
[extractor/youtube] Fix duration check for post-live manifestless mode 2 years ago
Lesmiscore (Naoya Ozaki) 1275aeb955
[extractor/bigo] Fix extractor (#4312)
Closes #4139

Authored by: Lesmiscore
2 years ago
ischmidt20 170a031386
[extractor/fifa] Fix extractor (#4272)
Authored by: ischmidt20
2 years ago
Felix S 65493f64e1
[extractor/Audiodraft] Add extractors (#4288)
Based on https://github.com/yt-dlp/yt-dlp/pull/4259
Closes https://github.com/yt-dlp/yt-dlp/issues/4028

Authored by: fstirlitz, Ashish0804
2 years ago
HobbyistDev 63e66cd0ad
[extractor/liputan6] Add extractor (#4304)
Closes #4303

Authored by: HobbyistDev
2 years ago
Andrew 12a1b2254d
[extractor/youtube, cleanup] Fix tests (#4293)
Authored by: sheerluck
2 years ago
pukkandan 6154438178
[extractor/generic] Remove HEAD request 2 years ago
pukkandan a3976e0760
Improve chapter sanitization 2 years ago
pukkandan 385f7f3895
[extractor/iq] Set language correctly for Korean subtitles
Closes #3500
2 years ago
pukkandan ae61d108dd
[cleanup] Misc cleanup 2 years ago
pukkandan 47046464fa
[extractor] Fix empty `BaseURL` in MPD
Closes #4113
2 years ago
nomevi 844086505f
[extractor/livestreamfails] Add extractor (#4204)
Authored by: nomevi
2 years ago
FestplattenSchnitzel 1db1461272
[extractor/ViMP] Add playlist extractor (#4147)
Authored by: FestplattenSchnitzel
2 years ago
HobbyistDev 5fb450a64c
[extractor/steam] Add broadcast extractor (#4137)
Closes #4083

Authored by: HobbyistDev
2 years ago
Abubukker Chaudhary 2c60eae899
[extractor/Scrolller] Add extractor (#4010)
Closes #3635
Authored by: LunarFang416
2 years ago
crazymoose77756 962ffcf89c
[cleanup] Fix some typos (#4194)
Authored by: crazymoose77756
2 years ago
MMM 8a40bffaf9
[exractor/lbry] Use HEAD request for redirect URL (#4181)
and misc cleanup 

Authored by: flashdagger
2 years ago
pukkandan e08f72e675
[extractor/mediaset] Improve `_VALID_URL`
Fixes https://github.com/yt-dlp/yt-dlp/issues/4141#issuecomment-1166521057
2 years ago
pukkandan 1685d46007
[extractor/ertflix] Improve `_VALID_URL`
Closes #4180
2 years ago
ischmidt20 8d214c484c
[extractor/CWTV] Extract thumbnail (#4185)
Authored by: ischmidt20
2 years ago
HobbyistDev 30d22d775b
[extractor/premiershiprugby] Add extractor (#4129)
Closes #2980
Authored by: HobbyistDev
2 years ago
pukkandan c043c24625
[extractor] Fix `_create_request` when headers is None
Closes #4164
2 years ago
FestplattenSchnitzel 74900105be
[extractor/ViMP] Add thumbnail and support more sites (#4147)
Authored by: FestplattenSchnitzel
2 years ago
HobbyistDev d1bf2e199c
[extractor/fuyin] Add extractor (#4151)
Closes #2871

Authored by: HobbyistDev
2 years ago
pukkandan 14f25df2b6
[compat] Remove deprecated functions from core code 2 years ago
pukkandan 54007a45f1
[cleanup] Consistent style for file heads 2 years ago
pukkandan ac66811112
[compat] Remove more functions
Removing any more will require changes to a large number of extractors
2 years ago
Brett824 06cc8f103b
[extractor/youtube] Mark videos as fully watched (#4146)
* Also fixes videos appearing as shorts in watch history

Closes #2555
Authored by: Brett824
2 years ago
Jelle Besseling 34baaced11
[extractor/dropout] Support cookies and login only as needed (#4075)
Closes #4035
Authored by: pingiun, pukkandan
2 years ago
pukkandan 9809740ba5
[extractor, cleanup] Reduce direct use of `_downloader` 2 years ago
zenerdi0de 37e40d693b
[extractor/tennistv] Rewrite extractor (#2324)
Closes #2177
Authored by: zenerdi0de, pukkandan
2 years ago
pukkandan 0c36dc00d7
[extractor/npr] Implement e50c3500b4 differently
Closes #4141
2 years ago
pukkandan 471d0367c7
[youtube:clips] Support downloading clips
Closes #2543
2 years ago
pukkandan 3975b4d2e8
Allow extractors to specify section_start/end for clips 2 years ago
pukkandan 95032f302c
[f4m] Bugfix 2 years ago
pukkandan 8102a5991b
[extractor/mediaset] Improve `_VALID_URL` 2 years ago
HobbyistDev c27eaf8920
[extractor/kicker.de] Add extractor (#4073)
Closes #3670
Authored by: HobbyistDev
2 years ago
pukkandan dfb855b42d
[extractor/BiliIntl] Fix subtitle extraction
Closes #3123

Authored by: HobbyistDev
2 years ago
pukkandan 612f2be5d3
Bugfix for 7b2c3f47c6 2 years ago
pukkandan 6d1b34896e
Update to ytdl-commit-8a158a9
[NHK] Use new API URL
6508688e88

Closes #2337, Closes #4063
2 years ago
pukkandan 7b2c3f47c6
[cleanup] Misc 2 years ago
HobbyistDev 695b28afaa
[DailyWire] Add extractors (#4084)
Closes #3139
Authored by: HobbyistDev, pukkandan
2 years ago
ischmidt20 0a4fb0d3fe
[WatchESPN] Support free videos and BAM_DTC (#4118)
Authored by: ischmidt20
2 years ago
pukkandan 8072ef2bbd
[extractor/BiliIntl] Fix metadata extraction
Closes #4116
2 years ago
Elyse 40268a7974
[extractor/foxnews] Update embed extraction (#4043)
Authored by: elyse0
2 years ago
HobbyistDev 697ebe4d31
[extractor/ixigua] Add Extractor (#3953)
Closes #2840
Authored by: HobbyistDev
2 years ago
bubbleguuum 38d86f4d45
[extractor/radiofrance] Add more radios (#4065)
Closes #4087 
Authored by: bubbleguuum
2 years ago
pukkandan f254d6ccd9
[extractor/dropbox] Extract the correct `mountComponent` 2 years ago
coletdev f0bc6e2019
[extractor] Add `default` parameter to `_search_json` (#4057)
Authored by: pukkandan, coletdjnz
2 years ago
MMM 9fde8a6b12
[extractor/lbry] Update livestream API (#4042)
Authored by: flashdagger
2 years ago
Elyse 612e31f5ea
[extractor/substack] Add extractor (#4011)
Closes #3722
Authored by: elyse0
2 years ago
Abubukker Chaudhary 7a2e40dd48
[extractor/MirrorCoUK] Add extractor (#3999)
Authored by: LunarFang416, pukkandan
2 years ago
HobbyistDev 60ba603ab5
[extractor/netverse] Add extractors (#3854)
Authored by: HobbyistDev, pukkandan
2 years ago
Zhymabek Roman a79cba0c95
[exctractor/digitalconcerthall] Fix extractor (#4105)
Authored by: ZhymabekRoman
2 years ago
Lesmiscore 4f2a58c9c5
[extractor/pornhub] Extract `uploader_id` field (#4104)
Authored by: Lesmiscore
2 years ago
pukkandan a70635b8a1
[cleanup, utils] Don't use kwargs for `format_field` 2 years ago
christoph-heinrich e121e3cee7
[cleanup] Minor fixes (#4096)
Authored by: christoph-heinrich
2 years ago
pukkandan 0df111a371
[youtube] Extract `comment_count` from webpage
Closes #4091
2 years ago
pukkandan a39a7ba8d6
[extractor/tiktok] Extract `SIGI_STATE`
Based on #3624, https://github.com/ytdl-org/youtube-dl/pull/30479

Closes #3551

Authored by dirkf, sulyi, pukkandan
2 years ago
pukkandan f0c9fb9682
[utils] `Popen`: Refactor to use contextmanager
Fixes https://github.com/yt-dlp/yt-dlp/issues/3531#issuecomment-1156223597
2 years ago
pukkandan 560738f34d
[extractor] Import `_ALL_CLASSES` lazily
This significantly speeds up `import yt_dlp` in the absence of `lazy_extractors`
2 years ago
pukkandan 99d10bf607
[cleanup, extractor] Rename `extractors.py` to `_extractors.py`
This should be considered part of the next commit,
but is separated so that `git` can detect the renaming better
2 years ago
Evan Spensley 145c5a83a8
[extractor/GoogleDrive] Add folder extractor (#4009)
Closes #3388
Authored by: evansp, pukkandan
2 years ago
pukkandan e3aae45a6f
[extractor/zdf] Fix bug in 62b2b736e7
Closes #4061
2 years ago
pukkandan f3c0c77304
[extractor] Handle `json_ld` with multiple `@type`s
Closes: #4022
2 years ago
pukkandan 79e591b59b
[extractor/rumble] Detect JS embed
Closes #4064
2 years ago
pukkandan 21a73e9f39
[extractor/generic] Revert e6ae51c123
85553414ae made it unnecessary
2 years ago
coletdjnz 4ce05f5759
[extractor/youtube] Fix live chat for videos with content warning
Fixes #4051
Authored by: coletdjnz
2 years ago
Lesmiscore 2523702718
[extractor/tver] Fix bug in 6837633a4a
This corrects a mistake in 64fa820ccf
Authored by: Lesmiscore
Closes #4054
2 years ago
pukkandan 55baa67c7c
[extractor/jwplatform] Look for `data-video-jw-id`
Closes #3821
2 years ago
pukkandan 64fa820ccf
[cleanup] Misc fixes (see desc)
* [tvver] Fix bug in 6837633a4a - Closes #4054
* [rumble] Fix tests - Closes #3976
* [make] Remove `cat` abuse - Closes #3989
* [make] Revert #3684 - Closes #3814
* [utils] Improve `get_elements_by_class` - Closes #3993
* [utils] Inherit `Namespace` from `types.SimpleNamespace`
* [utils] Use `re.fullmatch` for matching filters
* [jsinterp] Handle quotes in `_separate`
* [make_readme] Allow overshooting last line

Authored by: pukkandan, kwconder, MrRawes, Lesmiscore
2 years ago
pukkandan 56ba69e4c9
[cleanup] Misc fixes
Closes #4027
2 years ago
Aurélien Grosdidier d05460e5fe
[extractor/FranceCulture] Fix extractor (#3874)
Closes #3742
Authored by: aurelg, pukkandan
2 years ago
ping 14c3a98049
[extractor/naver] Add `navernow` extractor (#3866)
Authored by: ping
2 years ago
Elyse e0a4a3d5bf
[extractor/freetv] Add extractor (#3587)
Closes #3486
Authored by: elyse0
2 years ago
Elyse 62b2b736e7
[extractor/zdf] Improve format sorting (#4040)
Closes #4020

Authored by: elyse0
2 years ago
Lesmiscore 6837633a4a
[extractor/tver] Fix extractor (#4033)
Authored by: Lesmiscore
2 years ago
coletdev 2ae778b8fc
[extractor/youtube] Add `innertube_host` and `innertube_key` extractor args (#3916)
Allows user to override Innertube API host or key for all requests
Authored by: coletdjnz
2 years ago
Ashish Gupta c82a4a8fce
[extractor/atscaleconfevent] Add extractor (#3971)
Closes #3961
Authored by: Ashish0804
2 years ago
vkorablin 6e7c9201cd
[extractor/ccc] Extract view_count (#3939)
Authored by: vkorablin
2 years ago
Angel Toloza bde0132e15
[extractor/southpark] Add `southpark.lat` extractor (#4008)
Authored by: darkxex
2 years ago
Daniel Lindholm 0d6bafbfa7
[expressen] Fix extractor (#4006)
Authored by: aejdl
2 years ago
MMM 36195c4461
[dash] Show fragment count with `--live-from-start` (#3493)
Authored by: flashdagger
2 years ago
coletdjnz 65141660ab
[extractor/youtube] Fix bug in b7c47b7438
Closes #3997

Authored by: coletdjnz
2 years ago
pukkandan b7c47b7438
[extractor] Add `_search_json`
All fetching of JSON objects should eventually be done with this function
but only `youtube` is being refactored for now
2 years ago
Lesmiscore 0bea4fd807
[extractor/0000studio] Add extractors (#3959)
Authored by: Lesmiscore
2 years ago
ischmidt20 b5770743fe
[extractor/espn] Add `WatchESPN` extractor (#2283)
Authored by: ischmidt20, pukkandan
2 years ago
pukkandan 1890fc6389
[cleanup] Misc fixes
Cherry-picks from: #3498, #3947
Related: #3949, https://github.com/yt-dlp/yt-dlp/issues/1839#issuecomment-1140313836
Authored by: pukkandan, flashdagger, gamer191
2 years ago
pukkandan c4910024f3
[extractor] Fix bug in 617f658b7e
While the function signature don't enforce it, some IEs that override
`_download_webpage_handle` assume all optional arguments to be keyword-only

Closes #3954
2 years ago
coletdev c7a7baaa13
[extractor/youtube] Fix `:ytnotifications` extractor (#3775)
Still some issues, see https://github.com/yt-dlp/yt-dlp/pull/3775

Authored by: coletdjnz
2 years ago
siddharth ravikumar e50c3500b4
[extractor/npr] Use stream url from json-ld (#3455)
Closes #1934
Authored by: r5d
2 years ago
pukkandan 09d02ea429
[extractor] Fix bug in f95b9dee45
Closes #3951
2 years ago
sqrtNOT ac05fb9338
[extractor/niconico:series] Fix extractor (#3935)
Authored by: sqrtNOT
2 years ago
pukkandan 28786529dc
[extractor/dropout] Login is not mandatory
Workaround for #3931
2 years ago
pukkandan 6b0b0a289a
[extractor/youtube:tab] Detect `videoRenderer` in `_post_thread_continuation_entries` 2 years ago
pukkandan f95b9dee45
[extractor] Add dev option `--load-pages` 2 years ago
pukkandan 617f658b7e
[extractor, cleanup] Refactor `_download_...` methods 2 years ago
Lesmiscore 9c0412cf6b
[extractor/vevo] Fix extractor (#3921)
Authored by: Lesmiscore
2 years ago
gamer191 84131d0351
[extractor/animelab] Remove extractor (#3922)
https://www.animelab.com/sunset

Authored by: gamer191
2 years ago
Lesmiscore 1cd6cba306
[extractor/PokemonSoundLibrary] Remove extractor (#3918)
Authored by: Lesmiscore
2 years ago
Lesmiscore 661e7253a2
[extractor/iwara:user] Make paging better (#3901)
Authored by: Lesmiscore
2 years ago
Lesmiscore 222a230871
[extractor/common] Recognize `src` attribute from HTML5 media elements (#3899)
Authored by: Lesmiscore
2 years ago
coletdjnz ee27297f82
[extractor/youtube] Fix initial player response extraction
Authored by: pukkandan, coletdjnz
2 years ago
Stefan Borer ee164987c7
[extractor/playsuisse] Add extractor (#845)
Authored by: sbor23, pukkandan
2 years ago
pukkandan 0fe51254cb
[extractor/youtube] Bring back `_extract_chapters_from_description`
Closes #3886
2 years ago
pukkandan 52023f1291
[extractor/youtube] Make signature extraction non-fatal
and reduce verbosity of it's warning

Closes #3882
2 years ago
mozbugbox 5bbe631e04
[extractor/duboku] Fix for hostname change (#3891)
Authored by: mozbugbox
2 years ago
miseran 520876fa09
[extractor/zattoo] Fix live streams (#3812)
Authored by: miseran
2 years ago
pukkandan 829bbd1d05
[youtube] Add warning for PostLiveDvr
Closes #3746, Related #1564
2 years ago
pukkandan 8a82af3511
[cleanup] Misc fixes and cleanup
Closes #3780, Closes #3853, Closes #3850
2 years ago
pukkandan 8246f8402b
[spotify:show] Fix extractor
Closes #3768
2 years ago
monnef d2ff2c91bb
[curiositystream] Get `auth_token` from cookie (#3836)
Closes #3753
Authored by: mnn
2 years ago
m4tu4g 7879e79d11
[bloomberg] Change playback endpoint (#3857)
Closes #3787
Authored by: m4tu4g
2 years ago
Lesmiscore 8a3e7b1c95
[yahoo:gyao] Fix extractor
This fixes 400 error for /title/ URLs.
2 years ago
Felix S 92922fe7f9
[rumble] Extract subtitles (#3823)
Closes #3132
Authored by: fstirlitz
2 years ago
pukkandan c487cf0010
[cleanup] Misc 2 years ago
pukkandan 2762dbb17e
[compat] Add `functools.cached_property` 2 years ago
adamanldo 854b0d325e
[StreamCZ] Fix extractor (#3789)
Closes #3579
Authored by: dirkf, adamanldo
2 years ago
Elyse 79c318937b
[ina] Fix extractor (#3807)
Closes #2463
Authored by: elyse0
2 years ago
Jeff Huffman 88d62206b4
[crunchyroll:beta] Fix extractor after API change (#3801)
Closes #2052
Authored by: Burve, tejing1
2 years ago
pukkandan b801cd7179
[tiktok] Detect embeds
Closes #3799
2 years ago
pukkandan 21633673c3
[cleanup] Minor fixes 2 years ago
pukkandan 80e8493ee7
[utils] `is_html`: Handle double BOM
Closes #2885
2 years ago
pukkandan aedaa455d9
[vimeo] Fix extractors
Closes #3037, Closes #2858, Closes #2880, Closes #3712
May also fix #3602, #3360
2 years ago
pukkandan d6bf1161db
[generic] Refactor `_extract_rss`
Closes #3738
2 years ago
pukkandan b2a2d91310
[adobepass] Allow cookies for authenticating MSO
Possible workaround for #1034
2 years ago
pukkandan 2414649192
[cleanup] Misc cleanup 2 years ago
pukkandan 5d5c0f7e99
[Hotstar] Bugfix for a1ddaa899c
Closes #3595
2 years ago
Dzmitry Neviadomski 3ac7b66047
[goodgame] Add extractor (#3686)
Authored by: nevack
2 years ago
P-reducible c9b2b368b3
[rokfin:search] Add extractor (#2992)
Authored by: P-reducible, pukkandan
2 years ago
pukkandan e037c405ad
[rokfin] Implement login (#2992)
Authored by: P-reducible, pukkandan
2 years ago
Conner 4bf72cc1c9
[Podchaser] Add extractors (#3665)
Authored by; connercsbn
2 years ago
Elyse 25f0e68f97
[wat] Fix extraction of multi-language videos and subtitles (#3739)
Closes #982, closes #1683
Authored by: elyse0
2 years ago
Elyse 3358f89361
[adn] Update AES key (#3743)
Closes #2002
Authored by: elyse0
2 years ago
Henrik Heimbuerger f3b3fe16af
[nebula] Add support for subscriptions (#3719)
Closes #3609 
Authored by: hheimbuerger
2 years ago
Jordan Weatherby d1c4f6d4da
[youtube] Added piped instance urls (#3714)
Closes #3661
Authored by: JordanWeatherby
2 years ago
pukkandan 82d020804d
[extractor] Use classmethod/property where possible
and refactor lazy extractors accordingly.

This reduces the need to create extractor instances
2 years ago
Filip Hedman 7ddbf09c25
[DRTV] Improve `_VALID_URL` (#3708)
Authored by: vertan
2 years ago
pukkandan 8dcce6a89c
[extractor] Document netrc machines
Closes #3169
2 years ago
pukkandan 0f06bcd759
[cleanup] Minor fixes (See desc)
* [youtube] Fix `--youtube-skip-dash-manifest`
* [build] Use `$()` in `Makefile`. Closes #3684
* Fix bug in 385ffb467b
* Fix bug in 43d7f5a5d0
* [cleanup] Remove unnecessary `utf-8` from `str.encode`/`bytes.decode`
* [utils] LazyList: Expose unnecessarily "protected" attributes
and other minor cleanup
2 years ago
ca-za d239db0306
[toggo] Improve `_VALID_URL` (#3689)
Authored by: ca-za
2 years ago
pukkandan 385ffb467b
[wistia] Fix `_VALID_URL`
Closes #2866
Authored by: dirkf
2 years ago
Evan Spensley 5f8ea7e0d8
[Jamendo] Extract more metadata (#3672)
Authored by: evansp
2 years ago
MMM 5747d4f4e8
[kaltura] Update API calls (#3657)
Authored by: flashdagger
2 years ago
Lesmiscore 1f8b4ab733
[radiko] Fix extractor (#3655)
Authored by: Lesmiscore
2 years ago
pukkandan d4736fdb43
Remove warning for videos with an empty title 2 years ago
pukkandan 895aeb71d7
[toggo] Fix `_VALID_URL`
Closes #2610
2 years ago
pukkandan 6b70527f9d
[cleanup, zingmp3] Refactor extractors 2 years ago
Teemu Ikonen a0fe51d562
[ruutu] Support hs.fi embeds (#3547)
Authored by: tpikonen, pukkandan
2 years ago
diegorodriguezv bd18c5d170
[cleanup, tmz] Update tests (#3654)
Authored by: diegorodriguezv
2 years ago
Ha Tien Loi 54044decd0
[ZingMp3] Add chart and user extractors (#3423)
Authored by: hatienl0i261299
2 years ago
Ha Tien Loi 89f383c4ee
[gronkh] Add playlist extractors (#3337)
Closes #3300
Authored by: hatienl0i261299
2 years ago
pukkandan 91e5e839d3
[youtube] Deprioritize format 22
Reduces chance of encountering #3372
2 years ago
FestplattenSchnitzel 10fa2471fc
[VideocampusSachsen] Improve extractor (#3604)
Authored by: FestplattenSchnitzel
2 years ago
i6t ff4d7860d5
[iwara] Add playlist extractors (#3639)
Authored by: i6t
2 years ago
rand-net 4f7a98c565
[KhanAcademy] Fix extractor (#3462)
Authored by: rand-net
2 years ago
Lesmiscore b58f8d8f2c
[TVer] Improve extraction (#3634)
Authored by: Lesmiscore
2 years ago
Ha Tien Loi f963b7ab18
[Likee] Add extractor (#3625)
Closes #3603
Authored by: hatienl0i261299
2 years ago
pukkandan 86925f6334
[Fifa] Sort formats
Closes #3632
2 years ago
m4tu4g 468f104ce7
[masters] Add extractor (#3358)
Closes #3240
Authored by: m4tu4g
2 years ago
Bricio cbc6ee10da
[Fifa] Add Extractor (#3414)
Closes #3408
Authored by: Bricio
2 years ago
nyuszika7h 6ef5ad9e29
[trovo] Update to new API (#3509)
Closes #3457
Authored by: nyuszika7h
2 years ago
HE7086 b4f536626a
[BilibiliLive] Add extractor (#3406)
Authored by: HE7086, pukkandan
2 years ago
Marwen Dallel 1a7cd9c487
[LCI] Fix extractor (#3534)
Authored by: MarwenDallel
2 years ago
coletdev 6e634cbe42
[youtube] Add YoutubeStoriesIE (#3362)
Get channel stories with `ytstories:<channel UCID>`

Authored-by: coletdjnz
2 years ago
pukkandan 3fe75fdc80
[cleanup] Misc fixes (see desc)
* Do not warn when fixup is skipped for existing file
* [fragment] Fix `--skip-unavailable-fragments` for HTTP Errors
* [utils] write_string: Fix bug in 59f943cd50
* [utils] parse_codecs: Subtitle codec is generally referred to as `scodec`. https://github.com/yt-dlp/yt-dlp/pull/2174#discussion_r790156048
* [docs] Remove note about permissions. Closes #3597
2 years ago
pukkandan 07689fc149
[reddit] Prevent infinite loop
Closes #3588
2 years ago
pukkandan bfec31bec8
[youtube] De-prioritize auto-generated thumbnails
Closes #3112
2 years ago
pukkandan 1d485a1a79
[cleanup] Misc fixes
Closes #3565, https://github.com/yt-dlp/yt-dlp/issues/3514#issuecomment-1105944364
2 years ago
pukkandan 0a41f331cc
[doc] Minor improvements
Closes #3518, Closes #3560
2 years ago
pukkandan 0a5a191a2a
Improve `--clean-infojson`
It should not removes fields that may be needed for `--load-infojson`.
Eg: `_ffmpeg_args`, `_has_drm`
2 years ago
Giedrius Statkevičius 4877f9055c
[lrt] Support livestreams (#3555)
Authored by: GiedriusS
2 years ago
Elyse a076c1f97a
[extractor] Update `manifest_url`s after redirect (#3575)
Authored by: elyse0
2 years ago
Evan Spensley b3602f6824
[InfoQ] Don't fail on missing audio format (#3573)
Closes #3441 
Authored by: evansp
2 years ago
Elyse 779da8e31b
[extractor] Update dash `manifest_url` after redirects (#3563)
Closes #2696 
Authored by: elyse0
2 years ago
Lesmiscore 997378f9df
[twitcasting] Pass headers for each formats (#3568)
Authored by: Lesmiscore
2 years ago
ekangmonyet 83bfb5e290
[Niconico] Support 2FA (#3559)
Authored by: ekangmonyet
2 years ago
pukkandan 4f80952353
[cleanup] Delete unused extractors 2 years ago
Yipten 96b49af01c
[bandcamp] Exclude merch links (#3368)
Closes #3318
Authored by: Yipten
2 years ago
Teemu Ikonen 52c2af8298
[icareus] Add extractor (#3320)
Authored by: tpikonen, pukkandan
2 years ago
pukkandan a1ddaa899c
[hotstar] Refactor extractors
Closes #3517
2 years ago
pukkandan 90f4229409
[telegram] Fix metadata extraction
Closes #3528
2 years ago
Ha Tien Loi d14b920c33
[PearVideo] Add fallback for formats (#3438)
Closes #3425
Authored by: hatienl0i261299
2 years ago
pukkandan 9b8ee23b99
[dependencies] Create module with all dependency imports 2 years ago
mehq e08585b0f8
[Gofile] Support password-protected links (#3488)
Closes #3465
Authored by: mehq
2 years ago
pukkandan 2d3b3feb7e
[Olympics] Fix format extension
Closes #3481
2 years ago
pukkandan 6f638d325e
Fix `Makefile`
Closes #3467, #35

Authored by: putnam
2 years ago
Lesmiscore fdfc8149e1
[openrec:movie] Enable fallback for /movie/ URLs
Closes #3474
2 years ago
pukkandan 1e9969f4f5
bugfix for a44ca5a470, 19a0394044, 77f9033095
Closes #3472
2 years ago
felix 77f9033095
[compat] Split into sub-modules (#2173)
Authored by: fstirlitz, pukkandan
2 years ago
pukkandan 19a0394044
[cleanup] Misc cleanup and refactor (#2173) 2 years ago
pukkandan b6dc37fe2a
[test] Convert warnings into errors
* And fix some existing warnings

Authored by: fstirlitz
2 years ago
pukkandan 3d3bb1688b
[docs] Improve embedding docs and other minor fixes 2 years ago
pukkandan 2e25ce3a05
[niconico] Set `expected_protocol` to a public field
Closes #3440
2 years ago
coletdjnz affc4fefea
[youtube] Fix episode metadata extraction 2 years ago
pukkandan 583910682f
[chingari] Fix archiving and tests 2 years ago
Felix S a49e777d59
[spotify] Detect iframe embeds (#3430)
Authored by: fstirlitz
2 years ago
Akmal cda1bc5197
[facebook] Improve thumbnail extraction (#3392)
Authored by: Wikidepia
2 years ago
pukkandan e5a998f368
[cleanup] Misc cleanup (#2173)
Authored by: fstirlitz, pukkandan
2 years ago
pukkandan f82711587c
[cleanup] Sort imports
Using https://github.com/PyCQA/isort

    isort -m VERTICAL_HANGING_INDENT --py 36 -l 80 --rr -n --tc .
2 years ago
pukkandan 86e5f3ed2e
[cleanup] Upgrade syntax
Using https://github.com/asottile/pyupgrade

1. `__future__` imports and `coding: utf-8` were removed
2. Files were rewritten with `pyupgrade --py36-plus --keep-percent-format`
3. f-strings were cherry-picked from `pyupgrade --py36-plus`

Extractors are left untouched (except removing header) to avoid unnecessary merge conflicts
2 years ago
pukkandan f9934b9614
[cleanup] Mark some compat variables for removal (#2173)
Authored by fstirlitz, pukkandan
2 years ago
felix cfb0511d82
[cleanup] Remove unused code paths (#2173)
Notes:

* `_windows_write_string`: Fixed in 3.6
  * https://bugs.python.org/issue1602
  * PEP: https://www.python.org/dev/peps/pep-0528

* Windows UTF-8 fix: Fixed in 3.3
  * https://bugs.python.org/issue13216

* `__loader__`: is always present in 3.3+
  * https://bugs.python.org/issue14646

* `workaround_optparse_bug9161`: Fixed in 2.7
  * https://bugs.python.org/issue9161

Authored by: fstirlitz
2 years ago
mehq fcdb8d6e88
[Gofile] Fix extraction (#3386)
Closes #3380
Authored by: mehq
2 years ago
krichbanana ca5300c7ed
[youtube] Add `:ytnotifications` extractor (#3347)
Authored by: krichbanana
2 years ago
pukkandan a25bca9f89
[youtube, cleanup] Minor refactoring
Authored by: coletdjnz, pukkandan
2 years ago
pukkandan d46a3e7a12
[rai] Add `release_year`
Closes #2319
2 years ago
Ashish Gupta 2d2b5493ee [ZEE5] Fix extractor.
Authored by: Ashish0804
Closes: https://github.com/yt-dlp/yt-dlp/issues/3105
2 years ago
Jacek Nowacki 89fabf1125
[bilibili] Fix extraction of title with quotes (#3350)
Closes #3289
Authored by: dzek69
2 years ago
pukkandan 11e1c2e3f8
[TikTokVM] Fix redirect to user URL
Closes #3349, Closes #3351
2 years ago
mehq 4d57133095
[Jable] Add extractor (#3341)
Closes #3284
Authored by: mehq
2 years ago
Alexander Seiler 9b8b7a7b5e
[Zattoo] Fix extractors (#2288)
Closes: #1244
Authored by: goggle
2 years ago
Ha Tien Loi ab0970b233
[NRK] Extract timestamp (#3231)
Closes #3211
Authored by: hatienl0i261299
2 years ago
Lesmiscore b52e788eb2
[Piapro] Extract description with break lines
Authored by: Lesmiscore
Closes #3334
2 years ago
Ha Tien Loi bd4073c535
[AfreecaTV] Add `AfreecaTVUserIE` (#3286)
Closes #3257
Authored by: hatienl0i261299
2 years ago
coletdev 61d3665d9d
[youtube] Fix uploader for collaborative playlists (#3332)
Authored by: coletdjnz
2 years ago
Lesmiscore (Naoya Ozaki) 870efdee28
[TVer] Fix extractor (#3268)
Authored by: Lesmiscore
2 years ago
Lesmiscore (Naoya Ozaki) 06b1628d3e
[twitcasting] Don't return multi_video for archive with single hls manifest (#3319)
Authored by: Lesmiscore
2 years ago
panatexxa da1ffde15d
[Moviepilot] Add extractor (#3282)
Authored by: panatexxa
2 years ago
Ha Tien Loi 42a4f21a03
[fptplay] Fix metadata extraction (#3218)
Authored by: hatienl0i261299
2 years ago
pukkandan a44ca5a470
[cleanup] Misc fixes
Closes https://github.com/yt-dlp/yt-dlp/pull/3213, Closes https://github.com/yt-dlp/yt-dlp/pull/3117

Related: https://github.com/yt-dlp/yt-dlp/issues/3146#issuecomment-1077323114, https://github.com/yt-dlp/yt-dlp/pull/3277#discussion_r841019671, a825ffbffa (commitcomment-68538986), https://github.com/yt-dlp/yt-dlp/issues/2360, 5fa3c9a88f (r70393519), 5fa3c9a88f (r70393254)
2 years ago
Teemu Ikonen 0a8a7e68fa
[ruutu] Detect embeds (#3294)
Authored by: tpikonen
2 years ago
Jeff Huffman f4d706a931
[crunchyroll:playlist] Implement beta API (#2955)
Closes #3121, #2930

Authored by: tejing1
2 years ago
Ha Tien Loi 5fa3c9a88f
[TikTok] Fix URLs with user id (#3295)
Closes #3243
Authored by: hatienl0i261299
2 years ago
pukkandan 04f3fd2c89
[cleanup] Use `_html_extract_title` 2 years ago
Ha Tien Loi 18eac302a2
[Imdb] Improve extractor (#3291)
Closes #3283
Authored by: hatienl0i261299
2 years ago
Tim Schindler 12e022d074
[Cybrary] Add extractor (#3264)
Authored by: aaearon
2 years ago
Lesmiscore (Naoya Ozaki) 265e586d96
[openrec] Download archived livestreams (#3267)
Authored by: Lesmiscore
2 years ago
Fam0r fbfde1c3e6
[elonet] Rewrite extractor (#3277)
Closes #2911
Authored by: Fam0r, pukkandan
2 years ago
aarubui dc57e74a7f
[tenplay] Improve extractor (#3280)
Authored by: aarubui
2 years ago
pukkandan a17526e427
[youtube:tab] Minor improvements (See desc)
* Support shorts on channel homepage
* Extract thumbnail of OLAK playlists
2 years ago
coletdev ad210f4fd4
[youtube:search] Support hashtag entries (#3265)
Authored-by: coletdjnz
2 years ago
coletdjnz c8e856a551
[web.archive:youtube] Make CDX API requests non-fatal
Partial fix for https://github.com/yt-dlp/yt-dlp/issues/3278
Authored-by: coletdjnz
2 years ago
nixxo c085e4ec47
[rai] Fix extraction of http formats (#3272)
Closes #3270
Authored by: nixxo
2 years ago
pukkandan 4c268f9cb7
[Nebula] Fix bug in 52efa4b312 2 years ago
Lesmiscore (Naoya Ozaki) 5d45484cc7
[niconico] Fix extraction of thumbnails and uploader (#3266) 2 years ago
pukkandan e6f868a63c
[utils] `traverse_obj`: Allow filtering by value 2 years ago
pukkandan c4f60dd7cd
[utils] Add `try_call` 2 years ago
pukkandan f189faf1ce
[BRMediathek] Fix VALID_URL
Closes #2466
2 years ago
Alexander Seiler 504f789ad5
[AZMedien] Support `tv.telezueri.ch` (#3251)
Authored by: goggle
2 years ago
Bricio bb5a7cb8ad
[Craftsy] Add extractor (#3208)
Authored by: Bricio
2 years ago
zackmark29 c418e6b5a6
[viu] Fix bypass for preview (#3247)
Authored by: zackmark29
2 years ago
pukkandan 11078c6d57
[crunhyroll] Fix inheritance
https://github.com/yt-dlp/yt-dlp/pull/2955#issuecomment-1083060465
2 years ago
Daniel ab2579bb45
[xnxx] Add `xnxx3.com` (#3188)
Authored by: rozari0
2 years ago
Ha Tien Loi 48e15bb6b1
[dailymotion] Support `geo.dailymotion.com` (#3230)
Closes #3229
Authored by: hatienl0i261299
2 years ago
David e7870111e8
[YouTube] Add new age-gate bypass (#3233)
Closes #3182
Authored by: zerodytrash, pukkandan
2 years ago
Ha Tien Loi 9139d2fae0
[WasdTV] Add extractor (#3045)
Closes #3041
Authored by: un-def, hatienl0i261299
2 years ago
nyuszika7h bdd60588b0
[viki] Don't attempt to modify URLs with signature (#3222)
Closes #1379
Authored by: nyuszika7h
2 years ago
Luc Ritchie f5f15c9993
[BiliIntl] Support user-generated videos (#3203)
Authored by: wlritchi
2 years ago
pukkandan 90137ca4be
[utils] Add `filter_dict` 2 years ago
coletdev 1c1b2f96ae
[youtube:tab] Fix duration extraction for shorts (#3171)
Related: https://github.com/TeamNewPipe/NewPipe/issues/8034
Authored-by: coletdjnz
2 years ago
Felix S 47b8bf207b
[go,viu] Extract subtitles from the m3u8 manifest (#3219)
Authored by: fstirlitz
2 years ago
Tim Schindler 4628a3aa75
[ITProTV] Add extractor (#3196)
Authored by: aaearon
2 years ago
mehq 5b4bb715e6
[BanBye] Add extractor (#3177)
Closes #3175
Authored by: mehq
2 years ago
pukkandan 1235d333ab
[youtube] Fix auto-translated automatic captions
d49669acad only covered ASR

Closes #2956
2 years ago
pukkandan 18e4940825
[youtube] Add extractor-arg to skip auto-translated subs 2 years ago
shirt 727029c508
[youtube] Detect DRM better
Authored by: shirt-dev
2 years ago
coletdev fd2ad7cb24
[youtube:tab] Return shorts url if video is a short (#3168)
Allows filtering out shorts from feeds with `--match-filter`
Closes #3165
Authored-by: coletdjnz
2 years ago
Lesmiscore (Naoya Ozaki) 3cea3edd1a
[utils] WebSocketsWrapper: Allow omitting `__enter__` invocation (#3187)
Authored by: Lesmiscore
2 years ago
zackmark29 1fb707badb
[viu] Fixed extractor (#3136)
Closes #3133
Authored by: zackmark29, pukkandan
2 years ago
pukkandan ae72962643
[youtube] Try embedded client variants before agegate
agegate variants appears to be broken, but don't remove them for the time-being
2 years ago
pukkandan ae6a1b9585
[docs] Minor improvements
Closes #3127, Closes #3081, Closes #3177
2 years ago
pukkandan 231025c463
Fix bug in 52efa4b312
Closes #3173
2 years ago
pukkandan 700ccbe3f1
[extractor] Allow control characters inside json
Closes #3174
2 years ago
vvto33 12a64f2777
[TVer] Support landing page (#3075)
Authored by: vvto33
2 years ago
mehq b8f2f8f6b3
[LastFM] Add extractors (#3141)
Closes #2967
Authored by: mehq
2 years ago
pukkandan ea5ca8e7fc
[ellentube] Extract subtitles from manifest
Fixes https://github.com/ytdl-org/youtube-dl/issues/30761
2 years ago
Lesmiscore (Naoya Ozaki) c2d2ee40eb
[generic] Extract subtitles from video.js (#3156)
Authored by: Lesmiscore
2 years ago
pukkandan b9c7b1e9b4
[cleanup, vimeo] Fix tests 2 years ago
CplPwnies 1f1df1251e
[adobepass] Fix Suddenlink MSO (#3148)
Authored by: CplPwnies
2 years ago
1-Byte 84842aee2b
[azmedien] Add TVO Online to supported hosts (#3125)
Authored by: 1-Byte
2 years ago
coletdev e6552207da
[panopto] Improve subtitle extraction and support slides (#3009)
Related: #1946, #2908
Authored-by: coletdjnz
2 years ago
foghawk 510809f1aa
[nitter] Minor fixes and update instance list (#3099)
Authored by: foghawk
2 years ago
i6t f4ad919298
[Veo] Fix extractor (#3101)
Authored by: i6t
2 years ago
pukkandan 52efa4b312
[extractor] Add `_perform_login` function (#2943)
* Adds new functions `_initialize_pre_login` and `_perform_login` as part of the extractor API
* Adds `ie.supports_login` to the public API
2 years ago
Luc Ritchie 028f6437f1
[afreecatv] Match new vod url (#3097)
Authored by: wlritchi
2 years ago
Sipherdrakon 43c38abd1f
[ParamountPlus,CBS] Change VALID_URL (#3098)
Closes #3096

Authored by: Sipherdrakon
2 years ago
pukkandan e4b98809cf
[youtube] Fix pagination of `membership` tab 2 years ago
pukkandan 5a373d9768
[veo] Fix `_VALID_URL`
Closes #3095
2 years ago
Ha Tien Loi 7e6a187096
[Huya] Add extractor (#3035)
Closes #3033
Authored by: hatienl0i261299
2 years ago
Lesmiscore (Naoya Ozaki) 3f168f0e45
[RUTV] Fix format sorting (#3085)
Closes #3084
Authored by: Lesmiscore
2 years ago
Lesmiscore (Naoya Ozaki) 7bdcb4a40e
[niconico] Rewrite NiconicoIE (#3018)
Closes https://github.com/yt-dlp/yt-dlp/issues/2636, partially fixes https://github.com/yt-dlp/yt-dlp/issues/367
Authored by: Lesmiscore
2 years ago
Soebb 497a6c5f57
[daftsex] Fix extractor (#2757)
Closes #2637

Authored by: Soebb
2 years ago
BohwaZ 4b3c5d1b81
[FranceCulture] Support playlists (#1872)
Authored by: bohwaz
2 years ago
Dorian Westacott ec47c12f69
[ParamountPlusSeries] Support multiple pages (#3026)
Authored by: dodrian
2 years ago
pukkandan 25791435b7
[arte] Add `format_note` to m3u8 formats
Related: #3086
2 years ago
pukkandan 4e34889f1c
[rumble] unescape title 2 years ago
pukkandan a1b2d84360
[youtube] Avoid false positives when detecting damaged formats
Closes #3083
2 years ago
coletdjnz 5dbc77df26
[youtube:api] Prefer minified JSON response
Authored-by: coletdjnz
2 years ago
pukkandan aeb21b98f1
[phantomjs] Fix bug in 8b7539d27c
Closes #3066
2 years ago
coletdev b3edc8068e
[downloader/mhtml] Fix fragments with absolute urls (#3044)
Authored-by: coletdjnz
2 years ago
coletdev 17322130a9
[youtube] Improve video upload date handling (#3029)
* Don't prefer UTC upload date for past live streams/premieres
* Improve regex (fixes a regression)

Authored-by: coletdjnz
2 years ago
coletdjnz a825ffbffa
[extractor] Support merging subtitles with data
Authored-by: coletdjnz
2 years ago
Lesmiscore (Naoya Ozaki) 24e3d87431
[PokemonSoundLibrary] Add extractor (#3001)
Authored by: Lesmiscore
2 years ago
Ha Tien Loi 63b2f88bc7
[Zingmp3] Fix signature (#3004)
Authored by: hatienl0i261299
2 years ago
Ha Tien Loi 33b8c411bc
[MangoTV] Improve extractor (#2971)
Authored by: hatienl0i261299
2 years ago
Lesmiscore (Naoya Ozaki) 6e6beffd04
[openrec] Refactor extractors (#2941)
Authored by: Lesmiscore
2 years ago
coletdev e248be3319
[panopto] Add extractors (#2908)
Based on https://github.com/ytdl-org/youtube-dl/pull/13449
Closes #1946
Authored by: coletdjnz, kmark
2 years ago
pukkandan ff91cf7483
[utils] Add `get_first` 2 years ago
P-reducible 9461cb586a
[Rokfin] Fix `availability` (#1534)
Authored by: P-reducible
2 years ago
pukkandan a405b38f20
[youtube] Further de-prioritize 3gp format 2 years ago
pukkandan 08d30158ec
[cleanup, docs] Misc cleanup
Closes #2828, closes #2734, closes #2802, closes #2937
2 years ago
Ha Tien Loi c89bec262c
[xinpianchang] Add extractor (#2963)
Authored by: hatienl0i261299
2 years ago
Ha Tien Loi 151f8f1c02
[fptplay] Add extractor (#2949)
Closes #2857
Authored by: hatienl0i261299
2 years ago
Max Mehl a35155be17
[peertube] Add media.fsfe.org (#2986)
Authored by: mxmehl
2 years ago
nyuszika7h e66662b1e0
[ccma] Fix timestamp parsing (#2989)
Authored by: nyuszika7h
2 years ago
CplPwnies 9e0e6adb2d
[adobepass] Add Suddenlink MSO (#2977)
Closes #2704
Authored by: CplPwnies
2 years ago