Commit Graph

3027 Commits (d1b21561497b6bbb8ff1202e63f48eb41bd315af)

Author SHA1 Message Date
coletdjnz b87e01c123
[cookies] Move `YoutubeDLCookieJar` to cookies module (#7091)
Authored by: coletdjnz
2 years ago
coletdjnz 08916a49c7
[core] Improve HTTP redirect handling (#7094)
Aligns HTTP redirect handling with what browsers commonly do and RFC standards. 

Fixes issues afac4caa7d missed.

Authored by: coletdjnz
2 years ago
sqrtNOT 66468bbf49
[extractor/comedycentral] Add support for movies (#7108)
Closes #1926
Authored by: sqrtNOT
2 years ago
bashonly b844a3f8b1
[extractor/weverse] Add extractors (#6711)
Closes #4786
Authored by: bashonly
2 years ago
Audrey 5caf30dbc3
[extractor/youtube] Extract `heatmap` data (#7100)
Closes #3888
Authored by: tntmod54321
2 years ago
MMM 4ad58667c1
[extractor/bibeltv] Fix extraction, support live streams and series (#6505)
Authored by: flashdagger
2 years ago
Simon Sawicki edbe5b589d
Bugfixes for 4823ec9f46
Hotfix for fragmented downloads

Authored by: bashonly
2 years ago
Simon Sawicki 032de83ea9
[extractor/crunchyroll] Rework with support for movies, music and artists (#6237)
This adds `CrunchyrollMusicIE` and `CrunchyrollArtistIE` extractors using the new, reworked base class and expands the `CrunchyrollBetaIE` with support for movies and movie listings and more complete metadata extraction

Authored by: Grub4K
2 years ago
Simon Sawicki 8417f26b8a
[core] Implement `--color` flag (#6904)
Authored by: Grub4K
2 years ago
pukkandan 7aeda6cc9e
[jsinterp] Do not compile regex 2 years ago
pukkandan 4823ec9f46
Update to ytdl-commit-d1c6c5
[YouTube] [core] Improve platform debug log, based on yt-dlp
d1c6c5c4d6

Except:
    * 6ed34338285f722d0da312ce0af3a15a077a3e2a [jsinterp] Add short-cut evaluation for common expression
        * There was no performance improvement when tested with https://github.com/ytdl-org/youtube-dl/issues/30641
    * e8de54bce50f6f77a4d7e8e80675f7003d5bf630 [core] Handle `/../` sequences in HTTP URLs
        * We plan to implement this differently
2 years ago
pukkandan 46f1370e9a
[devscripts/cli_to_api] Add script 2 years ago
kangalio 69a40e4a7f
[extractor/youtube:music:search_url] Extract title (#7102)
Authored by: kangalio
Closes #7095
2 years ago
coletdjnz 955c89584b
[core] Deprecate internal `Youtubedl-no-compression` header (#6876)
Authored by: coletdjnz
2 years ago
coletdjnz 69bec6730e
[cleanup, utils] Split into submodules (#7090)
Closes https://github.com/yt-dlp/yt-dlp/pull/2173

Authored by: pukkandan, coletdjnz
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>
2 years ago
Simon Sawicki 665472a7de
[update] Implement `--update-to` repo
Authored by: Grub4K, pukkandan
2 years ago
Simon Sawicki d2e84d5eb0
[update] Better error handling
Authored by: pukkandan
2 years ago
coletdjnz 447afb9eaa
[extractor/youtube] Support podcasts and releases tabs
Closes https://github.com/yt-dlp/yt-dlp/issues/6893

Authored by: coletdjnz
2 years ago
pukkandan 6f2287cb18
[cleanup] Misc
Closes #7030, closes #6967
2 years ago
pukkandan 1d7656184c
[jsinterp] Handle `NaN` in bitwise operators
Closes #6131
2 years ago
pukkandan f7f7a877bf
[extractor/booyah] Remove extractor
Site shut down. Closes #6425
2 years ago
pukkandan c8bc203fbf
[docs] Misc improvements
Closes #6814, closes #6940, closes #6733, closes #6923, closes #6566, closes #6726, closes #6728
2 years ago
toomyzoom 21b9413cf7
[extractor/iwara] Implement login (#6721)
Authored by: toomyzoom
2 years ago
bashonly ef8fb7f029
[extractor/wrestleuniverse] Fix extraction, add login (#6982)
Closes #6975
Authored by: bashonly, Grub4K

Co-authored-by: Simon Sawicki <contact@grub4k.xyz>
2 years ago
ringus1 3b52a60688
[extractor/facebook] Fix metadata extraction (#6856)
Closes #3432
Authored by: ringus1
2 years ago
Lesmiscore c449c0655d
[extractor/abematv] Add fallback for title and description extraction and extract more metadata (#6994)
Authored by: Lesmiscore
2 years ago
lauren n. liberda 0c7ce146e4
[extractor/tvp] Use new API (#6989)
Authored by: selfisekai
Closes #6987
2 years ago
pukkandan ddae33754a
[extractor/youporn] Extract m3u8 formats
Closes #6977
2 years ago
Eveldee 45998b3e37
[utils] `locked_file`: Fix for virtiofs (#6840)
Authored by: brandon-dacrib
Closes #6823
2 years ago
bashonly 2f07c4c1da
[extractor/clipchamp] Add extractor (#6978)
Closes #6973
Authored by: bashonly
2 years ago
Nicholas Defranco b423b6a48e
[extractor/dlf] Add extractors (#6697)
Closes #6430
Authored by: nick-cd
2 years ago
bashonly 147e62fc58
[extractor/twitter] Default to GraphQL, handle auth errors (#6957)
Closes #6763
Authored by: bashonly
2 years ago
Simon Sawicki b079c26f0a
[utils] `traverse_obj`: More fixes (#6959)
- Fix result when branching with `traverse_string`
- Fix `slice` path on `dict`s
- Fix tests and docstrings from 21b5ec86c2
- Add `is_iterable_like` helper function

Authored by: Grub4K
2 years ago
bashonly 4d9280c9c8
[extractor/reddit] Add login support (#6950)
Closes #6949
Authored by: bashonly
2 years ago
pukkandan 17ba4343cf
Fix f005a35aa7
Printing inside `finally` causes the order of logging to change
when there is an error, which is undesirable. So this is reverted.

The issue of `--print` being blocked by pre-processors was an
unintentional side-effect of changing the operation orders in
170605840e, and this is also partially
reverted.
2 years ago
pukkandan f005a35aa7
Ensure pre-processor errors do not block `--print`
Closes #6937
2 years ago
makeworld 7a7b1376fb
[extractor/cbc] Fix live extractor, playlist `_VALID_URL` (#6625)
Authored by: makew0rld
2 years ago
pukkandan b5f61b69d4
Fix bug in 170605840e
and related refactor
2 years ago
pukkandan 7cf51f2191
[jsinterp] Handle negative numbers better
Closes #6131
2 years ago
pukkandan 170605840e
Populate `filename` and `urls` fields at all stages of `--print`
Closes https://github.com/yt-dlp/yt-dlp/issues/6920
2 years ago
garret 30647668a9
[extractor/globalplayer] Add extractors (#6903)
Authored by: garret1317
2 years ago
Alex Klapheke ed81b74802
[extractor/aeonco] Support Youtube embeds (#6591)
Authored by: alexklapheke
2 years ago
Noah 62beefa818
[extractor/pornhub] Set access cookies to fix extraction (#6685)
Closes #4299
Authored by: Schmoaaaaah, arobase-che

Co-authored-by: Noah <nkempers@outlook.de>
Co-authored-by: ache <ache@ache.one>
2 years ago
Neurognostic 0c4e0fbcad
[extractor/bitchute] Add more fallback subdomains (#6907)
Authored by: Neurognostic
2 years ago
sqrtNOT c86e433c35
[extractor/NiconicoSeries] Fix extraction (#6898)
Authored by: sqrtNOT
2 years ago
Elyse 9b30cd3dfc
[extractors/rtvc] Add extractors (#6578)
* Add `RTVCPlay` extractor
* Add `RTVCPlayEmbed` extractor
* Add `RTVCKaltura` extractor
* Add `SenalColombiaLive` extractor

Closes #6457
Authored by: elyse0
2 years ago
Simon Sawicki 21b5ec86c2
[utils] `traverse_obj`: Allow iterables in traversal (#6902)
Authored by: Grub4K
2 years ago
pukkandan c16644642b
Add option `--xff`
Deprecates `--geo-bypass`, `--no-geo-bypass, `--geo-bypass-country`, `--geo-bypass-ip-block`
2 years ago
pukkandan 04f8018a05
[extractor/hentaistigma] Remove extractor
Piracy site

Closes #6870
2 years ago
pukkandan d669772c65
Add `--no-quiet`
Closes #6796
2 years ago
pukkandan ec9311c41b
[outtmpl] Support `str.format` syntax inside replacements
Closes #6843
2 years ago
pukkandan 78fde6e339
[outtmpl] Allow `\n` in replacements and default.
Fixes: https://github.com/yt-dlp/yt-dlp/issues/6808#issuecomment-1510055357
Fixes: https://github.com/yt-dlp/yt-dlp/issues/6808#issuecomment-1510363645
2 years ago
JC-Chung 80b732b7a9
[extractor/twitch] Extract original size thumbnail (#6629)
Authored by: JC-Chung
2 years ago
truedread 1ea15603d8
[extractor/wevidi] Add extractor (#6868)
Closes #6129
Authored by: truedread
2 years ago
garret 8f0be90ecb
[extractor/nhk] Add `NhkRadiru` extractor (#6819)
* Add `NhkRadioNewsPage` extractor

Authored by: garret1317
2 years ago
vidiot720 6a765f135c
[extractor/sbs] Overhaul extractor for new API (#6839)
Closes #6543
Authored by: vidiot720, dirkf, bashonly
2 years ago
qbnu ab29e47029
[extractor/bilibili] Support festival videos (#6547)
Closes #6138
Authored by: qbnu
2 years ago
bashonly e5265dc651
[extractor/stageplus] Add extractor (#6838)
Closes #6806
Authored by: bashonly
2 years ago
zhgwn cbdf9408e6
[extractor/pornez] Support new URL formats (#6792)
Closes #6791, Closes #6298
Authored by: zhgwn
2 years ago
CoryTibbettsDev 2c566ed141
[extractor/whyp] Add extractor (#6803)
Authored by: CoryTibbettsDev
2 years ago
satan1st 9c92b803fa
[extractor/gronkh] Extract duration and chapters (#6817)
Authored by: satan1st
2 years ago
bashonly 7a6f6f2459
[extractor/reddit] Support cookies and short URLs (#6825)
Closes #6665, Closes #6753
Authored by: bashonly
2 years ago
bashonly ea05708203
[extractor/adobepass] Handle `Charter_Direct` MSO as `Spectrum` (#6824)
Authored by: bashonly
2 years ago
pukkandan 9874e82b5a
Do not translate newlines in `--print-to-file`
Fixes https://github.com/yt-dlp/yt-dlp/issues/6808#issuecomment-1509361107
2 years ago
pukkandan 84ffeb7d5e
[extractor] Do not warn for invalid chapter data in description
Fixes https://github.com/yt-dlp/yt-dlp/issues/6811#issuecomment-1509876209
2 years ago
coletdjnz 7666b93604
[extractor/youtube] Define strict uploader metadata mapping (#6384)
New mapping:
```
channel -> channel name
channel_id -> UCID
channel_url -> UCID channel url

uploader -> channel name (same as channel field)
uploader_id -> @handle
uploader_url -> @handle channel url 
```

Authored by: coletdjnz
2 years ago
bashonly 93e7c6995e
[extractor/generic] Attempt to detect live HLS (#6775)
* Extract duration for non-live generic HLS videos
* Add extractor-arg `is_live` to bypass live HLS check

Closes #6705
Authored by: bashonly
2 years ago
bashonly 3f7e2bd80e
[FFmpegFixupM3u8PP] Check audio codec before fixup (#6778)
Closes #6673
Authored by: bashonly
2 years ago
bashonly 925936908a
[extractor/tiktok] Fix and improve metadata extraction (#6777)
Authored by: bashonly
2 years ago
bashonly 90c1f51206
[extractor/zoom] Fix share URL extraction (#6789)
Authored by: bashonly
2 years ago
hasezoey 56793f74c3
[extractor/iwara] Fix format sorting (#6651)
Authored by: hasezoey
2 years ago
Lesmiscore d1483ec693 [extractor/iwara] Fix typo
Authored by: Lesmiscore

Closes #6795
2 years ago
MyNey 979568f26e
[extractor/BrainPOP] Add extractors (#6106)
Authored by: MinePlayersPE
Based on https://github.com/ytdl-org/youtube-dl/pull/10025
2 years ago
HobbyistDev b093c38cc9
[extractor/biliIntl] Add comment extraction (#6079)
Authored by: HobbyistDev
2 years ago
HobbyistDev 2d97d154fe
[extractor/gmanetwork] Add extractor (#5945)
Authored by: HobbyistDev
Partially fixes #5770
2 years ago
pukkandan c3f624ef0a
Relaxed validation for numeric format filters
Continued from f96bff99cb

Closes #6782
2 years ago
Lesmiscore 52ecc33e22
[extractor/niconico] Download comments from the new endpoint (#6773)
Authored by: Lesmiscore
2 years ago
pukkandan 26010b5cec
[postprocessor/FixupDuplicateMoov] Fix bug in triggering 2 years ago
pukkandan c6786ff3ba
[extractor/youtube] Revert default formats to `https` 2 years ago
Shreyas Minocha 79c77e85b7
[extractor/zoom] Fix extractor (#6741)
Authored by: shreyasminocha
Closes #6677
2 years ago
sian1468 faa0332ed6
[extractor/line] Remove extractors (#6734)
Service has shut down - https://archive.ph/txVKy
Authored by: sian1468
2 years ago
lauren n. liberda 7e35526d5b
[extractor/hrefli] Add extractor (#6762)
Authored by: selfisekai
2 years ago
Chris Caruso ef0848abd4
[extractor/youku] Improve error message (#6690)
Authored by: carusocr
Closes #6551
2 years ago
bashonly 0a6918a4a1
[extractor/kick] Make initial request non-fatal
Authored by: bashonly
2 years ago
coletdjnz 141a8dff98
[extractor/youtube] Fix comment loop detection for pinned comments (#6714)
Pinned comments may repeat a second time - this is expected.

Fixes https://github.com/yt-dlp/yt-dlp/issues/6712

Authored by: coletdjnz
2 years ago
Lesmiscore 68be95bd0c
[extractor/YahooGyaOIE,extactor/YahooGyaOPlayerIE] Delete extractors due to website close (#6218)
Authored by: Lesmiscore
2 years ago
Lesmiscore ab92d8651c
[extractor/iwara] Accept old URLs
Authored by: Lesmiscore

Closes #6669
2 years ago
Lesmiscore 0f0875ed55
[postprocessor/EmbedThumbnail,postprocessor/FFmpegMetadata] Fix error on attaching thumbnails and info json for mkv/mka (#6647)
Authored by: Lesmiscore

Current yt-dlp code never hit this bug, but would hit once filename sanitization gets better
2 years ago
Lesmiscore 95a383be1b
[extractor/iwara] Report private videos (#6641)
Authored by: Lesmiscore
2 years ago
bashonly 9be0fe1fd9
[extractor/nbc] Fix `NBCStations` direct mp4 formats (#6637)
Authored by: bashonly
2 years ago
bashonly 33b737bedf
[extractor/triller] Support short URLs, detect removed videos (#6636)
Authored by: bashonly
2 years ago
Simon Sawicki 0898c5c8cc
[utils] `js_to_json`: Implement template strings (#6623)
Authored by: Grub4K
2 years ago
pukkandan f68434cc74
[extractor] Extract more metadata from ISM
Fixes 81b6102d20 (r105892531)
2 years ago
pukkandan baa922b5c7
[extractor] Do not exit early for unsuitable `url_result` 2 years ago
bashonly 9bfe0d15bd
Fix 5cc0a8fd2e
Authored by: bashonly
2 years ago
bashonly 8ceb07e870
[extractor/tiktok] Fix mp3 formats (#6615)
Closes #6608
Authored by: bashonly
2 years ago
bashonly 6bdb64e2a2
[extractor/hollywoodreporter] Add extractors (#6614)
Closes #6525
Authored by: bashonly
2 years ago
bashonly 3ae182ad89
[extractor/pgatour] Add extractor (#6613)
Closes #6537
Authored by: bashonly
2 years ago
bashonly 5cc0a8fd2e
[extractor/generic] Accept values for `fragment_query`, `variant_query` (#6600)
Closes #6593
Authored by: bashonly
2 years ago
pukkandan 6994afc030
[extractor/rumble] Fix videos without quality selection
Closes #6612
2 years ago
pukkandan 78bc1868ff
[extractor/rumble] Detect timeline format
Closes #6607
2 years ago
bashonly 69b2f838d3
[extractor/telecaribe] Expand livestream support (#6601)
Closes #6598
Authored by: bashonly
2 years ago
bashonly 44369c9afa
[extractor/cbs] Add `ParamountPressExpress` extractor (#6604)
Closes #6597
Authored by: bashonly
2 years ago
bashonly c2e0fc40a7
[extractor/generic] Add extractor-args `hls_key`, `variant_query` (#6567)
Authored by: bashonly
2 years ago
bashonly 06966cb896
[extractor/bravotv] Fix extractor (#6568)
Closes #6562
Authored by: bashonly
2 years ago
bashonly e4cf7741f9
[extractor/rozhlas] Extract manifest formats (#6590)
Closes #6584
Authored by: bashonly
2 years ago
Lesmiscore c14af7a741
[extractor/iwara] Overhaul extractors (#6557)
Authored by: Lesmiscore
2 years ago
viktor-enzell 9a06b7b189
[extractor/drtv] Fix radio page extraction (#6552)
Authored by: viktor-enzell
2 years ago
bashonly 216bcb66d7
[extractor/tiktok] Improve `TikTokLive` extractor (#6520)
Closes #6459
Authored by: bashonly
2 years ago
bashonly 460da07439
[extractor/genius] Add support for articles (#6474)
Closes #6465
Authored by: bashonly
2 years ago
bashonly 03025b6e10
[extractor/mediastream] Improve `WinSports` and embed extraction (#6426)
Closes #6419, Closes #6527
Authored by: bashonly
2 years ago
Nicholas Defranco 071670cbea
[extractor/youtube] Fix parsing `comment_count` (#6523)
Closes #5849
Authored by: nick-cd
2 years ago
coletdjnz 607510b9f2
[extractor/youtube] Handle incomplete initial data from watch page (#6510)
Authored by: coletdjnz
2 years ago
pukkandan 98ac902c49
[dependencies/Cryptodome] Fix `__bool__`
Bug in 65f6e80780
2 years ago
unbeatable-101 cbfe2e5cbe
[extractor/nebula] Add `beta.nebula.tv` (#6516)
Authored by: unbeatable-101
2 years ago
Chris Caruso cf9fd52fab
[extractor/jwplatform] Update `_extract_embed_urls` (#6383)
Authored by: carusocr
2 years ago
JChris246 80ea6d3dea
[extractor/Parler] Rewrite extractor (#6446)
Authored by: JChris246
Closes #6068
2 years ago
Joshua Lochner 1e3c2b6ec2
[extractor/medaltv] Fix clips (#6502)
Closes #6489
Authored by: xenova
2 years ago
Ha Tien Loi 026435714c
[extractor/LastFM] Rewrite playlist extraction (#6379)
Authored by: hatienl0i261299, pukkandan
Closes #5975
2 years ago
Ha Tien Loi 0181b9a1b3
[extractor/thesun] Update `_VALID_URL` (#6522)
Authored by: hatienl0i261299
Closes #6479
2 years ago
pukkandan e389d172b6
Fix 2a23d92d9e
Closes #6517
2 years ago
pukkandan 2a23d92d9e
[extractor/youtube] Construct fragment list lazily
Building fragment list for all formats take significant time for large videos
2 years ago
pukkandan 86cb922118
[extractor/youtube] Add extractor-arg `include_duplicate_formats` 2 years ago
Lesmiscore c795c39f27
[extractor/youtube] Add client name to `format_note` when `-v` (#6254)
Authored by: Lesmiscore, pukkandan
2 years ago
vampirefrog 7a6c8a0807
[extractor/rokfin] Re-construct manifest url (#6507)
Authored by: vampirefrog
2 years ago
Daniel Vogt 89dbf08483
[extractor/opencast] Fix format bug (#6512)
Authored by: C0D3D3V
2 years ago
pukkandan e6ab678e36
[extractor/hidive] Fix login
Fixes https://github.com/yt-dlp/yt-dlp/issues/6493#issuecomment-1462906556
2 years ago
pukkandan ab1de9cb1e
Support loading info.json with a list at it's root 2 years ago
makeworld 871c907454
[extractor/cbc:gem] Update `_VALID_URL` (#6499)
Authored by: makeworld-the-better-one
Closes #6395
2 years ago
Elyse 0551511b45
[extractor/twitch] Fix `is_live` (#6500)
Closes #6494
Authored by: elyse0
2 years ago
pukkandan c9abebb851
[extractor/youtube] Bypass throttling for `-f17`
and related cleanup

Thanks @AudricV for the finding
2 years ago
pukkandan 66aeaac9aa
[downloader/curl] Fix progress reporting
Bug in 8c53322cda
Closes #6490
2 years ago
Daniel Vogt 3588be59ce
[extractor/opencast] Add ltitools to `_VALID_URL` (#6371)
Authored by: C0D3D3V
2 years ago
D0LLYNH0 2d5cae9636
[extractor/iq] Set more language codes (#6476)
Authored by: D0LLYNH0
2 years ago
Simon Sawicki 9b7a48abd1
[cookies] Defer extraction of v11 key from keyring
Closes #6082

Authored by: Grub4K
2 years ago
bashonly 01ddec7e66
[postprocessor] Fix chapters if duration is not extracted (#6037)
Authored by: bashonly
2 years ago
bashonly 6f4fc5660f
[extractor/chilloutzone] Fix extractor (#6445)
Closes #6029
Authored by: bashonly
2 years ago
Simon Sawicki 3b479100df
[utils] `write_string`: Fix noconsole behavior
Ref: https://github.com/pyinstaller/pyinstaller/pull/7217

Authored by: Grub4K
2 years ago
permunkle d4e6ef4077
[extractor/nubilesporn] Add extractor (#6231)
Authored by: permunkle
2 years ago
bashonly c459d45dd4
[extractor/teamcoco] Fix extractor (#6437)
Closes #6339
Authored by: bashonly
2 years ago
github-actions 8729e7b57c Release 2023.03.04
Created by: pukkandan

:ci skip all :ci run dl
2 years ago
pukkandan 392389b7df
[cleanup] Misc 2 years ago
Elyse eb8fd6d044
[extractor/lefigaro] Add extractors (#6309)
Authored by: elyse0
Closes #6197
2 years ago
Ferdinand Bachmann f44cb4e77b
[extractor/tubetugraz] Support `--twofactor` (#6424) (#6427)
Authored by: Ferdi265
Closes #6424
2 years ago
Elyse 46580ced56
[extractor/tunein] Fix extractors (#6310)
Authored by: elyse0
Closes #2973
2 years ago
Elyse b404712822
[extractor/telecaribe] Add extractor (#6311)
Authored by: elyse0
Closes #6001
2 years ago
Chris Caruso 1f8489cccb
[extractor/lumni] Add extractor (#6302)
Authored by: carusocr
Closes #6202
2 years ago
columndeeply ed4cc4ea79
[extractor/Prankcast] Fix tags (#6316)
Authored by: columndeeply
2 years ago
lauren n. liberda cf60522652
[extractor/twitter] Fix retweet extraction (#6422)
Authored by: selfisekai
2 years ago
pukkandan 45db357289
[extractor/SportDeutschland] Rewrite extractor
Note: `multi_video` live streams are untested

Closes #6417, closes #6418, closes #6420
2 years ago