Commit Graph

1332 Commits (0df11dafdd4de7a9324c43f9d97fe70256e9bd0c)

Author SHA1 Message Date
coletdjnz a709d87335
[youtube:tab] Extract video thumbnails from playlist (#2096)
closes #1184
Co-Authored-by: coletdjnz, pukkandan
3 years ago
siddharth 774a46c53d
[npr] Make SMIL extraction non-fatal (#2099)
Closes #1934
Authored by: r5d
3 years ago
MinePlayersPE c8b80b9643
[RCTIPlusSeries] Lazy extraction and video type selection (#2050)
Authored by: MinePlayersPE
3 years ago
MinePlayersPE 4e260d1a56
[Instagram] Try bypassing login wall with embed page (#2095)
Authored by: MinePlayersPE
3 years ago
Luc Ritchie 4f3fa23e5a
[utils] Fix parsing `YYYYMMDD` dates in Nov/Dec (#2094)
The date format `%Y%m%d%H%M` will successfully match against
one-digit month, day, hour, and minute strings, even though %m et al.
are documented as being zero-padded. So dates without time in
Nov/Dec may be wrongly parsed as dates in January with time.

This commit adds a format string of `%Y%m%d` to our supported date
format strings directly below (higher priority) its problematic relatives.

Closes #2076
Authored by: wlritchi
3 years ago
pukkandan b28bac93ab
Fix bug in 1cefca9e44
Fixes https://github.com/ytdl-patched/ytdl-patched/issues/11
3 years ago
pukkandan 37893bb0c9
[outtmpl] Change filename sanitization type to `S`
`F` is already used for float!
Bug in e0fd95737d
3 years ago
Ashish Gupta c25de59cf7
[LBRY] Support livestreams (#2062)
Closes #2054 
Authored by: Ashish0804, pukkandan
3 years ago
Emanuel Hoogeveen 205a0654c0
Add option `--file-access-retries` (#2066)
Closes #517
Authored by: ehoogeveen-medweb
3 years ago
aarubui 663949f825
[NJPWWorld] Extract formats from m3u8 (#2075)
Authored by: aarubui
3 years ago
pukkandan b69fd25c25
[cleanup] Misc cleanup
Closes #1942 #1976 #2020 #2058 #1984
3 years ago
pukkandan e0fd95737d
[outtmpl] Add alternate forms `F`, `D`
and improve `id` detection

F = sanitize as filename (# = restricted)
D = add Decimal suffixes

Closes #2085, 2081
3 years ago
pukkandan 4ac5b94807
[dash] Fix `--test`
Bug in adbc4ec4bb
3 years ago
pukkandan 4273cc776d
[dash] Fix aria2c dash downloads
Bug in adbc4ec4bb
3 years ago
pukkandan fa9f30b802
Add interactive format selection with `-f -`
Closes #2065
3 years ago
pukkandan 1cefca9e44
Add warning when using `-f best` 3 years ago
kebianizao 5edb8dfec2
[rtve] Add `RTVEAudioIE` (#1657)
Original PR: https://github.com/ytdl-org/youtube-dl/pull/29023
Authored by: kebianizao
3 years ago
The Hatsune Daishi adbc4ec4bb
[dash,youtube] Download live from start to end (#888)
* Add option `--live-from-start` to enable downloading live videos from start
* Add key `is_from_start` in formats to identify formats (of live videos) that downloads from start
* [dash] Create protocol `http_dash_segments_generator` that allows a function to be passed instead of fragments
* [fragment] Allow multiple live dash formats to download simultaneously
* [youtube] Implement fragment re-fetching for the live dash formats
* [youtube] Re-extract dash manifest every 5 hours (manifest expires in 6hrs)
* [postprocessor/ffmpeg] Add `FFmpegFixupDuplicateMoovPP` to fixup duplicated moov atoms

Known issue: Ctrl+C doesn't work on Windows when downloading multiple formats

Closes #1521
Authored by: nao20010128nao, pukkandan
3 years ago
Julien Hadley Jack c031b0414c
[ondemandkorea] Update `jw_config` regex (#2056)
Authored by: julien-hadleyjack
3 years ago
coletdjnz f3aa3c3f98
[youtube:tab] Extract more metadata from feeds/channels/playlists (#1018)
Parse relative time text, extract live, upcoming status, availability and channel id from feeds/channels/playlists (where applicable). 
Closes #1883
Authored-by: coletdjnz
3 years ago
cypheron ae43a4b986
[hse] Add extractors (#1906)
Original PR: https://github.com/ytdl-org/youtube-dl/pull/27060
Authored by: cypheron, pukkandan
3 years ago
pukkandan ca5db158ae
[postprocessor/ffmpeg] Always add `faststart`
Closes #1491
3 years ago
pukkandan 5f549d4959
[Facebook] Handle redirect URLs
Closes #1035
3 years ago
Paul Wise 6839d02cb6
[ABC:iview] Add show extractor (#1630)
Authored by: pabs3
3 years ago
Abdullah Ibn Fulan 2aae2c91ff
[audiomack] Update album and song VALID_URL (#1203)
Original PR: https://github.com/ytdl-org/youtube-dl/pull/29810
Closes #1352, https://github.com/ytdl-org/youtube-dl/issues/29800
Authored by: abdullah-if, dirkf
3 years ago
Lapinot c2dedf12e8
[soundcloud] Add related tracks extractor (#1000)
Authored by: Lapin0t
3 years ago
Unit 193 e75bb0d6c3
[cleanup] Fix some typos (#2033)
Authored by: unit193
3 years ago
pukkandan dd0228ce1f
Remove known invalid thumbnails from `info_dict`
Related: https://github.com/yt-dlp/yt-dlp/issues/980#issuecomment-997396821
3 years ago
pukkandan 37e57a9fd4
[youtube:tab] Ignore query when redirecting channel to playlist
and cleanup of related code
Closes #2046
3 years ago
pukkandan 940a67a3e2
[docs] Change all examples to use double quotes
to be platform-agnostic
3 years ago
pukkandan e6ae51c123
[generic] Extract m3u8 formats from JSON-LD 3 years ago
pukkandan aab41cdd33
[PlutoTV] Expand `_VALID_URL`
Closes #2007
3 years ago
pukkandan b3a5115ff1
[zee5] Support /episodes in URL
Closes #2016
3 years ago
Felix S d76d15a669
[utils] Update `std_headers` (#2023)
* Update our chrome versions used for `User-Agent`s
* Drop the `Accept-Charset` header that no browser emits any more

Authored by: kikuyan, fstirlitz
3 years ago
PilzAdam e978789f0f
[outtmpl] Add operator `&` for replacement text (#2012)
Authored by: PilzAdam
3 years ago
Sematre 375d9360bf
[gronkh] Support new URL pattern (#2019)
Authored by: Sematre
3 years ago
Zenon Mousmoulas d5c3254889
[extractor] Support default implicit graph in JSON-LD (#1983)
Original PR: https://github.com/ytdl-org/youtube-dl/pull/30229

Per W3C JSON-LD v1.1 §4.9 (non-normative ref):

    When a JSON-LD document's top-level structure is a map that contains
    no other keys than @graph and optionally @context (properties that
    are not mapped to an IRI or a keyword are ignored), @graph is
    considered to express the otherwise implicit default graph.

Authored by: zmousm
3 years ago
std-move fe69f52e5c
[NovaEmbed] update player regex (#2008)
Authored by: std-move
3 years ago
pukkandan 3116be32b4
[brightcove] Fix 487c5b3389 3 years ago
pukkandan a8549f19e7
[tiktok] Fix 53dad39e30 3 years ago
pukkandan 39ca3b5c7f
[extractor] Standardize `_live_title` 3 years ago
coletdjnz 46383212b3
[youtube:comments] Add more options for limiting number of comments extracted (#1626)
Extends `max_comments` extractor arg to support `max-parents,max-replies,max-replies-per-thread`.
Authored-by: coletdjnz
3 years ago
pukkandan 0bb322b9c0
Add field `webpage_url_domain`
Closes #1311
3 years ago
pukkandan ff9f925b63
[test/download] Add more fields 3 years ago
pukkandan 5bfc8bee5a
Fix PostProcessor hooks not registered for some PPs
Closes #1993
3 years ago
pukkandan 19188702ef
[FormatSort] Prevent incorrect deprecation warning
Closes #1981
3 years ago
The Hatsune Daishi d984a98def
[ok.ru] add mobile fallback (#1972)
Authored by: nao20010128nao
3 years ago
u-spec-png 069c6ccf02
[olympics] Add uploader and cleanup (#1990)
Authored by: u-spec-png
3 years ago
MinePlayersPE 53dad39e30
[TikTok] Pass cookies to mobile API (#1994)
Authored by: MinePlayersPE
3 years ago
Ashish Gupta db77c49c84
[SonyLiv] Add OTP login support (#1959)
Closes #1945
Authored by: Ashish0804
3 years ago
Ashish Gupta abc07b554c
[NateTV] Add NateIE and NateProgramIE (#1950)
Authored by: Ashish0804, Hyeeji
3 years ago
Ashish Gupta 86f3d52f8c [DiscoveryPlusShowBaseIE] yield actual video id 3 years ago
u-spec-png 8b688881ba
[instagram] Expand valid URL (#1977)
Closes #1925

Authored by: u-spec-png
3 years ago
Ashish Gupta 13debc86e7
[Rutube] Add RutubeChannelIE (#1970)
Closes #1966 
Authored by: Ashish0804
3 years ago
nyuszika7h b5f94e4fa1
[toggo] Add extractor (#1961)
Authored by: nyuszika7h
3 years ago
YuenSzeHong 61882afdc5
[fujitv] Extract 1080p from `tv_android` m3u8 (#1928)
Authored by: YuenSzeHong
3 years ago
coletdjnz aa4b054512
[web.archive:youtube] Improve metadata extraction (#1785)
Authored-by: coletdjnz
3 years ago
YuenSzeHong 487c5b3389
[TVer] Extract better thumbnails (#1929)
Authored by: YuenSzeHong
3 years ago
Nil Admirari 8157a09d22
[SponsorBlock] Add Filler and Highlight categories (#1664)
Authored by: nihil-admirari, pukkandan
3 years ago
Jertzukka b1aaf1c07f
[gofile] Add extractor (#1850)
Closes #1831 
Authored by: Jertzukka, Ashish0804
3 years ago
chris 5f9aaac8c2
[zdf] Support videos with different ptmd location (#1893)
Authored by: iw0nderhow
3 years ago
David Skrundz 54c2521ca6
[CBC Gem] Extract 1080p formats (#1913)
Authored by: DavidSkrundz
3 years ago
The Hatsune Daishi 2814f12ba4
[skeb] Add extractor (#1916)
Fixes: https://github.com/ytdl-org/youtube-dl/issues/30287
Authored by: nao20010128nao
3 years ago
raleeper 1619836cb7
[crackle] Look for non-DRM formats (#1938)
Authored by: raleeper
3 years ago
pukkandan e3c7d49571
[compat] Suppress errors in enabling VT mode
Closes #1932
3 years ago
The Hatsune Daishi ddd24c9949
[ntvcojp] Extract NUXT data (#1915)
Fixes: https://github.com/ytdl-org/youtube-dl/issues/30309
Authored by: nao20010128nao
3 years ago
Michal Kubeček 443b21dc4e
[ceskatelevize] Fetch iframe from nextJS data (#1904)
Closes #1899
Authored by: mkubecek
3 years ago
The Hatsune Daishi 66f4c04e50
[extractor] Add `_search_nuxt_data` (#1921)
Authored by: nao20010128nao
3 years ago
nixxo 93864403ea
[redtube] Handle formats delivered inside a JSON (#1877)
Closes #1663
Authored by: dirkf, nixxo
3 years ago
pukkandan b5475f1145
Pre-process when using `--flat-playlist` 3 years ago
pukkandan 38d79fd16c
Use `parse_duration` for `--wait-for-video`
and some minor fix
3 years ago
pukkandan acc0d6a411
Allow `--no-write-thumbnail` to override `--write-all-thumbnail`
Closes #1900
3 years ago
pukkandan 146cc4114a
bugfix for 63ccf4ff1a 3 years ago
pukkandan 818faa3a86
[vimeo] Extract chapters
Closes #1892
3 years ago
MinePlayersPE aa5ecf082c
[TrueID] Add extractor (#1847)
Authored by: MinePlayersPE
3 years ago
pukkandan d2b2fca53f
[extractor] Ignore errors in comment extraction when `-i` is given
Closes #1787
3 years ago
pukkandan 63ccf4ff1a
[lazy_extractors] Fix bug in 2c4aaaddc9
SearchIEs must not inherit from extractors that have a _VALID_URL defined
3 years ago
pukkandan 43b2290658
Fix `--throttled-rate` 3 years ago
nixxo 99148c6a33
[RaiNews] Fix extractor (#1864)
Closes #1862
Authored by: nixxo
3 years ago
pukkandan 9bdd99cf39
[EmbedSubtitle] Disable duration check temporarily
Closes #1870, #1385
3 years ago
pukkandan 2c4aaaddc9
[lazy_extractors] Fix for search IEs
Closes #1851
3 years ago
pukkandan 5f7cb91ae9
[youtube] Fix `ytsearchdate`
Related: #1851
3 years ago
pukkandan 3efb96a6d1
Fix control characters being printed to `--console-title`
Closes #1859
3 years ago
pukkandan 3262f8abf2
[trovo] Fix inheritance of `TrovoChannelBaseIE`
Closes #1849
3 years ago
Christian Paul bdbafb3913
[Jamendo] Fix use of `_VALID_URL_RE` (#1858)
Closes #1857
Authored by: jaller94
3 years ago
pukkandan a804f6d89c
[cleanup Fix some typos
* `MetadataFromFieldPP` is not deprecated!
* Wrong args to `MetadataFromFieldPP`
* Some mistakes in change log
* Type in build.yml causing release tag to be placed on wrong commit
3 years ago
github-actions 814dfb7e25 [version] update
Created by: pukkandan

:ci skip all
3 years ago
pukkandan 91f071af60
Release 2021.12.01 3 years ago
pukkandan 2aa5e2cc01
Ensure same config file is not loaded multiple times 3 years ago
j54vc1bk 1bad50eced
[CableAV] Add extractor (#1842)
Authored by: j54vc1bk
3 years ago
u-spec-png ac0efabf12
[Bilibili] Fix title extraction (#1716)
Closes #1714
Authored by: u-spec-png
3 years ago
Ashish Gupta 73f035e1fe
[Cleanup] Remove some unnecessary groups in regexes (#1738)
Authored by: Ashish0804
3 years ago
nyuszika7h 0cbed930c8
[trovo] Fix extractor (#1818)
Closes #1782

Authored by: nyuszika7h
3 years ago
Ashish Gupta 5118d2ec58
[DiscoveryPlus] Rewrite extractors (see desc) (#1766)
* Add `DiscoveryPlusItalyShowIE`
* Use `uuid.uuid4().hex` for device id so no cookies are required
* Fix dash formats not being downloaded
* Extract subtitles from manifests
* Move all extractors to one file and restructure inheritances

Authored by: Ashish0804, pukkandan
3 years ago
pukkandan 717216b093
Validate --get-bypass-country
Closes #1834
3 years ago
pukkandan 5c22c63da3
Fix `--trim-filename` when filename has `.`
Closes #1837
3 years ago
pukkandan ee8dd27a73
[cleanup] Add deprecation warnings 3 years ago
pukkandan f304da8a29
[cleanup] Misc cleanup
Closes #1805, closes #1800
3 years ago
pukkandan 06dfe0a0a2
[cleanup] Refactor `JSInterpreter._seperate` 3 years ago
pukkandan 75b725a7cc
[build] Use `workflow_dispatch` for release 3 years ago
pukkandan 36eaf3039a
[build] Save Git HEAD at release alongside version info 3 years ago
pukkandan f2ebc5c7be
Option `--wait-for-video` to wait for scheduled streams 3 years ago
pukkandan b222c27145
Option `--break-per-input` to apply --break-on... to each input URL 3 years ago
pukkandan 5e5be0c0b2
Fix --break-on-archive when pre-checking 3 years ago
pukkandan 7578d77d8c
[downloader] Add colors to download progress 3 years ago
pukkandan b29165267f
[youtube] Decrypt n-sig for URLs with `ratebypass`
Closes #1796
3 years ago
pukkandan bc104778d6
[vimeo] Sort http formats higher
Closes #1821
3 years ago
MinePlayersPE d298d33fe6
[Instagram] Display more login errors (#1822)
Authored by: MinePlayersPE
3 years ago
Deer-Spangle bf57cfa8b7
[RedGifs] Add Search and User extractors (#1808)
Authored by: Deer-Spangle
3 years ago
std-move 3c2208f82d
[NovaEmbed] Fix extractor (#1814)
Authored by: std-move
3 years ago
shirt 93e597ba28
Fix logic error in report_unplayable_conflict 3 years ago
pukkandan b28cdcc0e4
[tiktok:user] Set `webpage_url` correctly
Closes #1802
3 years ago
DEvmIb a33c0d9c5d
[twitch:vod] Extract live status (#1722)
Authored by: DEvmIb
3 years ago
pukkandan 75689fe59b
Ensure directory exists when checking formats 3 years ago
pukkandan 5ce1d13eba
[EmbedSubtitles] Slightly relax duration check
and related cleanup
Closes #1385
3 years ago
pukkandan e04b003e64
[FixupM3u8] Fixup MPEG-TS in MP4 container
Closes #1701, https://github.com/ytdl-org/youtube-dl/issues/26410
3 years ago
Grabien 909b0d66f4
[Senate.gov] Add SenateGovIE and fix SenateISVPIE (#1435)
Authored by: Grabien, pukkandan
3 years ago
u-spec-png dfd78699f5
[Aljazeera] Fix extractor (#1577)
Closes #1518
Authored by: u-spec-png
3 years ago
mpeter50 639f80c1f9
[Twitch:vod] Add chapters (#1515)
Authored by: mpeter50
3 years ago
gustaf 896a88c5c6
[Tvplayhome] Fix extractor (#1357)
Authored by: pukkandan, 18928172992817182 (gustaf)
3 years ago
chio0hai 4e4ba1d75f
[redgifs] Add extractor (#1631)
Closes #1504
Authored by: chio0hai
3 years ago
Yakabuff 2abf081554
[xvideos] Fix extractor (#1799)
Closes #1788 
Authored by: Yakabuff
3 years ago
Henrik Heimbuerger 359df0fc42
[nebula] Add NebulaCollectionIE and rewrite extractor (#1694)
Closes #1690
Authored by: hheimbuerger
3 years ago
Ashish Gupta 3938a9212c
[CPTwentyFour] Add extractor (#1769)
Closes #1768
Authored by: Ashish0804
3 years ago
shirt cf1f13b817
[generic] Support mpd manifests without extension (#1806)
Authored by: shirt-dev
3 years ago
Grabien 18d6dd4e01
[extractor/breitbart] Breitbart.com website support (#1434)
Authored by: Grabien
3 years ago
cntrl-s 883ecd5494
Streamff extractor (#1736)
Closes #1359 
Authored by: cntrl-s
3 years ago
pukkandan eb56d132d2
[cleanup,instagram] Refactor extractors
Closes #1561
3 years ago
Aurora 17b4540662
[radiozet] Add extractor (#1593)
Authored by: 0xA7404A (Aurora)
3 years ago
Tim da27aeea5c
[ITV] Fix extractor (#1776)
Closes #1775
Authored by: staubichsauger
3 years ago
Sipherdrakon fec41d17a5
[MTV] Improve mgid extraction (#1713)
Original PR: https://github.com/ytdl-org/youtube-dl/pull/30149
Fixes: #713, #1580, https://github.com/ytdl-org/youtube-dl/issues/30139

Authored by: Sipherdrakon, kikuyan
3 years ago
pukkandan a61fd4cf6f
[youtube:search_url] Add playlist/channel support
Closes #1213, #1214
3 years ago
pukkandan a6213a4925
[cleanup,youtube] Reorganize Tab and Search extractor inheritances 3 years ago
pukkandan 9941a1e127
[PatreonUser] Do not capture RSS URLs
Closes #1777
3 years ago
pukkandan ff51ed588f
Clarify video/audio-only formats in -F
Related: #1759
3 years ago
pukkandan 57dbe8077f
[jsinterp] Fix splice to handle float
Needed for new youtube js player f1ca6900
Closes #1767
3 years ago
pukkandan e5d731f35d
[tv2] Expand valid URL
Closes #1764
3 years ago
pukkandan d52cd2f5cd
[sbs] Fix for movies and livestreams
Closes #1640
3 years ago
pukkandan bc8ab44ea0
[itv] Fix for Python 3.6/3.7
Closes #1758
3 years ago
pukkandan 8f122fa070
[extractor] Extract `average_rating` from JSON-LD
Eg: Crunchyroll
3 years ago
pukkandan 14a086058a
[ARDBetaMediathek] Handle new URLs
Adapted from 8562218350
Closes #1601
3 years ago
Zirro 0e6b018a10
Ensure path for link files exists (#1755)
Authored by: Zirro
3 years ago
pukkandan f7b558df4d
[mediaklikk] Expand valid URL
Partial fix for #1409
3 years ago
pukkandan 1ee34c76bb
[vimeo] Add fallback for config URL
Closes #1662
3 years ago
pukkandan 234416e4bf
[downloader/ffmpeg] Fix for direct videos inside mpd manifests
Closes #1751
3 years ago
pukkandan c98d4df23b
[WDR] Expand valid URL
Closes #1749
3 years ago
4a1e2y5 849d699a8b
[xvideos] Detect embed URLs (#1729)
Authored by: 4a1e2y5
3 years ago
Ashish Gupta 77fcc65158
[CozyTV] Add extractor (#1727)
Authored by: Ashish0804
3 years ago
aarubui 545ad64988
[willow] Add extractor (#1723)
Authored by: aarubui
3 years ago
pukkandan d76991ab07
Fix `--check-formats` for `mhtml`
Closes #1709
3 years ago