Commit Graph

2008 Commits (14f25df2b6233553e968df023430ca96c0b1df9f)

Author SHA1 Message Date
felix 77f9033095
[compat] Split into sub-modules (#2173)
Authored by: fstirlitz, pukkandan
3 years ago
pukkandan 19a0394044
[cleanup] Misc cleanup and refactor (#2173) 3 years ago
pukkandan b6dc37fe2a
[test] Convert warnings into errors
* And fix some existing warnings

Authored by: fstirlitz
3 years ago
pukkandan 3d3bb1688b
[docs] Improve embedding docs and other minor fixes 3 years ago
pukkandan 2e25ce3a05
[niconico] Set `expected_protocol` to a public field
Closes #3440
3 years ago
Lesmiscore (Naoya Ozaki) c854208ccf
[downloader/fragment] Make single thread download work for --live-from-start (#3446)
Authored by: Lesmiscore
3 years ago
pukkandan e06bd8800f
Fix `--skip-unavailable-fragments`
Bug in d71fd41249
Closes #3437
3 years ago
pukkandan abfecb7bc1
[utils] Fix WebSocketsWrapper
Bug in 3cea3edd1a
Closes #3422
3 years ago
pukkandan 3b9d9f4374
Do not change fragment chunk-size when `--test`
Closes #3434
3 years ago
coletdjnz affc4fefea
[youtube] Fix episode metadata extraction 3 years ago
pukkandan 583910682f
[chingari] Fix archiving and tests 3 years ago
Felix S a49e777d59
[spotify] Detect iframe embeds (#3430)
Authored by: fstirlitz
3 years ago
Akmal cda1bc5197
[facebook] Improve thumbnail extraction (#3392)
Authored by: Wikidepia
3 years ago
pukkandan 743f39750c
Fix bug in 66cf3e1001 3 years ago
pukkandan 66cf3e1001
[EmbedSubtitle] Enable for more video extensions
Closes #3382
3 years ago
pukkandan b07897ef5b
[utils] certifi: Make sure the pem file exists
Closes #3353
3 years ago
pukkandan e5a998f368
[cleanup] Misc cleanup (#2173)
Authored by: fstirlitz, pukkandan
3 years ago
pukkandan f82711587c
[cleanup] Sort imports
Using https://github.com/PyCQA/isort

    isort -m VERTICAL_HANGING_INDENT --py 36 -l 80 --rr -n --tc .
3 years ago
pukkandan 86e5f3ed2e
[cleanup] Upgrade syntax
Using https://github.com/asottile/pyupgrade

1. `__future__` imports and `coding: utf-8` were removed
2. Files were rewritten with `pyupgrade --py36-plus --keep-percent-format`
3. f-strings were cherry-picked from `pyupgrade --py36-plus`

Extractors are left untouched (except removing header) to avoid unnecessary merge conflicts
3 years ago
pukkandan f9934b9614
[cleanup] Mark some compat variables for removal (#2173)
Authored by fstirlitz, pukkandan
3 years ago
felix cfb0511d82
[cleanup] Remove unused code paths (#2173)
Notes:

* `_windows_write_string`: Fixed in 3.6
  * https://bugs.python.org/issue1602
  * PEP: https://www.python.org/dev/peps/pep-0528

* Windows UTF-8 fix: Fixed in 3.3
  * https://bugs.python.org/issue13216

* `__loader__`: is always present in 3.3+
  * https://bugs.python.org/issue14646

* `workaround_optparse_bug9161`: Fixed in 2.7
  * https://bugs.python.org/issue9161

Authored by: fstirlitz
3 years ago
felix ab96d1ad1b
[cleanup] Remove unused scripts/tests (#2173)
Authored by fstirlitz, pukkandan
3 years ago
pukkandan 5a727063c5
[FFmpegMetadataPP] Remove `\0` from metadata 3 years ago
mehq fcdb8d6e88
[Gofile] Fix extraction (#3386)
Closes #3380
Authored by: mehq
3 years ago
krichbanana ca5300c7ed
[youtube] Add `:ytnotifications` extractor (#3347)
Authored by: krichbanana
3 years ago
pukkandan 97ec5bc550
[cookies] Report progress when importing cookies 3 years ago
pukkandan a25bca9f89
[youtube, cleanup] Minor refactoring
Authored by: coletdjnz, pukkandan
3 years ago
pukkandan f894294636
[EmbedThumbnail] Do not remove id3v1 tags 3 years ago
Lesmiscore 98804d034d
[utils] locked_file: Do not give executable bits for newly created files
Authored by: Lesmiscore
3 years ago
pukkandan 4abea8ca0a
[utils] `sanitize_path`: Fix when path is empty string 3 years ago
pukkandan d46a3e7a12
[rai] Add `release_year`
Closes #2319
3 years ago
Ashish Gupta 2d2b5493ee [ZEE5] Fix extractor.
Authored by: Ashish0804
Closes: https://github.com/yt-dlp/yt-dlp/issues/3105
3 years ago
github-actions dee1d65dc3 [version] update
Created by: pukkandan

:ci skip all
3 years ago
Jacek Nowacki 89fabf1125
[bilibili] Fix extraction of title with quotes (#3350)
Closes #3289
Authored by: dzek69
3 years ago
pukkandan 11e1c2e3f8
[TikTokVM] Fix redirect to user URL
Closes #3349, Closes #3351
3 years ago
pukkandan ebc7d3ff1f
[docs] Minor improvements (#3309, #3343)
Authored by: cffswb, danielyli


Co-authored-by: Daniel Li <dan@danielyli.com>
Co-authored-by: cffswb <karte577@gmail.com>
3 years ago
pukkandan d8a58ddce7
De-prioritize automatic-subtitles when no `--sub-lang` is given
Closes #3314
3 years ago
mehq 4d57133095
[Jable] Add extractor (#3341)
Closes #3284
Authored by: mehq
3 years ago
Alexander Seiler 9b8b7a7b5e
[Zattoo] Fix extractors (#2288)
Closes: #1244
Authored by: goggle
3 years ago
Ha Tien Loi ab0970b233
[NRK] Extract timestamp (#3231)
Closes #3211
Authored by: hatienl0i261299
3 years ago
Lesmiscore b52e788eb2
[Piapro] Extract description with break lines
Authored by: Lesmiscore
Closes #3334
3 years ago
pukkandan 316f2650f8
Ignore `mhtml` formats from `-f mergeall`
Closes #3324
3 years ago
Ha Tien Loi bd4073c535
[AfreecaTV] Add `AfreecaTVUserIE` (#3286)
Closes #3257
Authored by: hatienl0i261299
3 years ago
pukkandan 22fba53fbd
[FfmpegMetadata] Write id3v1 tags 3 years ago
coletdev 61d3665d9d
[youtube] Fix uploader for collaborative playlists (#3332)
Authored by: coletdjnz
3 years ago
Lesmiscore (Naoya Ozaki) 870efdee28
[TVer] Fix extractor (#3268)
Authored by: Lesmiscore
3 years ago
pukkandan b506289fe2
[test] Add `test_locked_file` 3 years ago
pukkandan b63837bce0
[utils] locked_file: Fix non-blocking non-exclusive lock 3 years ago
Justin Keogh fcfa8853e4
[utils] locked_file: Do not truncate files before locking (#2994)
Authored by: jakeogh, pukkandan
3 years ago
Lesmiscore (Naoya Ozaki) 06b1628d3e
[twitcasting] Don't return multi_video for archive with single hls manifest (#3319)
Authored by: Lesmiscore
3 years ago
panatexxa da1ffde15d
[Moviepilot] Add extractor (#3282)
Authored by: panatexxa
3 years ago
Ha Tien Loi 42a4f21a03
[fptplay] Fix metadata extraction (#3218)
Authored by: hatienl0i261299
3 years ago
pukkandan 8973767198
Do not lock downloading file on Windows
Closes #3124
3 years ago
pukkandan 0edb3e336c
Do not prevent download if locking is unsupported
Closes #3022

Failure to lock download-archive is still fatal.
This is consistent with youtube-dl's behavior
3 years ago
pukkandan ce0593ef61
[http] Fix #3215 3 years ago
pukkandan a44ca5a470
[cleanup] Misc fixes
Closes https://github.com/yt-dlp/yt-dlp/pull/3213, Closes https://github.com/yt-dlp/yt-dlp/pull/3117

Related: https://github.com/yt-dlp/yt-dlp/issues/3146#issuecomment-1077323114, https://github.com/yt-dlp/yt-dlp/pull/3277#discussion_r841019671, a825ffbffa (commitcomment-68538986), https://github.com/yt-dlp/yt-dlp/issues/2360, 5fa3c9a88f (r70393519), 5fa3c9a88f (r70393254)
3 years ago
Teemu Ikonen 0a8a7e68fa
[ruutu] Detect embeds (#3294)
Authored by: tpikonen
3 years ago
Jeff Huffman f4d706a931
[crunchyroll:playlist] Implement beta API (#2955)
Closes #3121, #2930

Authored by: tejing1
3 years ago
Ha Tien Loi 5fa3c9a88f
[TikTok] Fix URLs with user id (#3295)
Closes #3243
Authored by: hatienl0i261299
3 years ago
pukkandan 04f3fd2c89
[cleanup] Use `_html_extract_title` 3 years ago
pukkandan 85e801a9db
Fallback to video-only format when selecting by extension
Closes #3296
3 years ago
pukkandan 5127e92a94
Fix filepath sanitization in `--print-to-file` 3 years ago
Ha Tien Loi 18eac302a2
[Imdb] Improve extractor (#3291)
Closes #3283
Authored by: hatienl0i261299
3 years ago
Tim Schindler 12e022d074
[Cybrary] Add extractor (#3264)
Authored by: aaearon
3 years ago
Lesmiscore (Naoya Ozaki) 265e586d96
[openrec] Download archived livestreams (#3267)
Authored by: Lesmiscore
3 years ago
Fam0r fbfde1c3e6
[elonet] Rewrite extractor (#3277)
Closes #2911
Authored by: Fam0r, pukkandan
3 years ago
aarubui dc57e74a7f
[tenplay] Improve extractor (#3280)
Authored by: aarubui
3 years ago
pukkandan a17526e427
[youtube:tab] Minor improvements (See desc)
* Support shorts on channel homepage
* Extract thumbnail of OLAK playlists
3 years ago
coletdev ad210f4fd4
[youtube:search] Support hashtag entries (#3265)
Authored-by: coletdjnz
3 years ago
coletdjnz c8e856a551
[web.archive:youtube] Make CDX API requests non-fatal
Partial fix for https://github.com/yt-dlp/yt-dlp/issues/3278
Authored-by: coletdjnz
3 years ago
nixxo c085e4ec47
[rai] Fix extraction of http formats (#3272)
Closes #3270
Authored by: nixxo
3 years ago
pukkandan 4c268f9cb7
[Nebula] Fix bug in 52efa4b312 3 years ago
Lesmiscore (Naoya Ozaki) 5d45484cc7
[niconico] Fix extraction of thumbnails and uploader (#3266) 3 years ago
pukkandan e6f868a63c
[utils] `traverse_obj`: Allow filtering by value 3 years ago
pukkandan c4f60dd7cd
[utils] Add `try_call` 3 years ago
pukkandan f189faf1ce
[BRMediathek] Fix VALID_URL
Closes #2466
3 years ago
Alexander Seiler 504f789ad5
[AZMedien] Support `tv.telezueri.ch` (#3251)
Authored by: goggle
3 years ago
Bricio bb5a7cb8ad
[Craftsy] Add extractor (#3208)
Authored by: Bricio
3 years ago
zackmark29 c418e6b5a6
[viu] Fix bypass for preview (#3247)
Authored by: zackmark29
3 years ago
pukkandan 11078c6d57
[crunhyroll] Fix inheritance
https://github.com/yt-dlp/yt-dlp/pull/2955#issuecomment-1083060465
3 years ago
Daniel ab2579bb45
[xnxx] Add `xnxx3.com` (#3188)
Authored by: rozari0
3 years ago
Ha Tien Loi 48e15bb6b1
[dailymotion] Support `geo.dailymotion.com` (#3230)
Closes #3229
Authored by: hatienl0i261299
3 years ago
pukkandan af4944d84b
Fix bug in 8a7f68d0b1
Closes #3241
3 years ago
David e7870111e8
[YouTube] Add new age-gate bypass (#3233)
Closes #3182
Authored by: zerodytrash, pukkandan
3 years ago
pukkandan 8a7f68d0b1
[ffmpeg] Cache version data
Related: https://github.com/dasl-/pifi/issues/9
3 years ago
Ha Tien Loi 9139d2fae0
[WasdTV] Add extractor (#3045)
Closes #3041
Authored by: un-def, hatienl0i261299
3 years ago
nyuszika7h bdd60588b0
[viki] Don't attempt to modify URLs with signature (#3222)
Closes #1379
Authored by: nyuszika7h
3 years ago
Luc Ritchie f5f15c9993
[BiliIntl] Support user-generated videos (#3203)
Authored by: wlritchi
3 years ago
pukkandan cb96c5be70
Fix `--no-overwrite` for playlist infojson
Fixes: https://github.com/yt-dlp/yt-dlp/issues/1467#issuecomment-1079922971
3 years ago
pukkandan 90137ca4be
[utils] Add `filter_dict` 3 years ago
coletdev 1c1b2f96ae
[youtube:tab] Fix duration extraction for shorts (#3171)
Related: https://github.com/TeamNewPipe/NewPipe/issues/8034
Authored-by: coletdjnz
3 years ago
Felix S 47b8bf207b
[go,viu] Extract subtitles from the m3u8 manifest (#3219)
Authored by: fstirlitz
3 years ago
Tim Schindler 4628a3aa75
[ITProTV] Add extractor (#3196)
Authored by: aaearon
3 years ago
mehq 5b4bb715e6
[BanBye] Add extractor (#3177)
Closes #3175
Authored by: mehq
3 years ago
pukkandan 1235d333ab
[youtube] Fix auto-translated automatic captions
d49669acad only covered ASR

Closes #2956
3 years ago
pukkandan 18e4940825
[youtube] Add extractor-arg to skip auto-translated subs 3 years ago
pukkandan c0b6e5c74d
Show warning when all media formats have DRM
Related: #1379
3 years ago
shirt 727029c508
[youtube] Detect DRM better
Authored by: shirt-dev
3 years ago
pukkandan 5c3895fff1
[outtmpl] Limit changes during sanitization
Closes #2761
3 years ago
coletdev fd2ad7cb24
[youtube:tab] Return shorts url if video is a short (#3168)
Allows filtering out shorts from feeds with `--match-filter`
Closes #3165
Authored-by: coletdjnz
3 years ago
pukkandan 4a3175fc4c
[VideoConvertor] Ensure all streams are copied
Closes #3200
3 years ago
pukkandan 5cf34021f5
[Concat] Ensure final directory exists
Fixes https://github.com/yt-dlp/yt-dlp/issues/3181#issuecomment-1079622589
3 years ago
pukkandan 34baa9fdf0
[outtmpl] Fix replacement/default when used with alternate 3 years ago
pukkandan 6db9c4d57d
Ignore format-specific fields in initial pass of `--match-filter`
Closes #3074
3 years ago
Lesmiscore (Naoya Ozaki) 3cea3edd1a
[utils] WebSocketsWrapper: Allow omitting `__enter__` invocation (#3187)
Authored by: Lesmiscore
3 years ago
pukkandan b1a7cd056a
Treat multiple `--match-filters` as OR
Closes #3144
3 years ago
pukkandan 28787f16c6
[downloader] Fix invocation of `HttpieFD`
Closes #3154
3 years ago
zackmark29 1fb707badb
[viu] Fixed extractor (#3136)
Closes #3133
Authored by: zackmark29, pukkandan
3 years ago
pukkandan a3f2445e29
[postprocessor,cleanup] Create `_download_json` 3 years ago
pukkandan ae72962643
[youtube] Try embedded client variants before agegate
agegate variants appears to be broken, but don't remove them for the time-being
3 years ago
pukkandan ae6a1b9585
[docs] Minor improvements
Closes #3127, Closes #3081, Closes #3177
3 years ago
pukkandan 231025c463
Fix bug in 52efa4b312
Closes #3173
3 years ago
pukkandan 700ccbe3f1
[extractor] Allow control characters inside json
Closes #3174
3 years ago
vvto33 12a64f2777
[TVer] Support landing page (#3075)
Authored by: vvto33
3 years ago
mehq b8f2f8f6b3
[LastFM] Add extractors (#3141)
Closes #2967
Authored by: mehq
3 years ago
coletdev af14914baa
Remove `Accept-Encoding` header from `std_headers` (#3153)
This should be set by each downloader to what it supports.
Fixes https://github.com/yt-dlp/yt-dlp/issues/3142
Authored-by: coletdjnz
3 years ago
pukkandan ea5ca8e7fc
[ellentube] Extract subtitles from manifest
Fixes https://github.com/ytdl-org/youtube-dl/issues/30761
3 years ago
Lesmiscore (Naoya Ozaki) c2d2ee40eb
[generic] Extract subtitles from video.js (#3156)
Authored by: Lesmiscore
3 years ago
pukkandan c70c418d33
Fix `--abort-on-error` for subtitles
Closes #3163
3 years ago
pukkandan b9c7b1e9b4
[cleanup, vimeo] Fix tests 3 years ago
coletdev d5820461e8
Use certificates from `certifi` if installed (#3115)
Fixes #3102 and most `CERTIFICATE_VERIFY_FAILED` issues

Authored by: coletdjnz
3 years ago
coletdev 8a23db9519
[wget] Fix proxy (#3152)
Upstream PR: https://github.com/ytdl-org/youtube-dl/pull/29343
Authored-by: kikuyan, coletdjnz
3 years ago
CplPwnies 1f1df1251e
[adobepass] Fix Suddenlink MSO (#3148)
Authored by: CplPwnies
3 years ago
1-Byte 84842aee2b
[azmedien] Add TVO Online to supported hosts (#3125)
Authored by: 1-Byte
3 years ago
Lesmiscore (Naoya Ozaki) be4685ab7b
[http] Reject broken range before request (#3079)
* And fix filesize estimate for byterange downloads

Closes #2001
Authored by: Lesmiscore, Jules-A, pukkandan
3 years ago
coletdev e6552207da
[panopto] Improve subtitle extraction and support slides (#3009)
Related: #1946, #2908
Authored-by: coletdjnz
3 years ago
coletdev a2e77303e3
[downloader/http] Retry on more errors (#3065)
Closes #3056, #2071
Related: #3034, #2969
Authored-by: coletdjnz
3 years ago
foghawk 510809f1aa
[nitter] Minor fixes and update instance list (#3099)
Authored by: foghawk
3 years ago
i6t f4ad919298
[Veo] Fix extractor (#3101)
Authored by: i6t
3 years ago
s0u1h eeb2a770f3
[utils] `format_decimal_suffix`: Fix for very large numbers (#3109)
Authored by: s0u1h
3 years ago
pukkandan 0c14d66ad9
Fix `autonumber`
Bug in 09b49e1f68
3 years ago
pukkandan 52efa4b312
[extractor] Add `_perform_login` function (#2943)
* Adds new functions `_initialize_pre_login` and `_perform_login` as part of the extractor API
* Adds `ie.supports_login` to the public API
3 years ago
Luc Ritchie 028f6437f1
[afreecatv] Match new vod url (#3097)
Authored by: wlritchi
3 years ago
Sipherdrakon 43c38abd1f
[ParamountPlus,CBS] Change VALID_URL (#3098)
Closes #3096

Authored by: Sipherdrakon
3 years ago
pukkandan e4b98809cf
[youtube] Fix pagination of `membership` tab 3 years ago
pukkandan 16c620bc55
Handle float in `--wait-for-video`
Closes #3082
3 years ago
pukkandan 5a373d9768
[veo] Fix `_VALID_URL`
Closes #3095
3 years ago
Ha Tien Loi 7e6a187096
[Huya] Add extractor (#3035)
Closes #3033
Authored by: hatienl0i261299
3 years ago
Lesmiscore (Naoya Ozaki) 3f168f0e45
[RUTV] Fix format sorting (#3085)
Closes #3084
Authored by: Lesmiscore
3 years ago
Lesmiscore (Naoya Ozaki) 7bdcb4a40e
[niconico] Rewrite NiconicoIE (#3018)
Closes https://github.com/yt-dlp/yt-dlp/issues/2636, partially fixes https://github.com/yt-dlp/yt-dlp/issues/367
Authored by: Lesmiscore
3 years ago
Soebb 497a6c5f57
[daftsex] Fix extractor (#2757)
Closes #2637

Authored by: Soebb
3 years ago
BohwaZ 4b3c5d1b81
[FranceCulture] Support playlists (#1872)
Authored by: bohwaz
3 years ago
Dorian Westacott ec47c12f69
[ParamountPlusSeries] Support multiple pages (#3026)
Authored by: dodrian
3 years ago
pukkandan 25791435b7
[arte] Add `format_note` to m3u8 formats
Related: #3086
3 years ago
pukkandan 4e34889f1c
[rumble] unescape title 3 years ago
pukkandan a1b2d84360
[youtube] Avoid false positives when detecting damaged formats
Closes #3083
3 years ago
coletdjnz 5dbc77df26
[youtube:api] Prefer minified JSON response
Authored-by: coletdjnz
3 years ago
Lesmiscore (Naoya Ozaki) d71fd41249
[fragment] Read downloaded fragments only when needed (#3069)
Authored by: Lesmiscore
3 years ago
pukkandan aeb21b98f1
[phantomjs] Fix bug in 8b7539d27c
Closes #3066
3 years ago
coletdev b3edc8068e
[downloader/mhtml] Fix fragments with absolute urls (#3044)
Authored-by: coletdjnz
3 years ago
coletdev 17322130a9
[youtube] Improve video upload date handling (#3029)
* Don't prefer UTC upload date for past live streams/premieres
* Improve regex (fixes a regression)

Authored-by: coletdjnz
3 years ago
pukkandan 5ca764c506
[FFmpegVideoConvertor] Add more formats to `--remux-video` 3 years ago
pukkandan e880c92c65
Exit after `--dump-user-agent`
Bug in d1b5f70bc9

Closes #3055
3 years ago
coletdjnz a825ffbffa
[extractor] Support merging subtitles with data
Authored-by: coletdjnz
3 years ago
pukkandan 592b748582
[cleanup] Minor cleanup
Closes #3006
3 years ago
pukkandan cf4f42cb97
Protect stdout from unexpected progress and console-title
Closes #3023
3 years ago
pukkandan da1d734fbe
Remove incorrect warning for `--dateafter`
Closes #3030
3 years ago
pukkandan 2b38f7b2bc
[MetadataParser] Validate outtmpl early 3 years ago
pukkandan 76aa991374
Fix case of `http_headers`
Bug in 8b7539d27c

Fixes https://github.com/yt-dlp/yt-dlp/issues/1346#issuecomment-1064527765
3 years ago
Lesmiscore (Naoya Ozaki) 24e3d87431
[PokemonSoundLibrary] Add extractor (#3001)
Authored by: Lesmiscore
3 years ago
Ha Tien Loi 63b2f88bc7
[Zingmp3] Fix signature (#3004)
Authored by: hatienl0i261299
3 years ago
pukkandan 07ff290dce
Fix `--sleep-interval`
Bug in d1b5f70bc9

Closes #3012
3 years ago
pukkandan 51c22ef4e2
Fix `--throttled-rate`
Typo in d1b5f70bc9

Closes #2996
3 years ago
Ha Tien Loi 33b8c411bc
[MangoTV] Improve extractor (#2971)
Authored by: hatienl0i261299
3 years ago
MMM 10331a2672
Fix `--print` with `--ignore-no-formats` when url is `None` (#3000)
Authored by: flashdagger
3 years ago
Lesmiscore (Naoya Ozaki) 6e6beffd04
[openrec] Refactor extractors (#2941)
Authored by: Lesmiscore
3 years ago
pukkandan e491d06d34
[utils] ExtractorError: Fix for older python versions
Closes #2993
3 years ago
coletdev e248be3319
[panopto] Add extractors (#2908)
Based on https://github.com/ytdl-org/youtube-dl/pull/13449
Closes #1946
Authored by: coletdjnz, kmark
3 years ago
pukkandan ff91cf7483
[utils] Add `get_first` 3 years ago
github-actions a3b7dff015 [version] update
Created by: pukkandan

:ci skip all
3 years ago
pukkandan d1b5f70bc9
[cleanup] Refactor `__init__.py` (#2570)
* Split `__init__` code into multiple functions
* Clean up validation code by grouping similar types of options
* Expose `parse_options` to third parties
3 years ago
github-actions 1eae7f94c1
[version] update
Created by: pukkandan

:ci skip all
3 years ago
P-reducible 9461cb586a
[Rokfin] Fix `availability` (#1534)
Authored by: P-reducible
3 years ago
pukkandan a405b38f20
[youtube] Further de-prioritize 3gp format 3 years ago
pukkandan 08d30158ec
[cleanup, docs] Misc cleanup
Closes #2828, closes #2734, closes #2802, closes #2937
3 years ago
Ha Tien Loi c89bec262c
[xinpianchang] Add extractor (#2963)
Authored by: hatienl0i261299
3 years ago
Ha Tien Loi 151f8f1c02
[fptplay] Add extractor (#2949)
Closes #2857
Authored by: hatienl0i261299
3 years ago
Max Mehl a35155be17
[peertube] Add media.fsfe.org (#2986)
Authored by: mxmehl
3 years ago
nyuszika7h e66662b1e0
[ccma] Fix timestamp parsing (#2989)
Authored by: nyuszika7h
3 years ago
coletdev 4390d5ec12
Add brotli content-encoding support (#2433)
Authored by: coletdjnz
3 years ago
CplPwnies 9e0e6adb2d
[adobepass] Add Suddenlink MSO (#2977)
Closes #2704
Authored by: CplPwnies
3 years ago
Lesmiscore b637c4e22e
[mildom] Fix linter 3 years ago
Lesmiscore (Naoya Ozaki) fb6e3f4389
[mildom] Rework extractors (#2940)
Authored by: Lesmiscore
3 years ago
pukkandan 409cdd1ec9
[ard] Fix valid URL
Partial fix for #2975
3 years ago
coletdev 992f9a730b
[youtube] Prefer UTC upload date for videos (#2223)
Except for live/scheduled streams/premieres. 
Closes #1881
Related: #2402 
Authored-by: coletdjnz
3 years ago
pukkandan 497d2fab6c
[utils] Better traceback for `ExtractorError` 3 years ago
pukkandan 2807d1709b
[nrk] Add fallback API
Closes #1891
3 years ago
Lesmiscore 1ed7953a74
[utils] render_table: Fix character calculation for removing extra gap
without this fix, the column next to delimiter will lack leading spaces on terminal (see https://github.com/yt-dlp/yt-dlp/pull/920#issuecomment-1059914615 for the situation)
3 years ago
pukkandan d49669acad
[youtube] Fix automatic captions
Closes #2956
3 years ago
foghawk bed30106f5
[tumblr] Fix extractor (#2883)
Authored by: foghawk
3 years ago
Zenon Mousmoulas 27231526ae
[ant1newsgr] Add extractor (#1982)
Authored by: zmousm
3 years ago
pukkandan 50e93e03a7
Update to ytdl-commit-6508688
Make default upload_/release_date a compat_str
6508688e88

Except:
* "[NDR] Overhaul NDR and NJoy extractors" https://github.com/ytdl-org/youtube-dl/pull/30531
    - 01824d275b
    - 39a98b09a2
    - f0a05a55c2
    - 4186e81777
3 years ago
FestplattenSchnitzel 72e995f122
[VideocampusSachsen] Add extractors (#2787)
Authored by: FestplattenSchnitzel
3 years ago
pukkandan 8b7539d27c
Implement `--add-header` without modifying `std_headers`
Closes #2526, #1614
3 years ago
pukkandan e48b3875ec
Revert 2e4cacd038
Closes #2923
3 years ago
pukkandan 2a938746f3
Fix verbose log when stdout/stderr encoding is `None`
See: 5c10453827
3 years ago
pukkandan 933dbf5a55
[bandcamp] Detect acodec 3 years ago
pukkandan a10aa588b0
[FormatSort] Consider `acodec`=`ogg` as `vorbis` 3 years ago
pukkandan be8cd3cb1d
[twitch] Fix field name of `view_count` 3 years ago
pukkandan 319b6059d2
Better error message when no --live-from-start format 3 years ago
pukkandan 4c3f8c3fb6
Handle negative duration from extractor
Closes #2921
3 years ago
pukkandan 7265a2190c
Fix doubling of `video_id` in `ExtractorError` 3 years ago
pukkandan 3a4bb9f751
[lbry] Fix `--ignore-no-formats-error`
Closes #2942
3 years ago
i6t b90dbe6c19
[Gettr] Improve extractor (#2920)
Authored by: i6t
3 years ago
Jeff Huffman 97bef011ee
[crunchyroll] Better error reporting on login failure (#2938)
Authored by: tejing1
3 years ago
Ha Tien Loi ecca4519b7
[zingmp3] Fix extractor (#2889)
Authored by: hatienl0i261299
3 years ago
Ha Tien Loi 761fba6d22
[daystar] Add extractor (#2924)
Closes #2887
Authored by; hatienl0i261299
3 years ago
Ha Tien Loi 5bcccbfec3
[telegram] Add extractor (#2922)
Closes #2910

Authored by: hatienl0i261299
3 years ago
coletdev ded9f32667
[extractor] Support `--mark-watched` without `_NETRC_MACHINE` (#2939)
Authored by: coletdjnz
3 years ago
Emanuel Hoogeveen 45806d44a7
[downloader] Obey `--file-access-retries` when deleting/renaming (#2224)
Authored by: ehoogeveen-medweb
3 years ago
pukkandan 747c0bd127
[utils] Improve file locking
* Implement non-blocking locks for windows
* Don't raise error when closing a closed file
3 years ago
Justin Keogh acea8d7cfb
[utils] Fix file locking for AOSP (#2714)
Closes #2080, #2670

Authored by: jakeogh
3 years ago
pukkandan f1d130902b
[utils] OnDemandPagedList: Do not download pages after error 3 years ago
pukkandan c2ae48dbd5
[manyvids] Extract `uploader` (#2913)
Authored by: regarten
3 years ago
pukkandan a5c0c20252
[cleanup] Don't pass protocol to `_extract_m3u8_formats` for live videos
`live` parameter already handles changing the protocol
3 years ago
Lesmiscore (Naoya Ozaki) f494ddada8
[niconico] Add playlist extractors and refactor (#2915)
Authored by: Lesmiscore
3 years ago
Lesmiscore (Naoya Ozaki) 02fc6feb6e
[mirrativ] Cleanup extractor code (#2925)
Authored by: Lesmiscore
3 years ago
pukkandan 7eaf7f9aba
[rokfin] Add stack and channel extractors (#1534)
Authored by: P-reducible, pukkandan
3 years ago
pukkandan 334b1c4800
[rokfin] Add extractor (#1534)
Authored by: P-reducible, pukkandan
3 years ago
coletdev 7c219ea601
[youtube:tab] Follow redirect to regional channel (#2884)
Closes #2694
Authored by: coletdjnz
3 years ago
Lesmiscore (Naoya Ozaki) 93c8410d33
[downloader/fragment] Fix bugs around resuming with Range (#2901)
Authored by: Lesmiscore
3 years ago
Lesmiscore 195c22840c
[downloader/fragment] Ignore `FileNotFoundError` when downloading livestreams
when `--live-from-start` is used for YouTube and the live ends, request for the last segment prematurely ends (or 404, 403).
this is causing lack of the file and `FileNotFoundError`
lacking segment doesn't have any data, so it's safe to ignore
3 years ago
Lesmiscore f0734e1190
[downloader/fragment] Fix problem where multiple threads can share one iterator
which causes "ValueError: generator already executing" error

Closes #2881
3 years ago
Lesmiscore (Naoya Ozaki) 15dfb3929c
[fc2:live] Add extractor (#2418)
Authored by: Lesmiscore
3 years ago
Lesmiscore (Naoya Ozaki) 3e9b66d761
[AbemaTV] Add extractors (#1688)
Authored by: Lesmiscore
3 years ago
Lesmiscore (Naoya Ozaki) a539f06570
[downloader/fragment] Improve `--live-from-start` for YouTube livestreams (#2870) 3 years ago
Lesmiscore (Naoya Ozaki) 03f830040a
[YoutubeDL] Fill more fields for playlists (#2824) 3 years ago
pukkandan 09b49e1f68
Add pre-processor stage `after_filter`
* Move `_match_entry` and `post_extract` to `process_video_result`. It is also left in `process_info` for API compat
* `--list-...` options and `--force-write-archive` now obey filtering options
* Move `SponsorBlockPP` to `after_filter`. Closes https://github.com/yt-dlp/yt-dlp/issues/2536
* Reverts 4ec82a72bb since this commit addresses the issue it was solving
3 years ago
pukkandan 1108613f02
[youtube:tab] Reject webpage data if redirected to home page
Closes #2660
3 years ago
pukkandan a30a6ed3e4
[youtube:tab] Add `approximate_date` extractor-arg 3 years ago
pukkandan 65d151d58f
[spiegel] Fix `_VALID_URL`
Closes #2842
3 years ago
pukkandan 72073451be
[ThumbnailsConvertor] Support `webp`
Closes #2226
3 years ago
Lesmiscore (Naoya Ozaki) 77cc7c6e60
[nhk] Add support for NHK for School (#2850)
Authored by: Lesmiscore
3 years ago
i6t 971c4847d7
[Gettr] Fix formats order (#2832)
Closes #2557

Authored by: i6t
3 years ago
Nil Admirari 7a34b5d628
[SponsorBlock] Fixes for highlight and "full video labels" (#2849)
Authored by: nihil-admirari
3 years ago
Aniruddh Joshi 4d4f9a029f
[zee5] Support web-series (#2827)
Authored by: Aniruddh-J
3 years ago
Lesmiscore (Naoya Ozaki) f099df1463
[TwitCasting] Check for password protection (#2838)
Authored by: Lesmiscore
3 years ago
pukkandan 3f4faff748
[generic] Pass referer to extracted formats
Closes #2839
3 years ago
Daniel.Zeng be8d623455
[Bilibili] Pass referer for all formats (#2834)
Authored by: blackgear
3 years ago
Lesmiscore a7d4acc018
[youtube] Escape possible `$` in `_extract_n_function_name` regex 3 years ago
Bepis febff4c119
[tubitv] Fix/improve TV series extraction (#2829)
Authored by: bbepis
3 years ago
pukkandan ed66a17ef0
[FFmpegConcat] Abort on `--simulate` 3 years ago
Bricio 5625e6073f
[Biqle] Fix extractor (#2731)
Closes #193
Authored by: Bricio
3 years ago
pukkandan 0ad92dfb18
[youtube] De-prioritize potentially damaged formats
Closes #2823
3 years ago
pukkandan 60f3e99592
Tolerate failure to `--write-link` due to unknown URL
Closes #2724
3 years ago
pukkandan 8d93e69d67
Create necessary directories for `--print-to-file`
Closes #2721
3 years ago
pukkandan 3aa915400d
Fix `-all` for `--sub-langs`
Closes #2703
3 years ago
pukkandan dcd55f766d
[aria2c] Add `--http-accept-gzip=true`
Closes #1936, #1236
3 years ago
pukkandan 2e4cacd038
[youtube] Fix intermittent failure of embed-based age-gate bypass 3 years ago
Ronnnny c15c316b21
[abc] Support 1080p (#2819)
Authored by: Ronnnny
3 years ago
Bricio 549cb2a836
[rtvs] Fix extractor (#2795)
Closes #2758

Authored by: Bricio
3 years ago
MinePlayersPE c571b3a6ab
[youtube] Fix n-sig extraction for phone player JS (#2816)
Authored by: MinePlayersPE
3 years ago
Bricio 5b804e3906
[washingtonpost] Fix extractor (#2796)
Closes #2778
Authored by: Bricio
3 years ago
Lesmiscore (Naoya Ozaki) 6bb608d055
[piapro] Add extractor (#2801)
Based on https://github.com/ytdl-org/youtube-dl/pull/25922
Closes #2710, https://github.com/ytdl-org/youtube-dl/issues/5856

Authored by: pycabbage, Lesmiscore
3 years ago
Nil Admirari ae419aa94f
[Sponsorblock] minor fixes (#2793)
* preserve mtime - Closes #2769
* keep concat spec on failure

Authored by: nihil-admirari
3 years ago
ajj8 ac184ab742
[bbc] Fix extraction of news articles (#2811)
Closes #1374

Authored by: ajj8
3 years ago
pukkandan 5c10453827
Fix for when stdout/stderr encoding is None
Closes #2711
3 years ago
pukkandan ffa89477ea
[extractor] Fix for manifests without period duration
Closes #2705
Authored by: dirkf, pukkandan
3 years ago
zenerdi0de db74de8c54
[dropbox] fix regex (#2814)
Closes #2812
Authored by: zenerdi0de
3 years ago
Grabien edecb5f81f
[extractor/cspan] Support of C-Span congress videos (#2295)
Authored by: Grabien
3 years ago
lyz-code 85a0ad0117
[bandcamp] Fix user URLs (#2800)
Authored by: lyz-code
3 years ago
Lesmiscore (Naoya Ozaki) 07ea0014ae
[twitcasting] Add fallback for finding running live (#2803)
Authored by: Lesmiscore
3 years ago
schn0sch e1f7f235bd
[peekvids] Use JSON-LD (#2784)
Authored by: schn0sch
3 years ago
Lesmiscore (Naoya Ozaki) 9a5b012575
[niconico:tag] Add support for searching tags (#2789) 3 years ago
Lesmiscore (Naoya Ozaki) df635a09a4
[twitcasting] Fix extraction (#2788)
Authored by: Lesmiscore
3 years ago
cyberfox1691 812283199a
[murrtube] Add extractor (#2387)
Authored by: cyberfox1691
3 years ago
marieell 5c6dfc1f79
[ATVAt] Detect geo-restriction (#2777)
Authored by: marieell
3 years ago
schn0sch c2a8547fdc
[peekvids] Add extractor (#2414)
Authored by: schn0sch
3 years ago
Bricio 0a19532ead
[Caltrans] Add extractor (#2781)
Closes #2775

Authored by: Bricio
3 years ago
Ronald Ip 2d41e2eceb
[twitter] Fix for private videos (#2772)
Closes #2762, https://github.com/ytdl-org/youtube-dl/issues/27643
Authored by: iphoting
3 years ago
Lesmiscore (Naoya Ozaki) 81c5f44c0f
[fc2] Fix extraction (#2776)
Closes #2774

Authored by: Lesmiscore
3 years ago
Michael Pauley 1f7db8533a
[cookies] Update MacOS12 `Cookies.binarycookies` location (#2742)
Authored by: mdpauley
3 years ago
pukkandan e8969bda94
Obey `--abort-on-error` for "ffmpeg not installed"
Closes #1840
3 years ago
chris c82f051dbb
[ruv.is] Add extractor (#2665)
Closes: #2122

Authored by: iw0nderhow
3 years ago
pukkandan 49895f062e
[tiktok] Fix `vt.tiktok` URLs
and add test
3 years ago
coletdev 60f393e48b
[youtube] Ensure subtitle urls are absolute (#2765)
Closes #2755

Authored by: coletdjnz
3 years ago
pukkandan 88afe05695
[tiktok] Fix `vm.tiktok` URLs
Closes #2396
3 years ago
pukkandan 57ebfca39b
Set `webpage_url_...` from `webpage_url` and not input URL
Closes #2756
3 years ago
YuenSzeHong b1cb0525ac
[fujitv] Extract resolution for free sources (#2685)
Authored by: YuenSzeHong
3 years ago
Lesmiscore (Naoya Ozaki) da42679b87
[utils] WebSockets wrapper for non-async functions (#2417)
Authored by: Lesmiscore
3 years ago
Lesmiscore 2944835080
[bigo] Fix extractor to not to use `form_params` 3 years ago
Tom a3eb987e0e
[zoom] Add support for screen cast (#2699)
Authored by: Mipsters
3 years ago
Lesmiscore (Naoya Ozaki) 7bc33ad0e9
[bigo] Add extractor (#2749)
Fixes https://github.com/ytdl-org/youtube-dl/issues/18357

Authored by: Lesmiscore
3 years ago
Bricio 2068a60318
[generic] Set rss `guid` as video id (#2741)
Closes #2424
Authored by: Bricio
3 years ago
Lukas Fink 1ce9a3cb49
Add regex operator and quoting to format filters (#2698)
Closes #2681 
Authored by: lukasfink1
3 years ago
pukkandan d49f8db39f
[utils] Validate `DateRange` input
Closes #2641
3 years ago
pukkandan ab6df717d1
[youtube] Differentiate descriptive audio by language code
Related: #2677
3 years ago
pukkandan 0c8d9e5fec
[youtube] Label original auto-subs
Closes #2655
3 years ago
Felix S 3f047fc406
[extractor] Extract subtitles from manifests for more sites (#2686)
vimeo, globo, kaltura, svt

Authored by: fstirlitz
3 years ago
i6t 82b5176783
[Gettr] Add `GettrStreamingIE` (#2661)
Closes #2654
Authored by: i6t
3 years ago
Bricio 17b183886f
[globo] Expand valid URL (#2732)
Closes #2730 
Authored by: Bricio
3 years ago
Bricio cd170e8184
[beeg] Fix extractor (#2616)
Closes #2592

Authored by: Bricio
3 years ago
pukkandan 297e9952b6
[extractor] Allow `http_headers` to be specified for `thumbnails` 3 years ago
marieell dca4f46274
[cleanup] Remove extractors for some dead websites (#2739)
90tv.ir, HornBunny.com, 220.ro, 5min.com, Kankan.com, Roxwel.com,
FreshLive.tv, TheScene.com, Vube.com

Authored by: marieell
3 years ago
Luc Ritchie 5dee3ad037
[afreecatv] Support password-protected livestreams (#2738)
Authored by: wlritchi
3 years ago
pukkandan 079a7cfc71
[downloader] Do not use aria2c for non-native `m3u8`
Closes #2718
3 years ago
pukkandan 3856407a86
[options] Rename `--clean-infojson` to `--clean-info-json` 3 years ago
pukkandan db2e129ca0
[options] Better ambiguous option resolution
Eg: `--write-auto` no longer results in
> ambiguous option: --write-auto (--write-auto-subs, --write-automatic-subs?)
3 years ago
marieell 1209b6ca5b
[zaq1] Remove dead extractor (#2728)
Was already partially removed in 29f7c58aaf
Authored-by: marieell
3 years ago
Justin Keogh a3125791c7
[utils] Use `locked_file` for `sanitize_open` (#1066)
Authored by: jakeogh
3 years ago