Commit Graph

168 Commits (d908aa636ad19c17ae0033e58bde3e45dca870c8)

Author SHA1 Message Date
pukkandan d908aa636a
[cleanup] Fix typos 3 years ago
pukkandan 3d89341b47
[common] bugfix for when `compat_opts` is not given 3 years ago
pukkandan d8ec40b39f
[rmcdecouverte] Generalize `_VALID_URL`
Closes #291
3 years ago
pukkandan fac988053f
Release 2021.05.11
* and some documentation improvements
3 years ago
pukkandan 61241abbb0
[generic] Respect the encoding in manifest 3 years ago
pukkandan 53ed7066ab
Option `--compat-options` to revert some of yt-dlp's changes
* Deprecates `--list-formats-as-table`, `--list-formats-old`
3 years ago
pukkandan 2f567473c6
[Plugins] Prioritize plugins over standard extractors
and prevent plugins from overwriting the standard extractor classes

Closes #304
3 years ago
pukkandan 41d1cca328
Update to ytdl-commit-a726009
[blinkx] Remove extractor
a726009987
3 years ago
pukkandan 12e73423f1
[plutotv] Fix format extraction for some urls
* And fallback to the first urls if ad-free urls can't be found
Closes #299
3 years ago
pukkandan 7700b37f39
[plutotv] Extract subtitles from manifests 3 years ago
Ashish c28cfda81f
[SonyLiv] Fix `title` and `series` extraction (#301)
Authored by: Ashish0804
3 years ago
pukkandan 3158150cb7
[utils] Add `network_exceptions` 3 years ago
pukkandan 06425e9621
[blinkx] Minor fix
Fixes: https://github.com/ytdl-org/youtube-dl/issues/28941
3 years ago
pukkandan 1815d1028b
[zee5] Fix py2 compatibility 3 years ago
The Hatsune Daishi 0fa9a1e236
[whowatch] Add extractor #292
closes #223

Authored by: nao20010128nao 
Modified from: 9e4a0e061a/youtube_dl/extractor/whowatch.py
3 years ago
pukkandan 80185155a1
[ukcolumn] Add Extractor
Closes #287
3 years ago
pukkandan c755f1901f
[CBS] Improve `_VALID_URL` to support movies
Closes #290
Tested by: BeeMuffins
3 years ago
pukkandan 68b91dc905
[youtube] Add `oembed` to reserved names 3 years ago
pukkandan 88f06afc0c
[rmcdecouverte] Improve `_VALID_URL`
Closes #291
3 years ago
CXwudi 40078a55e2
[niconico] Fix bug in thumbnail extraction #289
Bug from: 6b1d8c1e30
Authored by: CXwudi
3 years ago
pukkandan 07e4a40a9a
[crackle] Improve extraction (See desc)
Closes #282

* Refactor authorization as an extension to `_download_json`
* Better error messages and warnings
* Respect `--ignore-no-formats-error`
* Extract subtitles from manifests
* Try with crackle's geo-location service if all hard-coded countries fail
3 years ago
pukkandan e28f1c0ae8
[cleanup] Fix linter and some typos
* Also remove inconsistent use of `"` in setup.py
3 years ago
pukkandan ef39f8600a
[curiositystream] Fix collections
Closes #277

* A bug with authentication was reported in <https://github.com/yt-dlp/yt-dlp/issues/277#issuecomment-828254721> but cannot be tested without an account
3 years ago
pukkandan 2291dbce2a
[niconico] Fix HLS formats
Closes #171

* The structure of the API JSON was changed
* Smile Video seems to be no longer available. So remove the warning
* Move ping to downloader
* Change heartbeat interval to 40sec
* Remove unnecessary API headers

Authored-by: CXwudi, tsukumijima, nao20010128nao, pukkandan
Tested by: tsukumijima
3 years ago
pukkandan 895b0931e5
[youtube:tab] Detect playlists inside community posts 3 years ago
pukkandan 1ad047d0f7
[nebula] Move to nebula.app
Closes #272
Tested by: Lamieur
3 years ago
pukkandan be6202f12b
Subtitle extraction from streaming media manifests #247
Authored by fstirlitz
Modified from: https://github.com/ytdl-org/youtube-dl/pull/6144

Closes: #73
Fixes:
https://github.com/ytdl-org/youtube-dl/issues/6106
https://github.com/ytdl-org/youtube-dl/issues/14977
https://github.com/ytdl-org/youtube-dl/issues/21438
https://github.com/ytdl-org/youtube-dl/issues/23609
https://github.com/ytdl-org/youtube-dl/issues/28132

Might also fix (untested):
https://github.com/ytdl-org/youtube-dl/issues/15424
https://github.com/ytdl-org/youtube-dl/issues/18267
https://github.com/ytdl-org/youtube-dl/issues/23899
https://github.com/ytdl-org/youtube-dl/issues/24375
https://github.com/ytdl-org/youtube-dl/issues/24595
https://github.com/ytdl-org/youtube-dl/issues/27899

Related:
https://github.com/ytdl-org/youtube-dl/issues/22379
https://github.com/ytdl-org/youtube-dl/pull/24517
https://github.com/ytdl-org/youtube-dl/pull/24886
https://github.com/ytdl-org/youtube-dl/pull/27215

Notes:
* The functions `extractor.common._extract_..._formats` are still kept for compatibility
* Only some extractors have currently been moved to using `_extract_..._formats_and_subtitles`
* Direct subtitle manifests (without a master) are not supported and are wrongly identified as containing video formats
* AES support is untested
* The fragmented TTML subtitles extracted from DASH/ISM are valid, but are unsupported by `ffmpeg` and most video players
    * Their XML fragments can be dumped using `ffmpeg -i in.mp4 -f data -map 0 -c copy out.ttml`.
        Once the unnecessary headers are stripped out of this, it becomes a valid self-contained ttml file
    * The ttml subs downloaded from DASH manifests can also be directly opened with <https://github.com/SubtitleEdit>
* Fragmented WebVTT files extracted from DASH/ISM are also unsupported by most tools
    * Unlike the ttml files, the XML fragments of these cannot be dumped using `ffmpeg`
    * The webtt subs extracted from DASH can be parsed by <https://github.com/gpac/gpac>
    * But validity of the those extracted from ISM are untested
3 years ago
Felix S e8f834cd8d [threeqsdn] Extract subtitles from streaming manifests 3 years ago
Felix S e0e624ca7f [canvas] Extract subtitles from streaming manifests 3 years ago
Felix S ec4f374c05 [wat] Extract subtitles from streaming manifests 3 years ago
Felix S c811e8d8bd [atresplayer] Extract subtitles from streaming manifests 3 years ago
Felix S b2cd5da460 [francetv] Extract subtitles from the HLS manifest 3 years ago
Felix S 2de3b21e05 [uplynk] Extract subtitles from HLS manifests 3 years ago
Felix S 4bed436371 [twitter] Extract subtitles from HLS manifests 3 years ago
Felix S efe9dba595 [srgssr] Extract subtitles from HLS manifests 3 years ago
Felix S 47f4203dd3 [nytimes] Extract subtitles from HLS manifests 3 years ago
Felix S 015c10aeec [roosterteeth] Use common code for subtitle extraction 3 years ago
Felix S a00d781b73 [elonet] Use common code for subtitle extraction 3 years ago
Felix S 0c541b563f [tv4] Extract subtitles from streaming manifests 3 years ago
Felix S 64a5cf7929 [byutv] Extract subtitles from streaming manifests 3 years ago
Felix S 7a450a3b1c [generic] Extract subtitles from direct SSTR manifest links 3 years ago
Felix S 7de27caf16 [generic] Extract subtitles from direct DASH manifest links 3 years ago
Felix S c26326c1be [generic] Extract subtitles from direct HLS manifest links 3 years ago
Felix S 66a1b8643a [downloader/ism] Support muxing TTML subtitles 3 years ago
Felix S 4a2f19abbd [downloader/hls] Assemble single-file WebVTT subtitles from HLS segments 3 years ago
Felix S f6a1d69a87 [extractor/common] Extend _extract_akamai_formats to also extract subtitle tracks 3 years ago
Felix S fd76a14259 [extractor/common, downloader/ism] Extract SSTR subtitle tracks
_parse_ism_formats was extended into _parse_ism_formats_and_subtitles;
all direct users were updated, though _extract_ism_formats was left
as a compatibility wrapper.

The SSTR downloader was also modified in order to prepare for muxing
subtitle streams, although no support for any subtitle codecs was
added in this commit.
3 years ago
Felix S 171e59edd4 [extractor/common] Extract DASH subtitle tracks
_extract_mpd_formats and _parse_mpd_formats were extended into
_…_formats_and_subtitles; wrappers with old names are provided
for compatibility.
3 years ago
Felix S a0c3b2d5cf [extractor/common] Extract HLS subtitle tracks
_extract_m3u8_formats is renamed to _extract_m3u8_formats_and_subtitles
and extended to handle subtitle tracks instead of skipping them;
a wrapper with the old name is provided for compatibility.

_parse_m3u8_formats is likewise renamed and extended, but without adding
the compatibility wrapper; the test suite is adjusted to test the enhanced
method instead.
3 years ago
Felix S 19bb39202d [extractor/common] Generalise _merge_subtitles
This allows modifying a subtitles dictionary in-place.
3 years ago