Commit Graph

10824 Commits (b5eab86c2424ec04d17fac5de9d15574320ea8f1)

Author SHA1 Message Date
Yen Chi Hsuan a6571f1073
[common] Fix <bootstrapInfo> detection in F4M manifests
Regression since 0a5685b26f
9 years ago
Sergey M․ 57b6e9652e
[canal+] Add support for d17.tv 9 years ago
Sergey M․ 3d9b3605a3
[canal+] Update tests 9 years ago
Sergey M․ 74193838f7
[canal+] Improve extraction (Closes #9718) 9 years ago
Sergey M fb94e260b5 Merge pull request #9720 from Kagami/vlive-new-statuses
[vlive] Acknowledge vlive+ streams statuses
9 years ago
Kagami Hiiragi 345dec937f [vlive] Acknowledge vlive+ streams statuses
Same as common statuses just with "PRODUCT_" prefix:
PRODUCE_LIVE_END, PRODUCT_COMING_SOON, etc.
9 years ago
Philipp Hagemeister 4315f74fa8 Merge remote-tracking branch 'Boris-de/wdrmaus_fix#8562' 9 years ago
Jaime Marquínez Ferrándiz e67f688025 [compat] Add 'compat_input' to __all__ 9 years ago
Sergey M․ 244fe977fe
[options] Add --load-info-json alias for symmetry with --write-info-json 9 years ago
Sergey M․ 7b0d1c2859
[__init__] Use write_string instead of compat_string (Closes #9689) 9 years ago
Sergey M․ 633b444fd2
[downloader/hls] Correct comment on twitch vods 9 years ago
Sergey M․ 51c4d85ce7
[downloader/hls] PEP 8 9 years ago
Sergey M․ 631d4c87ee
[twitch:vod] Use native hls 9 years ago
Sergey M․ 1e236d7e23
[downloader/hls] Do not rely on EXT-X-PLAYLIST-TYPE:EVENT 9 years ago
Sergey M․ 2c34735267
[youtube] Add itags 256 and 258 9 years ago
Sergey M․ 1ae6c83bce
[compat] Add compat_input 9 years ago
Sergey M․ 0fc832e1b2
[vidio] Improve (Closes #9562) 9 years ago
TRox1972 7def35712a
[vidio] Add extractor (Closes #7195)
[Vidio] fix fallback value and wrap duration in int_or_none

[Vidio] don't use video_id for _html_search_regex()
9 years ago
Sergey M․ 762d44c956
[channel9] Add support for rss links (Closes #9673) 9 years ago
Sergey M․ 4d8856d511
[loc] Extract direct download links 9 years ago
Sergey M․ c917106be4
[loc] Extract subtites 9 years ago
Sergey M․ 76e9cd7f24
[loc] Add support for another URL schema and simplify 9 years ago
Sergey M․ bf4c6a38e1 release 2016.06.03 9 years ago
Sergey M․ 7f3c3dfa52
[loc] Improve (Closes #9521) 9 years ago
TRox1972 9c3c447eb3
[loc] Add extractor (Closes #3188)
Added extractor of loc.gov, which closes #3188. I am not an experienced programmer, so I am sure I did a bunch of mistakes, but the extractor works (for me at least).

[LibraryOfCongress] don't use video_id for _search_regex()

[LibraryOfCongress] Improvements
9 years ago
Yen Chi Hsuan ad73083ff0
[bilibili] Add _part%d suffixes back (closes #9660) 9 years ago
bzc6p c88270271e Added sanitization support for Hungarian letters Ő and Ű 9 years ago
Yen Chi Hsuan 9a4aec8b7e [utils] Use bytes-like objects as header values on Python 2 9 years ago
Yen Chi Hsuan 0ea590076f [utils] Always decode Location header
escape_url is broken for bytes-like objects
9 years ago
Remita Amine 4a684895c0 [seeker] Add new extractor(closes #9619) 9 years ago
Remita Amine f4e4aa9b6b [revision3:embed] Add new extractor 9 years ago
Sergey M․ 5e3856a2c5 release 2016.06.02 9 years ago
Sergey M․ 6e6b9f600f
[arte] Add support for playlists and rework tests (Closes #9632) 9 years ago
Sergey M․ 6a1df4fb5f
[spankwire] Add support for new URL format (Closes #9657) 9 years ago
Yen Chi Hsuan dde1ce7c06
[tf1] Fix a regular expression (closes #9656)
This is a Python bug fixed in 2.7.6 [1]

[1] https://github.com/rg3/youtube-dl/issues/9656#issuecomment-222968594
9 years ago
Yen Chi Hsuan 811586ebcf
[generic] Update the UDNEmbed test case 9 years ago
Yen Chi Hsuan 0ff3749bfe
[udn] Fix m3u8 and f4m extraction as well as improve 9 years ago
Yen Chi Hsuan 28bab13348
[generic,viewlift] Move a test case to the specialized extractor 9 years ago
Yen Chi Hsuan 877032314f
[generic] Improve Kaltura detection
Closes #4004
9 years ago
Peter Rowlands e7d85c4ef7 use /track/video/file to determine if video exists 9 years ago
Sergey M․ 8ec2b2c41c
[options] Add --limit-rate alias for rate limiting option
Closes #9644
In order to follow regular --verb-noun pattern and better conformity with wget and curl
9 years ago
Sergey M․ 197a5da1d0
[yandexmusic] Improve captcha detection 9 years ago
Sergey M․ abbb2938fa release 2016.05.30.2 9 years ago
Sergey M․ f657b1a5f2 release 2016.05.30.1 9 years ago
Sergey M․ 8267423652 release 2016.05.30 9 years ago
Yen Chi Hsuan 9ed6d8c6c5
[youku] Extract resolution 9 years ago
Yen Chi Hsuan 6461f2b7ec
[bilibili] Fix extraction, improve and cleanup 9 years ago
Sergey M․ 807cf7b07f
[udemy] Fix authentication for localized layout (Closes #9594) 9 years ago
Sergey M․ de7d76af52
[coub] Add another test 9 years ago
Sergey M․ 11c70deba7
[coub] Add extractor (Closes #9609) 9 years ago
Sergey M․ f36532404d
[vk] Remove superfluous code 9 years ago
Sergey M․ 77b8b4e696
[extractor/common] Borrow quality metadata from parent set-level manifest for f4m 9 years ago
Sergey M․ 2615fa7584
[downloader/f4m] Simply select format when it's the only one 9 years ago
Boris Wachtmeister 3a686853e1 [WDR] fixed parsing of playlists 9 years ago
Boris Wachtmeister 949fc42e00 [WDR] the other wdrmaus.de pages also changed to the new player 9 years ago
Boris Wachtmeister 33a1ff7113 [WDR] extract jsonp-url by parsing data-extension of mediaLink 9 years ago
Boris Wachtmeister bec2c14f2c [WDR] add special handling if alt-url is a m3u8 9 years ago
Boris Wachtmeister 37f972954d [WDR] use _download_json with a strip_jsonp 9 years ago
Boris Wachtmeister 3874e6ea66 [WDR] use single quotes for strings 9 years ago
Yen Chi Hsuan fac2af3c51
[common] Fix m3u8 extraction in f4m manifests 9 years ago
Sergey M․ 6f8cb24219
[tvp] Expand _VALID_URL and improve naming (Closes #9602) 9 years ago
Yen Chi Hsuan 448bb5f333
[common] Fix non-bootstrapped support in f4m 9 years ago
Yen Chi Hsuan 293c255688
[utils] Remove debugging codes 9 years ago
Yen Chi Hsuan ac88d2316e
[dw] Support documentaries (closes #9475) 9 years ago
Yen Chi Hsuan 5950cb1d6d
[utils] Support a new form of date
Found in dw.com (#9475)
9 years ago
Yen Chi Hsuan 761052db92
[playwire] Add the test (closed #9531) 9 years ago
Yen Chi Hsuan 240b60453e
[common] Support m3u8 in f4m manifests
Related: #9531
9 years ago
Yen Chi Hsuan 85b0fe7d64
[playwire] Use _extract_f4m_formats
Related: #9531
9 years ago
Yen Chi Hsuan 0a5685b26f
[common] Support non-bootstraped streams in f4m manifests
Related: #9531
9 years ago
Sergey M․ 6f748df43f
[eporner] Make test only_matching 9 years ago
Yen Chi Hsuan b410cb83d4 Merge pull request #9595 from Kagami/vlive-site-update
[vlive] Address site update
9 years ago
Yen Chi Hsuan da9d82840a Merge pull request #9600 from wankerer/master
[eporner] fix for the new URL layout
9 years ago
wankerer 4ee0b8afdb [eporner] fix for the new URL layout
Recently eporner slightly changed the URL layout, the ID that used to be
digits only are now digits and letters, so youtube-dl falls back to
the generic extractor that doesn't work.

Fix the matching regex to allow letters in ID.

[v2: added a test case]
9 years ago
remitamine 1de32771e1 [eyedotv] Add new extractor(closes #9582) 9 years ago
remitamine 688c634b7d skip some tests to reduce test time 9 years ago
Sergey M․ 6b43132ce9
[xhamster] Update tests 9 years ago
mexican porn commits a4690b3244
[xhamster] url regex fix for videos with empty title. 9 years ago
remitamine 444417edb5 [radiocanada] Add new extractor(#4020) 9 years ago
remitamine 277c7465f5 [ooyala] check manifest ext with determine_ext and update tests for related extractors 9 years ago
Kagami Hiiragi 25bcd3550e [vlive] Address site update
Changes:
* Fix video params extraction
* Don't make status request since status info now available on the page
* Remove unneeded code
* Fix test
9 years ago
remitamine a4760d204f [ooyala] use api v2 to reduce requests for format extraction 9 years ago
remitamine e8593f346a [ooyala] extract subtitles 9 years ago
remitamine 05b651e3a5 [washingtonpost] reduce requests for m3u8 manifests 9 years ago
remitamine 42a7439717 [cbs] allow to pass content id to the extractor(closes #9589) 9 years ago
remitamine b1e9ebd080 [washingtonpost] remove unnecessary code 9 years ago
remitamine 0c50eeb987 [reuters] Add new extractor 9 years ago
remitamine 4b464a6a78 [washingtonpost] improve format extraction and add support for video pages extraction 9 years ago
Sergey M․ 5db9df622f
[life:embed] Use native hls 9 years ago
Sergey M․ 5181759c0d
[life] Update _VALID_URL 9 years ago
Sergey M․ e54373204a
[lifenews] Fix metadata extraction 9 years ago
remitamine 102810ef04 [voxmedia] fix volume embed extraction 9 years ago
Yen Chi Hsuan 78d3b3e213
[generic] Improve Livestream detection (closes #2234) 9 years ago
Yen Chi Hsuan 7a46542f97
[livestream] Video IDs should always be strings (#2234) 9 years ago
Yen Chi Hsuan eb7941e3e6
[compat] Fix for XML with <!DOCTYPE> in Python 2.7 and 3.2
Such XML documents cause DeprecationWarning if python is run
with `-W error`
9 years ago
remitamine db3b8b2103 [tf1] add support for more related web sites 9 years ago
remitamine c5f5155100 [wat] extract all formats 9 years ago
Yen Chi Hsuan 4a12077855
[genric] Eliminate duplicated video URLs (closes #6562) 9 years ago
Thor77 70346165fe [bandcamp] raise ExtractorError when track not streamable (#9465)
* [bandcamp] raise ExtractorError when track not streamable

* [bandcamp] update md5 for second test

* don't rely on json-data, but just check for 'file'

* don't rely on presence of 'file'
9 years ago
Sergey M․ e9297256d4
[update] Fix youtube-dl.exe updating from arbitrary directory (Closes #2718) 9 years ago
Sergey M․ c6b9cf05e1
[utils] Do not fail on unknown date formats in unified_strdate 9 years ago
Sergey M․ 4d8819d249
[extractor/generic] Add support for theplatform embeds (Closes #8636, closes #9476) 9 years ago
Sergey M․ 898f4b49cc
[theplatform] Add _extract_urls 9 years ago
Sergey M․ 0150a00f33
[cc] Add test for tosh.cc (Closes #9566) 9 years ago
TRox1972 c8831015f4
[ComedyCentral] Add support for tosh.cc.com and cc.com/video-clips 9 years ago
Sergey M․ 92d221ad48
[periscope] Update uploader_id (Closes #9565) 9 years ago
Sergey M․ 0db9a05f88
[periscope:user] Adapt to layout changes (Closes #9563) 9 years ago
Philipp Hagemeister e03b35b8f9 release 2016.05.21.2 9 years ago
Philipp Hagemeister 598869afb1 release 2016.05.21.1 9 years ago
Philipp Hagemeister c8cc3745fb release 2016.05.21 9 years ago
Jaime Marquínez Ferrándiz 4c718d3c50 [rtve] Recognize 'filmoteca' URLs 9 years ago
Yen Chi Hsuan 115c65793a
[jwplatform] Don't fail with RTMP URLs without mp4:, mp3: or flv: 9 years ago
Yen Chi Hsuan 661d46b28f
[cbslocal] Add new extractor (closes #9522) 9 years ago
Yen Chi Hsuan 5ce3d5bd1b
[sendtonews] Add new extractor
Used in CBSLocal. Part of #9522
9 years ago
Yen Chi Hsuan 612b5f403e
[jwplatform] Improved m3u8 and rtmp support
Changes made for SendtoNewsIE. Part of #9522
9 years ago
Yen Chi Hsuan 9f54e692d2
[anvato] Add new extractor
Used in CBSLocal (#9522)
9 years ago
Yen Chi Hsuan 7b2fcbfd4e
[common] Skip TYPE=CLOSED-CAPTIONS lines in m3u8 manifests
According to [1], valid values for TYPE are AUDIO, VIDEO, SUBTITLES
and CLOSED-CAPTIONS. Such a value is found in Anvato master playlists,
though I don't use _extract_m3u8_formats() in the end.

Part of #9522.

[1] https://tools.ietf.org/html/draft-pantos-http-live-streaming-19#section-4.3.4.1
9 years ago
Yen Chi Hsuan 16da9bbc29
[common] Add _m3u8_meta_format() template
For extractors who handle m3u8 manifests by themselves. (eg., AnvatoIE)

Part of #9522
9 years ago
Sergey M․ c8602b2f9b
[nrk] Unquote subtitles' URLs 9 years ago
Sergey M․ b219f5e51b
[brightcove:new] Improve error reporting 9 years ago
Sergey M․ 1846e9ade0
[localnews8] Fix extractor (Closes #9539) 9 years ago
TRox1972 6756602be6
[LocalNews8] add extractor (Closes #9200) 9 years ago
Sergey M․ 6c114b1210
[extractor/generic] Remove generic id and title from wistia extractionand update tests 9 years ago
Sergey M․ 7ded6545ed
[extractor/generic] Add test for wistia standard embed 9 years ago
Sergey M․ aa5957ac49
[extractor/generic] Add support for async wistia embeds (Closes #9549) 9 years ago
remitamine 64413f7563 [cbc] fix extraction for flv only videos(fixes #5309) 9 years ago
Sergey M․ 45f160a43c
[wistia] Improve hls support 9 years ago
Sergey M․ 36ca2c55db
[wistia] Skip storyboard and improve extraction 9 years ago
Sergey M․ f0c96af9cb
[wistia] Add alias and modernize 9 years ago
Yen Chi Hsuan 31a70191e7
[cbc] Add the test case from #5156 9 years ago
Yen Chi Hsuan ad96b4c8f5
[common] Extract audio formats in SMIL
Found in http://www.cbc.ca/player/play/2657631896

Closes #5156
9 years ago
Yen Chi Hsuan 043dc9d36f
[cbc] Fix for old-styled URLs
The URL http://www.cbc.ca/player/News/ID/2672225049/ (#6342) redirects
to http://www.cbc.ca/player/play/2672224672, while youtube-dl wasn't
able to handle it correctly.
9 years ago
remitamine 52f7c75cff [cbc] extract http formats and update tests 9 years ago
Sergey M․ f6e588afc0
[24video] Fix description extraction 9 years ago
remitamine a001296703 [learnr] Add new extractor(closes #4284) 9 years ago
Sergey M․ dd81769c62
[ndtv] Fix extraction 9 years ago
Sergey M․ 46bc9b7d7c
[utils] Allow None in remove_{start,end} 9 years ago
remitamine b78531a36a [formula1] Add new extractor(closes #3617) 9 years ago
Sergey M․ 11e6a0b641
[nfb] Modernize and extract subtitles 9 years ago
Sergey M․ 15cda1ef77
[nfb] Fix uploader extraction 9 years ago
Yen Chi Hsuan 055f0d3d06
[abcnews] Added a new extractor (closes #3992)
Related: #6108, #8664, #9459
9 years ago
Yen Chi Hsuan cdd94c2eae
[utils] Check for None values in SOCKS proxy
Originally reported at
https://github.com/rg3/youtube-dl/pull/9287#issuecomment-219617864
9 years ago
Philipp Hagemeister 36755d9d69 release 2016.05.16 9 years ago
Sergey M․ f7199423e5
[groupon] Add support for Youtube embeds (Closes #9508) 9 years ago
Sergey M․ a0a81918f1
[collegehumor] Remove extractor
It now uses brightcove
9 years ago
Yen Chi Hsuan 5572d598a5
[hearthisat] Update the first test 9 years ago
Yen Chi Hsuan cec9727c7f
[hearthisat] Detect invalid download links (fixes #9440) 9 years ago
Yen Chi Hsuan 79298173c5
[utils] Fix getheader in urlhandle_detect_ext
Fixes #7049, related to #9440
9 years ago
Sergey M․ 69c9cc2716
[xvideos] Extract html5 player formats (Closes #9495) 9 years ago
Sergey M․ ed56f26039
[extractor/common] Improve name extraction for m3u8 formats 9 years ago
Sergey M․ 6f41b2bcf1
[extractor/generic] Improve 3qsdn embeds support (Closes #9453) 9 years ago
Sergey M․ cda6d47aad
[utils] Simplify integer conversion in js_to_json 9 years ago
Sergey M․ 5d39176f6d
[extractor/generic:3qsdn] Add support for embeds 9 years ago
Sergey M․ 5c86bfe70f
[3qsdn] Add extractor 9 years ago
Sergey M․ ca950f49e9
[ora] Revert extraction to regexes
It's less fragile than using js_to_json with ora js
9 years ago
Sergey M․ 89ac4a19e6
[utils] Process non-base 10 integers in js_to_json 9 years ago
felix 640eea0a0c
[ora] minimise fragile regex shenanigans; recognise unsafespeech.com URLs 9 years ago
felix bd1e484448
[utils] js_to_json: various improvements
now JS object literals like { /* " */ 0: ",]\xaa<\/p>", } will be correctly converted to JSON.
9 years ago
Yen Chi Hsuan a834622b89 Merge pull request #9492 from jwilk/teamcoco
[teamcoco] Fix base64 regexp
9 years ago
Jakub Wilk 66e7ace17a Don't hardcode errno constant
The value of ENOENT is architecture-dependent, so don't assume it's
always 2.
9 years ago
Jakub Wilk 791ff52f75 [teamcoco] Fix base64 regexp 9 years ago
Sergey M․ b5abf86148
[cinemassacre] Remove extractor (Closes #9457)
It now uses jwplatform
9 years ago
Sergey M․ 134c6ea856
[YoutubeDL] Sanitize url for url and url_transparent extraction results 9 years ago
remitamine 0730be9022 [sina] fix extraction(fixes #1146) 9 years ago
Sergey M․ 96c2e3e909
[imdb] Improve extraction 9 years ago
Sergey M․ f196508f7b
[imdb] Relax _VALID_URL (Closes #9481) 9 years ago
Yen Chi Hsuan cc1028aa6d
[openload] Fix extraction (closes #9472) 9 years ago
remitamine ad55e10165 [brightcove] change the protocol for m3u8 formats to m3u8_native 9 years ago
remitamine 18cf6381f6 [nrk] extract m3u8 formats 9 years ago
remitamine cdf32ff15d [extractors] add import for UstudioEmbedIE 9 years ago
remitamine 99d79b8692 [ustudio] add support ustudio app/embed urls 9 years ago
remitamine b9e7bc55da [mgtv] extract http formats 9 years ago
Sergey M․ d8d540cf0d
[nrk] Rework extractor (Closes #9470) 9 years ago
Sergey M․ 0df79d552a
[twitch:bookmarks] Remove extractor
Bookmarks no longer available
9 years ago
Sergey M․ 0db3a66162
[twitch] Skip dead tests 9 years ago
Yen Chi Hsuan 7581bfc958
[utils] Unquote crendentials passed to SOCKS proxies
Fixes #9450
9 years ago
Yen Chi Hsuan a3fa6024d6
[bloomberg] Fix test_Bloomberg
In this test case, sometimes HLS is the best format while sometimes HDS
is. To prevent occasional test failures, force HDS to be the best
format. In the past, testing against HDS formats causes the same error
as #9214, which is fixed as #9377 landed.
9 years ago
Yen Chi Hsuan 1b405bb47d
[downloader/f4m] Tolerate truncate segments when testing
Replaces #9216

Fixes #9214 and test_Bloomberg partially
9 years ago
Yen Chi Hsuan 7e8ddca1bb
[vevo] Delay the georestriction check to prevent false alerts
Fixes #9408
9 years ago
Yen Chi Hsuan 778a1ccca7
[utils] Add Œ and œ found in French to ACCENT_CHARS
Fixes #9463
9 years ago
Yen Chi Hsuan 4540515cb3
[iqiyi] Fix 1080P extraction (closes #9446) 9 years ago
Sergey M․ e0741fd449
[__init__] Simplify colon presence check 9 years ago
teemuy e73b9c65e2
Bugfix: Allow colons in custom HTTP header values. 9 years ago
Yen Chi Hsuan 702ccf2dc0
[compat] Rename shlex_quote and remove unused subprocess_check_output 9 years ago
Philipp Hagemeister 28b4f73620 release 2016.05.10 9 years ago
Yen Chi Hsuan 6ddb4888d2
[options] Update --proxy description for SOCKS proxies 9 years ago
Yen Chi Hsuan fa5cb8d021
[socks] Remove a superfluous clause 9 years ago
Yen Chi Hsuan edaa23f822
[compat] Rename struct_(un)pack to compat_struct_(un)pack 9 years ago
Yen Chi Hsuan d5ae6bb501
[utils] Add rationale for register_socks_protocols 9 years ago
Yen Chi Hsuan 51fb4995a5
[utils] Register SOCKS protocols in urllib and support SOCKS4A 9 years ago
Yen Chi Hsuan 9e9cd7248d
[socks] Eliminate magic constants and improve 9 years ago
Yen Chi Hsuan 71aff18809
[socks] Support SOCKS proxies 9 years ago
Yen Chi Hsuan dab0daeeb0
[utils,compat] Move struct_pack and struct_unpack to compat.py 9 years ago
Yen Chi Hsuan 4350b74545
[socks] Add socks.py from @bluec0re's public domain implementation
https://gist.github.com/bluec0re/cafd3764412967417fd3
9 years ago
Sergey M․ 2937590e8b
[downloader/hls] PEP 8 9 years ago
Sergey M․ e62d9c5caa
[downloader/external] Call ffmpeg with with HTTP_PROXY env variable set (#9437) 9 years ago
Sergey M․ fe40f9eef2
[compat] Add compat_setenv 9 years ago
Sergey M․ 6104cc2985
[downloader/hls] Add event media playlists to unsupported features of hlsnative 9 years ago
Sergey M․ c15c47d19b
[downloader/hls] Remove EXT-X-MEDIA-SEQUENCE from unsupported features for hlsnative 9 years ago
Sergey M․ 3951e7eb93
[ceskatelevize] Simplify, restore bonus video test and skip georestricted test (Closes #9431) 9 years ago
Tomáš Čech f1f6f5aa5e
[ceskatelevize] Add support for live streams
Live streams has no playlist title, use title of the stream containing
TV channel name. Internal m3u8 handler doesn't seem to handle well
continuous streams. Add test for live stream. Remove no longer
reachable test.
9 years ago