Commit Graph

9034 Commits (4bd7d9d4ae05319ebf6eb2aeffce7bde4fa7b6cf)

Author SHA1 Message Date
Philip Xu 2e638d7bca Made optional fields optional 8 years ago
Sergey M․ a26b174c61
[safari:course] Add support for techbus.safaribooksonline.com 8 years ago
Sergey M․ 73c801d660
[orf:tvthek] Fix extraction and modernize (closes #10898) 8 years ago
Yen Chi Hsuan 8c3e448e80
[clipfish] Update _TEST; the old one is gone 8 years ago
Yen Chi Hsuan 2ecbd2ad6f
[chirbit:profile] Fix extraction 8 years ago
Yen Chi Hsuan 62a0b86e4f
[carambatv] Fix extraction
The video requested in #9815 now has videomore embeds.
8 years ago
Yen Chi Hsuan 146969e05b
[videomore] Support <iframe> embed videos
Seen in CarambaTVPage
8 years ago
Yen Chi Hsuan e2004ccaf7
[canalplus] Fix video_id and update _TESTS
Some tests are gone, and some redirect to different videos
8 years ago
Yen Chi Hsuan a5f8473145
[cbsinteractive] Fix extraction for cnet.com 8 years ago
Philip Xu b7f59a3bf6 [huajiao] Add new extractor 8 years ago
Yen Chi Hsuan 580d411931
[parliamentliveuk] Recognize lower case URLs
Closes #10912

Seems parliamentliveuk matches URLs case-insentive. For example this URL
also works:
http://parliamentlive.tv/EvEnt/Index/3F24936f-130f-40bf-9a5d-b3d6479da6a4
8 years ago
Sergey M․ 591e384552
[streamable] Remove debug output 8 years ago
Yen Chi Hsuan 9feb1c9731
[dailymotion] Fix extraction and update _TESTS
Closes #10901

Seems all videos use player V5 syntax now
8 years ago
Yen Chi Hsuan a093cfc78b
[vimeo:review] Fix extraction (#10900)
Now Vimeo Review videos uses React. Thanks @davekaro for analyzing the
problem!
8 years ago
Yen Chi Hsuan cea364f70c
[extractor/common] Support HTML media elements without child nodes 8 years ago
Yen Chi Hsuan 55642487f0
[nhl] Skip invalid m3u8 formats (closes #10713) 8 years ago
Yen Chi Hsuan 3d643f4cec
[hbo] Add HBOEpisodeIE (#10892) 8 years ago
Yen Chi Hsuan c452e69d3d
[footyroom] Fix extraction and update _TESTS (closes #10810) 8 years ago
Yen Chi Hsuan 555787d717
[streamable] Add helper for extracting embedded videos 8 years ago
Yen Chi Hsuan f165ca70eb
[abc.net.au:iview] Fix for non-series videos (closes #10895) 8 years ago
Yen Chi Hsuan 27b8d2ee95
[hbo] Add display_id and another test (#10892) 8 years ago
Yen Chi Hsuan 71cdcb2331
[hbo] Support episode pages (closes #10892) 8 years ago
Yen Chi Hsuan 176006a120
[allocine] Fix for /video/ videos (closes #10860) 8 years ago
Yen Chi Hsuan 65f4c1de3d
[allocine] Fix extraction (closes #10860)
I change the URL of the third test case, because now the original URL
does not contain a video anymore, and there's no easy to get the real
URL from the /film/ one.
8 years ago
Yen Chi Hsuan b0082629a9
[nextmedia] Support action news (動新聞) on Apple Daily 8 years ago
Déstin Reed 2b51dac1f9
[slutload] Fix test and simplify 8 years ago
Sergey M․ f68901e50a
[reverbnation] Eliminate code duplication in thumbnails extraction 8 years ago
Déstin Reed 3adb9d119e
[reverbnation] Modernize 8 years ago
Remita Amine 1dd58e14d8 [lego] improve info extraction and bypass geo restriction(closes #10872) 8 years ago
Sergey M․ f475e88121
[vimeo] PEP 8
[ci skip]
8 years ago
Remita Amine 3c6b3bf221 [iprima] detect geo restriction 8 years ago
Yen Chi Hsuan 38588ab977
[facebook] Fix for new handleServerJS syntax (closes #10846)
According to the dump file in #10846, handleServerJS() now accepts
an optional second argument. It's a string from available dump files.
8 years ago
Yen Chi Hsuan 85bcdd081c
[extractors] Add MmsIE 8 years ago
Yen Chi Hsuan 9dcd6fd3aa
[generic,commonprotocols] Move mms suuport from GenericIE
And use _generic_* helpers in those extractors
8 years ago
Yen Chi Hsuan 98763ee354
[extractor/common] Add id and title helpers for generic IEs 8 years ago
Yen Chi Hsuan 3d83a1ae92
[generic] Support direct MMS links (closes #10838) 8 years ago
Sergey M․ 09b9c45e24
[generic] Add support for multiple vimeo embeds (Closes #10862) 8 years ago
Remita Amine 33898fb19c [nzz] Add new extractor(#4407) 8 years ago
Remita Amine 017eb82934 [npo] detect geo restriction 8 years ago
Sergey M․ b1d798887e
[npo] Add support for 2doc.nl (Closes #10842) 8 years ago
Remita Amine 185744f92f [lego] Add new extractor(closes #10369) 8 years ago
Remita Amine 7232e54813 [tonline] Add new extractor(#10376) 8 years ago
Sergey M․ 6eb5503b12
[techtalks] Relax _VALID_URL 8 years ago
Aleksander Nitecki 539c881bfc
[techtalks] Allow URL-s with name part omitted. 8 years ago
Sergey M․ c1b2a0858c
[youtube:live] Extend _VALID_URL (Closes #10839) 8 years ago
Remita Amine 215ff6e0f3 [theweatherchannel] Add new extractor(closes #7188) 8 years ago
Déstin Reed dcdb292fdd
Unify coding cookie 8 years ago
Remita Amine c1084ddb0c [thisoldhouse] Add new extractor(closes #10837) 8 years ago
Sergey M․ ee5de4e38e
[nhl] Add support for wch2016.com (Closes #10833) 8 years ago
Yen Chi Hsuan 25291b979a Merge pull request #10829 from TRox1972/pornoxo_improve
[pornoxo] Use JWPlatform to improve metadata extraction
8 years ago
Déstin Reed 567a5996ca [pornoxo] Use JWPlatform to improve metadata extraction 8 years ago
Yen Chi Hsuan 703b3afa93
[amcnetworks] Skip a restricted _TEST 8 years ago
Yen Chi Hsuan 99ed78c79e
[jwplatform] Support DASH streams 8 years ago
Yen Chi Hsuan fd15264172
[jwplatform] Support old-style jwplayer playlists 8 years ago
Yen Chi Hsuan bd26441205
[utils] Fix xattr error handling 8 years ago
Sergey M․ f6ba581f89
[byutv:event] Add extractor 8 years ago
Sergey M․ 6d2549fb4f
[byutv] Fix id and display id 8 years ago
Déstin Reed 4da4516973
[byutv] Rely on _match_id and _parse_json 8 years ago
Sergey M․ e1e97c2446
[periscope:user] Fix extraction (Closes #10820) 8 years ago
Yen Chi Hsuan 63e0fd5bcc Merge pull request #10818 from TRox1972/criterion_match_id
[criterion] Rely on _match_id, improve regex and add thumbnail to test
8 years ago
Déstin Reed 9c51a24642 [criterion] Rely on _match_id, improve regex and add thumbnail to test 8 years ago
Yen Chi Hsuan 9bd7bd0b80
[twitch] Skip a 404 test 8 years ago
Yen Chi Hsuan 4a76b73c6c Merge pull request #10817 from TRox1972/clubic_match_id
[clubic] Rely on _match_id and _parse_json
8 years ago
Yen Chi Hsuan e295618f9e
[dctp] Fix extraction (closes #10734) 8 years ago
Déstin Reed eaf9b22f94 [clubic] Rely on _match_id and _parse_json 8 years ago
Sergey M․ a1001f47fc
[instagram] PEP 8 8 years ago
Déstin Reed 1609782258
[Instagram] Extract video dimensions 8 years ago
Sergey M․ de6babf922
[tvland] Extend _VALID_URL (Closes #10812) 8 years ago
Sergey M․ b0582fc806
[vgtv] Add support for tv.aftonbladet.se (Closes #10800) 8 years ago
Sergey M․ af33dd8ee7
[aftonbladet] Remove extractor 8 years ago
Sergey M․ 70d7b323b6
[vk] Improve view count extraction 8 years ago
Sergey M․ a7ee8a00f4
[vk] Extract timestamp (Closes #10760) 8 years ago
Kacper Michajłow 3aa3953d28
[vk] Fix date and view count extraction. 8 years ago
Sergey M․ 475f8a4580
[vk] Add support for running live streams (Closes #10799) 8 years ago
Sergey M․ 93aa0b6318
[vk] Add support for finished live streams (#10799) 8 years ago
Yen Chi Hsuan 0ce26ef228 Merge pull request #10788 from TRox1972/instagram_comments
[Instagram] Extract comments
8 years ago
Yen Chi Hsuan 0d72ff9c51
[leeco] Recognize more Le Sports URLs (#10794) 8 years ago
Déstin Reed a56e74e271 [Instagram] Extract comments 8 years ago
Sergey M․ f533490bb7
[ketnet] Extract mzsource formats (#10770) 8 years ago
Remita Amine 8bfda726c2 [limelight:media] improve http formats extraction 8 years ago
Sergey M․ cdfcc4ce95
[mtv] Improve _VALID_URL 8 years ago
Kacper Michajłow e384552590
[vk] Add support for dailymotion embeds
Fixes #10661
8 years ago
Sergey M․ 1a2fbe322e
[periscope] Treat timed_out state as finished stream 8 years ago
Sergey M․ f9dd86a112
[npo] Clarify IE_NAMEs (Closes #10775) 8 years ago
Remita Amine 2342733f85 fix tests related to 1978540a5122c53012e17a78841f3da0df77fd34(closes #10774) 8 years ago
Remita Amine 93933c9819 [awaan:video] fix test(closes #10773) 8 years ago
Yen Chi Hsuan d75d9e343e
[einthusan] Fix extraction (closes #10714) 8 years ago
Sergey M․ 72c3d02d29
[promptfile] Improve and modernize 8 years ago
Ondřej Bárta d3dbb46330
[promptfile] Fix extraction (Closes #10634) 8 years ago
Sergey M․ fffb9cff94
[kaltura] Speed up embed regexes (#10764) 8 years ago
Sergey M․ 2d5b4af007
[extractors] Add import for anderetijden extractor 8 years ago
Sergey M․ 5742c18bc1
[npo] Add support for anderetijden.nl (Closes #10754) 8 years ago
Sergey M․ ddb19772d5
[vpro] Fix playlist title extraction and update tests 8 years ago
Sergey M․ a3d8b38168
[npo] Generalize playlist extractors 8 years ago
stepshal 2d3d29976b
[youtube] Change test URLs from http to https 8 years ago
Sergey M․ 493353c7fd
[prosiebensat1] Add support for advopedia 8 years ago
Sergey M․ 0a078550b9
[prosiebensat1] Improve _VALID_URL 8 years ago
Sergey M․ f92bb612c6
[mwave] Relax _VALID_URLs (Closes #10735, closes #10748) 8 years ago
Sergey M․ ddde91952f
[prosiebensat1] Fix playlist support (Closes #10745) 8 years ago
Sergey M․ 63c583eb2c
[prosiebensat1] Add support for sat1gold (#10745) 8 years ago
Remita Amine 7fd57de6fb [cbsnews:livevideo] fix extraction and extract m3u8 formats 8 years ago
Remita Amine e71a450956 [common] add hdcore sign to akamai f4m formats 8 years ago
Remita Amine 27e99078d3 [brightcove:new] add support for live streams 8 years ago
Sergey M․ 7518a61d41
[soundcloud] Fix typo in playlist base class name 8 years ago
Sergey M․ 8e45e1cc4d
[soundcloud] Generalize playlist entries extraction (#10733) 8 years ago
Yen Chi Hsuan f0bc5a8609
[twitter] Support Periscope embeds (closes #10737)
Also update _TESTS
8 years ago
Remita Amine a54ffb8aa7 [mtv] add common IE_NAME prefix for MTVIE and MTVVideoIE 8 years ago
Remita Amine 8add4bfecb [mtv] add support for new website urls(closes #8169)(closes #9808) 8 years ago
Yen Chi Hsuan 0711995bca
[openload] Support subtitles (closes #10625) 8 years ago
Yen Chi Hsuan 5968d7d2fe
[extractor/common] Improved support for HTML5 subtitles
Ref: #10625

In a strict sense, <track>s with kind=captions are not subtitles. [1]
openload misuses this attribute, and I guess there will be more
examples, so I add it to common.py.

Also allow extracting information for subtitles-only <video> or <audio>
tags, which is the case of openload.

[1] https://www.w3.org/TR/html5/embedded-content-0.html#attr-track-kind
8 years ago
Sergey M․ 24628cf7db
[soundcloud:playlist] Provide video id for playlist entries (Closes #10733) 8 years ago
Sergey M․ 71ad00c09f
[prosiebensat1] Add support for kabeleinsdoku (Closes #10732) 8 years ago
Remita Amine 45cae3b021 [cbs] extract info from thunder videoPlayerService(closes #10728) 8 years ago
Yen Chi Hsuan 4ddcb5999d
[openload] Fix extraction (closes #10408, closes #10727)
Thanks to @daniel100097 for providing a working version
8 years ago
Yen Chi Hsuan e3d6bdc8fc
[ustream] Support HLS streams (closes #10698) 8 years ago
Sergey M․ 0a439c5c4c
[udemy] Stringify video id 8 years ago
Remita Amine 1978540a51 [ooyala] extract all hls formats 8 years ago
Sergey M․ 12f211d0cb
[videomore] Fix embed regex 8 years ago
Remita Amine 3a5a18705f [adobepass] add support MSO that depend on watchTVeverywhere(closes #10709) 8 years ago
Remita Amine 1ae0ae5db0 [cartoonnetwork] add support Adobe Pass auth 8 years ago
Sergey M․ f62a77b99a
[soundcloud] Modernize 8 years ago
coolsa 4bfd294e2f
[soundcloud] Extract license metadata 8 years ago
Remita Amine e33a7253b2 [fox] add support for Adobe Pass auth(closes #8584) 8 years ago
Remita Amine c38f06818d add support for Adobe Pass auth in tbs,tnt and trutv extractors(fixes #10642)(closes #10222)(closes #10519) 8 years ago
Sergey M․ 70b4cf9b1b
[crunchyroll] Check if already logged in (Closes #10700) 8 years ago
Sergey M․ cc764a6da8
[twitch:stream] Remove fallback to profile extraction when stream is offline
Main page does not contain profile videos anymore
8 years ago
Yen Chi Hsuan d8dbf8707d
[thisav] Improve title extraction (closes #10682)
I didn't add a test case as the one in #10682 looks like a copyrighted
product.
8 years ago
Sergey M․ a1da888d0c
[vyborymos] Improve station info extraction 8 years ago
Sergey M․ 14ae11efab
[vyborymos] Add extractor (Closes #10692) 8 years ago
Sergey M․ 190d2027d0
[xfileshare] Add title regex for streamin.to and fallback to video id (Closes #10646) 8 years ago
Sergey M․ 26394d021d
[globo:article] Add support for multiple videos (Closes #10653) 8 years ago
Sergey M․ 30d0b549be
[extractor/common] Add manifest_url for hls and hds formats 8 years ago
Sergey M․ 86f4d14f81
Refactor fragments interface and dash segments downloader
- Eliminate segment_urls and initialization_url
+ Introduce manifest_url (manifest may contain unfragmented data in this case url will be used for direct media URL and manifest_url for manifest itself correspondingly)
* Rewrite dashsegments downloader to use fragments data
* Improve generic mpd extraction
8 years ago
Sergey M․ 21d21b0c72
[svt] Fix DASH formats extraction 8 years ago
Sergey M․ b4c1d6e800
[extractor/common] Expose fragments interface for dashsegments formats 8 years ago
Sergey M․ a0d5077c8d
[extractor/common] Introduce fragments interface 8 years ago
Yen Chi Hsuan 584d6f3457
[thisav] Recognize jwplayers (closes #10447) 8 years ago
Yen Chi Hsuan e14c82bd6b
[jwplatform] Use js_to_json to detect more JWPlayers 8 years ago
Sergey M․ c51a7f0b2f
[franceinter] Fix upload date extraction 8 years ago
Remita Amine d05ef09d9d [mangomolo] fix domain regex 8 years ago
Remita Amine fc86d4eed0 [mangomolo] fix typo 8 years ago
Remita Amine 7d273a387a [mangomolo] add support for Mangomolo embeds 8 years ago
Remita Amine 6ad0219556 [common] add helper method for Wowza Streaming Engine format extraction 8 years ago
Remita Amine 98b7506e96 [toutv] add support for authentication(closes #10669) 8 years ago
Sergey M․ 52dc8a9b3f
[franceinter] Fix upload date extraction 8 years ago
Sergey M․ 9d8985a165
[tv4] Fix hls and hds formats (Closes #10659) 8 years ago
stepshal 490b755769
Improve some id regexes 8 years ago
Sergey M․ 1dec2c8a0e
[adobepass] Change mvpd cache section name
In order to better emphasize it's relation to Adobe Pass
8 years ago
Sergey M․ dcce092e0a
[extractor/common] Simplify _get_netrc_login_info and carry long lines 8 years ago
Sergey M․ 32443dd346
[extractor/common] Update _get_login_info's comment 8 years ago
Sergey M․ 2133565cec
[extractor/common] Simplify _get_login_info 8 years ago
Sergey M․ c849836854
[utils] Improve _hidden_inputs 8 years ago
Sergey M․ eb5b1fc021
[crunchyroll] Fix authentication (Closes #10655) 8 years ago
Sergey M․ 95be29e1c6
[twitch] Fix api calls (Closes #10654, closes #10660) 8 years ago
Remita Amine c035dba19e [bellmedia] add support for more sites 8 years ago
Remita Amine 797c636bcb [ap] improve adobe pass names and parse error handling 8 years ago
Sergey M․ 0002962f3f
[franceinter] Improve extraction (Closes #10538) 8 years ago
renalid a942d6cb48
[utils,franceinter] Add french months' names and fix extraction
Update of the "FranceInter" radio extractor : webpages HTML structure
had changed, the extractor didn't work. So I updated this extractor to
get the mp3 URL and all details.
8 years ago
Yen Chi Hsuan 961516bfd1
[kwuo:song] Improve error detection (closes #10650) 8 years ago
Yen Chi Hsuan 6db354a9f4
[kuwo] Update _TESTS 8 years ago
Remita Amine 353f340e11 [go] fix typo 8 years ago
Remita Amine 014b7e6b25 [go] add support for free full episodes(#10439) 8 years ago
stepshal 925194022c
Improve some _VALID_URLs 8 years ago
Sergey M․ b690ea15eb
[viafree] Fix test 8 years ago
Remita Amine 5712c0f426 [adobepass] remove unnecessary option 8 years ago
Yen Chi Hsuan 86d68f906e
[bilibili] Fix extraction for videos without backup_url (#10647) 8 years ago
Yen Chi Hsuan 4875ff6847
[bilibili] Remove copyrighted test cases
I can't find any English or Chinese material that claims BiliBili has
bought legal redistribution permissions for copyrighted products from
copyrighted holders.

References for removed test cases:
"刀语": https://en.wikipedia.org/wiki/Katanagatari, by White Fox
"哆啦A梦": https://en.wikipedia.org/wiki/Doraemon, by Shin-Ei Animation
"岳父岳母真难当": https://en.wikipedia.org/wiki/Serial_(Bad)_Weddings, by Les films du 24
"混沌武士": https://en.wikipedia.org/wiki/Samurai_Champloo, by Manglobe

I shouldn't have added them to _TESTS
8 years ago
Remita Amine 1b6712ab23 [adobepass] add specific options for adobe pass authentication
- add --ap-username and --ap-password option to specify
TV provider username and password in the cmd line
- add --ap-retries option to limit the number of retries
- add --list-ap-msi-ids to list the supported TV Providers
8 years ago
Sergey M․ 8414c2da31
[adobepass] PEP 8 8 years ago
Sergey M․ 45396dd2ed
[nhk] Fix extraction (Closes #10633) 8 years ago
Remita Amine 7a7309219c [adobepass] add an option to specify mso_id and support for ROGERS TV Provider(closes #10606) 8 years ago
Sergey M․ a6ccc3e518
[safari] Improve ids regexes (#10617) 8 years ago
Sergey M․ 1d16035bb4
[kaltura] Improve audio detection 8 years ago
Sergey M․ e8bcd982cc
[kaltura] Skip chun format 8 years ago
Sergey M․ a5ff05df1a
[extractor/generic] Add vimeo embed that requires Referer passed 8 years ago
Sergey M․ d002e91986
[vimeo:ondemand] Pass Referer along with embed URL (#10624) 8 years ago
Yen Chi Hsuan be45730226
[nbc] Add new extractor for NBC Olympics (#10295, #10361) 8 years ago
Sergey M․ ee7e672eb0
[tube8] Remove proxy settings from test 8 years ago
Sergey M․ bc9186c882
[tvplay] Remove unused import 8 years ago
Sergey M․ 6599c72527
[tube8] Extract categories and tags (Closes #10579) 8 years ago
Yen Chi Hsuan 6bb05b32a9
[pornhub] Extract categories and tags (closes #10499) 8 years ago
Yen Chi Hsuan fea74acad8
[foxnews] Revert to old extractor names 8 years ago
Yen Chi Hsuan f01115c933 [openload] Temporary fix (#10408) 8 years ago
Yen Chi Hsuan 2cdbc06a1f
[foxnews] Support Fox News Articles (closes #10598) 8 years ago
Sergey M․ 2cb93afcd8
[viafree] Improve video id extraction (Closes #10615) 8 years ago
Yen Chi Hsuan bfcda07a27
[abc:iview] Skip the test. They are removed soon 8 years ago
Yen Chi Hsuan 001a5fd3d7
[iwara] Fix extraction after relaunch
Closes #10462, closes #3215
8 years ago
Remita Amine 1e35999c1e [tfo] Add new extractor 8 years ago
Sergey M․ 2512b17493
[lrt] Fix audio extraction (Closes #10566) 8 years ago
Sergey M․ 56c0ead4d3
[9now] Improve video data extraction (Closes #10561) 8 years ago
Scott Leggett 7324243750
[9now] Fix extraction 8 years ago
Sergey M․ 84a18e9b90
[polskieradio:category] Improve extraction 8 years ago
Sergey M․ b29f842e0e
[canalplus] Add support for c8.fr (Closes #10577) 8 years ago
Sergey M․ f009fcac0d
Merge branch 'master' of github.com:rg3/youtube-dl 8 years ago
Yen Chi Hsuan 6c3affcb18
[newgrounds] Fix uploader extraction
Closes #10584

Also change test URLs to HTTPS, as proposed by
@stepshal in #10593.

Closes #10593
8 years ago
Sergey M․ 1e19ff2984
Merge branch 'polskie-radio-programme' of https://github.com/JakubAdamWieczorek/youtube-dl 8 years ago
Sergey M․ c6129feb7f
[ketnet] Add extractor (Closes #10343) 8 years ago
Sergey M․ bb5ebd4453
[canvas] Add support for een.be (Closes #10605) 8 years ago
Remita Amine cb9cbd84ed [extractors] add import for TeleQuebecIE 8 years ago
Remita Amine 4d5726b0d7 [telequebec] Add new extractor(closes #1999) 8 years ago