Commit Graph

8904 Commits (481cc7335c90dba8c0e7954fc99a38d2022eecfb)

Author SHA1 Message Date
Sergey M․ 190d2027d0
[xfileshare] Add title regex for streamin.to and fallback to video id (Closes #10646) 8 years ago
Sergey M․ 26394d021d
[globo:article] Add support for multiple videos (Closes #10653) 8 years ago
Sergey M․ 30d0b549be
[extractor/common] Add manifest_url for hls and hds formats 8 years ago
Sergey M․ 86f4d14f81
Refactor fragments interface and dash segments downloader
- Eliminate segment_urls and initialization_url
+ Introduce manifest_url (manifest may contain unfragmented data in this case url will be used for direct media URL and manifest_url for manifest itself correspondingly)
* Rewrite dashsegments downloader to use fragments data
* Improve generic mpd extraction
8 years ago
Sergey M․ 21d21b0c72
[svt] Fix DASH formats extraction 8 years ago
Sergey M․ b4c1d6e800
[extractor/common] Expose fragments interface for dashsegments formats 8 years ago
Sergey M․ a0d5077c8d
[extractor/common] Introduce fragments interface 8 years ago
Yen Chi Hsuan 584d6f3457
[thisav] Recognize jwplayers (closes #10447) 8 years ago
Yen Chi Hsuan e14c82bd6b
[jwplatform] Use js_to_json to detect more JWPlayers 8 years ago
Sergey M․ c51a7f0b2f
[franceinter] Fix upload date extraction 8 years ago
Remita Amine d05ef09d9d [mangomolo] fix domain regex 8 years ago
Remita Amine fc86d4eed0 [mangomolo] fix typo 8 years ago
Remita Amine 7d273a387a [mangomolo] add support for Mangomolo embeds 8 years ago
Remita Amine 6ad0219556 [common] add helper method for Wowza Streaming Engine format extraction 8 years ago
Remita Amine 98b7506e96 [toutv] add support for authentication(closes #10669) 8 years ago
Sergey M․ 52dc8a9b3f
[franceinter] Fix upload date extraction 8 years ago
Sergey M․ 9d8985a165
[tv4] Fix hls and hds formats (Closes #10659) 8 years ago
stepshal 490b755769
Improve some id regexes 8 years ago
Sergey M․ 1dec2c8a0e
[adobepass] Change mvpd cache section name
In order to better emphasize it's relation to Adobe Pass
8 years ago
Sergey M․ dcce092e0a
[extractor/common] Simplify _get_netrc_login_info and carry long lines 8 years ago
Sergey M․ 32443dd346
[extractor/common] Update _get_login_info's comment 8 years ago
Sergey M․ 2133565cec
[extractor/common] Simplify _get_login_info 8 years ago
Sergey M․ c849836854
[utils] Improve _hidden_inputs 8 years ago
Sergey M․ eb5b1fc021
[crunchyroll] Fix authentication (Closes #10655) 8 years ago
Sergey M․ 95be29e1c6
[twitch] Fix api calls (Closes #10654, closes #10660) 8 years ago
Remita Amine c035dba19e [bellmedia] add support for more sites 8 years ago
Remita Amine 797c636bcb [ap] improve adobe pass names and parse error handling 8 years ago
Sergey M․ 0002962f3f
[franceinter] Improve extraction (Closes #10538) 8 years ago
renalid a942d6cb48
[utils,franceinter] Add french months' names and fix extraction
Update of the "FranceInter" radio extractor : webpages HTML structure
had changed, the extractor didn't work. So I updated this extractor to
get the mp3 URL and all details.
8 years ago
Yen Chi Hsuan 961516bfd1
[kwuo:song] Improve error detection (closes #10650) 8 years ago
Yen Chi Hsuan 6db354a9f4
[kuwo] Update _TESTS 8 years ago
Remita Amine 353f340e11 [go] fix typo 8 years ago
Remita Amine 014b7e6b25 [go] add support for free full episodes(#10439) 8 years ago
stepshal 925194022c
Improve some _VALID_URLs 8 years ago
Sergey M․ b690ea15eb
[viafree] Fix test 8 years ago
Remita Amine 5712c0f426 [adobepass] remove unnecessary option 8 years ago
Yen Chi Hsuan 86d68f906e
[bilibili] Fix extraction for videos without backup_url (#10647) 8 years ago
Yen Chi Hsuan 4875ff6847
[bilibili] Remove copyrighted test cases
I can't find any English or Chinese material that claims BiliBili has
bought legal redistribution permissions for copyrighted products from
copyrighted holders.

References for removed test cases:
"刀语": https://en.wikipedia.org/wiki/Katanagatari, by White Fox
"哆啦A梦": https://en.wikipedia.org/wiki/Doraemon, by Shin-Ei Animation
"岳父岳母真难当": https://en.wikipedia.org/wiki/Serial_(Bad)_Weddings, by Les films du 24
"混沌武士": https://en.wikipedia.org/wiki/Samurai_Champloo, by Manglobe

I shouldn't have added them to _TESTS
8 years ago
Remita Amine 1b6712ab23 [adobepass] add specific options for adobe pass authentication
- add --ap-username and --ap-password option to specify
TV provider username and password in the cmd line
- add --ap-retries option to limit the number of retries
- add --list-ap-msi-ids to list the supported TV Providers
8 years ago
Sergey M․ 8414c2da31
[adobepass] PEP 8 8 years ago
Sergey M․ 45396dd2ed
[nhk] Fix extraction (Closes #10633) 8 years ago
Remita Amine 7a7309219c [adobepass] add an option to specify mso_id and support for ROGERS TV Provider(closes #10606) 8 years ago
Sergey M․ a6ccc3e518
[safari] Improve ids regexes (#10617) 8 years ago
Sergey M․ 1d16035bb4
[kaltura] Improve audio detection 8 years ago
Sergey M․ e8bcd982cc
[kaltura] Skip chun format 8 years ago
Sergey M․ a5ff05df1a
[extractor/generic] Add vimeo embed that requires Referer passed 8 years ago
Sergey M․ d002e91986
[vimeo:ondemand] Pass Referer along with embed URL (#10624) 8 years ago
Yen Chi Hsuan be45730226
[nbc] Add new extractor for NBC Olympics (#10295, #10361) 8 years ago
Sergey M․ ee7e672eb0
[tube8] Remove proxy settings from test 8 years ago
Sergey M․ bc9186c882
[tvplay] Remove unused import 8 years ago
Sergey M․ 6599c72527
[tube8] Extract categories and tags (Closes #10579) 8 years ago
Yen Chi Hsuan 6bb05b32a9
[pornhub] Extract categories and tags (closes #10499) 8 years ago
Yen Chi Hsuan fea74acad8
[foxnews] Revert to old extractor names 8 years ago
Yen Chi Hsuan f01115c933 [openload] Temporary fix (#10408) 8 years ago
Yen Chi Hsuan 2cdbc06a1f
[foxnews] Support Fox News Articles (closes #10598) 8 years ago
Sergey M․ 2cb93afcd8
[viafree] Improve video id extraction (Closes #10615) 8 years ago
Yen Chi Hsuan bfcda07a27
[abc:iview] Skip the test. They are removed soon 8 years ago
Yen Chi Hsuan 001a5fd3d7
[iwara] Fix extraction after relaunch
Closes #10462, closes #3215
8 years ago
Remita Amine 1e35999c1e [tfo] Add new extractor 8 years ago
Sergey M․ 2512b17493
[lrt] Fix audio extraction (Closes #10566) 8 years ago
Sergey M․ 56c0ead4d3
[9now] Improve video data extraction (Closes #10561) 8 years ago
Scott Leggett 7324243750
[9now] Fix extraction 8 years ago
Sergey M․ 84a18e9b90
[polskieradio:category] Improve extraction 8 years ago
Sergey M․ b29f842e0e
[canalplus] Add support for c8.fr (Closes #10577) 8 years ago
Sergey M․ f009fcac0d
Merge branch 'master' of github.com:rg3/youtube-dl 8 years ago
Yen Chi Hsuan 6c3affcb18
[newgrounds] Fix uploader extraction
Closes #10584

Also change test URLs to HTTPS, as proposed by
@stepshal in #10593.

Closes #10593
8 years ago
Sergey M․ 1e19ff2984
Merge branch 'polskie-radio-programme' of https://github.com/JakubAdamWieczorek/youtube-dl 8 years ago
Sergey M․ c6129feb7f
[ketnet] Add extractor (Closes #10343) 8 years ago
Sergey M․ bb5ebd4453
[canvas] Add support for een.be (Closes #10605) 8 years ago
Remita Amine cb9cbd84ed [extractors] add import for TeleQuebecIE 8 years ago
Remita Amine 4d5726b0d7 [telequebec] Add new extractor(closes #1999) 8 years ago
Remita Amine 4614ad7b59 [parliamentliveuk] fix extraction(closes #9137) 8 years ago
Sergey M․ ad0e2b3359
[abcotvs] Add support for ABC Owned Television Stations 8 years ago
Sergey M․ 37720844f6
[jwplatform] Extract height from label 8 years ago
Sergey M․ 6cfcb8ac36
[tvnoe] Do not capture unused groups in _VALID_URL 8 years ago
Remita Amine 7a979da8cb [yahoo] Look for Brightcove Legacy Studio embeds(closes #9345) 8 years ago
Sergey M․ 2fdc7b0e04
[viafree] PEP 8 8 years ago
Sergey M․ 010d034fca
[videomore] Fix extraction (Closes #10592) 8 years ago
stepshal 25042f7372 Add missing r prefix for _VALID_URLs 8 years ago
Yen Chi Hsuan 3f612f0767
Fix _VALID_URLs further (#10594) 8 years ago
Yen Chi Hsuan 17bf6e71cc Merge pull request #10594 from stepshal/https_support
Add support for https for rest of the exctractors.
8 years ago
stepshal 89f257d6e5 Add support for https for rest of the exctractors. 8 years ago
Yen Chi Hsuan e78a5428b6
[foxgay] Fix extraction (closes #10480) 8 years ago
Remita Amine 6656a82481 [rmcdecouverte] Add new extractor(closes #9709) 8 years ago
Remita Amine d7e794928d [tlc] fix query string parsing 8 years ago
Yen Chi Hsuan f87feb4b68
[miaopai] Coding style (#10556) 8 years ago
Yen Chi Hsuan 2841bdcebb
Merge branch 'miaopai' of https://github.com/xyb/youtube-dl into xyb-miaopai 8 years ago
Yen Chi Hsuan 84b91dd4e3
[gamestar] Fix metadata extraction (closes #10479) 8 years ago
Yen Chi Hsuan 92c9c2a88b
[moevideo] Skip another removed test (#10474) 8 years ago
Remita Amine 9d54b02bae [puls4] fix extraction(closes #10583) 8 years ago
Remita Amine 846d8b76a0 [cctv] Add new extractor(closes #8153) 8 years ago
Remita Amine 8258f4457c [lci] Add new extractor(closes #10573) 8 years ago
Remita Amine 948cd5b72d [wat] extract dash formats 8 years ago
Jakub Adam Wieczorek 8d3737cda7 [polskieradio] Add support for downloading whole programmes.
This extends the Polskie Radio (the Polish national radio) extractor to
enable the user to download all the broadcasts of a single programme.
8 years ago
Sergey M․ 155bc674c4
[viafree] Improve video id detection (Closes #10569) 8 years ago
Remita Amine c33c962adf [trutv] Add new extractor(#10519) 8 years ago
Remita Amine bdcc046d12 [turner] use android secure hls host and catch token extraction errors 8 years ago
Xie Yanbo a493f10208 using _parse_html5_media_entries to parse video tag 8 years ago
Sergey M․ f3eeaacb4e
[nick] Add test for #10559 8 years ago
Sergey M․ b4d6a85d60
[nick] Add support for nickelodeon.nl (Closes #10559) 8 years ago
Remita Amine 0b36a96212 [abcotvs] extend _VALID_URL and add support for clips.abcotvs.com(closes #9551) 8 years ago
Yen Chi Hsuan 1f85029d82
[bilibili] Simplify 8 years ago
Xie Yanbo 95be19d436 [miaopai] Add new extractor 8 years ago
Yen Chi Hsuan 95843da529
Merge branch 'bilibili' of https://github.com/PeterDing/youtube-dl into PeterDing-bilibili 8 years ago
Yen Chi Hsuan 9127e1533d
[tvnoe] PEP8 and coding style 8 years ago
Matěj Cepl 78e762d23c Add new extractor for TV Noe (Czech Christian TV).
Fixes #10520
8 years ago
Remita Amine 433af6ad30 [theplatform] fix player regex(closes #10546) 8 years ago
Sergey M․ feaa5ad787
[youtube:playlist] Extend _VALID_URL 8 years ago
Remita Amine 100bd86a68 [rottentomatoes] delegate extraction to InternetVideoArchiveIE 8 years ago
Remita Amine 0def758782 [internetvideoarchive] extract all formats 8 years ago
Yen Chi Hsuan b29cd56591
[pornovoisines] Fix extraction (closes #10469) 8 years ago
Yen Chi Hsuan 622638512b
[rottentomatoes] Fix extraction
Closes #10467
8 years ago
Sergey M․ 37c7490ac6
[espn] Extend _VALID_URL (Closes #10549) 8 years ago
Sergey M․ 091624f9da
[vimple] Extend _VALID_URL (Closes #10547) 8 years ago
Sergey M․ 7e5dc339de
[youtube:watchlater] Fix extraction (Closes #10544) 8 years ago
Yen Chi Hsuan 45aab4d30b
[youjizz] Fix extraction. The site has moved to HTML5
Closes #10437
8 years ago
Yen Chi Hsuan ed2bfe93aa
[fc2:embed] Add ie_key 8 years ago
Yen Chi Hsuan cdc783510b
[foxnews:insider] Add new extractor
Closes #10445
8 years ago
Yen Chi Hsuan cf0efe9636
[fc2:embed] New extractor for Flash player URLs
Closes #10512
8 years ago
Christian Pointner dedb177029
Fix parsing of HTML5 media elements
This fixes an error in _parse_html5_media_entries in case
an audio or video tag directly uses a src attribute insted
of <source> elements in it's body.
8 years ago
Sergey M․ 6496ccb413
[youtube] Add support for rental videos' previews (Closes #10532) 8 years ago
Sergey M․ 3fcce30289
[drtv] Update tests 8 years ago
Sergey M․ dacb3a864a
[youtube:playlist] Fallback to video extraction for video/playlist URLs when playlist is broken (Closes #10537) 8 years ago
Sergey M․ 6066d03db0
[drtv] Modernize and make more robust 8 years ago
Sebastian Blunt 5e9e3d0f6b
[drtv] Add support for dr.dk/nyheder
It's the same video player, the only difference is that the video player
is loaded differently, and certain metadata (title and description) is
not available under dr.dk/mu, so make it by default get that from some
of the html meta tags.

Skip the dr.dk/tv test

dr.dk/tv videos are only available for between 7 and 90 days due to
Danish law, and in certain cases may be readded. Skip this test as it is
no longer available.
8 years ago
Sergey M․ 349fc5c705
[facebook:plugins:video] Add extractor (Closes #10530) 8 years ago
Remita Amine 2c3e0af93e [go] Add new extractor 8 years ago
Remita Amine 6150502e47 [adobepass] check for authz_token expiration(#10527) 8 years ago
Remita Amine b207d5ebd4 [curiositystream] don't cache auth token 8 years ago
Remita Amine 4191779dcd [nytimes] improve extraction 8 years ago
Sergey M․ f97ec8bcb9
[glide] Remove unused import 8 years ago
Sergey M․ 8276d3b87a
[thestar] Fix extraction (Closes #10465) 8 years ago
Sergey M․ af95ee94b4
[glide] Fix extraction (Closes #10478) 8 years ago
Sergey M․ 8fb6af6bba
[exfm] Remove extractor (Closes #10482) 8 years ago
Sergey M․ f6af0f888b
[youporn] Fix categories and tags extraction (Closes #10521) 8 years ago
Sergey M․ e816c9d158
[extractor/common] Simplify _extract_m3u8_formats 8 years ago
Sergey M․ 9250181f37
[extractor/common] Restore NAME usage from EXT-X-MEDIA tag for formats codes in _extract_m3u8_formats (Closes #10522) 8 years ago
Remita Amine f096ec2625 [curiositystream] Add new extractor 8 years ago
Yen Chi Hsuan 4c8ab6fd71
[thvideo] Remove extractor. Website down.
Closes #10464

According to a screenshot in http://tieba.baidu.com/p/4691302183,
thvideo.tv is shut down "temporarily". I see no clues that it will be up
again, so I remove it here.
8 years ago
Yen Chi Hsuan 05d4612947
[movingimage] Adapt to the new domain name and fix extraction
Closes #10466
8 years ago
Yen Chi Hsuan 746a695b36
[myvidster] Update _TESTS (closes #10473) 8 years ago
Yen Chi Hsuan 165c54e97d
[southpark.cc.com:español] Skip geo-restricted _TESTS
Breaks https://travis-ci.org/rg3/youtube-dl/jobs/156728175
8 years ago
Remita Amine 2896dd73bc [cbs] extract once formats(closes #10515) 8 years ago
Remita Amine f8fd510eb4 [limelight] skip ism manifests and reduce requests 8 years ago
Sergey M․ 7a3e849f6e
[porncom] Extract categories and tags (Closes #10510) 8 years ago
Sergey M․ 196c6ba067
[facebook] Extract timestamp (Closes #10508) 8 years ago
Remita Amine 165620e320 [yahoo] extract more and better formats 8 years ago
Sergey M․ a249ab83cb
[pyvideo] Remove debugging code 8 years ago
Sergey M․ f7043ef39c
[soundcloud] Fix _VALID_URL clashes with sets (Closes #10505) 8 years ago
Sergey M․ 64fc49aba0
[bandcamp:album] Fix title extraction (Closes #10455) 8 years ago
Sergey M․ 245023a861
[pyvideo] Fix extraction (Closes #10468) 8 years ago
Remita Amine 3c77a54d5d [turner] keep video id intact 8 years ago
Remita Amine da30a20a4d [turner,cnn] move a check for wrong timestamp to CNNIE 8 years ago
Remita Amine 1fe48afea5 [cnn] update _TEST for CNNBlogsIE and CNNArticleIE(closes #10489) 8 years ago
Remita Amine 42e05be867 [ctv] add support for (tsn,bnn,thecomedynetwork).ca websites(#10016) 8 years ago
Remita Amine fe45b0e060 [9c9media] fix multiple stacks extraction and extract more metadata(#10016) 8 years ago
Sergey M․ a06e1498aa
[kusi] Update test 8 years ago
Sergey M․ 5a80e7b43a
[turner] Skip invalid subtitles' URLs 8 years ago
Sergey M․ 3fb2a23029
[adultswim] Extract video info from onlineOriginals (Closes #10492) 8 years ago
PeterDing 7be15d4097 [bilibili] Support episodes
[extractor/bilibili] add md5 for testing

[extractor/bilibili] remove unnecessary headers

[extractor/bilibili] correct _TESTS; find thumbnail for episode

[extractor/bilibili] [Fix] restore removed tests
8 years ago
Sergey M․ cd10b3ea63
[turner] Extract all formats 8 years ago
Sergey M․ 547993dcd0
[turner] Fix subtitles extraction 8 years ago
Remita Amine 93b8404599 [generic,vodplatform] improve embed regex 8 years ago
Sergey M․ 9ba1e1dcc0
[played] Remove extractor (Closes #10470) 8 years ago
Remita Amine b8079a40bc [turner] fix secure m3u8 formats downloading 8 years ago
Remita Amine 5bc8a73af6 [cartoonnetwork] make extraction work for more videos in the website
some videos require `networkName=CN2` to be present in the feed url
8 years ago
Remita Amine b3eaeded12 [tbs] Add new extractor(#10222) 8 years ago
Remita Amine ec65b391cb [cartoonnetwork] Add new extractor(#10110) 8 years ago
Remita Amine 2982514072 [turner,nba,cnn,adultswim] add base extractor to parse cvp feeds 8 years ago
Yen Chi Hsuan 98908bcf7c
[openload] Update algorithm again (#10408) 8 years ago
Yen Chi Hsuan 04b32c8f96
[bilibili] Fix extraction (closes #10375)
Thanks @gdkchan for the algorithm
8 years ago
Yen Chi Hsuan 40eec6b15c
[openload] Fix extraction (closes #10408)
Thanks to @yokrysty again!
8 years ago
Yen Chi Hsuan 39efc6e3e0 [generic] Update some _TESTS 8 years ago
Sergey M․ 92c27a0dbf
[periscope:user] Fix extraction (Closes #10453) 8 years ago
Yen Chi Hsuan 3b4b82d4ce
[douyutv] Simplify 8 years ago
Yen Chi Hsuan 545ef4f531
Merge branch 'patch-2' of https://github.com/steven7851/youtube-dl into steven7851-patch-2 8 years ago
Yen Chi Hsuan 906b87cf5f
[crackle] Revert to template-based thumbnail extraction
To reduce to number of HTTP requests
8 years ago
steven7851 b281aad2dc [douyutv] Use new api
use lapi for flv info, and html5 api for room info
#10153 #10318
8 years ago
Sergey M․ 6b18a24e6e
[tnaflix] Fix extraction (Closes #10434) 8 years ago
Sergey M․ f9b373afda
[nhk:vod] Improve extraction (Closes #10424) 8 years ago
Aleksander Nitecki 298a120ab7
[nhk] Add extractor for VoD. 8 years ago
Sergey M․ e3faecde30
[trutube] Remove extractor (Closes #10438) 8 years ago
Remita Amine a0f071a50d [usanetwork] Add new extractor 8 years ago
Yen Chi Hsuan b54a2da433
[crackle] Fix extraction and update _TESTS (closes #10333) 8 years ago
Yen Chi Hsuan dc2c37f316
[spankbang] Fix description and uploader (closes #10339) 8 years ago
Remita Amine 5c13c28566 raise unexpected error when no stream found 8 years ago
Remita Amine f70e9229e6 [discoverygo] detect when video needs authentication(closes #10425) 8 years ago
Remita Amine 30afe4aeb2 [cbc] Add support for watch.cbc.ca 8 years ago
Remita Amine f39ffc5877 [common] extract formats from #EXT-X-MEDIA tags 8 years ago
Yen Chi Hsuan 08773689f3 [kickstarter] Silent the warning for og:description
Closes #10415
8 years ago
Yen Chi Hsuan 0c75abbb7b [mtvservices:embedded] Use another endpoint to get feed URL
Closes #10363

In the original mtvservices:embedded test case, config.xml is still used
to get the feed URL. Some other examples, including test_Generic_40
(http://www.vulture.com/2016/06/new-key-peele-sketches-released.html),
and the video mentioned in #10363, use another endpoint to get the feed
URL. The 'index.html' approach works for the original test case, too. So
I didn't keep the old approach.
8 years ago
Yen Chi Hsuan 97653f81b2 [bilibili] Mark as broken
Bilibili now uses emscripten, which is very difficult for reverse
engineering. I don't expect it to be fixed in near future, so I mark
it as broken.

Ref: #10375
8 years ago
Sergey M․ 30317f4887
[pluralsight] Modernize and make more robust 8 years ago
Sergey M․ 8c3e35dd44
[pluralsight] Add support for subtitles (Closes #9681) 8 years ago
Sergey M․ 05bddcc512
[youtube] Fix authentication (2) (Closes #10392) 8 years ago
Sergey M․ 1212e9972f
[youtube] Fix authentication (#10392) 8 years ago
Remita Amine ccb6570e9e [syfy,bravotv] restrict drupal settings regex 8 years ago
Yen Chi Hsuan 18b6216150
[openload] Fix extraction (closes #10408)
Thanks @yokrysty for the algorithm
8 years ago
Remita Amine fb009b7f53 [bravotv] correct clip info extraction and add support for adobe pass auth(closes #10407) 8 years ago
Sergey M․ 3083e4dc07
[eagleplatform] Improve detection of embedded videos (Closes #10409) 8 years ago