Commit Graph

9858 Commits (8b6ac49ecc873f787f647f1e623af989f85de644)

Author SHA1 Message Date
Throaway 21fbf0f955
[pornhub] Decode obfuscated video URL (closes #12470) 8 years ago
John Hawkinson 97952bdb78 [generic] Add test for Senate ISVP iframe embed 8 years ago
John Hawkinson 8a8cc339b6 [senateisvp] Allow https URL scheme for embeds 8 years ago
Vijay Singh 957f453429 [Openload.co] Fixed Extraction
They did it again. just a minor change though. here's quick fix
8 years ago
John Hawkinson 46b18f2349 [BostonGlobe] New. Nonstandard version of Brightcove.
Has a "data-brightcove-video-id" instead of a "data-video-id," otherwise
pretty much just Brightcove. Except the Globe isn't all Brightcove
videos, so fallback to Generic, too.

Also, abstract playlist_from_matches() from generic.py to common.py, and use
it here.

History of these changes can be found in
51170427d4b1143572a498dedaee61863a5b2c5b.
8 years ago
Remita Amine 772b5ff57f [toongoggles] Add new extractor(closes #12171) 8 years ago
Sergey M․ f68ef1e2ab
[medialaan] Remove unrelated test 8 years ago
Sergey M․ febfe1e262
[adobepass] Detect and output error on authz token extraction (#12472) 8 years ago
Vijay Singh 5f0daab1ca [openload] Fix extraction 8 years ago
Sergey M․ 2a721cdff2
[medialaan] Fix and improve extraction (closes #11912) 8 years ago
mrBliss e7a51a4c02
[vtm] Add extractor (closes #9974)
Implementation of the approach described in #9974.
8 years ago
Remita Amine 3e5856d860 [discoverynetworks] add support for more domains and bypass geo restiction 8 years ago
Yen Chi Hsuan ea883a687c
[openload] Fix extraction (closes #10408)
Thanks to @makgun02

Ref: http://pastebin.com/raw/JX9gHFUz
8 years ago
Sergey M․ b51dc9db0e
[extractor/common] Extract SMIL formats from jwplayer 8 years ago
Sergey M․ a309684285
[extractor/generic] Add forgotten return for jwplayer formats 8 years ago
Remita Amine ba448445b8 [redbull] improve extraction
- extract 1080p quality
- correct ttml subtitle ext
- catch api errors
- reduce request size
8 years ago
Vijay Singh 398887b4c0 [Openload] Fixed Extraction
They did changed it again.
8 years ago
Sergey M․ 66bf351f80
[facebook] Make title optional (closes #12443) 8 years ago
Sergey M․ 9d08963022
[telecinco] Add test for #12430 8 years ago
Sergey M․ e313d209c2
[mitele] Add support for ooyala videos (closes #12430) 8 years ago
Vijay Singh ff9d509d20 [openload] Fix extraction
Just a minor fix for openload
8 years ago
Lucas M c1795ca6c8 [streamable] Update API URL 8 years ago
Starsam80 8c99623259 [crunchyroll] Extract season name 8 years ago
Sergey M․ 57b0ddb35f
[discoverygo] Actualize test 8 years ago
Sergey M․ a28f8d7396
[discoverygo] Bypass geo restriction 8 years ago
Sergey M․ 7049799470
[discoverygo:playlist] Add extractor (closes #12424) 8 years ago
Sergey M․ c2ee861c6d
[extractor/generic] Make title optional for jwplayer embeds (closes #12410) 8 years ago
Sergey M․ bd34c32bd7
[wdr] Actualize comment 8 years ago
runningbits f802c48660 [wdr:maus] Fix extraction and update tests 8 years ago
Sergey M․ 76bee08fe7
[prosiebensat1] Improve title extraction and add test 8 years ago
Thomas Christlieb 2913821723 [prosiebensat1] Improve title extraction (closes #12318) 8 years ago
Sergey M․ 0e7f9a9b48
[dplayit] Relax playback info URL extraction 8 years ago
Sergey M․ 0cf2352e85
[dplayit] Separate and rewrite extractor and bypass geo restriction (closes #12393) 8 years ago
Yen Chi Hsuan 0f6b87d067
[miomio] Fix extraction
Closes #12291
Closes #12388
Closes #12402
8 years ago
Sergey M․ d7344d33b1
[telequebec] Fix description extraction and update test (closes #12399) 8 years ago
denneboomyo b08cc749d6 [openload] Fix extraction 8 years ago
Sergey M․ b68a812ea8
[extractor/generic] Add test for brigthcove UUID-like videoPlayer 8 years ago
Sergey M․ 2e76bdc850
[brightcove:legacy] Relax videoPlayer validation check (closes #12381) 8 years ago
Yen Chi Hsuan fe646a2f10
[twitch] PEP8 8 years ago
Sergey M․ e30ccf7047
[soundcloud] Update client id (closes #12376) 8 years ago
denneboomyo da92da4b88 Openload fix extraction (#12357)
* Fix extraction
8 years ago
Sergey M․ 96182695e4
[drtv] Add geo countries to GeoRestrictedError 8 years ago
Sergey M․ fc11ad3833
[drtv:live] Bypass geo restriction 8 years ago
Yen Chi Hsuan d2b64e04b4
[addanime] Skip an invalid test 8 years ago
Sergey M․ 5dd376345b
[tunepk] Add extractor (closes #12197, closes #12243) 8 years ago
Sergey M․ 1a2192cb90
[extractor/common] Pass arguments to _parse_jwplayer_formats and PEP8 8 years ago
Sergey M․ 0236cd0dfd
[extractor/common] Improve height extraction and extract bitrate 8 years ago
Sergey M․ ed0cf9b383
[extractor/common] Move jwplayer formats extraction in separate method 8 years ago
Sergey M․ 5316566edc
[twitch] Use better naming and simplify (closes #11974) 8 years ago
Xiao Di Guan c64c03be35
[twitch] Add basic support for two-factor authentication 8 years ago
Lars Vierbergen a3ba8a7acf [vier] Add support for vijf.be
vier.be and vijf.be run on the same CMS and are property of the same company,
so the same extractor can be used for both of them.
8 years ago
Sergey M․ 054a587de8
[redbulltv] Improve extraction (closes #11948, closes #3919) 8 years ago
Juanjo Benages 64b7ccef3e
[redbulltv] Add extractor 8 years ago
Yen Chi Hsuan 6f4e4132d8
[douyutv] Switch to the PC API to escape the 5-min limitation
Thanks @spacemeowx2 for the algo.

Ref: https://gist.github.com/spacemeowx2/629b1d131bd7e240a7d28742048e80fc

Closes #12316
8 years ago
Sergey M․ eb3079b6ce
[generic] Add support for rutube embeds 8 years ago
Sergey M․ bc82f22879
[rutube] Relax _VALID_URL 8 years ago
Sergey M․ 4d058c9862
[vrak] Improve and update test (closes #11452) 8 years ago
Sergey M․ d16f27ca27
[brightcove:new] Add ability to smuggle geo_countries into URL 8 years ago
Olivier Bilodeau cbb127568a
[vrak] Add extractor 8 years ago
Sergey M․ d02d4fa0a9
[brightcove:new] Raise GeoRestrictedError 8 years ago
Sergey M․ 692fa200ca
[go] Relax _VALID_URL (closes #12341) 8 years ago
Sergey M․ 9bae185ba6
[24video] Use original host for requests (closes #12339) 8 years ago
Sergey M․ 4d345bf17b
[ruutu] Disable DASH formats (closes #12322)
Due to causing out of sync issue
8 years ago
Yen Chi Hsuan 11bb6ad1a5
[facebook] Fix extraction (closes #12323)
Almost all videos now use the pagelet type 'permalink_video_pagelet'
8 years ago
Yen Chi Hsuan c9612c0487
[youtube] Mark errors about rental videos as expected
Closes #12324
8 years ago
Yen Chi Hsuan af5049f128
[adobepass] Add Charter Spectrum (#11465)
Thanks @tv21 for the fix!
8 years ago
Sergey M․ 4b8a984c67
[npo] Add support for audio 8 years ago
Sergey M․ 83e8fce628
[npo] Improve extraction and update tests 8 years ago
Sergey M․ aa9cc2ecbf
[npo] Adapt to app.php API (closes #12311) 8 years ago
Sergey M․ 43b38424a9
[azmedien:showplaylist] Improve (closes #12160) 8 years ago
Alex Seiler 948519b35d
[azmedien:showplaylist] Add support for all episodes playlists 8 years ago
Sergey M․ 87dadd456a
[youtube:playlist] Recognize another playlist pattern (closes #11928, closes #12286) 8 years ago
Yen Chi Hsuan 7c4aa6fd6f
[daisuki] Add subtitles (#4738) 8 years ago
Yen Chi Hsuan 9bd05b5a18 [daisuki] Add new extractor (closes #4738) 8 years ago
Yen Chi Hsuan f4c68ba372
[douyu] Fix extraction and update _TESTS
They've switched from flv to hls

Closes #12301
8 years ago
Sergey M․ 18abb74376
[npo] Relax _VALID_URL for zapp.nl 8 years ago
Sergey M․ dbc01fdb6f
[hetklokhuis] Fix IE_NAME 8 years ago
Sergey M․ f264c62334
[npo] Add support for zapp.nl 8 years ago
Sergey M․ 0dc5a86a32
[npo] Add support for hetklokhuis.nl (closes #12293) 8 years ago
Sergey M․ 0e879f432a
[youtube:channel] Remove duplicate test 8 years ago
Yen Chi Hsuan 892b47ab6c
[scivee] Remove extractor (#9315)
The Wikipedia page is changed from active to down:
https://en.wikipedia.org/w/index.php?title=SciVee&diff=prev&oldid=723161154

Some other interesting bits:

$ nslookup www.scivee.tv
Server:         8.8.8.8
Address:        8.8.8.8#53

Non-authoritative answer:
www.scivee.tv   canonical name = scivee.rcsb.org.
Name:   scivee.rcsb.org
Address: 132.249.231.211

$ nslookup rcsb.org
Server:         8.8.8.8
Address:        8.8.8.8#53

Non-authoritative answer:
Name:   rcsb.org
Address: 132.249.231.77

Both IPs are from UCSD. I guess it's maintained by a lab and they don't
maintain it anymore.
8 years ago
Alex Seiler fdeea72611 [cda] Decode URL (fixes #12255) 8 years ago
xbe 7fd4655256 [crunchyroll] Extract uploader name that's not a link
Provide the Crunchyroll extractor with the ability to extract uploader
names that aren't links. Add a test for this new functionality.
This fixes #12267.
8 years ago
Sergey M․ fd5c4aab59
[youtube] Raise GeoRestrictedError 8 years ago
Sergey M․ 8878789f11
[dailymotion] Raise GeoRestrictedError 8 years ago
Yen Chi Hsuan a5cf17989b
[MDR] Relax _VALID_URL and playerURL matching and update _TESTS
Ref: #12169
8 years ago
Sergey M․ b3aec47665
[tvigle] Raise GeoRestrictedError 8 years ago
Yen Chi Hsuan 9d0c08a02c
[vevo] Fix videos with the new streams/streamsV3 format (closes #11719) 8 years ago
Sergey M․ e498758b9c
[freshlive] Fix issues and improve (closes #12175) 8 years ago
Ricardo Constantino 5fc8d89361
[freshlive] Add extractor 8 years ago
Sergey M․ 103f8c8d36
[xhamster] Capture and output videoClosed error (#12263) 8 years ago
Sergey M․ 922ab7840b
[etonline] Add extractor (closes #12236) 8 years ago
Yen Chi Hsuan db182c63fb
[njpwworld] Add new extractor (closes #11561) 8 years ago
Yen Chi Hsuan eeb0a95684
[extractor/common] Add 'preference' to _parse_html5_media_entries
Some websites, like NJPWorld, put different qualities on different
player pages.
8 years ago
Sergey M․ 231bcd0b6b
[amcnetworks] Relax _VALID_URL (#12127) 8 years ago
Sergey M․ ad3033037c
[noco] Modernize 8 years ago
Sergey M․ f3bc281239
[noco] Swtich login URL to https (closes #12246) 8 years ago
Sergey M․ 441d7a32e5
[thescene] Extract more metadata 8 years ago
Thomas Christlieb 51ed496307 [thescene] Fix extraction (closes #12235) 8 years ago
Remita Amine 68f17a9c2d [tubitv] use geo bypass mechanism 8 years ago
Remita Amine 39e7277ed1 [openload] fix extraction(closes #10408) 8 years ago
Sergey M․ 42dcdbe11c
[ivi] Raise GeoRestrictedError 8 years ago
Sergey M․ f2980fddeb
[lynda:course] Add webpage extraction fallback (closes #12238) 8 years ago
Remita Amine 8e1409fd80 [go] sign all uplynk urls and use geo bypass only for free videos(closes #12087)(closes #12210) 8 years ago
Sergey M․ d5fd9a3be3
[skylinewebcams] Add extractor (closes #12221) 8 years ago
Sergey M․ ada77fa544
[instagram] Add support for multi video posts (closes #12226) 8 years ago
Remita Amine 9e03aa75c7 [crunchyroll] extract playlist entries ids 8 years ago
Remita Amine 30eaa3a702 [mgtv] fix extraction 8 years ago
Remita Amine c59f703610 [sohu] raise GeoRestrictedError 8 years ago
Remita Amine bc61c80c14 [leeco] raise GeoRestrictedError and use geo bypass mechanism 8 years ago
Yen Chi Hsuan b5869560a4
[crunchyroll] Fix descriptions with double quotes (closes #12124) 8 years ago
Sergey M․ 527ef85fe9
[dailymotion] Make comment count optional (closes #12209)
Not served anymore
8 years ago
Sergey M․ 58ad6995cd
[vidzi] Add test for #12213 8 years ago
Tobias Florek a86e416088 [vidzi] Add support for vidzi.cc 8 years ago
Sergey M․ 71e9577b94
[24video] Add support for 24video.tube (closes #12217) 8 years ago
Remita Amine abd29a2ced [crackle] use geo bypass mechanism 8 years ago
Remita Amine 31615ac279 [viewster] use geo verifcation headers 8 years ago
Remita Amine fc320a40d9 Revert "[cbc] use geo bypass mechanism"
This reverts commit 86466a8b6f.
8 years ago
Remita Amine 7345d6d465 [tfo] Improve geo restriction detection and use geo bypass mechanism 8 years ago
Remita Amine 86466a8b6f [cbc] use geo bypass mechanism 8 years ago
Remita Amine 33dc173cdc [telequebec] use geo bypass mechanism 8 years ago
Remita Amine 3444844b04 [limelight] extract PlaylistService errors 8 years ago
Sergey M․ eea0716cae
[extractor/common] Print origin country for fake IP 8 years ago
Sergey M․ 336a76551b
[extractor/common] Do not quit _initialize_geo_bypass on empty countries 8 years ago
Sergey M․ dc0a869e5e
[extractor/common] Fix typo 8 years ago
Sergey M․ e39b5d4ab8
[extractor/common] Allow calling _initialize_geo_bypass from extractors (#11970) 8 years ago
Remita Amine e469ab2528 [ninecninemedia] use geo bypass mechanism 8 years ago
Remita Amine 890d44b005 [adobepass] add support for Time Warner Cable(closes #12191) 8 years ago
Sergey M․ 6926304472
[spankbang] Make uploader optional (closes #12193) 8 years ago
Sergey M․ 3ccdde8cb7
[extractor/common] Emphasize geo bypass APIs are experimental 8 years ago
Sergey M․ da42ff0668
[iprima] Improve geo restriction detection and disable geo bypass 8 years ago
Sergey M․ 82f662182b
[iprima] Modernize 8 years ago
Sergey M․ 2cc7fcd338
[commonmistakes] Disable UnicodeBOM extractor test for python 3.2 8 years ago
Sergey M․ 6d4c259765
[svt] PEP 8 8 years ago
Sergey M․ c78dd35491
[nrk] PEP 8 8 years ago
Sergey M․ 8ffb8e63fe
[prosiebensat1] Throw ExtractionError on unsupported page type (closes #12180) 8 years ago
Sergey M․ 983e9b7746
[nrk] Update _API_HOST and relax _VALID_URL 8 years ago
Sergey M․ c58b7ffef4
[tv4] Bypass geo restriction and improve detection 8 years ago
Sergey M․ f1a78ee4ef
[tv4] Switch to hls3 protocol (closes #12177) 8 years ago
Sergey M․ 4248dad92b Improve geo bypass mechanism
* Rename options to preffixly match with --geo-verification-proxy
* Introduce _GEO_COUNTRIES for extractors
* Implement faking IP right away for sites with known geo restriction
8 years ago
Sergey M․ 0a840f584c Rename bypass geo restriction options 8 years ago
Sergey M․ 0016b84e16 Add faked X-Forwarded-For to formats' HTTP headers 8 years ago
Sergey M․ 5d3fbf77d9 [viki] Improve geo restriction detection 8 years ago
Sergey M․ 80b59020e0 [vgtv] Improve geo restriction detection 8 years ago
Sergey M․ 71631862f4 [srgssr] Improve geo restriction detection 8 years ago
Sergey M․ 89cc7fe770 [vbox7] Improve geo restriction detection and use geo bypass mechanism 8 years ago
Sergey M․ 04d906eae3 [svt] Improve geo restriction detection and use geo bypass mechanism 8 years ago
Sergey M․ 8ab8066cf0 [pbs] Improve geo restriction detection and use geo bypass mechanism 8 years ago
Sergey M․ 01b1aa9ff4 [ondemandkorea] Improve geo restriction detection and use geo bypass mechanism 8 years ago
Sergey M․ ff4007891f [nrk] Improve geo restriction detection and use geo bypass mechanism 8 years ago
Sergey M․ 28200e654b [itv] Improve geo restriction detection and use geo bypass mechanism 8 years ago
Sergey M․ e633f21a96 [go] Improve geo restriction detection and use geo bypass mechanism 8 years ago
Sergey M․ d392005a79 [dramafever] Improve geo restriction detection and use geo bypass mechanism 8 years ago
Sergey M․ 773f291dcb Add experimental geo restriction bypass mechanism
Based on faking X-Forwarded-For HTTP header
8 years ago
Remita Amine 049a0f4d6d [brightcove:legacy] restrict videoPlayer value(closes #12040) 8 years ago
Sergey M․ e84888b432
[tvn24] Improve extraction (closes #11679) 8 years ago
Jakub Wilk 02d9b82a23
[tvn24] Add extractor 8 years ago
Sergey M․ a2e3286676
[thisav] Add support for html5 media (closes #11771) 8 years ago
Sergey M․ f75caf059e
[metacafe] Improve (closes #10371) 8 years ago
Alex Monk bdabbc220c
[metacafe] Bypass family filter
If you don't send this user=ffilter: false cookie, it will 301 redirect you to a page asking about it, and then the title check will fail.
8 years ago
Remita Amine 70bcc444a9 [viceland] improve info extraction and update test 8 years ago
Sergey M․ bad4ccdb5d
[heise] Improve (closes #9725) 8 years ago
Tobias Gruetzmacher db76c30c6e
[heise] Support videos embedded in any article. 8 years ago
Déstin Reed c2bde5d081
[ellentv] Improve 8 years ago
Sergey M․ 90fad0e74c
[openload] Fix extraction (closes #12002) 8 years ago
Vijay Singh d94badc755
[openload] Semifix extraction (closes #10408)
just updated the code. i don't do much python still i tried to convert my code. lemme know if there is any prob with it
8 years ago
Yen Chi Hsuan fef51645d6
[theplatform] Recognize URLs with whitespaces (closes #12044) 8 years ago
Sergey M․ 4cead6a614
[einthusan] Relax _VALID_URL (closes #12141, closes #12159) 8 years ago
Yen Chi Hsuan a4a554a793
[generic] Try parsing JWPlayer embedded videos (closes #12030) 8 years ago
Sergey M․ b898f0a173
[elpais] Fix typo and improve extraction (closes #12139) 8 years ago
Sergey M․ eafaeb226a
[ceskatelevize] Lower priority for audio description sources (#12119) 8 years ago
Sergey M․ de4d378c0c
[ceskatelevize] Prefix format ids 8 years ago
Remita Amine 1bd05345ea [amcnetworks] fix extraction(closes #12127) 8 years ago
Sergey M․ 3021cf83b7
[pinkbike] Fix uploader extraction (closes #12054) 8 years ago
Sergey M․ 04a741232f
[onetpl] Add support for businessinsider.com.pl and plejada.pl 8 years ago
Sergey M․ 43a3d9edfc
[onetpl] Add support for onet.pl (closes #10507) 8 years ago
Sergey M․ d31aa74fdb
[onetmvp] Add shortcut extractor 8 years ago
Sergey M․ 6092ccd058
[vodpl] Make more robust and add another test (closes #12122) 8 years ago
Marek Rusinowski 22ce9ad2bd
[vod.pl] Add new extractor 8 years ago
Sergey M․ 9a372f14b4
[pornhub] Extract video URL from tv platform site (#12007, #12129) 8 years ago
Sergey M․ 5cb2d36c82
[ceskatelevize] Extract DASH formats (closes #12119, closes #12133) 8 years ago
Ondřej Caletka fcca0d53a8
[ceskatelevize] Quick fix to revert to using old HLS-based playlist
This fixes recent changes in iVysilani. Proper patch should migrate to
MPEG-DASH version, which is now the default.
8 years ago
Sergey M․ 50de3dbad3
[zdf] Fix extraction (closes #12117) 8 years ago
Sergey M․ 085f169ffe
[xtube] Fix extraction for both kinds of video id (closes #12088) 8 years ago
Vobe f6d6ca1db3
[xtube] Improve title extraction 8 years ago
Sergey M․ 6e5956e6ba
[lemonde] Fallback delegate extraction to generic extractor (closes #12115, closes #12116) 8 years ago
Remita Amine 89c6691f9d [bellmedia] accept longer video id(closes #12114) 8 years ago
Remita Amine 454e5cdb17 [limelight] add support referer protected videos 8 years ago
Remita Amine 9dad941853 [disney] improve extraction
- add support for more urls
- detect expired videos
- skip Adobe Flash Access protected videos

closes #4975
closes #11000
closes #11882
closes #11936
8 years ago
Remita Amine 0dac7cbb09 [hotstar] improve extraction(closes #12096)
- extract all qualities
- detect drm protected videos
- extract more metadata
8 years ago
Yen Chi Hsuan f8514630db
[einthusan] Fix extraction (closes #11416)
The old test URLs are no longer valid, so I replace them with the one
from #11416
8 years ago
Aniruddh-J 459818e280 [aenetworks] Add support for lifetimemovieclub.com 8 years ago
Sergey M․ 6310acf512
[youtube] Fix parsing codecs (closes #12091) 8 years ago
Yen Chi Hsuan 68c22c4c15
[iqiyi] Update _TESTS 8 years ago
Sergey M․ 3d7e3aaa0e
[pluralsight:course] Fix extraction (closes #12075) 8 years ago
Sergey M․ 624c4b92ff
[facebook] Add coding cookie 8 years ago
Remita Amine 97eb9bd2ac [bbc] extract m3u8 formats with 320k audio 8 years ago
Sergey M․ 71cdd75628
[facebook] Relax video id matching (closes #11017, closes #12055, closes #12056) 8 years ago
Remita Amine c7d6f614f3 [corus] Add new extractor(closes #12060)(#9164) 8 years ago
Remita Amine 08a00eef79 [extractor/common] skip m3u8 manifests protected with Adobe Flash Access 8 years ago
Sergey M․ 9dd5408c99
[pluralsight] Detect blocked account error message (#12070) 8 years ago
Sergey M․ 9510709575
[bloomberg] Add another video id regex (closes #12062) 8 years ago
Remita Amine 5abcca9060 [sixplay] use raw string for regex 8 years ago
Sergey M․ e01bfc19c3
[extractor/commonmistakes] Restrict _VALID_URL (closes #12050) 8 years ago
Remita Amine 4d32b63851 [tvplayer] Add new extractor 8 years ago
Sergey M․ ff24261ba0
[kaltura] Add explicit port to regexes
They should not match e.g. cdnapi.kaltura.computernetworks.com/...
8 years ago
Sergey M․ fbc6dc525e
[xtube] Fix shortcuts 8 years ago
Sergey M․ 9150d1eb69
[xtube] Fix extraction (closes #12023) 8 years ago
Sergey M․ b7f9843bec
[pornhub] Simplify (closes #12018) 8 years ago
Thomas Christlieb e64b0fca14
[pornhub] Fix extraction (closes #12007) 8 years ago
Sergey M․ 78ef214d2d
[facebook] Improve JS data regex (closes #12042) 8 years ago
Remita Amine 37084f6641 [kaltura] improve embed partner id extraction(fixes #12041) 8 years ago
Remita Amine b04975733c [sprout] Add new extractor 8 years ago
Remita Amine c8b8fb0a99 [sixplay] improve extraction
- skip drm protected formats
- extract more and better formats
- skip duplicate asset urls
8 years ago
Remita Amine 8298018273 [scrippsnetworks:watch] Add new extractor(closes #10765) 8 years ago
Remita Amine ae8d5a5c59 [go] add support for adobe pass auth(closes #11468)(closes #10831) 8 years ago
Sergey M․ b9c9cb5f79
[6play] Fix extraction (closes #12011) 8 years ago
Remita Amine fdf9b959bc [nbc] add support adobe pass auth(closes #12006) 8 years ago
Sergey M․ f28aeff264
[pornhub] Fix extraction (closes #11997) 8 years ago
Sergey M․ 242a14a1f6
[extractor/common] Fix audio only with audio group in m3u8 (closes #11995) 8 years ago
Sergey M․ d5d904ff7d
[canalplus] Add support for cstar.fr (#11990) 8 years ago
Sergey M․ 5620f840f6
[extractor/generic] Add test for #11993 and more metadata for rtmp 8 years ago
Sergey M․ b7a8c1bcfa
[extractor/generic] Improve rtmp support (closes #11993) 8 years ago
Sergey M․ 2aec7256ae
[extractor/common] Speed-up media tags regex (closes #11979) 8 years ago
Yen Chi Hsuan 9c14fe9681
[gaskrank] Minor change and update ChangeLog after #11685 8 years ago
motophil e705755739 [gaskrank] Add new extractor (#11685)
* [gaskrank] Add new extractor

* [gaskrank] Add new extractor - fixes as requested

* [gaskrank] Add new extractor - style fix

* [Gaskrank] Add new extractor - requested fixes

* [Gaskrank] Add new extractor - fix md5 checksum

* [gaskrank] Add new extractor - more requested fixes

* [Gaskrank] Add new extractor - fixed all but one quantified code issues

* [Gaskrank] add new extractor - more fields extracted, added second test

* [Gaskrank] Add new extractor - requested fixes.

* [Gaskrank] Add new extractor - requested changes.

* [Gaskrank] Add new extractor - final(?) fixes.
8 years ago
Yen Chi Hsuan 019f4c0371
[bandcamp] Fix extraction for incomplete albums
Closes #11727
8 years ago
Yen Chi Hsuan 2ab2c0d1f5
[iwara] Add width (closes #11724)
The heuristic is from #11724
8 years ago
Yen Chi Hsuan caf0f5f8b7
[iwara] Fix extraction (closes #11781) 8 years ago
Yen Chi Hsuan e4e50f60b1
[googledrive] Fix extraction on Python 3.6
Since Python 3.6, invalid escape sequences are deprecated. It's likely
that there are invalid escape sequences somewhere on the webpage, so
instead of unescaping the whole webpage, just unescape the URL.

See https://bugs.python.org/issue27364. That change was designed for
string literals, while it affects the 'unicode_escape' encoding as well.
The code path is:

str.decode('unicode_escape')
    codecs.unicode_escape_decode()
        PyUnicode_DecodeUnicodeEscape()
8 years ago
Sergey M․ 6ef3e65a7b
[videopress] Add extractor 8 years ago
Sergey M․ 6fd138bed8
[sportbox] PEP 8 8 years ago
Remita Amine 3d2c2752c5 [afreecatv] extract rtmp formats 8 years ago
Sergey M․ 9db8f6c540
[twitch:stream] Improve _VALID_URL (closes #11971) 8 years ago
Remita Amine 8e4041cf3f [radiocanada] fix extraction for toutv rtmp formats 8 years ago
John Hawkinson c2521c1ac6 [Piksel] Add another app token regex 8 years ago
A Connecticut Princess 643dc0fcfe
[vk] Catch author blocked error message
Example link (video in blocked group):
https://vk.com/search?c%5Bq%5D=%D0%9F%D1%80%D1%8B%D0%B6%D0%BE%D0%BA%20c%20%D0%BA%D1%80%D0%B0%D0%BD%D0%B0%20%D0%B2%20%D1%81%D1%82%D0%B8%D0%BB%D0%B5%20%D0%A7%D0%B5%D0%BB%D0%BE%D0%B2%D0%B5%D0%BA%D0%B0-%D0%BF%D0%B0%D1%83%D0%BA%D0%B0&c%5Bsection%5D=video&c%5Bsort%5D=2&z=video-10639516_456240611
8 years ago
Remita Amine 36fce54816 [turner] fix downloading of secure hls formats using ffmpeg(closes #11358)(closes #11373)(closes #11800) 8 years ago
Remita Amine 2c15db829c [drtv] add support for live and radio sections(closes #1827)(closes #3427) 8 years ago
Remita Amine f65dba7cdb [myspace] fix extraction and extract hls and http formats 8 years ago
Remita Amine 605fd6392f [youtube] add format info for itag 325 and 328 8 years ago
Sergey M․ f962790ee5
[vine] Fix extraction (closes #11955) 8 years ago
Sergey M․ b7cc5f078e
[extractors] Remove remnants of sportbox extractor (#11954) 8 years ago
Sergey M․ f7a10d8cd6
[sportbox] Remove extractor (closes #11954)
Covered by generic extractor
8 years ago
Remita Amine df0588a31f Merge branch 'fstirlitz-filmon' 8 years ago
Remita Amine 4ce3407d08 [filmon] improve extraction 8 years ago
Mattias Wadman 45024183ae [infoq] Add audio only format if available (#11565)
* [infoq] Add audio only format if available

Refactor cookie code into a function.
Renamed formats to http_video, http_audio, rtmp_video
Renamed extract functions to video instead of videos as they return
one or no video.

* [infoq] Rename to _extract_cookies as it more than one

* [infoq] Remove redundant determine_ext

* [infoq] Add comment about hardcoded URL

* [infoq] Use _hidden_inputs instead of messy regex

* [infoq] Probe if audio URL is valid

Make it possible to pass headers to _is_valid_url

* [infoq] Add audio only test
8 years ago
Justsoos 33da98f493
[douyutv] Improve room id regex
http://www.douyu.com/t/lpl  source get extra '\' with "room_id\" (from js coding)
8 years ago
Michal Čihař 0bbcc8a10a
[iprima] Fix extraction (closes #11920, closes #11896) 8 years ago
Yen Chi Hsuan a22b2fd19b
[youtube] Fix ytsearch* when cookies are provided
Closes #11924

The API with `page` is no longer used in browsers, and YouTube always
returns {'reload': 'now'} when cookies are provided.

See http://youtube.github.io/spfjs/documentation/start/ for how SPF
works. Basically appending static link with a `spf` parameter yields the
corresponding dynamic link.
8 years ago
Sergey M․ c54c01f82d
[go] Relax video id regex (closes #11937) 8 years ago
Sergey M․ 5a116e1302
[facebook] Fix title extraction (closes #11941) 8 years ago
Sergey M․ a685751051
[youtube:playlist] Recognize TL playlists (closes #11945) 8 years ago
Yen Chi Hsuan bd8f48c78b
[bilibili] Support new Bangumi URLs (closes #11845)
To reduce complexity, I don't support old Bangumi URLs directly via
_VALID_URL. Instead, I choose to let it go to generic redirection. An
example can be found in #10190:

http://bangumi.bilibili.com/anime/v/40062
8 years ago
Remita Amine 81aeafeb44 [cbc:watch] extract audio codec for audion only formats(fixes #11893) 8 years ago
Jaime Marquínez Ferrándiz 020c5df52d [elpais] Fix extraction for some URLs (closes #11765) 8 years ago
Sergey M․ b83ef507b4
[facebook] Fix extraction (closes #11926) 8 years ago
Yen Chi Hsuan fe5aa197b5
[prosiebensat1] PEP8 and update _TESTS 8 years ago
Thomas Christlieb 7882f1115e Added new Regex for prosiebensat1 Extractor Description. Fixes #11810 (#11929)
* Added new Regex for prosiebensat1 Extractor Description. Fixes #11810

* Using _og_search_description() as a Fallback for Description-Regex

* Using _og_search_description() as a Fallback for Description-Regex - Second try

* Also added fallback regex

* Using _og_search_description() as a Fallback for Description-Regex - Third try

* removed fatal=False from search for description regex. default=None should be preferred only

* Using fatal=false for _og_search_description

* Revert "Using fatal=false for _og_search_description"

This reverts commit 2b7e123f9d.

* Deleted default=None Parameter for _og_search_property
8 years ago
Yen Chi Hsuan 2b2d5d319b
[crunchyroll] Remove ScaledBorderAndShadow settings
See https://github.com/rg3/youtube-dl/pull/9028, especially @lachs0r's
comments for the reason behind this change
8 years ago
Sergey M․ 26c0f09935
[vimeo] PEP 8 8 years ago
Sergey M․ c15cd29640
[vimeo] Extract upload timestamp 8 years ago
Sergey M․ c38a67bcd5
[vimeo] Extract license (closes #11880) 8 years ago
Sergey M․ 7c5329e6f4
[nrk] Improve extraction and update tests (closes #11571) 8 years ago
Odd Stråbø 8fd65faece
[NRKTV] Added NRKTVSeriesIE
[NRKTV] Added season and episode number to metadata.

[NRKTV] Added category to metadata.

[NRKTV] Added tests to NRKTVSeries.

[NRKTV] Fixed whitespace issues (flake8).
8 years ago
Sergey M․ 3c90cc8b6f
[youtube] Fix extraction for domainless player URLs
Closes #11890
Closes #11891
Closes #11892
Closes #11894
Closes #11895
Closes #11897
Closes #11900
Closes #11903
Closes #11904
Closes #11906
Closes #11907
Closes #11909
Closes #11913
Closes #11914
Closes #11915
Closes #11916
Closes #11917
Closes #11918
Closes #11919
8 years ago
Remita Amine ae9a173b64 [vimeo] extract both mixed and separated dash formats 8 years ago
Remita Amine dadb836139 [ruutu] extract dash formats 8 years ago
Remita Amine 4719419951 [itv] fix extraction in python 2.6 8 years ago
Alex Seiler f13da8af28
[azmedien:playlist] Add support for topic and themen playlists 8 years ago
Sergey M․ e228616c6e
[extractor/common] Fix initialization template (closes #11605, closes #11825) 8 years ago
Sergey M․ c58c2d63cb
[extractor/common] Document forgotten fragment base and path interfaces 8 years ago
Sergey M․ d04621daf4
[extractor/common] Fix duration per dash segment (closes #11868) 8 years ago
Andre Walker 56fc078da8 [npo] Update subtitles url
NPO websites changed the domain they used for subtitles, from
e.omroep.nl to tt888.omroep.nl.
8 years ago
Remita Amine 4edeac5bfa [itv] fix subtitle extraction 8 years ago
Remita Amine f592ff9868 [itv] extract subtitles 8 years ago
Remita Amine a71b8d3b3b [itv] Add new extractor(closes #9240) 8 years ago
Sergey M․ 008f247077
[mtv81] Add extractor (closes #7619) 8 years ago
Sergey M․ 661cc229d2
[vlive:channel] Improve 8 years ago
ping b92d3c5343 [vlive] Add support for channels 8 years ago
Sergey M․ ab6f6aee78
[kaltura] Add fallback for fileExt 8 years ago
Sergey M․ 26e40542dd
[kaltura] Improve uploader_id extraction 8 years ago
Alex Seiler 99a0baf370
[konserthusetplay] Add support for rspoplay.se 8 years ago
Sergey M․ e0b6e50ccd
[crunchyroll] Improve series and season metadata extraction (closes #11832) 8 years ago
Sergey M․ 3a194cb4ec
[soundcloud] Improve formats extraction and extract audio bitrate 8 years ago
Sergey M․ 9b73471801
[soundcloud] Extract hls formats 8 years ago
Sergey M․ 489ffc1182
[soundcloud] Fix track URL extraction (closes #11852) 8 years ago
Sergey M․ 0b23c222ba
[twitch:vod] Expand _VALID_URL (closes #11846) 8 years ago
Remita Amine b51a4ebed4 [aenetworks] fix season episodes extraction(fixes #11669) 8 years ago
Remita Amine 9463637887 [tva] Add new extractor(closes #11842) 8 years ago
Sergey M․ 3cbecdd111
[jamendo] Improve and extract more metadata (closes #11836) 8 years ago
Stefan Pöschel c19ef77c31
[jamendo] Extract full title 8 years ago
Remita Amine b3277115a1 [disney] Add new extractor(closes #7409)(closes #11801)(#4975)(#11000) 8 years ago
Remita Amine 9bccdc7004 [vevo] remove request to old api and catch apiv2 errors 8 years ago
Sergey M․ cf0cabbe50
[cmt,mtv,southpark] Add support for episode URLs (closes #11837) 8 years ago
Sergey M․ 556dbe7fe3
[youtube] Add fallback for duration extraction (closes #11841) 8 years ago
Sergey M․ c1fa3f4672
[openload] Fallback video extension to mp4 8 years ago
Sergey M․ 17f8deeb48
[extractor/generic] Add support for openload embeds (closes #11536, closes #11812) 8 years ago
Remita Amine b8a03b6660 [srgssr] fix rts video extraction(closes #11831) 8 years ago
Remita Amine c60089c022 [afreecatv:global] Add new extractor(closes #11807) 8 years ago
Sergey M․ af59bddc4e
[konserthusetplay] Extract subtitles (#11823) 8 years ago
Remita Amine 23b35a634e [crackle] improve extraction
- extract vtt subtitles
- extract multiple resolutions for thumbnails
- pass geo verification proxy headers
- add support for mobile urls
8 years ago
Sergey M․ 74af9c700d
[konserthusetplay] Add support for hls formats (closes #11823) 8 years ago
Sergey M․ d61aa5eb37
[vimeo:review] Fix config URL extraction (closes #11821) 8 years ago
Sergey M․ b494d6856c
[pluralsight] Fix extraction (closes #11820) 8 years ago
Yen Chi Hsuan bc35ed3fb6
[nextmedia] Add support for NextTV (壹電視) 8 years ago
Sergey M․ 6d119c2a6b
[24video] Fix extraction (closes #11811) 8 years ago
Sergey M․ 4201ba13e6
[youtube:playlist] Fix nonexistent/private playlist detection and skip private tests 8 years ago
Grzegorz P 8bc0800d7c [youtube:playlist] Fix nonexistent/private playlist detection (closes #11604) 8 years ago
Alex Seiler a089545e03 [azmedien:show] Improve _VALID_URL 8 years ago
Gaetan Gilbert 30dda24de3 [chirbit] Extract uploader 8 years ago
Sergey M․ 271808b6b2
[pornflip] Improve and extract dash formats (closes #11795) 8 years ago
einstein95 8d1fbe0cb2
[pornflip] Add extractor (closes #11556) 8 years ago
Sergey M․ a243abb80d
[chaturbate] Improve (closes #11797) 8 years ago
einstein95 42697bab3c
[chaturbate] Fix extraction 8 years ago
Sergey M․ 94629e537f
[azmedien] Improve (closes #11784) 8 years ago
Alex Seiler e84495cd8d
[azmedien] Add extractor (closes #11785) 8 years ago
Yen Chi Hsuan 7c20b7484c
[nextmedia] Support redirected URLs 8 years ago
ha shao 04a3d4d234
[vimeo:channel] Extract videos' titles for playlist entries 8 years ago
Sergey M․ 12afdc2ad6
[youtube] Extract episode metadata (closes #9695, closes #11774) 8 years ago
Yen Chi Hsuan f3c21cb7a7
[cspan] Fix _TESTS 8 years ago
Yen Chi Hsuan 972efe60c3
[generic] Remove a dead test
The web page does not contain a video anymore

Ref: #2694, #2696
8 years ago
Yen Chi Hsuan 4447fb2332
[cspan] Support Ustream embedded videos
Closes #11547
8 years ago
Yen Chi Hsuan d77ac73790
[ustream] Add UstreamIE._extract_url()
Ref: #11547
8 years ago
Sergey M․ 1fe84be0f3
[1tv] Add support for hls (closes #11786) 8 years ago
james mike dupont cccd70a275 untie 8 years ago
Sergey M․ eb3f008c9e
[uol] Fix extraction (closes #11770) 8 years ago
Sergey M․ f1e70fc2ff
[mtv] Relax triforce feed regex (closes #11766) 8 years ago
Remita Amine baa3e1845b [bilibili] fix extraction(closes #11077) 8 years ago
Sergey M․ aaf2b7c57a
[canalplus] Add fallback for video id (closes #11764) 8 years ago
Sergey M․ b687c85eab
[extractor/generic] Add support for 20 minuten embeds (closes #11683, closes #11751) 8 years ago
Sergey M․ 538b17a09c
[20min] Improve 8 years ago
Alex Seiler 4e44598547
[20min] Fix extraction 8 years ago
Sergey M․ 136078966b
[imdb] Extend _VALID_URL (closes #11744) 8 years ago
Sergey M․ 8a5f0a6357
[naver] Update tests for #11743 8 years ago
Kagami Hiiragi c0bd51c090 [naver] Support tv.naver.com links 8 years ago
Sergey M․ 79fc8496c6
[xiami] Improve extraction (closes #11699)
* Relax _VALID_URLs
* Improve track metadata extraction
8 years ago
Sergey M․ 906420cae3
[limelight] Improve and make more robust (closes #11737)
+ Add support for direct http for videos hosted on video.llnw.net
* Check handmade http URLs
8 years ago
Yen Chi Hsuan 16e2c8f771
[brightcove] Recognize another player ID
Closes #11688
8 years ago
Yen Chi Hsuan dcae7b3fdc
[niconico] Allow login via cookies
Some codes are borrowed from #7968, which is by @jlhg

Closes #7968
8 years ago
Yen Chi Hsuan 8e4988f1a2
[niconico] Remove codes for downloading anonymously
Apparently Niconico now blocks playing without an account

Closes #11170
8 years ago
Sergey M․ a7acf868a5
[yourupload] Fix extraction (closes #11601) 8 years ago
Sergey M․ af62de104f
[beam:live] Improve and simplify (#10702, closes #11596) 8 years ago
sh!zeeg cd55c6ccd7
[beam:live] Add extractor 8 years ago
Sergey M․ 621a2800ca
[vevo] Improve geo restriction detection 8 years ago
Sergey M․ b80e2ebc8d
[dramafever] Add support for URLs with language code (#11714) 8 years ago
Remita Amine 99d537a5e0 [ooyala] fix typo 8 years ago
Sergey M․ abe8cb763f
[cbc] Improve playlist support (closes #11704) 8 years ago
Jakub Wilk 4f66c16f33 [brightcove:legacy] Fix misplaced backslash in a regexp 8 years ago
Sergey M․ e54fc0524e
[cmt] Add support for video-clips 8 years ago
Sergey M․ adf063dad1
[mtv,cc,cmt,spike] Improve and refactor
- Eliminate _transform_rtmp_url
* Generalize triforce mgid extraction
+ [cmt] Add support for full-episodes (closes #11623)
8 years ago
Remita Amine 5e8eebb600 [mitele] extract dash formats 8 years ago
Remita Amine 9837cb7507 [ooyala] add support for videos with embedToken(#11684) 8 years ago
Sergey M․ fb6a59205e
[mixcloud] Fix extraction (closes #11674) 8 years ago
Vijay Singh 06e9363b7a
[openload] Fix extraction (closes #10408)
Just a minor fix for openload
8 years ago
Remita Amine 1f393a3241 [tv4] improve extraction(closes #11698)
- remove check for requires_subscription
- extract more formats
- extract subtitles
8 years ago
Remita Amine c4251b9aaa [common] add possibility to customize akamai manifest host 8 years ago
Sergey M․ 3a407e707a
[freesound] Improve and remove unrelated metadata (closes #11608) 8 years ago
sh!zeeg ed06da4e7b
[freesound] Fix extraction and extended (closes #11602) 8 years ago
Sergey M․ 365d136b7c
[vimeo] Fix tests 8 years ago
Sergey M․ 1fd0fc42bd
[vimeo:ondemand] Fix test (closes #11651) 8 years ago
Sergey M․ 10cd2003b4
[nick] Add support for beta.nick.com (closes #11655) 8 years ago
Sergey M․ cdd11c0540
[mtv] Use native hls by default 8 years ago
Sergey M․ 67fc365b86
[mtv,cc] Use hls by default (closes #11641) 8 years ago
Sergey M․ 20faad74b6
[mtv] Fix non-hls extraction
method attribute may not be present
8 years ago
Sergey M․ 2032d935d1
[mtv] Add default value for use_hls
These methods are used across codebase with old number of arguments
8 years ago
Sergey M․ 366b759a60
[inc] Improve (closes #11647) 8 years ago
Déstin Reed 7f0bdc7a31
[inc] Add extractor 8 years ago
Sergey M․ 022a5d663b
[youtube] Add test for itag 212 (#11575) 8 years ago
Kacper Michajłow 8409b3683c [youtube] Add itag 212
Seen on video with id 1t24XAntNCY
8 years ago
Philipp Hagemeister 8084951b7f [egghead:course] Add support for egghead.io course playlists
Individual egghead videos are already handled by the generic/Wistia extractors.
8 years ago
Sergey M․ 364131584b
[hitrecord] Improve (closes #11626) 8 years ago
J 553c68bbd9
[hitrecord] Add extractor 8 years ago
Remita Amine 827961b122 [videott] remove extractor 8 years ago
Remita Amine a5eefc492b [swrmediathek] skip tests correctly 8 years ago
Remita Amine a9cd1691b2 [swrmediathek] improve extraction 8 years ago
Remita Amine 2365f94412 [sharesix] remove extractor 8 years ago
Remita Amine 32b7c2a57e [aol] remove AolFeaturesIE 8 years ago
Remita Amine 221ce32529 [break] merge BreakIE and ScreenJunkiesIE 8 years ago
Remita Amine e5dfdc8164 [sendtonews] improve info extraction 8 years ago
Remita Amine a814da3f62 [skynews] update test 8 years ago
Sergey M․ b2727d0bee
[3sat,phoenix] Fix extraction (closes #11619) 8 years ago
Philipp Hagemeister dbaf601646 [comedycentral/mtv] Add support for HLS videos (fixes #11600)
Currently, the HTTP files of the RTMP urls are not present for the The Daily Show.
Use HLS instead for now.
8 years ago
Yen Chi Hsuan ec85ded83c
Fix "invalid escape sequences" error on Python 3.6 8 years ago
Yen Chi Hsuan 24d8a75982
[discoverygo] Fix JSON data parsing
HTMLParser, which is used by extract_attributes, already unescapes
attribute values with HTMLParser.unescape. They shouldn't be unescaped
again, to there may be parsing errors.

Ref: #11219, #11522
8 years ago
Sergey M․ fb47cb5b23
[zdf] Improve (closes #11055, closes #11063) 8 years ago
Paul Hartmann b6de53ea8a
[zdf] Fix extraction 8 years ago
Sergey M․ 96d315c2be
[pornhub:playlist] Improve extraction (closes #11594) 8 years ago
Sergey M․ 1911d77d28
[cctv] Add support for ncpa-classic.com (closes #11591) 8 years ago
Sergey M․ 027e231295
[tunein] Add support for embeds (closes #11579) 8 years ago
Sergey M․ 7a9e066972
[cctv] Relax some video id regexes 8 years ago
Sergey M․ 3783a5ccba
[cctv] Relax _VALID_URL 8 years ago
Sergey M․ 327caf661a
[cctv] Do not fallback on video id extracted from URL 8 years ago
Sergey M․ ce7ccb1caa
[cctv] Improve and merge with cntv (closes #879, closes #6753, closes #8541) 8 years ago
RPing 295eac6165
[cntv] Add extractor 8 years ago
Sergey M․ 966815e139
[nrktv:episodes] Add support for episodes (#11571) 8 years ago
Sergey M․ 1f766b6e7b
[arkena] Add support for video.arkena.com (closes #11568) 8 years ago
Sergey M․ 3f1ce16876
[twitch:vod] Improve _VALID_URL (closes #11537) 8 years ago
Robert Smith 9a0f999585
[twitch] Added support for player.twitch.tv URLs (closes #11535) 8 years ago
Sergey M․ e186a9ec03
[videa] Add support for videa embeds 8 years ago