Commit Graph

9671 Commits (b62985a9a5d25643f1b1d6db8711013b1f123698)

Author SHA1 Message Date
Sergey M․ d0ba55871e
[youtube] Improve _VALID_URLs (closes #12538) 8 years ago
Sergey M․ 54b960f340
[generic] Do not follow redirects to the same URL 8 years ago
Sergey M․ bea7af6947
[channel9] Remove expired comment and sort imports 8 years ago
Sergey M․ a5d783f525
[channel9] Extract more formats 8 years ago
Remita Amine d0572557c2 [ninecninemedia] remove mp4 url extraction request 8 years ago
Remita Amine 52d5ecabd5 [bellmedia] add support for etalk.ca(closes #12447) 8 years ago
Remita Amine b0f7f21cb9 [channel9] fix extraction(closes #11323) 8 years ago
Sergey M․ 579c99a284
[cloudy] Fix extraction (closes #12525) 8 years ago
Remita Amine ca5ed022e9 [hbo] add support for free episode urls and new formats extraction(closes #12519) 8 years ago
Sergey M․ 391d076d7c
[condenast] Fix extraction and style (closes #12526) 8 years ago
Sergey M․ c183e14f89
[viu] Relax _VALID_URL (closes #12529) 8 years ago
Sergey M․ 8e5a7c5e67
[pluralsight] Omit module title from video title (closes #12506) 8 years ago
Sergey M․ e1e35d1ac6
[pornhub] Improve extraction and style (closes #12515) 8 years ago
Throaway 21fbf0f955
[pornhub] Decode obfuscated video URL (closes #12470) 8 years ago
John Hawkinson 97952bdb78 [generic] Add test for Senate ISVP iframe embed 8 years ago
John Hawkinson 8a8cc339b6 [senateisvp] Allow https URL scheme for embeds 8 years ago
Vijay Singh 957f453429 [Openload.co] Fixed Extraction
They did it again. just a minor change though. here's quick fix
8 years ago
John Hawkinson 46b18f2349 [BostonGlobe] New. Nonstandard version of Brightcove.
Has a "data-brightcove-video-id" instead of a "data-video-id," otherwise
pretty much just Brightcove. Except the Globe isn't all Brightcove
videos, so fallback to Generic, too.

Also, abstract playlist_from_matches() from generic.py to common.py, and use
it here.

History of these changes can be found in
51170427d4b1143572a498dedaee61863a5b2c5b.
8 years ago
Remita Amine 772b5ff57f [toongoggles] Add new extractor(closes #12171) 8 years ago
Sergey M․ f68ef1e2ab
[medialaan] Remove unrelated test 8 years ago
Sergey M․ febfe1e262
[adobepass] Detect and output error on authz token extraction (#12472) 8 years ago
Vijay Singh 5f0daab1ca [openload] Fix extraction 8 years ago
Sergey M․ 2a721cdff2
[medialaan] Fix and improve extraction (closes #11912) 8 years ago
mrBliss e7a51a4c02
[vtm] Add extractor (closes #9974)
Implementation of the approach described in #9974.
8 years ago
Remita Amine 3e5856d860 [discoverynetworks] add support for more domains and bypass geo restiction 8 years ago
Yen Chi Hsuan ea883a687c
[openload] Fix extraction (closes #10408)
Thanks to @makgun02

Ref: http://pastebin.com/raw/JX9gHFUz
8 years ago
Sergey M․ b51dc9db0e
[extractor/common] Extract SMIL formats from jwplayer 8 years ago
Sergey M․ a309684285
[extractor/generic] Add forgotten return for jwplayer formats 8 years ago
Remita Amine ba448445b8 [redbull] improve extraction
- extract 1080p quality
- correct ttml subtitle ext
- catch api errors
- reduce request size
8 years ago
Vijay Singh 398887b4c0 [Openload] Fixed Extraction
They did changed it again.
8 years ago
Sergey M․ 66bf351f80
[facebook] Make title optional (closes #12443) 8 years ago
Sergey M․ 9d08963022
[telecinco] Add test for #12430 8 years ago
Sergey M․ e313d209c2
[mitele] Add support for ooyala videos (closes #12430) 8 years ago
Vijay Singh ff9d509d20 [openload] Fix extraction
Just a minor fix for openload
8 years ago
Lucas M c1795ca6c8 [streamable] Update API URL 8 years ago
Starsam80 8c99623259 [crunchyroll] Extract season name 8 years ago
Sergey M․ 57b0ddb35f
[discoverygo] Actualize test 8 years ago
Sergey M․ a28f8d7396
[discoverygo] Bypass geo restriction 8 years ago
Sergey M․ 7049799470
[discoverygo:playlist] Add extractor (closes #12424) 8 years ago
Sergey M․ c2ee861c6d
[extractor/generic] Make title optional for jwplayer embeds (closes #12410) 8 years ago
Sergey M․ bd34c32bd7
[wdr] Actualize comment 8 years ago
runningbits f802c48660 [wdr:maus] Fix extraction and update tests 8 years ago
Sergey M․ 76bee08fe7
[prosiebensat1] Improve title extraction and add test 8 years ago
Thomas Christlieb 2913821723 [prosiebensat1] Improve title extraction (closes #12318) 8 years ago
Sergey M․ 0e7f9a9b48
[dplayit] Relax playback info URL extraction 8 years ago
Sergey M․ 0cf2352e85
[dplayit] Separate and rewrite extractor and bypass geo restriction (closes #12393) 8 years ago
Yen Chi Hsuan 0f6b87d067
[miomio] Fix extraction
Closes #12291
Closes #12388
Closes #12402
8 years ago
Sergey M․ d7344d33b1
[telequebec] Fix description extraction and update test (closes #12399) 8 years ago
denneboomyo b08cc749d6 [openload] Fix extraction 8 years ago
Sergey M․ b68a812ea8
[extractor/generic] Add test for brigthcove UUID-like videoPlayer 8 years ago
Sergey M․ 2e76bdc850
[brightcove:legacy] Relax videoPlayer validation check (closes #12381) 8 years ago
Yen Chi Hsuan fe646a2f10
[twitch] PEP8 8 years ago
Sergey M․ e30ccf7047
[soundcloud] Update client id (closes #12376) 8 years ago
denneboomyo da92da4b88 Openload fix extraction (#12357)
* Fix extraction
8 years ago
Sergey M․ 96182695e4
[drtv] Add geo countries to GeoRestrictedError 8 years ago
Sergey M․ fc11ad3833
[drtv:live] Bypass geo restriction 8 years ago
Yen Chi Hsuan d2b64e04b4
[addanime] Skip an invalid test 8 years ago
Sergey M․ 5dd376345b
[tunepk] Add extractor (closes #12197, closes #12243) 8 years ago
Sergey M․ 1a2192cb90
[extractor/common] Pass arguments to _parse_jwplayer_formats and PEP8 8 years ago
Sergey M․ 0236cd0dfd
[extractor/common] Improve height extraction and extract bitrate 8 years ago
Sergey M․ ed0cf9b383
[extractor/common] Move jwplayer formats extraction in separate method 8 years ago
Sergey M․ 5316566edc
[twitch] Use better naming and simplify (closes #11974) 8 years ago
Xiao Di Guan c64c03be35
[twitch] Add basic support for two-factor authentication 8 years ago
Lars Vierbergen a3ba8a7acf [vier] Add support for vijf.be
vier.be and vijf.be run on the same CMS and are property of the same company,
so the same extractor can be used for both of them.
8 years ago
Sergey M․ 054a587de8
[redbulltv] Improve extraction (closes #11948, closes #3919) 8 years ago
Juanjo Benages 64b7ccef3e
[redbulltv] Add extractor 8 years ago
Yen Chi Hsuan 6f4e4132d8
[douyutv] Switch to the PC API to escape the 5-min limitation
Thanks @spacemeowx2 for the algo.

Ref: https://gist.github.com/spacemeowx2/629b1d131bd7e240a7d28742048e80fc

Closes #12316
8 years ago
Sergey M․ eb3079b6ce
[generic] Add support for rutube embeds 8 years ago
Sergey M․ bc82f22879
[rutube] Relax _VALID_URL 8 years ago
Sergey M․ 4d058c9862
[vrak] Improve and update test (closes #11452) 8 years ago
Sergey M․ d16f27ca27
[brightcove:new] Add ability to smuggle geo_countries into URL 8 years ago
Olivier Bilodeau cbb127568a
[vrak] Add extractor 8 years ago
Sergey M․ d02d4fa0a9
[brightcove:new] Raise GeoRestrictedError 8 years ago
Sergey M․ 692fa200ca
[go] Relax _VALID_URL (closes #12341) 8 years ago
Sergey M․ 9bae185ba6
[24video] Use original host for requests (closes #12339) 8 years ago
Sergey M․ 4d345bf17b
[ruutu] Disable DASH formats (closes #12322)
Due to causing out of sync issue
8 years ago
Yen Chi Hsuan 11bb6ad1a5
[facebook] Fix extraction (closes #12323)
Almost all videos now use the pagelet type 'permalink_video_pagelet'
8 years ago
Yen Chi Hsuan c9612c0487
[youtube] Mark errors about rental videos as expected
Closes #12324
8 years ago
Yen Chi Hsuan af5049f128
[adobepass] Add Charter Spectrum (#11465)
Thanks @tv21 for the fix!
8 years ago
Sergey M․ 4b8a984c67
[npo] Add support for audio 8 years ago
Sergey M․ 83e8fce628
[npo] Improve extraction and update tests 8 years ago
Sergey M․ aa9cc2ecbf
[npo] Adapt to app.php API (closes #12311) 8 years ago
Sergey M․ 43b38424a9
[azmedien:showplaylist] Improve (closes #12160) 8 years ago
Alex Seiler 948519b35d
[azmedien:showplaylist] Add support for all episodes playlists 8 years ago
Sergey M․ 87dadd456a
[youtube:playlist] Recognize another playlist pattern (closes #11928, closes #12286) 8 years ago
Yen Chi Hsuan 7c4aa6fd6f
[daisuki] Add subtitles (#4738) 8 years ago
Yen Chi Hsuan 9bd05b5a18 [daisuki] Add new extractor (closes #4738) 8 years ago
Yen Chi Hsuan f4c68ba372
[douyu] Fix extraction and update _TESTS
They've switched from flv to hls

Closes #12301
8 years ago
Sergey M․ 18abb74376
[npo] Relax _VALID_URL for zapp.nl 8 years ago
Sergey M․ dbc01fdb6f
[hetklokhuis] Fix IE_NAME 8 years ago
Sergey M․ f264c62334
[npo] Add support for zapp.nl 8 years ago
Sergey M․ 0dc5a86a32
[npo] Add support for hetklokhuis.nl (closes #12293) 8 years ago
Sergey M․ 0e879f432a
[youtube:channel] Remove duplicate test 8 years ago
Yen Chi Hsuan 892b47ab6c
[scivee] Remove extractor (#9315)
The Wikipedia page is changed from active to down:
https://en.wikipedia.org/w/index.php?title=SciVee&diff=prev&oldid=723161154

Some other interesting bits:

$ nslookup www.scivee.tv
Server:         8.8.8.8
Address:        8.8.8.8#53

Non-authoritative answer:
www.scivee.tv   canonical name = scivee.rcsb.org.
Name:   scivee.rcsb.org
Address: 132.249.231.211

$ nslookup rcsb.org
Server:         8.8.8.8
Address:        8.8.8.8#53

Non-authoritative answer:
Name:   rcsb.org
Address: 132.249.231.77

Both IPs are from UCSD. I guess it's maintained by a lab and they don't
maintain it anymore.
8 years ago
Alex Seiler fdeea72611 [cda] Decode URL (fixes #12255) 8 years ago
xbe 7fd4655256 [crunchyroll] Extract uploader name that's not a link
Provide the Crunchyroll extractor with the ability to extract uploader
names that aren't links. Add a test for this new functionality.
This fixes #12267.
8 years ago
Sergey M․ fd5c4aab59
[youtube] Raise GeoRestrictedError 8 years ago
Sergey M․ 8878789f11
[dailymotion] Raise GeoRestrictedError 8 years ago
Yen Chi Hsuan a5cf17989b
[MDR] Relax _VALID_URL and playerURL matching and update _TESTS
Ref: #12169
8 years ago
Sergey M․ b3aec47665
[tvigle] Raise GeoRestrictedError 8 years ago
Yen Chi Hsuan 9d0c08a02c
[vevo] Fix videos with the new streams/streamsV3 format (closes #11719) 8 years ago
Sergey M․ e498758b9c
[freshlive] Fix issues and improve (closes #12175) 8 years ago
Ricardo Constantino 5fc8d89361
[freshlive] Add extractor 8 years ago
Sergey M․ 103f8c8d36
[xhamster] Capture and output videoClosed error (#12263) 8 years ago
Sergey M․ 922ab7840b
[etonline] Add extractor (closes #12236) 8 years ago
Yen Chi Hsuan db182c63fb
[njpwworld] Add new extractor (closes #11561) 8 years ago
Yen Chi Hsuan eeb0a95684
[extractor/common] Add 'preference' to _parse_html5_media_entries
Some websites, like NJPWorld, put different qualities on different
player pages.
8 years ago
Sergey M․ 231bcd0b6b
[amcnetworks] Relax _VALID_URL (#12127) 8 years ago
Sergey M․ ad3033037c
[noco] Modernize 8 years ago
Sergey M․ f3bc281239
[noco] Swtich login URL to https (closes #12246) 8 years ago
Sergey M․ 441d7a32e5
[thescene] Extract more metadata 8 years ago
Thomas Christlieb 51ed496307 [thescene] Fix extraction (closes #12235) 8 years ago
Remita Amine 68f17a9c2d [tubitv] use geo bypass mechanism 8 years ago
Remita Amine 39e7277ed1 [openload] fix extraction(closes #10408) 8 years ago
Sergey M․ 42dcdbe11c
[ivi] Raise GeoRestrictedError 8 years ago
Sergey M․ f2980fddeb
[lynda:course] Add webpage extraction fallback (closes #12238) 8 years ago
Remita Amine 8e1409fd80 [go] sign all uplynk urls and use geo bypass only for free videos(closes #12087)(closes #12210) 8 years ago
Sergey M․ d5fd9a3be3
[skylinewebcams] Add extractor (closes #12221) 8 years ago
Sergey M․ ada77fa544
[instagram] Add support for multi video posts (closes #12226) 8 years ago
Remita Amine 9e03aa75c7 [crunchyroll] extract playlist entries ids 8 years ago
Remita Amine 30eaa3a702 [mgtv] fix extraction 8 years ago
Remita Amine c59f703610 [sohu] raise GeoRestrictedError 8 years ago
Remita Amine bc61c80c14 [leeco] raise GeoRestrictedError and use geo bypass mechanism 8 years ago
Yen Chi Hsuan b5869560a4
[crunchyroll] Fix descriptions with double quotes (closes #12124) 8 years ago
Sergey M․ 527ef85fe9
[dailymotion] Make comment count optional (closes #12209)
Not served anymore
8 years ago
Sergey M․ 58ad6995cd
[vidzi] Add test for #12213 8 years ago
Tobias Florek a86e416088 [vidzi] Add support for vidzi.cc 8 years ago
Sergey M․ 71e9577b94
[24video] Add support for 24video.tube (closes #12217) 8 years ago
Remita Amine abd29a2ced [crackle] use geo bypass mechanism 8 years ago
Remita Amine 31615ac279 [viewster] use geo verifcation headers 8 years ago
Remita Amine fc320a40d9 Revert "[cbc] use geo bypass mechanism"
This reverts commit 86466a8b6f.
8 years ago
Remita Amine 7345d6d465 [tfo] Improve geo restriction detection and use geo bypass mechanism 8 years ago
Remita Amine 86466a8b6f [cbc] use geo bypass mechanism 8 years ago
Remita Amine 33dc173cdc [telequebec] use geo bypass mechanism 8 years ago
Remita Amine 3444844b04 [limelight] extract PlaylistService errors 8 years ago
Sergey M․ eea0716cae
[extractor/common] Print origin country for fake IP 8 years ago
Sergey M․ 336a76551b
[extractor/common] Do not quit _initialize_geo_bypass on empty countries 8 years ago
Sergey M․ dc0a869e5e
[extractor/common] Fix typo 8 years ago
Sergey M․ e39b5d4ab8
[extractor/common] Allow calling _initialize_geo_bypass from extractors (#11970) 8 years ago
Remita Amine e469ab2528 [ninecninemedia] use geo bypass mechanism 8 years ago
Remita Amine 890d44b005 [adobepass] add support for Time Warner Cable(closes #12191) 8 years ago
Sergey M․ 6926304472
[spankbang] Make uploader optional (closes #12193) 8 years ago
Sergey M․ 3ccdde8cb7
[extractor/common] Emphasize geo bypass APIs are experimental 8 years ago
Sergey M․ da42ff0668
[iprima] Improve geo restriction detection and disable geo bypass 8 years ago
Sergey M․ 82f662182b
[iprima] Modernize 8 years ago
Sergey M․ 2cc7fcd338
[commonmistakes] Disable UnicodeBOM extractor test for python 3.2 8 years ago
Sergey M․ 6d4c259765
[svt] PEP 8 8 years ago
Sergey M․ c78dd35491
[nrk] PEP 8 8 years ago
Sergey M․ 8ffb8e63fe
[prosiebensat1] Throw ExtractionError on unsupported page type (closes #12180) 8 years ago
Sergey M․ 983e9b7746
[nrk] Update _API_HOST and relax _VALID_URL 8 years ago
Sergey M․ c58b7ffef4
[tv4] Bypass geo restriction and improve detection 8 years ago
Sergey M․ f1a78ee4ef
[tv4] Switch to hls3 protocol (closes #12177) 8 years ago
Sergey M․ 4248dad92b Improve geo bypass mechanism
* Rename options to preffixly match with --geo-verification-proxy
* Introduce _GEO_COUNTRIES for extractors
* Implement faking IP right away for sites with known geo restriction
8 years ago
Sergey M․ 0a840f584c Rename bypass geo restriction options 8 years ago
Sergey M․ 0016b84e16 Add faked X-Forwarded-For to formats' HTTP headers 8 years ago
Sergey M․ 5d3fbf77d9 [viki] Improve geo restriction detection 8 years ago
Sergey M․ 80b59020e0 [vgtv] Improve geo restriction detection 8 years ago
Sergey M․ 71631862f4 [srgssr] Improve geo restriction detection 8 years ago
Sergey M․ 89cc7fe770 [vbox7] Improve geo restriction detection and use geo bypass mechanism 8 years ago
Sergey M․ 04d906eae3 [svt] Improve geo restriction detection and use geo bypass mechanism 8 years ago
Sergey M․ 8ab8066cf0 [pbs] Improve geo restriction detection and use geo bypass mechanism 8 years ago
Sergey M․ 01b1aa9ff4 [ondemandkorea] Improve geo restriction detection and use geo bypass mechanism 8 years ago
Sergey M․ ff4007891f [nrk] Improve geo restriction detection and use geo bypass mechanism 8 years ago
Sergey M․ 28200e654b [itv] Improve geo restriction detection and use geo bypass mechanism 8 years ago
Sergey M․ e633f21a96 [go] Improve geo restriction detection and use geo bypass mechanism 8 years ago
Sergey M․ d392005a79 [dramafever] Improve geo restriction detection and use geo bypass mechanism 8 years ago
Sergey M․ 773f291dcb Add experimental geo restriction bypass mechanism
Based on faking X-Forwarded-For HTTP header
8 years ago
Remita Amine 049a0f4d6d [brightcove:legacy] restrict videoPlayer value(closes #12040) 8 years ago
Sergey M․ e84888b432
[tvn24] Improve extraction (closes #11679) 8 years ago
Jakub Wilk 02d9b82a23
[tvn24] Add extractor 8 years ago
Sergey M․ a2e3286676
[thisav] Add support for html5 media (closes #11771) 8 years ago
Sergey M․ f75caf059e
[metacafe] Improve (closes #10371) 8 years ago
Alex Monk bdabbc220c
[metacafe] Bypass family filter
If you don't send this user=ffilter: false cookie, it will 301 redirect you to a page asking about it, and then the title check will fail.
8 years ago
Remita Amine 70bcc444a9 [viceland] improve info extraction and update test 8 years ago
Sergey M․ bad4ccdb5d
[heise] Improve (closes #9725) 8 years ago
Tobias Gruetzmacher db76c30c6e
[heise] Support videos embedded in any article. 8 years ago
Déstin Reed c2bde5d081
[ellentv] Improve 8 years ago
Sergey M․ 90fad0e74c
[openload] Fix extraction (closes #12002) 8 years ago
Vijay Singh d94badc755
[openload] Semifix extraction (closes #10408)
just updated the code. i don't do much python still i tried to convert my code. lemme know if there is any prob with it
8 years ago
Yen Chi Hsuan fef51645d6
[theplatform] Recognize URLs with whitespaces (closes #12044) 8 years ago
Sergey M․ 4cead6a614
[einthusan] Relax _VALID_URL (closes #12141, closes #12159) 8 years ago
Yen Chi Hsuan a4a554a793
[generic] Try parsing JWPlayer embedded videos (closes #12030) 8 years ago
Sergey M․ b898f0a173
[elpais] Fix typo and improve extraction (closes #12139) 8 years ago
Sergey M․ eafaeb226a
[ceskatelevize] Lower priority for audio description sources (#12119) 8 years ago
Sergey M․ de4d378c0c
[ceskatelevize] Prefix format ids 8 years ago
Remita Amine 1bd05345ea [amcnetworks] fix extraction(closes #12127) 8 years ago
Sergey M․ 3021cf83b7
[pinkbike] Fix uploader extraction (closes #12054) 8 years ago
Sergey M․ 04a741232f
[onetpl] Add support for businessinsider.com.pl and plejada.pl 8 years ago
Sergey M․ 43a3d9edfc
[onetpl] Add support for onet.pl (closes #10507) 8 years ago
Sergey M․ d31aa74fdb
[onetmvp] Add shortcut extractor 8 years ago
Sergey M․ 6092ccd058
[vodpl] Make more robust and add another test (closes #12122) 8 years ago
Marek Rusinowski 22ce9ad2bd
[vod.pl] Add new extractor 8 years ago
Sergey M․ 9a372f14b4
[pornhub] Extract video URL from tv platform site (#12007, #12129) 8 years ago
Sergey M․ 5cb2d36c82
[ceskatelevize] Extract DASH formats (closes #12119, closes #12133) 8 years ago
Ondřej Caletka fcca0d53a8
[ceskatelevize] Quick fix to revert to using old HLS-based playlist
This fixes recent changes in iVysilani. Proper patch should migrate to
MPEG-DASH version, which is now the default.
8 years ago
Sergey M․ 50de3dbad3
[zdf] Fix extraction (closes #12117) 8 years ago
Sergey M․ 085f169ffe
[xtube] Fix extraction for both kinds of video id (closes #12088) 8 years ago
Vobe f6d6ca1db3
[xtube] Improve title extraction 8 years ago
Sergey M․ 6e5956e6ba
[lemonde] Fallback delegate extraction to generic extractor (closes #12115, closes #12116) 8 years ago
Remita Amine 89c6691f9d [bellmedia] accept longer video id(closes #12114) 8 years ago