Commit Graph

12675 Commits (4abdba643cc2d610fbbfe7ece9ee97a3df98ad33)

Author SHA1 Message Date
Sergey M․ 54b960f340
[generic] Do not follow redirects to the same URL 8 years ago
Sergey M․ a3ccd6bd11
release 2017.03.24 8 years ago
Sergey M․ bea7af6947
[channel9] Remove expired comment and sort imports 8 years ago
Sergey M․ a5d783f525
[channel9] Extract more formats 8 years ago
Remita Amine d0572557c2 [ninecninemedia] remove mp4 url extraction request 8 years ago
Remita Amine 52d5ecabd5 [bellmedia] add support for etalk.ca(closes #12447) 8 years ago
Remita Amine b0f7f21cb9 [channel9] fix extraction(closes #11323) 8 years ago
Sergey M․ 579c99a284
[cloudy] Fix extraction (closes #12525) 8 years ago
Remita Amine ca5ed022e9 [hbo] add support for free episode urls and new formats extraction(closes #12519) 8 years ago
Sergey M․ 391d076d7c
[condenast] Fix extraction and style (closes #12526) 8 years ago
Sergey M․ c183e14f89
[viu] Relax _VALID_URL (closes #12529) 8 years ago
Sergey M․ 093dad9e25
release 2017.03.22 8 years ago
Sergey M․ 8e5a7c5e67
[pluralsight] Omit module title from video title (closes #12506) 8 years ago
Sergey M․ e1e35d1ac6
[pornhub] Improve extraction and style (closes #12515) 8 years ago
Throaway 21fbf0f955
[pornhub] Decode obfuscated video URL (closes #12470) 8 years ago
John Hawkinson 97952bdb78 [generic] Add test for Senate ISVP iframe embed 8 years ago
John Hawkinson 8a8cc339b6 [senateisvp] Allow https URL scheme for embeds 8 years ago
Vijay Singh 957f453429 [Openload.co] Fixed Extraction
They did it again. just a minor change though. here's quick fix
8 years ago
Sergey M․ 0e9a73e612
release 2017.03.20 8 years ago
Sergey M․ 9487ce03e9
[YoutubeDL] Allow multiple input URLs to be used with stdout as output template 8 years ago
John Hawkinson 46b18f2349 [BostonGlobe] New. Nonstandard version of Brightcove.
Has a "data-brightcove-video-id" instead of a "data-video-id," otherwise
pretty much just Brightcove. Except the Globe isn't all Brightcove
videos, so fallback to Generic, too.

Also, abstract playlist_from_matches() from generic.py to common.py, and use
it here.

History of these changes can be found in
51170427d4b1143572a498dedaee61863a5b2c5b.
8 years ago
Remita Amine 772b5ff57f [toongoggles] Add new extractor(closes #12171) 8 years ago
Sergey M․ f68ef1e2ab
[medialaan] Remove unrelated test 8 years ago
Sergey M․ febfe1e262
[adobepass] Detect and output error on authz token extraction (#12472) 8 years ago
Vijay Singh 5f0daab1ca [openload] Fix extraction 8 years ago
Sergey M․ 2a721cdff2
[medialaan] Fix and improve extraction (closes #11912) 8 years ago
mrBliss e7a51a4c02
[vtm] Add extractor (closes #9974)
Implementation of the approach described in #9974.
8 years ago
Remita Amine 3e5856d860 [discoverynetworks] add support for more domains and bypass geo restiction 8 years ago
Yen Chi Hsuan ea883a687c
[openload] Fix extraction (closes #10408)
Thanks to @makgun02

Ref: http://pastebin.com/raw/JX9gHFUz
8 years ago
Sergey M․ 7d539ee10a
release 2017.03.16 8 years ago
Philipp Hagemeister 0efbc6b56d [options] Mention flac support and sort alphabetically among the audio formats 8 years ago
Philipp Hagemeister 21bfcd3d6e [postprocessor/ffmpeg] Add support for flac
Requested at http://stackoverflow.com/q/42828041/35070
8 years ago
Sergey M․ b51dc9db0e
[extractor/common] Extract SMIL formats from jwplayer 8 years ago
Sergey M․ a309684285
[extractor/generic] Add forgotten return for jwplayer formats 8 years ago
Remita Amine ba448445b8 [redbull] improve extraction
- extract 1080p quality
- correct ttml subtitle ext
- catch api errors
- reduce request size
8 years ago
Sergey M․ 5db83d79bf
release 2017.03.15 8 years ago
Vijay Singh 398887b4c0 [Openload] Fixed Extraction
They did changed it again.
8 years ago
Sergey M․ 66bf351f80
[facebook] Make title optional (closes #12443) 8 years ago
Sergey M․ 9d08963022
[telecinco] Add test for #12430 8 years ago
Sergey M․ e313d209c2
[mitele] Add support for ooyala videos (closes #12430) 8 years ago
Vijay Singh ff9d509d20 [openload] Fix extraction
Just a minor fix for openload
8 years ago
Lucas M c1795ca6c8 [streamable] Update API URL 8 years ago
Starsam80 8c99623259 [crunchyroll] Extract season name 8 years ago
Sergey M․ 57b0ddb35f
[discoverygo] Actualize test 8 years ago
Sergey M․ a28f8d7396
[discoverygo] Bypass geo restriction 8 years ago
Sergey M․ 7049799470
[discoverygo:playlist] Add extractor (closes #12424) 8 years ago
Yen Chi Hsuan 4605c94d1a
[__init__] Fix missing subtitles if --add-metadata is used (#12423)
The previous fix for #5594 is incorrect
8 years ago
Sergey M․ a8e687a4da
release 2017.03.10 8 years ago
Sergey M․ c2ee861c6d
[extractor/generic] Make title optional for jwplayer embeds (closes #12410) 8 years ago
Sergey M․ bd34c32bd7
[wdr] Actualize comment 8 years ago
runningbits f802c48660 [wdr:maus] Fix extraction and update tests 8 years ago
Sergey M․ 76bee08fe7
[prosiebensat1] Improve title extraction and add test 8 years ago
Thomas Christlieb 2913821723 [prosiebensat1] Improve title extraction (closes #12318) 8 years ago
Sergey M․ 0e7f9a9b48
[dplayit] Relax playback info URL extraction 8 years ago
Sergey M․ 0cf2352e85
[dplayit] Separate and rewrite extractor and bypass geo restriction (closes #12393) 8 years ago
Yen Chi Hsuan 0f6b87d067
[miomio] Fix extraction
Closes #12291
Closes #12388
Closes #12402
8 years ago
Sergey M․ d7344d33b1
[telequebec] Fix description extraction and update test (closes #12399) 8 years ago
denneboomyo b08cc749d6 [openload] Fix extraction 8 years ago
Sergey M․ b68a812ea8
[extractor/generic] Add test for brigthcove UUID-like videoPlayer 8 years ago
Sergey M․ 2e76bdc850
[brightcove:legacy] Relax videoPlayer validation check (closes #12381) 8 years ago
Yen Chi Hsuan fe646a2f10
[twitch] PEP8 8 years ago
Sergey M․ dccd0ab35d
release 2017.03.07 8 years ago
Sergey M․ e30ccf7047
[soundcloud] Update client id (closes #12376) 8 years ago
Yen Chi Hsuan 54a3a8827b
[__init__] Metadata should be added after conversion
Fixes #5594
8 years ago
denneboomyo da92da4b88 Openload fix extraction (#12357)
* Fix extraction
8 years ago
Sergey M․ 1664702626
release 2017.03.06 8 years ago
Sergey M․ 4b5de77bdb
[utils] Process bytestrings in urljoin (closes #12369) 8 years ago
Sergey M․ 96182695e4
[drtv] Add geo countries to GeoRestrictedError 8 years ago
Sergey M․ fc11ad3833
[drtv:live] Bypass geo restriction 8 years ago
Yen Chi Hsuan d2b64e04b4
[addanime] Skip an invalid test 8 years ago
Sergey M․ 5dd376345b
[tunepk] Add extractor (closes #12197, closes #12243) 8 years ago
Sergey M․ 1a2192cb90
[extractor/common] Pass arguments to _parse_jwplayer_formats and PEP8 8 years ago
Sergey M․ 0236cd0dfd
[extractor/common] Improve height extraction and extract bitrate 8 years ago
Sergey M․ ed0cf9b383
[extractor/common] Move jwplayer formats extraction in separate method 8 years ago
Sergey M․ a50862b735
[downloader/external] Add missing import and PEP8 8 years ago
John Hawkinson 6d0fe752bf [external:ffmpeg] In test harness, limit to 10k download size
Otherwise, if you screw up a playlist test by including a playlist
dictionary key, you'll be there for eons while it downloads all the
files before erroring out.
8 years ago
Sergey M․ afa4597618
release 2017.03.05 8 years ago
Sergey M․ 5316566edc
[twitch] Use better naming and simplify (closes #11974) 8 years ago
Xiao Di Guan c64c03be35
[twitch] Add basic support for two-factor authentication 8 years ago
Lars Vierbergen a3ba8a7acf [vier] Add support for vijf.be
vier.be and vijf.be run on the same CMS and are property of the same company,
so the same extractor can be used for both of them.
8 years ago
Sergey M․ 054a587de8
[redbulltv] Improve extraction (closes #11948, closes #3919) 8 years ago
Juanjo Benages 64b7ccef3e
[redbulltv] Add extractor 8 years ago
Yen Chi Hsuan 6f4e4132d8
[douyutv] Switch to the PC API to escape the 5-min limitation
Thanks @spacemeowx2 for the algo.

Ref: https://gist.github.com/spacemeowx2/629b1d131bd7e240a7d28742048e80fc

Closes #12316
8 years ago
Sergey M․ eb3079b6ce
[generic] Add support for rutube embeds 8 years ago
Sergey M․ bc82f22879
[rutube] Relax _VALID_URL 8 years ago
Sergey M․ 4d058c9862
[vrak] Improve and update test (closes #11452) 8 years ago
Sergey M․ d16f27ca27
[brightcove:new] Add ability to smuggle geo_countries into URL 8 years ago
Olivier Bilodeau cbb127568a
[vrak] Add extractor 8 years ago
Sergey M․ d02d4fa0a9
[brightcove:new] Raise GeoRestrictedError 8 years ago
Sergey M․ 692fa200ca
[go] Relax _VALID_URL (closes #12341) 8 years ago
Sergey M․ 9bae185ba6
[24video] Use original host for requests (closes #12339) 8 years ago
Sergey M․ 4d345bf17b
[ruutu] Disable DASH formats (closes #12322)
Due to causing out of sync issue
8 years ago
Sergey M․ 250eea6821
release 2017.03.02 8 years ago
Yen Chi Hsuan 11bb6ad1a5
[facebook] Fix extraction (closes #12323)
Almost all videos now use the pagelet type 'permalink_video_pagelet'
8 years ago
Yen Chi Hsuan c9612c0487
[youtube] Mark errors about rental videos as expected
Closes #12324
8 years ago
Yen Chi Hsuan af5049f128
[adobepass] Add Charter Spectrum (#11465)
Thanks @tv21 for the fix!
8 years ago
Sergey M․ 158af5242e
[utils] Carry long doc string 8 years ago
Sergey M․ 40df485f55
[YoutubeDL] Don't sanitize identifiers (closes #12317) 8 years ago
Sergey M․ 4b8a984c67
[npo] Add support for audio 8 years ago
Sergey M․ 83e8fce628
[npo] Improve extraction and update tests 8 years ago
Sergey M․ aa9cc2ecbf
[npo] Adapt to app.php API (closes #12311) 8 years ago
Sergey M․ 1dc24093f8
release 2017.02.28 8 years ago
Sergey M․ 43b38424a9
[azmedien:showplaylist] Improve (closes #12160) 8 years ago
Alex Seiler 948519b35d
[azmedien:showplaylist] Add support for all episodes playlists 8 years ago
Sergey M․ 87dadd456a
[youtube:playlist] Recognize another playlist pattern (closes #11928, closes #12286) 8 years ago
Yen Chi Hsuan 7c4aa6fd6f
[daisuki] Add subtitles (#4738) 8 years ago
Yen Chi Hsuan 9bd05b5a18 [daisuki] Add new extractor (closes #4738) 8 years ago
Yen Chi Hsuan 0a5445ddbe [utils] Add bytes_to_long() and long_to_bytes()
Used in daisuki.net (#4738)

Both are adapted from public domain PyCrypto:
https://github.com/dlitz/pycrypto/blob/master/lib/Crypto/Util/number.py
8 years ago
Yen Chi Hsuan f48409c7ac [utils] Add pkcs1pad
Used in daisuki.net (#4738)
8 years ago
Yen Chi Hsuan c9619f0a17 [aes] Add aes_cbc_encrypt
Used in daisuki.net (#4738)
8 years ago
Yen Chi Hsuan f4c68ba372
[douyu] Fix extraction and update _TESTS
They've switched from flv to hls

Closes #12301
8 years ago
Sergey M․ ef48a1175d
release 2017.02.27 8 years ago
Sergey M․ 18abb74376
[npo] Relax _VALID_URL for zapp.nl 8 years ago
Sergey M․ dbc01fdb6f
[hetklokhuis] Fix IE_NAME 8 years ago
Sergey M․ f264c62334
[npo] Add support for zapp.nl 8 years ago
Sergey M․ 0dc5a86a32
[npo] Add support for hetklokhuis.nl (closes #12293) 8 years ago
Sergey M․ 0e879f432a
[youtube:channel] Remove duplicate test 8 years ago
Yen Chi Hsuan 892b47ab6c
[scivee] Remove extractor (#9315)
The Wikipedia page is changed from active to down:
https://en.wikipedia.org/w/index.php?title=SciVee&diff=prev&oldid=723161154

Some other interesting bits:

$ nslookup www.scivee.tv
Server:         8.8.8.8
Address:        8.8.8.8#53

Non-authoritative answer:
www.scivee.tv   canonical name = scivee.rcsb.org.
Name:   scivee.rcsb.org
Address: 132.249.231.211

$ nslookup rcsb.org
Server:         8.8.8.8
Address:        8.8.8.8#53

Non-authoritative answer:
Name:   rcsb.org
Address: 132.249.231.77

Both IPs are from UCSD. I guess it's maintained by a lab and they don't
maintain it anymore.
8 years ago
Alex Seiler fdeea72611 [cda] Decode URL (fixes #12255) 8 years ago
xbe 7fd4655256 [crunchyroll] Extract uploader name that's not a link
Provide the Crunchyroll extractor with the ability to extract uploader
names that aren't links. Add a test for this new functionality.
This fixes #12267.
8 years ago
Sergey M․ fd5c4aab59
[youtube] Raise GeoRestrictedError 8 years ago
Sergey M․ 8878789f11
[dailymotion] Raise GeoRestrictedError 8 years ago
Yen Chi Hsuan a5cf17989b
[MDR] Relax _VALID_URL and playerURL matching and update _TESTS
Ref: #12169
8 years ago
Sergey M․ b3aec47665
[tvigle] Raise GeoRestrictedError 8 years ago
Yen Chi Hsuan 9d0c08a02c
[vevo] Fix videos with the new streams/streamsV3 format (closes #11719) 8 years ago
Sergey M․ e498758b9c
[freshlive] Fix issues and improve (closes #12175) 8 years ago
Ricardo Constantino 5fc8d89361
[freshlive] Add extractor 8 years ago
Pratyush Singh d374d943f3
[downloader/common] Limit displaying 2 digits after decimal point in sleep interval message 8 years ago
Sergey M․ 103f8c8d36
[xhamster] Capture and output videoClosed error (#12263) 8 years ago
Sergey M․ 922ab7840b
[etonline] Add extractor (closes #12236) 8 years ago
Sergey M․ 831217291a
[compat] Use try except for compat_numeric_types 8 years ago
Yen Chi Hsuan db182c63fb
[njpwworld] Add new extractor (closes #11561) 8 years ago
Yen Chi Hsuan eeb0a95684
[extractor/common] Add 'preference' to _parse_html5_media_entries
Some websites, like NJPWorld, put different qualities on different
player pages.
8 years ago
Sergey M․ 231bcd0b6b
[amcnetworks] Relax _VALID_URL (#12127) 8 years ago
Sergey M․ 204efc8509
release 2017.02.24.1 8 years ago
Sergey M․ ad3033037c
[noco] Modernize 8 years ago
Sergey M․ f3bc281239
[noco] Swtich login URL to https (closes #12246) 8 years ago
Sergey M․ 441d7a32e5
[thescene] Extract more metadata 8 years ago
Thomas Christlieb 51ed496307 [thescene] Fix extraction (closes #12235) 8 years ago
Remita Amine 68f17a9c2d [tubitv] use geo bypass mechanism 8 years ago
Remita Amine 39e7277ed1 [openload] fix extraction(closes #10408) 8 years ago
Sergey M․ 42dcdbe11c
[ivi] Raise GeoRestrictedError 8 years ago
Sergey M․ 6b097cff27
release 2017.02.24 8 years ago
Sergey M․ be5df5ee31
Suppress help for all deprecated options and print warning when used 8 years ago
Sergey M․ f2980fddeb
[lynda:course] Add webpage extraction fallback (closes #12238) 8 years ago
Sergey M․ 0f57447de7
[postprocessor/ffmpeg] Add mising space (closes #12232) 8 years ago
Remita Amine 8e1409fd80 [go] sign all uplynk urls and use geo bypass only for free videos(closes #12087)(closes #12210) 8 years ago
Sergey M․ fafc2bf5a9
[options] Deprecate --autonumber-size 8 years ago
Sergey M․ b3175982c3
[YoutubeDL] Add more numeric fields for NA substitution in outtmpl 8 years ago
Sergey M․ 89db639dfe
[YoutubeDL] Rewrite outtmpl for playlist_index and autonumber for backward compatibility 8 years ago
Sergey M․ d0d9ade486 [YoutubeDL] Add support for string formatting operations in output template 8 years ago
Sergey M․ 28572a1a0b [compat] Add compat_numeric_types 8 years ago
Sergey M․ d5fd9a3be3
[skylinewebcams] Add extractor (closes #12221) 8 years ago
Sergey M․ ada77fa544
[instagram] Add support for multi video posts (closes #12226) 8 years ago
Remita Amine 9e03aa75c7 [crunchyroll] extract playlist entries ids 8 years ago
Remita Amine 30eaa3a702 [mgtv] fix extraction 8 years ago
Remita Amine c59f703610 [sohu] raise GeoRestrictedError 8 years ago
Remita Amine bc61c80c14 [leeco] raise GeoRestrictedError and use geo bypass mechanism 8 years ago
Sergey M․ 345b24538b
release 2017.02.22 8 years ago
Yen Chi Hsuan b5869560a4
[crunchyroll] Fix descriptions with double quotes (closes #12124) 8 years ago
Sergey M․ 527ef85fe9
[dailymotion] Make comment count optional (closes #12209)
Not served anymore
8 years ago
Sergey M․ 58ad6995cd
[vidzi] Add test for #12213 8 years ago
Tobias Florek a86e416088 [vidzi] Add support for vidzi.cc 8 years ago
Sergey M․ 71e9577b94
[24video] Add support for 24video.tube (closes #12217) 8 years ago
Remita Amine abd29a2ced [crackle] use geo bypass mechanism 8 years ago
Remita Amine 31615ac279 [viewster] use geo verifcation headers 8 years ago
Remita Amine fc320a40d9 Revert "[cbc] use geo bypass mechanism"
This reverts commit 86466a8b6f.
8 years ago
Remita Amine 7345d6d465 [tfo] Improve geo restriction detection and use geo bypass mechanism 8 years ago
Remita Amine 86466a8b6f [cbc] use geo bypass mechanism 8 years ago
Remita Amine 33dc173cdc [telequebec] use geo bypass mechanism 8 years ago
Remita Amine 3444844b04 [limelight] extract PlaylistService errors 8 years ago
Sergey M․ 8c6c88c7da
release 2017.02.21 8 years ago
Sergey M․ eea0716cae
[extractor/common] Print origin country for fake IP 8 years ago
Sergey M․ 336a76551b
[extractor/common] Do not quit _initialize_geo_bypass on empty countries 8 years ago
Sergey M․ dc0a869e5e
[extractor/common] Fix typo 8 years ago
Sergey M․ e39b5d4ab8
[extractor/common] Allow calling _initialize_geo_bypass from extractors (#11970) 8 years ago
Remita Amine e469ab2528 [ninecninemedia] use geo bypass mechanism 8 years ago
Remita Amine 890d44b005 [adobepass] add support for Time Warner Cable(closes #12191) 8 years ago
Sergey M․ 6926304472
[spankbang] Make uploader optional (closes #12193) 8 years ago
Sergey M․ 3ccdde8cb7
[extractor/common] Emphasize geo bypass APIs are experimental 8 years ago
Sergey M․ da42ff0668
[iprima] Improve geo restriction detection and disable geo bypass 8 years ago
Sergey M․ 82f662182b
[iprima] Modernize 8 years ago
Sergey M․ 2cc7fcd338
[commonmistakes] Disable UnicodeBOM extractor test for python 3.2 8 years ago
Sergey M․ 6d4c259765
[svt] PEP 8 8 years ago
Sergey M․ c78dd35491
[nrk] PEP 8 8 years ago
Sergey M․ 8ffb8e63fe
[prosiebensat1] Throw ExtractionError on unsupported page type (closes #12180) 8 years ago
Sergey M․ 983e9b7746
[nrk] Update _API_HOST and relax _VALID_URL 8 years ago
Sergey M․ c58b7ffef4
[tv4] Bypass geo restriction and improve detection 8 years ago
Sergey M․ f1a78ee4ef
[tv4] Switch to hls3 protocol (closes #12177) 8 years ago
Sergey M․ de64e23c56
[downloader/ism] Honor HTTP headers when downloading fragments 8 years ago
Sergey M․ 553f6dbac7
[downloader/dash] Honor HTTP headers when downloading fragments
For example, https://www.oppetarkiv.se/video/1196142/natten-ar-dagens-mor
8 years ago
Sergey M․ 0aa10994f4 [options] Move geo restriction related options to separate section 8 years ago
Sergey M․ 4248dad92b Improve geo bypass mechanism
* Rename options to preffixly match with --geo-verification-proxy
* Introduce _GEO_COUNTRIES for extractors
* Implement faking IP right away for sites with known geo restriction
8 years ago
Sergey M․ 0a840f584c Rename bypass geo restriction options 8 years ago
Sergey M․ 0016b84e16 Add faked X-Forwarded-For to formats' HTTP headers 8 years ago
Sergey M․ 18a0defab0 [utils] Make random_ipv4 return unicode string 8 years ago
Sergey M․ 5d3fbf77d9 [viki] Improve geo restriction detection 8 years ago
Sergey M․ 80b59020e0 [vgtv] Improve geo restriction detection 8 years ago
Sergey M․ 71631862f4 [srgssr] Improve geo restriction detection 8 years ago
Sergey M․ 89cc7fe770 [vbox7] Improve geo restriction detection and use geo bypass mechanism 8 years ago