Commit Graph

12558 Commits (be61efdf1754d026f270f6d87446040231d56954)

Author SHA1 Message Date
Yen Chi Hsuan 892b47ab6c
[scivee] Remove extractor (#9315)
The Wikipedia page is changed from active to down:
https://en.wikipedia.org/w/index.php?title=SciVee&diff=prev&oldid=723161154

Some other interesting bits:

$ nslookup www.scivee.tv
Server:         8.8.8.8
Address:        8.8.8.8#53

Non-authoritative answer:
www.scivee.tv   canonical name = scivee.rcsb.org.
Name:   scivee.rcsb.org
Address: 132.249.231.211

$ nslookup rcsb.org
Server:         8.8.8.8
Address:        8.8.8.8#53

Non-authoritative answer:
Name:   rcsb.org
Address: 132.249.231.77

Both IPs are from UCSD. I guess it's maintained by a lab and they don't
maintain it anymore.
8 years ago
Alex Seiler fdeea72611 [cda] Decode URL (fixes #12255) 8 years ago
xbe 7fd4655256 [crunchyroll] Extract uploader name that's not a link
Provide the Crunchyroll extractor with the ability to extract uploader
names that aren't links. Add a test for this new functionality.
This fixes #12267.
8 years ago
Sergey M․ fd5c4aab59
[youtube] Raise GeoRestrictedError 8 years ago
Sergey M․ 8878789f11
[dailymotion] Raise GeoRestrictedError 8 years ago
Yen Chi Hsuan a5cf17989b
[MDR] Relax _VALID_URL and playerURL matching and update _TESTS
Ref: #12169
8 years ago
Sergey M․ b3aec47665
[tvigle] Raise GeoRestrictedError 8 years ago
Yen Chi Hsuan 9d0c08a02c
[vevo] Fix videos with the new streams/streamsV3 format (closes #11719) 8 years ago
Sergey M․ e498758b9c
[freshlive] Fix issues and improve (closes #12175) 8 years ago
Ricardo Constantino 5fc8d89361
[freshlive] Add extractor 8 years ago
Pratyush Singh d374d943f3
[downloader/common] Limit displaying 2 digits after decimal point in sleep interval message 8 years ago
Sergey M․ 103f8c8d36
[xhamster] Capture and output videoClosed error (#12263) 8 years ago
Sergey M․ 922ab7840b
[etonline] Add extractor (closes #12236) 8 years ago
Sergey M․ 831217291a
[compat] Use try except for compat_numeric_types 8 years ago
Yen Chi Hsuan db182c63fb
[njpwworld] Add new extractor (closes #11561) 8 years ago
Yen Chi Hsuan eeb0a95684
[extractor/common] Add 'preference' to _parse_html5_media_entries
Some websites, like NJPWorld, put different qualities on different
player pages.
8 years ago
Sergey M․ 231bcd0b6b
[amcnetworks] Relax _VALID_URL (#12127) 8 years ago
Sergey M․ 204efc8509
release 2017.02.24.1 8 years ago
Sergey M․ ad3033037c
[noco] Modernize 8 years ago
Sergey M․ f3bc281239
[noco] Swtich login URL to https (closes #12246) 8 years ago
Sergey M․ 441d7a32e5
[thescene] Extract more metadata 8 years ago
Thomas Christlieb 51ed496307 [thescene] Fix extraction (closes #12235) 8 years ago
Remita Amine 68f17a9c2d [tubitv] use geo bypass mechanism 8 years ago
Remita Amine 39e7277ed1 [openload] fix extraction(closes #10408) 8 years ago
Sergey M․ 42dcdbe11c
[ivi] Raise GeoRestrictedError 8 years ago
Sergey M․ 6b097cff27
release 2017.02.24 8 years ago
Sergey M․ be5df5ee31
Suppress help for all deprecated options and print warning when used 8 years ago
Sergey M․ f2980fddeb
[lynda:course] Add webpage extraction fallback (closes #12238) 8 years ago
Sergey M․ 0f57447de7
[postprocessor/ffmpeg] Add mising space (closes #12232) 8 years ago
Remita Amine 8e1409fd80 [go] sign all uplynk urls and use geo bypass only for free videos(closes #12087)(closes #12210) 8 years ago
Sergey M․ fafc2bf5a9
[options] Deprecate --autonumber-size 8 years ago
Sergey M․ b3175982c3
[YoutubeDL] Add more numeric fields for NA substitution in outtmpl 8 years ago
Sergey M․ 89db639dfe
[YoutubeDL] Rewrite outtmpl for playlist_index and autonumber for backward compatibility 8 years ago
Sergey M․ d0d9ade486 [YoutubeDL] Add support for string formatting operations in output template 8 years ago
Sergey M․ 28572a1a0b [compat] Add compat_numeric_types 8 years ago
Sergey M․ d5fd9a3be3
[skylinewebcams] Add extractor (closes #12221) 8 years ago
Sergey M․ ada77fa544
[instagram] Add support for multi video posts (closes #12226) 8 years ago
Remita Amine 9e03aa75c7 [crunchyroll] extract playlist entries ids 8 years ago
Remita Amine 30eaa3a702 [mgtv] fix extraction 8 years ago
Remita Amine c59f703610 [sohu] raise GeoRestrictedError 8 years ago
Remita Amine bc61c80c14 [leeco] raise GeoRestrictedError and use geo bypass mechanism 8 years ago
Sergey M․ 345b24538b
release 2017.02.22 8 years ago
Yen Chi Hsuan b5869560a4
[crunchyroll] Fix descriptions with double quotes (closes #12124) 8 years ago
Sergey M․ 527ef85fe9
[dailymotion] Make comment count optional (closes #12209)
Not served anymore
8 years ago
Sergey M․ 58ad6995cd
[vidzi] Add test for #12213 8 years ago
Tobias Florek a86e416088 [vidzi] Add support for vidzi.cc 8 years ago
Sergey M․ 71e9577b94
[24video] Add support for 24video.tube (closes #12217) 8 years ago
Remita Amine abd29a2ced [crackle] use geo bypass mechanism 8 years ago
Remita Amine 31615ac279 [viewster] use geo verifcation headers 8 years ago
Remita Amine fc320a40d9 Revert "[cbc] use geo bypass mechanism"
This reverts commit 86466a8b6f.
8 years ago
Remita Amine 7345d6d465 [tfo] Improve geo restriction detection and use geo bypass mechanism 8 years ago
Remita Amine 86466a8b6f [cbc] use geo bypass mechanism 8 years ago
Remita Amine 33dc173cdc [telequebec] use geo bypass mechanism 8 years ago
Remita Amine 3444844b04 [limelight] extract PlaylistService errors 8 years ago
Sergey M․ 8c6c88c7da
release 2017.02.21 8 years ago
Sergey M․ eea0716cae
[extractor/common] Print origin country for fake IP 8 years ago
Sergey M․ 336a76551b
[extractor/common] Do not quit _initialize_geo_bypass on empty countries 8 years ago
Sergey M․ dc0a869e5e
[extractor/common] Fix typo 8 years ago
Sergey M․ e39b5d4ab8
[extractor/common] Allow calling _initialize_geo_bypass from extractors (#11970) 8 years ago
Remita Amine e469ab2528 [ninecninemedia] use geo bypass mechanism 8 years ago
Remita Amine 890d44b005 [adobepass] add support for Time Warner Cable(closes #12191) 8 years ago
Sergey M․ 6926304472
[spankbang] Make uploader optional (closes #12193) 8 years ago
Sergey M․ 3ccdde8cb7
[extractor/common] Emphasize geo bypass APIs are experimental 8 years ago
Sergey M․ da42ff0668
[iprima] Improve geo restriction detection and disable geo bypass 8 years ago
Sergey M․ 82f662182b
[iprima] Modernize 8 years ago
Sergey M․ 2cc7fcd338
[commonmistakes] Disable UnicodeBOM extractor test for python 3.2 8 years ago
Sergey M․ 6d4c259765
[svt] PEP 8 8 years ago
Sergey M․ c78dd35491
[nrk] PEP 8 8 years ago
Sergey M․ 8ffb8e63fe
[prosiebensat1] Throw ExtractionError on unsupported page type (closes #12180) 8 years ago
Sergey M․ 983e9b7746
[nrk] Update _API_HOST and relax _VALID_URL 8 years ago
Sergey M․ c58b7ffef4
[tv4] Bypass geo restriction and improve detection 8 years ago
Sergey M․ f1a78ee4ef
[tv4] Switch to hls3 protocol (closes #12177) 8 years ago
Sergey M․ de64e23c56
[downloader/ism] Honor HTTP headers when downloading fragments 8 years ago
Sergey M․ 553f6dbac7
[downloader/dash] Honor HTTP headers when downloading fragments
For example, https://www.oppetarkiv.se/video/1196142/natten-ar-dagens-mor
8 years ago
Sergey M․ 0aa10994f4 [options] Move geo restriction related options to separate section 8 years ago
Sergey M․ 4248dad92b Improve geo bypass mechanism
* Rename options to preffixly match with --geo-verification-proxy
* Introduce _GEO_COUNTRIES for extractors
* Implement faking IP right away for sites with known geo restriction
8 years ago
Sergey M․ 0a840f584c Rename bypass geo restriction options 8 years ago
Sergey M․ 0016b84e16 Add faked X-Forwarded-For to formats' HTTP headers 8 years ago
Sergey M․ 18a0defab0 [utils] Make random_ipv4 return unicode string 8 years ago
Sergey M․ 5d3fbf77d9 [viki] Improve geo restriction detection 8 years ago
Sergey M․ 80b59020e0 [vgtv] Improve geo restriction detection 8 years ago
Sergey M․ 71631862f4 [srgssr] Improve geo restriction detection 8 years ago
Sergey M․ 89cc7fe770 [vbox7] Improve geo restriction detection and use geo bypass mechanism 8 years ago
Sergey M․ 04d906eae3 [svt] Improve geo restriction detection and use geo bypass mechanism 8 years ago
Sergey M․ 8ab8066cf0 [pbs] Improve geo restriction detection and use geo bypass mechanism 8 years ago
Sergey M․ 01b1aa9ff4 [ondemandkorea] Improve geo restriction detection and use geo bypass mechanism 8 years ago
Sergey M․ ff4007891f [nrk] Improve geo restriction detection and use geo bypass mechanism 8 years ago
Sergey M․ 28200e654b [itv] Improve geo restriction detection and use geo bypass mechanism 8 years ago
Sergey M․ e633f21a96 [go] Improve geo restriction detection and use geo bypass mechanism 8 years ago
Sergey M․ d392005a79 [dramafever] Improve geo restriction detection and use geo bypass mechanism 8 years ago
Sergey M․ 773f291dcb Add experimental geo restriction bypass mechanism
Based on faking X-Forwarded-For HTTP header
8 years ago
Pierre Mdawar bf5b9d859a [utils] Introduce YoutubeDLError base class for all youtube-dl exceptions 8 years ago
Remita Amine 049a0f4d6d [brightcove:legacy] restrict videoPlayer value(closes #12040) 8 years ago
Sergey M․ ac33accd96
[options] Mention quoted string literals for --match-filter 8 years ago
Sergey M․ e84888b432
[tvn24] Improve extraction (closes #11679) 8 years ago
Jakub Wilk 02d9b82a23
[tvn24] Add extractor 8 years ago
Sergey M․ a2e3286676
[thisav] Add support for html5 media (closes #11771) 8 years ago
Sergey M․ f75caf059e
[metacafe] Improve (closes #10371) 8 years ago
Alex Monk bdabbc220c
[metacafe] Bypass family filter
If you don't send this user=ffilter: false cookie, it will 301 redirect you to a page asking about it, and then the title check will fail.
8 years ago
Remita Amine 70bcc444a9 [viceland] improve info extraction and update test 8 years ago
Sergey M․ 28e35f5070
release 2017.02.17 8 years ago
Sergey M․ 2c1f442c2b
[options] Add missing spaces 8 years ago
Sergey M․ bad4ccdb5d
[heise] Improve (closes #9725) 8 years ago
Tobias Gruetzmacher db76c30c6e
[heise] Support videos embedded in any article. 8 years ago
Déstin Reed c2bde5d081
[ellentv] Improve 8 years ago
Sergey M․ 90fad0e74c
[openload] Fix extraction (closes #12002) 8 years ago
Vijay Singh d94badc755
[openload] Semifix extraction (closes #10408)
just updated the code. i don't do much python still i tried to convert my code. lemme know if there is any prob with it
8 years ago
Yen Chi Hsuan fef51645d6
[theplatform] Recognize URLs with whitespaces (closes #12044) 8 years ago
Sergey M․ 4cead6a614
[einthusan] Relax _VALID_URL (closes #12141, closes #12159) 8 years ago
Yen Chi Hsuan a4a554a793
[generic] Try parsing JWPlayer embedded videos (closes #12030) 8 years ago
Sergey M․ b898f0a173
[elpais] Fix typo and improve extraction (closes #12139) 8 years ago
Sergey M․ 2480b056c1
release 2017.02.16 8 years ago
Sergey M․ eafaeb226a
[ceskatelevize] Lower priority for audio description sources (#12119) 8 years ago
Sergey M․ de4d378c0c
[ceskatelevize] Prefix format ids 8 years ago
Sergey M․ db13c16ef8
[utils] Add support for quoted string literals in --match-filter (closes #8050, closes #12142, closes #12144) 8 years ago
Remita Amine 1bd05345ea [amcnetworks] fix extraction(closes #12127) 8 years ago
Sergey M․ 3021cf83b7
[pinkbike] Fix uploader extraction (closes #12054) 8 years ago
Sergey M․ 04a741232f
[onetpl] Add support for businessinsider.com.pl and plejada.pl 8 years ago
Sergey M․ 43a3d9edfc
[onetpl] Add support for onet.pl (closes #10507) 8 years ago
Sergey M․ d31aa74fdb
[onetmvp] Add shortcut extractor 8 years ago
Sergey M․ 6092ccd058
[vodpl] Make more robust and add another test (closes #12122) 8 years ago
Marek Rusinowski 22ce9ad2bd
[vod.pl] Add new extractor 8 years ago
Sergey M․ 9a372f14b4
[pornhub] Extract video URL from tv platform site (#12007, #12129) 8 years ago
Sergey M․ 5cb2d36c82
[ceskatelevize] Extract DASH formats (closes #12119, closes #12133) 8 years ago
Ondřej Caletka fcca0d53a8
[ceskatelevize] Quick fix to revert to using old HLS-based playlist
This fixes recent changes in iVysilani. Proper patch should migrate to
MPEG-DASH version, which is now the default.
8 years ago
Sergey M․ 58a65ba852
release 2017.02.14 8 years ago
Sergey M․ 50de3dbad3
[zdf] Fix extraction (closes #12117) 8 years ago
Sergey M․ 085f169ffe
[xtube] Fix extraction for both kinds of video id (closes #12088) 8 years ago
Vobe f6d6ca1db3
[xtube] Improve title extraction 8 years ago
Sergey M․ 6e5956e6ba
[lemonde] Fallback delegate extraction to generic extractor (closes #12115, closes #12116) 8 years ago
Remita Amine 89c6691f9d [bellmedia] accept longer video id(closes #12114) 8 years ago
Remita Amine 454e5cdb17 [limelight] add support referer protected videos 8 years ago
Remita Amine 9dad941853 [disney] improve extraction
- add support for more urls
- detect expired videos
- skip Adobe Flash Access protected videos

closes #4975
closes #11000
closes #11882
closes #11936
8 years ago
Remita Amine 0dac7cbb09 [hotstar] improve extraction(closes #12096)
- extract all qualities
- detect drm protected videos
- extract more metadata
8 years ago
Yen Chi Hsuan f8514630db
[einthusan] Fix extraction (closes #11416)
The old test URLs are no longer valid, so I replace them with the one
from #11416
8 years ago
Aniruddh-J 459818e280 [aenetworks] Add support for lifetimemovieclub.com 8 years ago
Sergey M․ 6310acf512
[youtube] Fix parsing codecs (closes #12091) 8 years ago
Yen Chi Hsuan f3915452de Merge pull request #12085 from wiiaboo/python2
utils.py: Workaround TypeError with Python 2.7.13 in Windows
8 years ago
Ricardo Constantino 2f49bcd690
utils.py: Workaround TypeError with Python 2.7.13 in Windows
Fixes #11540

Tested with Windows Python 2.7.12 and 2.7.13.
8 years ago
Yen Chi Hsuan 68c22c4c15
[iqiyi] Update _TESTS 8 years ago
Sergey M․ 9b92a5917b
release 2017.02.11 8 years ago
Sergey M․ 3d7e3aaa0e
[pluralsight:course] Fix extraction (closes #12075) 8 years ago
Sergey M․ 624c4b92ff
[facebook] Add coding cookie 8 years ago
Thomas Christlieb 2af12ad9d2 Introduce get_elements_by_class and get_elements_by_attribute utility functions 8 years ago
Remita Amine 97eb9bd2ac [bbc] extract m3u8 formats with 320k audio 8 years ago
Sergey M․ 71cdd75628
[facebook] Relax video id matching (closes #11017, closes #12055, closes #12056) 8 years ago
Remita Amine c7d6f614f3 [corus] Add new extractor(closes #12060)(#9164) 8 years ago
Remita Amine 08a00eef79 [extractor/common] skip m3u8 manifests protected with Adobe Flash Access 8 years ago
Sergey M․ 9dd5408c99
[pluralsight] Detect blocked account error message (#12070) 8 years ago
Sergey M․ 9510709575
[bloomberg] Add another video id regex (closes #12062) 8 years ago
Remita Amine 5abcca9060 [sixplay] use raw string for regex 8 years ago
Sergey M․ e01bfc19c3
[extractor/commonmistakes] Restrict _VALID_URL (closes #12050) 8 years ago
Remita Amine 4d32b63851 [tvplayer] Add new extractor 8 years ago
Sergey M․ 55d4de2283
release 2017.02.10 8 years ago
Sergey M․ ff24261ba0
[kaltura] Add explicit port to regexes
They should not match e.g. cdnapi.kaltura.computernetworks.com/...
8 years ago
Sergey M․ fbc6dc525e
[xtube] Fix shortcuts 8 years ago
Sergey M․ 9150d1eb69
[xtube] Fix extraction (closes #12023) 8 years ago
Sergey M․ b7f9843bec
[pornhub] Simplify (closes #12018) 8 years ago
Thomas Christlieb e64b0fca14
[pornhub] Fix extraction (closes #12007) 8 years ago
Sergey M․ 78ef214d2d
[facebook] Improve JS data regex (closes #12042) 8 years ago
Remita Amine be670b8e8f [external:ffmpeg] do not assume that ffmpeg unknown version format is new 8 years ago
Remita Amine 37084f6641 [kaltura] improve embed partner id extraction(fixes #12041) 8 years ago
Remita Amine b04975733c [sprout] Add new extractor 8 years ago
Remita Amine c8b8fb0a99 [sixplay] improve extraction
- skip drm protected formats
- extract more and better formats
- skip duplicate asset urls
8 years ago
Remita Amine 8298018273 [scrippsnetworks:watch] Add new extractor(closes #10765) 8 years ago
Remita Amine ae8d5a5c59 [go] add support for adobe pass auth(closes #11468)(closes #10831) 8 years ago
Sergey M․ b9c9cb5f79
[6play] Fix extraction (closes #12011) 8 years ago
Remita Amine fdf9b959bc [nbc] add support adobe pass auth(closes #12006) 8 years ago
Sergey M․ 013877298d
release 2017.02.07 8 years ago
Sergey M․ f28aeff264
[pornhub] Fix extraction (closes #11997) 8 years ago
Sergey M․ 242a14a1f6
[extractor/common] Fix audio only with audio group in m3u8 (closes #11995) 8 years ago
Sergey M․ d5d904ff7d
[canalplus] Add support for cstar.fr (#11990) 8 years ago
Sergey M․ 5620f840f6
[extractor/generic] Add test for #11993 and more metadata for rtmp 8 years ago
Sergey M․ b7a8c1bcfa
[extractor/generic] Improve rtmp support (closes #11993) 8 years ago
Sergey M․ 7097bffba6
[downloader/fragment] Respect --no-part 8 years ago
Sergey M․ 2aec7256ae
[extractor/common] Speed-up media tags regex (closes #11979) 8 years ago
Yen Chi Hsuan 9c14fe9681
[gaskrank] Minor change and update ChangeLog after #11685 8 years ago
motophil e705755739 [gaskrank] Add new extractor (#11685)
* [gaskrank] Add new extractor

* [gaskrank] Add new extractor - fixes as requested

* [gaskrank] Add new extractor - style fix

* [Gaskrank] Add new extractor - requested fixes

* [Gaskrank] Add new extractor - fix md5 checksum

* [gaskrank] Add new extractor - more requested fixes

* [Gaskrank] Add new extractor - fixed all but one quantified code issues

* [Gaskrank] add new extractor - more fields extracted, added second test

* [Gaskrank] Add new extractor - requested fixes.

* [Gaskrank] Add new extractor - requested changes.

* [Gaskrank] Add new extractor - final(?) fixes.
8 years ago
Yen Chi Hsuan 019f4c0371
[bandcamp] Fix extraction for incomplete albums
Closes #11727
8 years ago
Yen Chi Hsuan 2ab2c0d1f5
[iwara] Add width (closes #11724)
The heuristic is from #11724
8 years ago
Yen Chi Hsuan caf0f5f8b7
[iwara] Fix extraction (closes #11781) 8 years ago
Yen Chi Hsuan e4e50f60b1
[googledrive] Fix extraction on Python 3.6
Since Python 3.6, invalid escape sequences are deprecated. It's likely
that there are invalid escape sequences somewhere on the webpage, so
instead of unescaping the whole webpage, just unescape the URL.

See https://bugs.python.org/issue27364. That change was designed for
string literals, while it affects the 'unicode_escape' encoding as well.
The code path is:

str.decode('unicode_escape')
    codecs.unicode_escape_decode()
        PyUnicode_DecodeUnicodeEscape()
8 years ago
Sergey M․ 6ef3e65a7b
[videopress] Add extractor 8 years ago
Sergey M․ 6fd138bed8
[sportbox] PEP 8 8 years ago
Remita Amine 3d2c2752c5 [afreecatv] extract rtmp formats 8 years ago
Sergey M․ a713a86755
release 2017.02.04.1 8 years ago
Sergey M․ 9db8f6c540
[twitch:stream] Improve _VALID_URL (closes #11971) 8 years ago
Remita Amine 8e4041cf3f [radiocanada] fix extraction for toutv rtmp formats 8 years ago
Sergey M․ 31487eb974
release 2017.02.04 8 years ago
John Hawkinson c2521c1ac6 [Piksel] Add another app token regex 8 years ago
A Connecticut Princess 643dc0fcfe
[vk] Catch author blocked error message
Example link (video in blocked group):
https://vk.com/search?c%5Bq%5D=%D0%9F%D1%80%D1%8B%D0%B6%D0%BE%D0%BA%20c%20%D0%BA%D1%80%D0%B0%D0%BD%D0%B0%20%D0%B2%20%D1%81%D1%82%D0%B8%D0%BB%D0%B5%20%D0%A7%D0%B5%D0%BB%D0%BE%D0%B2%D0%B5%D0%BA%D0%B0-%D0%BF%D0%B0%D1%83%D0%BA%D0%B0&c%5Bsection%5D=video&c%5Bsort%5D=2&z=video-10639516_456240611
8 years ago
Remita Amine 36fce54816 [turner] fix downloading of secure hls formats using ffmpeg(closes #11358)(closes #11373)(closes #11800) 8 years ago
Remita Amine 2c15db829c [drtv] add support for live and radio sections(closes #1827)(closes #3427) 8 years ago
Remita Amine f65dba7cdb [myspace] fix extraction and extract hls and http formats 8 years ago
Remita Amine 605fd6392f [youtube] add format info for itag 325 and 328 8 years ago
Sergey M․ f962790ee5
[vine] Fix extraction (closes #11955) 8 years ago
Sergey M․ b7cc5f078e
[extractors] Remove remnants of sportbox extractor (#11954) 8 years ago
Sergey M․ f7a10d8cd6
[sportbox] Remove extractor (closes #11954)
Covered by generic extractor
8 years ago
Yen Chi Hsuan 8939f784d9 Merge pull request #11901 from ThomasChr/randonplaylistorder
New parameter --playlist-random to randomize playlist download order. Fixes #11889
8 years ago
Remita Amine df0588a31f Merge branch 'fstirlitz-filmon' 8 years ago