Commit Graph

10669 Commits (22a0a95247c30b346592b6e3d464776bceb3b934)

Author SHA1 Message Date
Yen Chi Hsuan cec9727c7f
[hearthisat] Detect invalid download links (fixes #9440) 9 years ago
Yen Chi Hsuan 79298173c5
[utils] Fix getheader in urlhandle_detect_ext
Fixes #7049, related to #9440
9 years ago
Sergey M․ 69c9cc2716
[xvideos] Extract html5 player formats (Closes #9495) 9 years ago
Sergey M․ ed56f26039
[extractor/common] Improve name extraction for m3u8 formats 9 years ago
Sergey M․ 6f41b2bcf1
[extractor/generic] Improve 3qsdn embeds support (Closes #9453) 9 years ago
Sergey M․ cda6d47aad
[utils] Simplify integer conversion in js_to_json 9 years ago
Sergey M․ 5d39176f6d
[extractor/generic:3qsdn] Add support for embeds 9 years ago
Sergey M․ 5c86bfe70f
[3qsdn] Add extractor 9 years ago
Sergey M․ ca950f49e9
[ora] Revert extraction to regexes
It's less fragile than using js_to_json with ora js
9 years ago
Sergey M․ 89ac4a19e6
[utils] Process non-base 10 integers in js_to_json 9 years ago
felix 640eea0a0c
[ora] minimise fragile regex shenanigans; recognise unsafespeech.com URLs 9 years ago
felix bd1e484448
[utils] js_to_json: various improvements
now JS object literals like { /* " */ 0: ",]\xaa<\/p>", } will be correctly converted to JSON.
9 years ago
Yen Chi Hsuan a834622b89 Merge pull request #9492 from jwilk/teamcoco
[teamcoco] Fix base64 regexp
9 years ago
Jakub Wilk 66e7ace17a Don't hardcode errno constant
The value of ENOENT is architecture-dependent, so don't assume it's
always 2.
9 years ago
Jakub Wilk 791ff52f75 [teamcoco] Fix base64 regexp 9 years ago
Sergey M․ b5abf86148
[cinemassacre] Remove extractor (Closes #9457)
It now uses jwplatform
9 years ago
Sergey M․ 134c6ea856
[YoutubeDL] Sanitize url for url and url_transparent extraction results 9 years ago
remitamine 0730be9022 [sina] fix extraction(fixes #1146) 9 years ago
Sergey M․ 96c2e3e909
[imdb] Improve extraction 9 years ago
Sergey M․ f196508f7b
[imdb] Relax _VALID_URL (Closes #9481) 9 years ago
Yen Chi Hsuan cc1028aa6d
[openload] Fix extraction (closes #9472) 9 years ago
remitamine ad55e10165 [brightcove] change the protocol for m3u8 formats to m3u8_native 9 years ago
remitamine 18cf6381f6 [nrk] extract m3u8 formats 9 years ago
remitamine cdf32ff15d [extractors] add import for UstudioEmbedIE 9 years ago
remitamine 99d79b8692 [ustudio] add support ustudio app/embed urls 9 years ago
remitamine b9e7bc55da [mgtv] extract http formats 9 years ago
Sergey M․ d8d540cf0d
[nrk] Rework extractor (Closes #9470) 9 years ago
Sergey M․ 0df79d552a
[twitch:bookmarks] Remove extractor
Bookmarks no longer available
9 years ago
Sergey M․ 0db3a66162
[twitch] Skip dead tests 9 years ago
Yen Chi Hsuan 7581bfc958
[utils] Unquote crendentials passed to SOCKS proxies
Fixes #9450
9 years ago
Yen Chi Hsuan a3fa6024d6
[bloomberg] Fix test_Bloomberg
In this test case, sometimes HLS is the best format while sometimes HDS
is. To prevent occasional test failures, force HDS to be the best
format. In the past, testing against HDS formats causes the same error
as #9214, which is fixed as #9377 landed.
9 years ago
Yen Chi Hsuan 1b405bb47d
[downloader/f4m] Tolerate truncate segments when testing
Replaces #9216

Fixes #9214 and test_Bloomberg partially
9 years ago
Yen Chi Hsuan 7e8ddca1bb
[vevo] Delay the georestriction check to prevent false alerts
Fixes #9408
9 years ago
Yen Chi Hsuan 778a1ccca7
[utils] Add Œ and œ found in French to ACCENT_CHARS
Fixes #9463
9 years ago
Yen Chi Hsuan 4540515cb3
[iqiyi] Fix 1080P extraction (closes #9446) 9 years ago
Sergey M․ e0741fd449
[__init__] Simplify colon presence check 9 years ago
teemuy e73b9c65e2
Bugfix: Allow colons in custom HTTP header values. 9 years ago
Yen Chi Hsuan 702ccf2dc0
[compat] Rename shlex_quote and remove unused subprocess_check_output 9 years ago
Philipp Hagemeister 28b4f73620 release 2016.05.10 9 years ago
Yen Chi Hsuan 6ddb4888d2
[options] Update --proxy description for SOCKS proxies 9 years ago
Yen Chi Hsuan fa5cb8d021
[socks] Remove a superfluous clause 9 years ago
Yen Chi Hsuan edaa23f822
[compat] Rename struct_(un)pack to compat_struct_(un)pack 9 years ago
Yen Chi Hsuan d5ae6bb501
[utils] Add rationale for register_socks_protocols 9 years ago
Yen Chi Hsuan 51fb4995a5
[utils] Register SOCKS protocols in urllib and support SOCKS4A 9 years ago
Yen Chi Hsuan 9e9cd7248d
[socks] Eliminate magic constants and improve 9 years ago
Yen Chi Hsuan 71aff18809
[socks] Support SOCKS proxies 9 years ago
Yen Chi Hsuan dab0daeeb0
[utils,compat] Move struct_pack and struct_unpack to compat.py 9 years ago
Yen Chi Hsuan 4350b74545
[socks] Add socks.py from @bluec0re's public domain implementation
https://gist.github.com/bluec0re/cafd3764412967417fd3
9 years ago
Sergey M․ 2937590e8b
[downloader/hls] PEP 8 9 years ago
Sergey M․ e62d9c5caa
[downloader/external] Call ffmpeg with with HTTP_PROXY env variable set (#9437) 9 years ago
Sergey M․ fe40f9eef2
[compat] Add compat_setenv 9 years ago
Sergey M․ 6104cc2985
[downloader/hls] Add event media playlists to unsupported features of hlsnative 9 years ago
Sergey M․ c15c47d19b
[downloader/hls] Remove EXT-X-MEDIA-SEQUENCE from unsupported features for hlsnative 9 years ago
Sergey M․ 3951e7eb93
[ceskatelevize] Simplify, restore bonus video test and skip georestricted test (Closes #9431) 9 years ago
Tomáš Čech f1f6f5aa5e
[ceskatelevize] Add support for live streams
Live streams has no playlist title, use title of the stream containing
TV channel name. Internal m3u8 handler doesn't seem to handle well
continuous streams. Add test for live stream. Remove no longer
reachable test.
9 years ago
Sergey M eb785b856f Merge pull request #9358 from dstftw/hls-native-to-ffmpeg-delegation
[downloader/hls] Delegate extraction to ffmpeg when unsupported features detected
9 years ago
Sergey M․ c52f4efaee
[mva] Improve _VALID_URLs 9 years ago
Sergey M․ f23a92a0ce
[mva] Add extractor (Closes #6667) 9 years ago
Yen Chi Hsuan 3b01a9fbb6
[litv] Add new extractor
LiTV is a streaming platform providing free and paid legal contents in
Taiwan.
9 years ago
Sergey M․ 9c072d38c6
[arte] Improve language preference (Closes #9401, closes #9162) 9 years ago
Sergey M․ 3e169233da
Expanduser for more options with input files 9 years ago
Sergey M․ f5436c5d9e
[downloader/external] Add temp fix ffmpeg m3u8 downloads (Closes #9394) 9 years ago
Kevin Deldycke e2eca6f65e Expand user's home in batch file path. 9 years ago
Yen Chi Hsuan a0904c5d80
[telegraaf] Fix extractor (closes #9318) 9 years ago
Sergey M․ cb1fa58813
[flickr] Extract uploader URL (Closes #9426) 9 years ago
remitamine 3fd6332c05 [flickr] extract license field(closes #9425) 9 years ago
Sergey M 401d147893 Merge pull request #9400 from inondle/master
[liveleak] Adds support for thumbnails and updates tests
9 years ago
inondle e2ee97dcd5 [liveleak] Adds support for thumbnails, updates tests 9 years ago
Sergey M․ f745403b5b
[vevo] Revert videoplayer.vevo.com to api.vevo.com 9 years ago
Sergey M․ 3e80e6f40d
[vevo] Allow request to api.vevo.com to fail (Closes #9417)
I don't know whether this it's tempopary or api has just gone
9 years ago
Sergey M․ 25cb7a0eeb
[youtube] Allow empty attribute values in description regex 9 years ago
Sergey M․ abc97b5eda
[utils] Allow empty attribute values in get_element_by_attribute (Closes #9415) 9 years ago
remitamine 04e88ca2ca [vk] improve extraction(fixes #7976) 9 years ago
Yen Chi Hsuan 6f59aa934b
[periscope:user] Add new extractor for user pages
Closes #9388
9 years ago
Yen Chi Hsuan 109db8ea64 Merge pull request #9367 from codesparkle/master
Feature: --restrict-filenames: replace accented characters by their unaccented counterpart instead of "_"
9 years ago
Sergey M․ 915620fd68
[redtube] PEP 8 9 years ago
Sergey M․ ac12e888f9
[redtube] Extract all formats, duration, upload date and view count (Closes #9397) 9 years ago
Yen Chi Hsuan 7d08f6073d
[kuwo:category] Update test 9 years ago
remitamine 758a059241 [dailymail] Add new extractor(closes #2667) 9 years ago
Yen Chi Hsuan 4f8c56eb4e
[fczenit] Fix extraction and update test
Closes #9359
9 years ago
Sergey M․ 9da526aae7
[yandexmusic:playlist] Update test 9 years ago
Sergey M․ 75b81df3af
[udemy] Modernize 9 years ago
Sergey M․ aabdc83d6e
[udemy] Fix course enroll (Closes #9393) 9 years ago
Sergey M․ 2a48e6f01a
[yandexmusic:playlist] Respect track order for long (>150) playlists 9 years ago
Sergey M․ 203a3c0e6a
[yandexmusic:playlist] Make title optional 9 years ago
Sergey M․ d36724cca4
[yandexmusic:playlist] Remove unused imports 9 years ago
Sergey M․ 15fc0658f7
[yandexmusic:playlist] Modernize 9 years ago
Sergey M․ e960c3c223
[yandexmusic:playlist] Improve extraction (Closes #6801) 9 years ago
Sergey M․ bc7e77a04b
[vevo] Use raise_geo_restricted 9 years ago
Sergey M․ 964f49336f
[aol] Improve _VALID_URL (Closes #9381) 9 years ago
Sergey M․ 57d8e32a3e
[xfileshare] Add support for streamin.to 9 years ago
Sergey M․ 4174552391
[xfileshare] Refactor _VALID_URL and remove ded sites 9 years ago
Sergey M․ 80bc4106af
[xfileshare] Add support for thevideobee.to (Closes #9374) 9 years ago
Yen Chi Hsuan 7759be38da
[xiami] Detect georestriction and skip tests 9 years ago
Yen Chi Hsuan a0a309b973
[kuwo:category] Fix description and update test 9 years ago
Adam Thalhammer c587cbb793 improved performance by extracting accented chars to top level 9 years ago
Sergey M․ 8a92e51c60
[extractor/common] Relax wording for creator metafield 9 years ago
Sergey M․ f0e14fdd43
[YoutubeDL] Skip non-relevant field types when building output template 9 years ago
Sergey M․ df5f4e8888
[vevo] Remove superfluous code 9 years ago
Sergey M․ 7960b0563b
[YoutubeDL] Properly process unable-to-download-error on python2 9 years ago
Sergey M․ 5c9ced9504
[vevo] Improve genre extraction 9 years ago
Adam Thalhammer 79a2e94e79 Instead of replacing accented characters with an underscore when sanitizing file names in restricted mode, replace them with their non-accented equivalents fixes #9347 9 years ago
Sergey M․ 686cc89634
[discovery] Fix typo 9 years ago
Sergey M․ 9508738f9a
[vevo] Extract featured artist 9 years ago
Sergey M․ 78a3ff33ab
[vevo:playlist] Add fallback for playlist id 9 years ago
Sergey M․ 881dbc86c4
[vevo] Extract track related metafields and add artists to title (Closes #1684) 9 years ago
Sergey M․ 8e7d004888
[vevo] Add test for video only available via webpage 9 years ago
Sergey M․ 9618c44824
[vevo] Extract video versions from webpage as a last resort (Closes #8426, closes #9366) 9 years ago
Sergey M․ 516ea41a7d
[vevo] Fix _call_api 9 years ago
Sergey M․ e2bd301ce7
[vevo:playlist] Fix genre playlists 9 years ago
Sergey M․ 0c9d288ba0
[vevo:playlist] Remove debug params 9 years ago
Sergey M․ e0da32df6e
[vevo:playlist] Add extractor (Closes #9334, closes #9364) 9 years ago
Philipp Hagemeister 174aba3223 release 2016.05.01 9 years ago
Sergey M․ 0d66bd0eab
[downloader/hls] Delegate extraction to ffmpeg when unsupported features detected 9 years ago
Sergey M․ 4bd143a3a0
[postprocessor/ffmpeg] Simplify metadata preparation and add track related metafields (Closes #9357) 9 years ago
Sergey M․ 68bb2fef95
[tagesschau] Restrict playlist entry regex 9 years ago
Sergey M․ 854cc54bc1
[tagesschau] Expand video id 9 years ago
Sergey M․ 651ad35ce0
[tagesschau] Relax _VALID_URL 9 years ago
Sergey M․ 6a0f9a24d0
[tagesschau] Separate player extractor 9 years ago
remitamine 9cf79e8f4b [ccc] improve extraction 9 years ago
Sergey M․ 2844b09336
[tagesschau] Fix article media ids 9 years ago
Sergey M․ 1a2b377cc2
[tagesschau] Fix audio support 9 years ago
Sergey M․ 4c1b2e5c0e
[tagesschau] Add support for playlists 9 years ago
Sergey M․ 9e1b96ae40
[rtlnl] Match formats only by height 9 years ago
Sergey M․ fc35cd9e0c
[tagesschau] Relax _VALID_URL 9 years ago
Sergey M․ 339fe7228a
[tagesschau] Update _FORMATS map 9 years ago
remitamine ea7e7fecbd [discovery] remove unused imports 9 years ago
remitamine d00b93d58c [discovery] extract more info using BrightcoveNewIE 9 years ago
remitamine 93f7a31bf3 [discovery] extract subtitle 9 years ago
remitamine 33a1ec950c [discovery] extract http formats 9 years ago
Sergey M․ 4e0c0c1508
[xiami] Improve extraction (Closes #9079)
* Switch to JSON source
* Add abstract IE for playlists
* Extract more track related metadata
9 years ago
BlahGeek 89c0dc9a5f
[xiami] Add xiami extractor 9 years ago
remitamine f628d800fb [ted] add support for youtube embeds and update tests 9 years ago
remitamine 11fa3d7f99 [ted] extract all http formats 9 years ago
Sergey M․ d41ee7b774
[vlive] Pass Referer as bytestring (Closes #9352) 9 years ago
remitamine e0e9bbb0e9 [pbs] extract srt and vtt subtitles 9 years ago
remitamine 7691184a31 [pbs] remove duplicate format 9 years ago
remitamine 35cd2f4c25 [pbs] extract only the formats that we know that they will be available as http format
https://projects.pbs.org/confluence/display/coveapi/COVE+Video+Specifications
9 years ago
remitamine 350d7963db [pbs] fix the least bitrate http url construction 9 years ago
remitamine cbc032c8b7 [pbs] extract all http formats 9 years ago
remitamine 69c4cde4ba [wsj] improve extraction 9 years ago
Sergey M․ ca278a182b
[rtlnl] Replace test 9 years ago
Sergey M․ 373e1230e4
[rtlnl] Clarify tests 9 years ago
Sergey M․ cd63d091ce
[rtlnl] Fix tests 9 years ago
Sergey M․ 0571ffda7d
[rtlnl] Improve extraction (Closes #9329)
* Make hls extraction non fatal and revert ext
* Extract progressive formats' metadata from corresponding hls formats
9 years ago
Reino17 5556047465
[rtlnl] Update 720p PG_URL_TEMPLATE
- Fixed the format_id for the 720p progressive videostream and added the video's resolution.
- The adaptive videostreams have the m3u8-extension, so I removed the confusing mp4-extension in order to make a better distinction between the these and the progressive videostreams.
9 years ago
remitamine 65a3bfb379 [dfb] extract m3u8 formats 9 years ago
Yen Chi Hsuan cef3f3011f
[funimation] Detect blocking and support CloudFlare cookies 9 years ago
Yen Chi Hsuan e9c6cdf4a1
[common] Fix format_id construction for HLS 9 years ago
Sergey M․ 00a17a9e12
[crunchyroll] Sort formats 9 years ago
Sergey M․ 8312b1a3d1
[crunchyroll] Add even more relaxed fmt fallback 9 years ago
Sergey M․ 6ff4469528
[crunchyroll] Relax fmt regex 9 years ago
Yen Chi Hsuan 68835d687a
Merge branch 'Kagami-vlive-hls' 9 years ago
Yen Chi Hsuan 9d186afac8
[vlive] Coding style and PEP8 9 years ago
Yen Chi Hsuan 151d98130b Merge branch 'vlive-hls' of https://github.com/Kagami/youtube-dl into Kagami-vlive-hls 9 years ago
Kagami Hiiragi b24d6336a7 [vlive] Add support for live videos 9 years ago
remitamine 065216d94f [crunchyroll] reduce requests for formats extraction 9 years ago
remitamine 67167920db [viewlift] replace SnagFilms extractors
- add support for other sites that use the same logic
- improve format extraction and sorting
9 years ago
Yen Chi Hsuan 14638e2915
[sexykarma] Rename to WatchIndianPornIE and fix extraction 9 years ago
Yen Chi Hsuan 1910077ed7
Revert "[sexykarma] Remove the extractor"
This reverts commit 31ff3c074e.
9 years ago
Yen Chi Hsuan 5819edef03
[ooyala] Skip an invalid test
Ooyala is used by lots of extractors and its correctness can be verified
by these websites.
9 years ago
Yen Chi Hsuan f5535ed0e3
[orf] Skip the expired test 9 years ago
Yen Chi Hsuan 31ff3c074e
[sexykarma] Remove the extractor
Its domain name is on sale.

Closes #9317
9 years ago
Sergey M․ 72670c39de
[arte:+7] Fix typo in _VALID_URL 9 years ago
Sergey M․ 683d892bf9
[viewster] Remove unused import 9 years ago
Sergey M․ 497971cd4a
[yandexmusic] Clarify blockage even more 9 years ago
remitamine e757fb3d05 [crunchyroll] improve extraction
- extract more metadata(series, episode, episode_number)
- reduce duplicate requests for extracting formats
- remove duplicate formats
9 years ago
remitamine 0ba9e3ca22 [viewster] extract formats for videos with multiple audios/subtitles 9 years ago
Sergey M․ 4b53762914
[yandexmusic] Clarify blockage 9 years ago
Sergey M․ eebe6b382e
[yandexmusic] Improve error handling 9 years ago
Yen Chi Hsuan 0cbcbdd89d
[nuvid] Fix extraction
Closes #7620
9 years ago
Yen Chi Hsuan 7f776fa4b5
[yandexmusic] Skip tests as Travis CI blocked 9 years ago
Yen Chi Hsuan a5941305b6
[mwave] Coding style 9 years ago
Yen Chi Hsuan f8dddaf456 Merge branch 'mwave-meetgreet' of https://github.com/pmrowla/youtube-dl into pmrowla-mwave-meetgreet 9 years ago
Yen Chi Hsuan 618c71dc64
[cloudy] New domain name for the test_cloudy_1
I'm sure whether videoraj.ch still works or not, so keep it.
9 years ago
Sergey M․ 52af8f222b
[cwtv] Relax _VALID_URL (Closes #9327) 9 years ago
Yen Chi Hsuan 3cc8649c9d
[20min] Detect embedded YouTube videos
Fixes #9331
9 years ago
Yen Chi Hsuan dcf094d626
[theplatform] Fix for Python 3.2
test_AENetworks{,_1} fails as in Python < 3.3, binascii.a2b_* functions
accepts only bytes-like objects
9 years ago
Peter Rowlands 5b5d7cc11e [mwave] Add Mwave Meet & Greet extractor 9 years ago
Yen Chi Hsuan 2ac2cbc0a3
[malemotion] Remove the extractor
Announcement from their homepage:

```
MaleMotion is closed

After another system crash, I'm forced to close the site

This week all content will be erased

Don't forget to cancel your subscription if any !
```

Closes #9311.
9 years ago
Yen Chi Hsuan a7e03861e8
[scivee] Skip the test
Not accessible from either Travis CI or my machine.

Closes #9315
9 years ago
Sergey M․ 175c2e9ec3
[youtube:search_url] Reimplement in terms of youtube:playlistbase 9 years ago
remitamine f1f879098a [viewster] extract more metadata for http formats 9 years ago
Sergey M․ c9fd530670
[ok] Extract start time 9 years ago
Sergey M․ 749b0046a8
[ok] Allow embeds without title (Closes #9303) 9 years ago
Yen Chi Hsuan e3de3d6f2f
[normalboots] Fix extraction
Now it's using ScreenwaveMedia
9 years ago
Yen Chi Hsuan ad58942d57
[muzu] Remove extractor
MUZU is shutting down in October 2015. [1]

[1] http://www.musicbusinessworldwide.com/youtube-rival-muzu-is-heading-into-liquidation/
9 years ago
Yen Chi Hsuan 4645432d7a
[eagleplatform] Checking direct HTTP links
Sometimes they fail with 404
9 years ago
Yen Chi Hsuan 6bdc2d5358
[mitele] Comment out unstable MD5
Also Akamai f4f fragments
9 years ago
Yen Chi Hsuan 2beff95da5
[nrk] Comment out unstable MD5 checksums
Both are Akamai f4f fragments.
9 years ago
Yen Chi Hsuan abc1723edd
[unistra] Sort formats
Originally URLs are passed to set() and not sorted, so the result is not
deterministic, causing occasional FAILs on Travis CI.
9 years ago
Yen Chi Hsuan d6712378e7
Merge branch 'akamai_pv' of https://github.com/remitamine/youtube-dl into remitamine-akamai_pv 9 years ago
remitamine fb72ec58ae [extractor/common] do not process f4m manifest that contain akamai playerVerificationChallenge 9 years ago
Sergey M․ c83a352227
[openload] Make thumbnail optional 9 years ago
Sergey M․ e9063b5de9
[openload] Add test 9 years ago
Sergey M․ 594b0c4c69
[openload] Fix ext extraction 9 years ago
Sergey M․ eb9ee19422
[utils] Allow None mimetypes in mimetype2ext 9 years ago
Sergey M․ a1394b820d
[openload] Fix title extraction (Closes #9298) 9 years ago
Yen Chi Hsuan aa9dc24f5a
[douyutv] Improve extraction and update tests
The JSON API sometimes return HTML pages with errors
9 years ago
Yen Chi Hsuan 51762e1a31
[xminus] Fix extraction (closes #9228) 9 years ago