Commit Graph

10669 Commits (22a0a95247c30b346592b6e3d464776bceb3b934)

Author SHA1 Message Date
Philipp Hagemeister 8b38f2ac40 release 2016.04.24 9 years ago
Yen Chi Hsuan a82398bd72
[kwuo:song] Fix extraction and update the test 9 years ago
remitamine c14dc00df3 [viewster] improve http formats extraction 9 years ago
Yen Chi Hsuan 03dd60ca41
[kuwo:category] Fix the test
Sometimes there are 24 songs and sometimes 30 lol
9 years ago
Yen Chi Hsuan 0738187f9b
[ThePlatform] Fix tests failed since 79ba9140dc 9 years ago
Yen Chi Hsuan a956cb6306
[onionstudios] Fix description extraction
\1 does not work in []. Fixes test_Generic_75
(http://www.clickhole.com/video/dont-understand-bitcoin-man-will-mumble-explanatio-2537)
9 years ago
Yen Chi Hsuan a8062eabcd
[mwave] Skip checking unstable MD5
On my PC the checksum is 02eda6d09fb63131a17a8d44e6237463, while a
recent Travis CI build
(https://travis-ci.org/rg3/youtube-dl/jobs/125341081) shows it's
c930e27b7720aaa3c9d0018dfc8ff6cc
9 years ago
Yen Chi Hsuan 2a7dee8cc5
[yahoo] Improve error detection and update tests 9 years ago
Yen Chi Hsuan d9ed362116
[yahoo] Extract all <iframe>s
Fixes test_yahoo_6

(https://ca.finance.yahoo.com/news/hackers-sony-more-trouble-well-154609075.html)
9 years ago
Yen Chi Hsuan 4f54958097
[yahoo] Update some tests
One has new fields as ThePlatformIE changed, and others have changed
files.
9 years ago
Yen Chi Hsuan 2a7c38831c
[yahoo] Extend _VALID_URL and fix extraction
Closes #9271
9 years ago
Yen Chi Hsuan 949b6497cc
[generic] Unescape the video URL
Fixes #9279
9 years ago
remitamine fda9a1ca9e [viewster] simplify qualities_basename regex 9 years ago
remitamine 864d5e7231 [viewster] extract all http formats 9 years ago
Sergey M․ 5448b781f6
[dplay] Sign unsigned final download hls URLs 9 years ago
Sergey M․ e239413fbc
[dplay] Extract subtitles (Closes #9284) 9 years ago
Sergey M․ fd0ff8bad8
[dplay] Improve extraction and document workarounds and tests 9 years ago
Sergey M․ 397ec446f3
[dplay] Try secure api for no tld (Closes #9282) 9 years ago
Boris Wachtmeister 14f7a2b8af [WDRMaus] switch current show to new WDR extractor (fixes #8562)
It seems that the "current show" already uses the new WDR video-player,
while all the others videos still use the old player.

I just added the current show URL to the normal WDR-extractor, which
works fine. This commit needs my changes from PR #8842 that fix the
support for WDR.
9 years ago
Boris Wachtmeister c0837a12c8 [WDR] complete overhaul after relaunch of the site
The WDR relaunched their site on 2016-02-23 which not only changed the
URL-schema completely but also the layout of their pages.

Apparently the whole "mediathek" now runs on the wdr-domain, so no
separate URL for funkhauseuropa anymore.
There seems to be no explicit handling of video-sizes on the page or in
the URLs anymore. There seems to be only one size for HTML5, but still
several sizes for flash. The extractor adds all to the list of formats.

There is no metadata for the HTML5-stream, so that the best flash-stream
will always be considered as the "best" format. At least in my tests
this seemed to be true anyway.
9 years ago
remitamine 29a7e8f6f8 [nhl] Add new extractor(closes #8419)(closes #8798) 9 years ago
Yen Chi Hsuan eb01e97e10
[youku] Skip streams with channel_type=tail
Fixes #9275

These video segments look like ads and they don't appear in the web
player.
9 years ago
remitamine cb7d4d0efd [nbc] add support for today.com(closes #2909) 9 years ago
Yen Chi Hsuan c80037918b
[iqiyi] Improve error detection (#9276) 9 years ago
remitamine 237a41108a [eagleplatform] extract all http formats 9 years ago
remitamine e962ae15d3 [newstube] extract http formats(closes #9253) 9 years ago
remitamine 7c36ea7d54 [rtbf] improve extraction(fixes #9267) 9 years ago
remitamine 9260cf1d97 [tubitv] fix extraction(closes #8741) 9 years ago
Sergey M․ bdbb8530c7
[vimeo] Pass Referer for check-password request 9 years ago
Sergey M․ 09a9fadb84
[dump] Remove extractor 9 years ago
Sergey M․ bf09af3acb
Add --hls-prefer-ffmpeg 9 years ago
Sergey M․ 88296ac326
[planetaplay] Remove remainings of extractor 9 years ago
Sergey M․ 870d525848
[options] Remove experimental mark for --hls-prefer-native 9 years ago
Sergey M․ 6577112890
[planetaplay] Remove extractor (Closes #9256) 9 years ago
Sergey M․ 1988647dda
[tvigle] Skip hls completely (#9259) 9 years ago
Yen Chi Hsuan a292cba256
[mgtv] Fix _VALID_URL and add localized name 9 years ago
Yen Chi Hsuan 982e518a96
[dispeak] Rename DigitalSpeaking to DigitallySpeaking 9 years ago
Yen Chi Hsuan 748e730099
[dispeak] Several fixes 9 years ago
Sergey M b6c0d4f431 Merge pull request #9110 from remitamine/parse_duration
[utils] imporove parse_duration to handle more formats
9 years ago
remitamine acaff49575 [utils] imporove parse_duration to handle more formats 9 years ago
Yen Chi Hsuan 1da19488f9
[mgtv] Add new extractor (closes #9212) 9 years ago
Yen Chi Hsuan 442c4d361f
[dispeak/gdcvault] Add the test case from #5784 9 years ago
Yen Chi Hsuan ec59d657e7
[dispeak] Add new extractor
Both GDCVault and GPUTechConf uses the service of DigitalSpeaking.
9 years ago
Yen Chi Hsuan 99ef96f84c
[gdcvault] Fix for videos with hard-coded hostnames
Fixes #9248
9 years ago
Yen Chi Hsuan 4dccea8ad0
[streetvoice] Fix extraction
The old API results in URLs with HTTP 403 from time to time.

Hopefully fixes #9219.
9 years ago
Yen Chi Hsuan 2c0d9c6217
[extractor/common] Allow empty post data 9 years ago
Sergey M․ 12a5134596
[tvigle] Fix extraction (Closes #9259) 9 years ago
Sergey M․ 16e633a5d7
[quickvid] Remove extractor (Closes #9258) 9 years ago
Sergey M․ 494ab6db73
[youtube] Capture and output login error message 9 years ago
Sergey M․ 107701fcfc
[people] Remove bogus comment 9 years ago
Sergey M․ f77970765a
[people] Add extractor 9 years ago
Philipp Hagemeister 81215d5652 release 2016.04.19 9 years ago
Sergey M․ 241a318f27
[vimeo] Improve _VALID_URL (Closes #9229) 9 years ago
Sergey M․ 4fdf082375
[theonion] Remove extractor (Closes #9220)
It now uses generic onionstudios embed
9 years ago
Jaime Marquínez Ferrándiz 1b6182d8f7 [youtube:playlist] Fetch all the videos in a mix (fixes #3837)
Since there doesn't seem to be any indication, it stops when there aren't new videos in the webpage.
9 years ago
remitamine 7bab22a402 [vice] remove unused import and variable 9 years ago
Yen Chi Hsuan 0f97fb4d00
[musicplayon] Relax _VALID_URL and improve metadata extraction
In r'pl=\d+&play=\d+' pages, several metadata items are missing

Closes #9222.
9 years ago
Yen Chi Hsuan b1cf58f48f
[musicplayon] Fix extraction (closes #9222) 9 years ago
remitamine 3014b0ae83 Merge pull request #9195 from remitamine/ffmpeg-pipe
[downloader/external] enable piping for FFmpegFD(closes #2124)
9 years ago
remitamine b9f2fdd37f [ffmpeg] Clarify rationale for pipe(-) exclusion in _ffmpeg_filename_argument 9 years ago
remitamine bbb3f730bb [onionstudios] extract m3u8 formats 9 years ago
remitamine d868f43c58 [ffmpeg] check for - file name in _ffmpeg_filename_argument 9 years ago
Yen Chi Hsuan 21525bb8ca
[kuwo:category] Update the test
Now the webpage says there are 24 songs.
9 years ago
Sergey M․ d8f103159f
[nerdist] Remove extractor
It now uses brightcove
9 years ago
remitamine 663ee5f0a9 [vice] extract youtube embed 9 years ago
Sergey M․ b6b950bf58
[cbs] Remove unused import 9 years ago
Sergey M․ 11e60fcad8
[extractor/generic] Improve instagram embeds (Closes #9213) 9 years ago
Sergey M․ c23533a100
[instagram] Add support for iframe embeds 9 years ago
Sergey M․ 0dafea02e6
[instagram] Add support for embed URLs 9 years ago
Sergey M․ 5d6360c3b7
[mooshare] Remove extractor 9 years ago
Yen Chi Hsuan 5e5c30c3fd
[mdr] Fix extraction and update tests
It's strange that the date is changed. Anyway, new data matches what the
webpage says.
9 years ago
Yen Chi Hsuan 9154c87fc4
[huffpost] Fix a typo 9 years ago
Yen Chi Hsuan ef0e4e7bc0
[generic] Fix test_Generic_2
Now a HEAD request returns 400 Bad Request
9 years ago
Yen Chi Hsuan 67d46a3f90
[ustream] Fix /embed/ URLs and add a test 9 years ago
Yen Chi Hsuan bec47a0748
[tudou] Improve error detection (closes #9175) 9 years ago
Yen Chi Hsuan 36b7d9dbfa
[twitter] Don't check /cards/ URLs
Fixes #9181

In this tweet, there are two cards:
1. https://twitter.com/i/cards/tfw/v1/719944006306701313
   This shows #TeamCap vs. #TeamIronMan
2. https://twitter.com/i/videos/tweet/719944021058060289
   This is the real video and can be handled by TwitterCardIE

In all current test_Twitter* tests, /videos/tweet/ approach works fine.
9 years ago
Yen Chi Hsuan 8c65e4a527
[bbc] Fix a test 9 years ago
Yen Chi Hsuan 6ad2ef8b7c
[audiomack] Update the test
The original test raises 404
9 years ago
Yen Chi Hsuan 00b426d66d
[varzesh3] Add md5 to the test 9 years ago
Yen Chi Hsuan 0de968b584
[newgrounds] Support videos (closes #9138) 9 years ago
remitamine 0841d5013c [cbs] do not catch Exceptions raised by by _extract_theplatform_smil 9 years ago
remitamine a71fca8577 [theplatform] remove _sort_formats from _extract_theplatform_smil 9 years ago
Yen Chi Hsuan ee94e7e66d
[varzesh3] Fix metadata extraction (closes #9197) 9 years ago
Yen Chi Hsuan 759e37c9e6
[gazeta] Relax _VALID_URL and update tests
Closes #9196
9 years ago
Yen Chi Hsuan ae65567102
[eagleplatform] Fix error handling 9 years ago
Yen Chi Hsuan c394b4f4cb
[puls4] Fix error detection (#9194) 9 years ago
Yen Chi Hsuan 260c7036ba
[sportbox] Fix SportBoxEmbedIE
Also fixes test_Generic_29 (http://www.vestifinance.ru/articles/25753)
9 years ago
remitamine f74197a074 [cbs] extract rtmp formats 9 years ago
remitamine f3a58d46bf [youtube:user] check if the url didn't match only the other youtube extractors 9 years ago
Sergey M․ b6612c9b11
[karaoketv] Fix extraction 9 years ago
Yen Chi Hsuan 7e176effb2
[iqiyi] Also suuport pps.tv URLs
PPS is acquired by Baidu and merged with iQiyi in 2013 [1]. Now they
have the same page layouts.

[1] http://www.chinanews.com/it/2013/05-07/4792526.shtml
9 years ago
Yen Chi Hsuan 4a252cc2d2
[karaoketv] Update and mark as not _WORKING 9 years ago
Yen Chi Hsuan f0ec61b525
[huffpost] Fix extraction 9 years ago
Yen Chi Hsuan 66d40ae3a5 Merge pull request #9041 from kasper93/master
[generic] Add support for LiveLeak embeds
9 years ago
Yen Chi Hsuan e6da9240d4
[mixcloud:stream] Add new extractor
Closes #7633
9 years ago
Yen Chi Hsuan dd91dfcd67
[mixcloud] Fix extraction by decrypting play info
Fixes #7521
9 years ago
Yen Chi Hsuan c773082692
Merge branch 'Phaeilo-mixcloud' 9 years ago
Yen Chi Hsuan 9c250931f5
[mixcloud] Improve and simplify mixcloud:user and mixcloud:playlist 9 years ago
Yen Chi Hsuan 56f1750049
[tdslifeway] Use the new Brightcove API
Thanks for @remitamine's suggestion.
9 years ago
Yen Chi Hsuan f2159c9815
[wayofthemaster] Remove extractor
Now it's using YouTube embeds.
9 years ago
Yen Chi Hsuan b0cf2e7c1b
[ubu] Remove extractor
1. Videos on ubu.com are now hosted on Vimeo
2. The duration is far from correct, and may not exist on other videos
   (For example http://ubu.com/film/hammons_king.html)
9 years ago
Yen Chi Hsuan 74b47d00c3
[xboxclips] Use http:// URL
xboxclips has misconfigured certificates
9 years ago
Yen Chi Hsuan 8cb57bab8e
[ministrygrid] Fix extraction and modernize 9 years ago
Yen Chi Hsuan e1bf277e19
[tdslifeway] Add TDSLifewayIE
Used by MinistryGridIE
9 years ago
remitamine ce599d5a7e [downloader/external] enable piping for FFmpegFD(closes #2124) 9 years ago
Sergey M․ 9e28538726
[arte:creative] Improve _VALID_URL 9 years ago
Sergey M․ 404284132c
[arte:info] Add extractor (Closes #9182) 9 years ago
remitamine 5565be9dd9 [aol] relex _VALID_URL regex 9 years ago
Yen Chi Hsuan b3a9474ad1 Merge branch 'mixcloud' of https://github.com/Phaeilo/youtube-dl into Phaeilo-mixcloud 9 years ago
Yen Chi Hsuan 86475d59b1
[metacritic] Add a new valid test case 9 years ago
Yen Chi Hsuan 73d93f948e
[lecture2go] Fix extraction
RTSP stream fails to download. Seems it's a mpv bug as direct playback
works well:

$ mpv --ytdl-format rtsp https://lecture2go.uni-hamburg.de/veranstaltungen/-/v/17473
9 years ago
Yen Chi Hsuan f5d8743e0a
[downloader/rtsp] Print the command 9 years ago
Yen Chi Hsuan d1c4e4ba15
[laola1tv] Improve error detection and skip an invalid test 9 years ago
Yen Chi Hsuan f141fefab7
[karrierevideos] Fix extraction
The server serves malformed header "Content Type: text/xml" for the XML
request (it should be Content-Type but not Content Type). Python 3.x,
which uses email.feedparser rejects such headers. As a result,
Content-Encoding header is not parsed, so the returned content is kept
not decompressed, and thus XML parsing error.
9 years ago
aystroganov@gmail.com 8334637f4a Make tbr field 'int' rather than 'tuple'
Closes #9180.
9 years ago
Philipp Hagemeister b0ba11cc64 release 2016.04.13 9 years ago
Kacper Michajłow b8f67449ec [generic] Add support for LiveLeak embeds 9 years ago
Yen Chi Hsuan 75af5d59ae
[netease] Skip all tests: completely georestricted 9 years ago
Philip Huppert 6d67169509 [mixcloud] improved extraction of user description 9 years ago
Philip Huppert dcaf00fb3e [mixcloud] support older urllib versions 9 years ago
Philip Huppert f896e1ccef [mixcloud] fixed some tests 9 years ago
Philip Huppert c96eca426b [mixcloud] Added support for user uploads, playlists, favorites and listens.
Fixes #3750 and #5272
9 years ago
Sergey M․ 466a614537
[youtube:playlist] Recognize popular uploads playlist as mix (Closes #9170) 9 years ago
Sergey M․ ffa2cecf72
[ard] Change subtitles extension to ttml (Closes #9169)
ttml is now served instead of srt
9 years ago
Yen Chi Hsuan a837416025
[jadorecettepub] Remove extractor: website gone 9 years ago
Yen Chi Hsuan c9d448876f
[izlesene] Fix extraction
description may be absent
9 years ago
Yen Chi Hsuan 8865b8abfd
[howstuffworks] Skip a broken test case 9 years ago
Yen Chi Hsuan c77a0c01cb
[groupon] Fix extraction 9 years ago
Yen Chi Hsuan 12355ac473
[goshgay] Fix extraction
isFamilyFriendly no longer exists in the webpage and I can't find
another indicator.
9 years ago
Sergey M․ 49f523ca50
[mixcloud] Capture error message (#9156) 9 years ago
remitamine 4a903b93a9 Revert "[openclassroom] Add new extractor(closes #9147)"
This reverts commit 13267a2be3.
9 years ago
remitamine 13267a2be3 [openclassroom] Add new extractor(closes #9147) 9 years ago
Yen Chi Hsuan 134c207e3f
[arte.tv:embed] Extended support (#2620) 9 years ago
Yen Chi Hsuan 0f56bd2178
Merge branch 'Phaeilo-presstv' 9 years ago
Yen Chi Hsuan dfbc7f7f3f
[presstv] Improve and simplify 9 years ago
Yen Chi Hsuan 7d58ea7c5b Merge branch 'presstv' of https://github.com/Phaeilo/youtube-dl into Phaeilo-presstv 9 years ago
Sergey M․ 452908b257
[telebruxelles] Fix extraction (Closes #9142) 9 years ago
Sergey M․ 5899e988d5
[glide] Improve extraction and extract upload info 9 years ago
Sergey M․ 4a121d29bb
[glide] Fix extraction (Closes #9141) 9 years ago
Sergey M․ 7ebc36900d
[jwplatform:base] Improve subtitles extraction 9 years ago
Sergey M․ d7eb052fa2
[screencastomatic] Add duration to test 9 years ago
Sergey M․ a6d6722c8f
[jwplatform:base] Extract duration 9 years ago
Sergey M․ 66fa495868
[screencastomatic] Fix extraction (Closes #9136) 9 years ago
Sergey M․ 443285aabe
[ebaumsworlds] Update _VALID_URL (Closes #9135) 9 years ago
Philip Huppert de728757ad [presstv] Refactored extractor. 9 years ago
Sergey M․ f44c276842
[extractor/extractors] Remove non-existant imports 9 years ago
Sergey M․ a1fa60a934
[cliprs] Add extractor (Closes #9099) 9 years ago
Sergey M․ 49caf3307f
[extractor/common] Remove irrelevant comment 9 years ago
Sergey M․ 61dd350a04
[1tv] Fix extraction (Closes #9103) 9 years ago
Philip Huppert 95153a960d [presstv] updated extractor and tests to work with current PressTV website 9 years ago
Yen Chi Hsuan c991106706 [videodetective] Adapt to InternetVideoArchiveIE 9 years ago
Yen Chi Hsuan dae2a058de [rottentomatoes] Adapt to InternetVideoArchiveIE 9 years ago
Yen Chi Hsuan c05025fdd7 [internetvideoarchive] Fix extraction and support json URLs 9 years ago
Philip Huppert bfe96d7bea [presstv] Added extractor PressTV.
Fixes #7060
9 years ago
Yen Chi Hsuan ab481b48e5 [funnyordie] Relax M3U8 URL matching
Also, m3u8_url extraction should be fatal as all formats depends
directly or indirectly on it.

This change fixes test_Generic_26 and TestFunnyOrDieSubtitles
9 years ago
Sergey M․ 92c7f3157a [aol] Add coding cookie 9 years ago
Yen Chi Hsuan cacd996662 [utils] Don't touch URLs if not necessary
Fix test_Generic_15 (Google redirect)
9 years ago
remitamine bffb245a48 [aol] add support for videos with vidible IDs(closes #9124) 9 years ago
Jaime Marquínez Ferrándiz e0986e31cf lazy extractors: Output if it's enabled in the verbose log 9 years ago
Jaime Marquínez Ferrándiz 779822d945 Add experimental support for lazy loading the info extractors
'make lazy-extractors' creates the youtube_dl/extractor/lazy_extractors.py (imported by youtube_dl/extractor/__init__.py), which contains simplified classes that only have the 'suitable' class method and that load the appropiate class with the '__new__' method when a instance is created.
9 years ago
Jaime Marquínez Ferrándiz 1b3d5e05a8 Move the extreactors import to youtube_dl/extractor/extractors.py 9 years ago
Jaime Marquínez Ferrándiz e52d7f85f2 Delay initialization of InfoExtractors until they are needed 9 years ago
Sergey M․ 568d2f78d6 [tnaflix] Fix metadata extraction 9 years ago
Sergey M․ 2f2fcf1a33 [tnaflix] Fix extraction (Closes #9074) 9 years ago
Sergey M․ bacec0397f [extractor/common] Relax _hidden_inputs 9 years ago
Sergey M․ 3c6c7e7d7e [gdcvault] Fix extraction (Closes #9107, closes #9114) 9 years ago
Sergey M․ fb38aa8b53 [extractor/common] Support arbitrary format strings for template based identifiers in mpd manifests (Closes #9119, closes #9120) 9 years ago
Sergey M․ 18da24634c [democracynow] Improve extraction 9 years ago
Sergey M․ a134426d61 [democracynow] Fix tests 9 years ago
Sergey M․ a64c0c9b06 [democracynow] Make description optional (Closes #9115) 9 years ago
Sergey M․ 56019444cb [novamov] Improve _VALID_URL template (Closes #9116) 9 years ago
remitamine a1ff3cd5f9 [acast] fix channel extraction(closes #9117) 9 years ago
remitamine 9a32e80477 [acast] fix extraction(#9117) 9 years ago
Sergey M․ 536a55dabd [YoutubeDL] Sanitize single thumbnail URL 9 years ago
Sergey M․ ed6fb8b804 [vrt] Add support for direct hls playlists and YouTube (Closes #9108) 9 years ago
Sergey M․ 3afef2e3fc [beeg] Improve extraction 9 years ago
Sergey M․ e90d175436 [yandexmusic] Extract music album metafields (Closes #7354) 9 years ago
Sergey M․ 7a93ab5f3f [extractor/common] Introduce music album metafields 9 years ago
Philipp Hagemeister c41cf65d4a release 2016.04.06 9 years ago
Yen Chi Hsuan 92d5477d84 [compat] Handle tuples properly in urlencode()
Fixes #9055
9 years ago
Yen Chi Hsuan 8790249c68 [iqiyi] Improve error detection for VIP-only videos
Closes #9071
9 years ago
Philipp Hagemeister 416930d450 release 2016.04.05 9 years ago
Sergey M․ 65150b41bb [deezer] Fix extraction (Closes #9086) 9 years ago
Sergey M․ e42f413716 [rte] Improve thumbnail extraction (Closes #9085) 9 years ago
Sergey M․ 40a056d85d [extractor/__init__] Remove novamov extractor and sort novamov based extractors alphabetically 9 years ago
Sergey M․ e7d77efb9d [auroravid] Add extractor (Closes #9070) 9 years ago
Sergey M․ 995cf05c96 [novamov] Make title fatal 9 years ago
Jaime Marquínez Ferrándiz 5bf28d7864 [utils] dfxp2srt: add additional namespace
Used by the ZDF subtitles (#9081).
9 years ago
Jaime Marquínez Ferrándiz 8c7d6e8e22 [zdf] Extract subtitles (closes #9081) 9 years ago
Sergey M․ 6d4fc66bfc [youtube] Add support for zwearz (Closes #9062) 9 years ago
remitamine 23576edbfc [brightcove:legacy] skip None value for uploader_id 9 years ago
remitamine 4d4cd35f48 [brightcove:legacy] extract uploader_id as a string 9 years ago
remitamine 3aac9b2fb1 [nowness] update tests 9 years ago
remitamine e47d19e991 [brightcove:new] extract subtitles and strip video title 9 years ago
remitamine 41f5492fbc [brightcove:legacy] improve format extraction and extract uploader_id, duration and timestamp 9 years ago
Jaime Marquínez Ferrándiz 2defa7d75a [instagram:user] Fix extraction (fixes #9059)
The URL for the next page was incorrect and we always got the same page, therefore it got trapped in an infinite loop.
9 years ago
Sergey M․ bbc26c8a01 [bbc] Set vcodec to none for audio formats 9 years ago
Sergey M․ b507cc925b [extractor/common] Carry long line 9 years ago
Sergey M․ db8ee7ec05 [extractor/common] Fix numeric identifiers conversion in DASH URL templates 9 years ago
remitamine 08136dc138 [brightcove] fix format sorting 9 years ago
remitamine fe7ef95e91 [cbsinteractive] Add support for ZDNet videos 9 years ago
remitamine 5f705baf5e [cnet] extract more formats 9 years ago
remitamine 0750b2491f [ffmpeg] try to convert tt subtitles usng dfxp2srt 9 years ago
remitamine df634be2ed [common] prefer using mime type over ext for smil subtitle extraction
the subtitle ext for http://www.cnet.com/videos/download-amazon-prime-movies-and-tv/
is adb_xml while using the mime type it get tt(application/smptett+xml)
9 years ago
Jaime Marquínez Ferrándiz 6d628fafca [camwithher] Remove extra blank line 9 years ago
Jaime Marquínez Ferrándiz 0f28777f58 [cbsnews] Remove unused import 9 years ago
Jaime Marquínez Ferrándiz 329c1eae54 [aenetworks] Make pep8 happy 9 years ago
Sergey M․ 9aaaf8e8e8 [camwithher] Improve extraction (Closes #8989) 9 years ago
theGeekPirate 04819db58e [camwithher] Add extractor
Corrected unnecessary test

Sane variable naming

RTMP all .flv & url_id for _download_webpage()

Corrected all outstanding issues, next up is a squash!
9 years ago
remitamine 79ba9140dc [theplatform] extract timestamp and uploader 9 years ago
Sergey M․ 75d572e9fb [screencast] Improve title regexes (Closes #9025) 9 years ago
Martin Trigaux 791d6aaecc screencast.com: fallback on page title
When determining the title of the page, use the <title> tag of the page
9 years ago
Sergey M․ 81de73e5b4 [screencast] Add test 9 years ago
Martin Trigaux 83cedc1cf2 screencast.com: support missing www
The "www." part of the URL is not mandatory
9 years ago
Sergey M․ 244cd04237 [pluralsight] Remove unnecessary login/password encode 9 years ago
Sergey M․ fbdaced256 [lynda] Remove unnecessary login/password encode 9 years ago
Sergey M․ a3373823e1 [udemy] Remove unnecessary login/password encode
This is now covered by compat_urllib_parse_urlencode
9 years ago
Sergey M․ 03caa463e7 [udemy:course] Skip non-video lectures 9 years ago
remitamine 3f64379eda [movieclips] fix extraction 9 years ago
remitamine 3e0c3d14d9 [cbs] add base extractor 9 years ago
remitamine d8873d4def [aenetworks] improve format extraction 9 years ago
remitamine db1c969da5 [theplatform] sign https urls 9 years ago
Philipp Hagemeister 1e02bc7ba2 release 2016.04.01 9 years ago
remitamine 63c55e9f22 [cbs] improve extraction(closes #6321) 9 years ago
remitamine f9b1529af8 [generic] remove sbnation test(handled by VoxMediaIE) 9 years ago
remitamine 961fc024d2 [voxmedia] improve sbnation support 9 years ago
Sergey M․ b53a06e3b9 [udemy:course] Use new URL format 9 years ago
remitamine 4ecc1fc638 [howstuffworks] improve extraction 9 years ago
Yen Chi Hsuan 5b012dfce8 [tudou] Improve error handling (closes #8988) 9 years ago
remitamine 8369942773 [voxmedia] Add new extractor(closes #3182) 9 years ago
Sergey M․ 86f3b66cec [udemy] Remove unused import 9 years ago
Sergey M․ 6bb4600717 [udemy:course] Simplify course curriculum downloading 9 years ago
Sergey M․ 41d06b0424 [extractor/common] Improve _request_webpage
* Do not ignore data, headers and query for Requests
* Default values for headers and query switched to dicts since these are used by urllib itself
9 years ago
Sergey M․ 15d260ebaa [utils] Use update_Request in http_request 9 years ago
Sergey M․ ed0291d153 [utils] Add update_Request 9 years ago
Sergey M․ 81da8cbc45 [udemy] Switch to api 2.0 (Closes #9035) 9 years ago
Sergey M․ 5299bc3f91 [beeg] Switch to api v6 (Closes #9036) 9 years ago
remitamine c9c39c22c5 [nationalgeographic] add support for channel.nationalgeographic.com urls 9 years ago
remitamine d84b48e3f1 [nationalgeographic] improve extraction 9 years ago
remitamine dd17041c82 [tenplay] remove extractor(fixes #6927) 9 years ago
remitamine fea7295b14 [brightcove] relax embed_in_page regex 9 years ago
remitamine 9cf01f7f30 [nbc] add new extractor for csnne.com(#5432) 9 years ago
remitamine ce548296fe [cnbc] fix test 9 years ago
remitamine c02ec7d430 [cnbc] Add new extractor(closes #8012) 9 years ago
remitamine 6b820a2376 [myspace] improve extraction 9 years ago
Yen Chi Hsuan e621a344e6 [kwuo] Port to new API and enable --cn-verification-proxy 9 years ago
Yen Chi Hsuan 3ae6f8fec1 [kwuo] Remove _sort_formats() from KuwoBaseIE._get_formats()
Following the idea proposed in 19dbaeece3
9 years ago
Yen Chi Hsuan 597d52fadb [kuwo:song] Correct song ID extraction (fixes #9033)
Bug introduced in daef04a4e7.
9 years ago
Sergey M․ afca767d19 [tumblr] Improve _VALID_URL (Closes #9027) 9 years ago
remitamine 6e359a1534 [comcarcoff] don not depend on crackle extractor(closes #8995)
previously extraction has been delegated to crackle to extract more info
and subtitles #6106 but some of the episodes can't be extracted using
crackle #8995.
9 years ago
Sergey M․ 33f3040a3e [YoutubeDL] Fix sanitizing subtitles' url 9 years ago
Sergey M․ 03442072c0 [pornhub] Fix typo (Closes #9008) 9 years ago
Sergey M․ c8b13fec02 [foxnews] Restore upload time fields in test 9 years ago
Sergey M․ 87d105ac6c [amp] Fix upload timestamp extraction (Closes #9007) 9 years ago
Sergey M․ 3454139576 [pornhub:uservideos] Add support for multipage videos (Closes #9006) 9 years ago
Sergey M․ 3a23bae9cc [pornhub:playlistbase] Do not include videos not from playlist 9 years ago
Sergey M․ 8f9a477e7f [pornhub:playlistbase] Use orderedSet 9 years ago
Sergey M․ a1cf3e38a3 [bbc] Extend vpid regex (Closes #9003) 9 years ago
Philipp Hagemeister a122e7080b release 2016.03.27 9 years ago
Sergey M․ b22ca76204 [extractor/common] Filter out unsupported encrypted media for f4m formats (Closes #8573) 9 years ago
Sergey M․ f7df343b4a [downloader/f4m] Extract routine for removing unsupported encrypted media 9 years ago
Sergey M․ 19dbaeece3 Remove _sort_formats from _extract_*_formats methods
Now _sort_formats should be called explicitly.
_sort_formats has been added to all the necessary places in code.

Closes #8051
9 years ago
Yen Chi Hsuan 395fd4b08a [twitter] Handle another form of embedded Vine
Fixes #8996
9 years ago
Sergey M․ 8018028d0f [pluralsight] Extract chapter metadata (Closes #8993) 9 years ago
Sergey M․ 00322ad4fd [lynda] Extract chapter metadata (#8993) 9 years ago
Sergey M․ 4cf3489c6e [vevo] Update videoservice API URL (Closes #8900) 9 years ago
Sergey M․ b24ab3e341 [udemy] Improve paid course detection 9 years ago
Sergey M․ af4116f4f0 [udemy] Improve format_id 9 years ago
Sergey M․ f973e5d54e [udemy] Drop outputs' formats
Always results in 403
9 years ago
Sergey M․ 62f55aa68a [udemy] Add outputs metadata to view_html formats 9 years ago
Sergey M․ 02d7634d24 [udemy] Fix outputs' formats format_id 9 years ago
Sergey M․ 48dce58ca9 [udemy] Use custom sorting 9 years ago
Sergey M․ efcba804f6 [udemy] Extract formats from view_html (Closes #8979) 9 years ago
Sergey M․ 6dee688e6d [youtube:playlistsbase] Restrict playlist regex (Closes #8986) 9 years ago
Sergey M․ eedb7ba536 [YoutubeDL] Sort imports 9 years ago
Sergey M․ dcf77cf1a7 [YoutubeDL] Sanitize final URLs (Closes #8991) 9 years ago
Sergey M․ 17bcc626bf [utils] Extract sanitize_url routine 9 years ago
Sergey M․ b5a5bbf376 [mailru] Extend _VALID_URL (Closes #8990) 9 years ago
Yen Chi Hsuan e68d3a010f [twitter] Fix extraction (closes #8966)
HLS and DASH formats are no longer appeared in test cases. I keep them
for fear of triggering new errors.
9 years ago
Yen Chi Hsuan d10fe8358c [generic] Add a test case for brightcove embed
Closes #8862
9 years ago
Yen Chi Hsuan d6c340cae5 [brightcove] Extract more formats (#8862) 9 years ago
Yen Chi Hsuan 5964b598ff [brightcove] Support alternative BrightcoveExperience layout
The full URL lays in the `data` attribute of <object> (#8862)
9 years ago
Philipp Hagemeister 62cdb96f51 release 2016.03.26 9 years ago
Sergey M․ 6e6bc8dae5 Use urlencode_postdata across the codebase 9 years ago
Sergey M․ 15707c7e02 [compat] Add compat_urllib_parse_urlencode and eliminate encode_dict
encode_dict functionality has been improved and moved directly into compat_urllib_parse_urlencode
All occurrences of compat_urllib_parse.urlencode throughout the codebase have been replaced by compat_urllib_parse_urlencode

Closes #8974
9 years ago
Sergey M․ 2156f16ca7 [thescene] Fix extraction and improve style (Closes #8978) 9 years ago
Sergey M․ 4db441de72 [once] Relax _VALID_URL (Closes #8976) 9 years ago
Philipp Hagemeister 0be8314dc8 release 2016.03.25 9 years ago
Yen Chi Hsuan d7f62b049a [iqiyi] Update enc_key 9 years ago
Yen Chi Hsuan 3bb3356812 [douyutv] Extend _VALID_URL 9 years ago
Sergey M․ 98e68806fb [mnet] Improve (Closes #8958) 9 years ago
Kagami Hiiragi e031768666 [mnet] Add new extractor 9 years ago
Sergey M․ 5eb7db4ee9 [udemy] Add support for new URL schema 9 years ago
Sergey M․ f0e83681d9 [udemy] Extract formats from outputs 9 years ago
Sergey M․ ff9d5d0938 [udemy] Improve course enrolling 9 years ago
Sergey M․ d041a73674 [extractor/__init__] Add youtube:live and sort youtube extractors alphabetically 9 years ago
Sergey M․ f07e276a04 [youtube:live] Add extractor (Closes #8959) 9 years ago
Sergey M․ 993271da0a [nytimes] Tolerate missing metadata (Closes #8952) 9 years ago
Sergey M․ 369e7e3ff0 [iprima] Fix extraction (Closes #8953) 9 years ago
Sergey M․ 5767b4eeae [mtv] Fix description extraction (Closes #8962) 9 years ago
Yen Chi Hsuan 622d19160b [utils] Clarify Python versions affected by buggy struct module 9 years ago
Yen Chi Hsuan 32d88410eb [tumblr] Add a test with Instagram embed
Closes #8817
9 years ago
Yen Chi Hsuan 5a51775a58 [generic] Extract Instagram embeds (#8817) 9 years ago
Yen Chi Hsuan 87696e78d7 [instagram] Unescape description (#8817) 9 years ago
Yen Chi Hsuan c4096e8aea [instagram] Extract embed videos (#8817) 9 years ago
Yen Chi Hsuan fc27ea9464 [tumblr] Support Vine embeds (#8817) 9 years ago
Yen Chi Hsuan 088e1aac59 [generic] Support Vine embeds (#8817) 9 years ago
Sergey M 4333d56494 Merge pull request #8898 from dstftw/fragment-retries
Add --fragment-retries option (Fixes #8466)
9 years ago
Sergey M․ 882c699296 [tunein] Fix stream data extraction (Closes #8899, closes #8924) 9 years ago
Yen Chi Hsuan efbed08dc2 [utils] Encode hostnames before passing to urllib
With IDN (Internationalized Domain Name) and a proxy, non-ascii URLs
are passed down to urllib/urllib2, causing UnicodeEncodeError

Fixes #8890
9 years ago
Jaime Marquínez Ferrándiz 7da2c87119 Add extractor for thescene.com (closes #8929) 9 years ago
Sergey M․ c6ca11f1b3 [once] Prevent ads from embedding into m3u8 playlists (Closes #8893) 9 years ago
Sergey M․ 2beeb286e1 [laola1tv] Add support for livestreams (Closes #8934) 9 years ago
Sergey M․ cc7397b04d [ceskatelevize] Make m3u8 formats extraction non fatal (Closes #8933) 9 years ago
Sergey M․ bc5d16b302 [animeondemand] Skip dash for now 9 years ago
Sergey M․ 85c637b737 [animeondemand] Extract teaser when no full episode available (#8923) 9 years ago
Sergey M․ 5c69f7a479 [animeondemand] Respect startvideo (Closes #8923) 9 years ago
Sergey M․ ff5873b72d [motherless] Detect friends only videos 9 years ago
Sergey M․ 065c4b27bf [xhamster:embed] Extract vars (Closes #8912) 9 years ago
Sergey M․ 1600ed1ff9 [rutv] Improve flash version pattern (Closes #8911) 9 years ago
Sergey M․ 5886b38d73 Add support for https for all extractors as preventive and future-proof measure 9 years ago
Sergey M․ 0cef27ad25 Add missing r prefix for _VALID_URLs 9 years ago
Sergey M․ 12af4beb3e [mailru] Add support for https (Closes #8920) 9 years ago
Sergey M․ 9016d76f71 [YoutubeDL] Improve _format_note 9 years ago
Sergey M․ 3c5d183c19 [animeondemand] Extract all formats (Closes #8906) 9 years ago
Sergey M․ 3e8bb9a972 [animeondemand] Detect geo restriction 9 years ago
Yen Chi Hsuan daef04a4e7 [kwuo] Fix KuwoChartIE and KuwoSingerIE and accept new URL forms 9 years ago
Yen Chi Hsuan 2648918c81 [vlive] Fix creator extraction (closes #8814) 9 years ago
Yen Chi Hsuan 9e3c2f1d74 [openload] Misc improvements
* Add thumbnail
* Detect errors (#6469)
* Match more (#6469, #8489)
9 years ago
Yen Chi Hsuan 2bfeee69b9 [openload] Add new extractor (closes #8489) 9 years ago
Yen Chi Hsuan 664bcd80b9 [tudou] Use InAdvancePagedList (closes #8884) 9 years ago
Sergey M․ 3c20208eff [francetv] Improve formats extraction 9 years ago
Sergey M․ db264e3cc3 [francetvinfo] Add support for france3-regions and strip title (Closes #7673) 9 years ago
Sergey M․ 96a9f22d98 [discovery] Relax _VALID_URL (Closes #8903) 9 years ago
Sergey M․ 40025ee2a3 [postprocessort/ffmpeg] Allow embedding webvtt into webm (Closes #8874) 9 years ago
Sergey M․ 298c04b464 [91porn] Use common messages' wording 9 years ago
Sergey M․ d95114dd83 [91porn] Unquote final URL (Closes #8881) 9 years ago
Sergey M․ fa023ccb2c [biobiochiletv] Fix extraction, extract m3u8 formats and overall improve (Closes #7314) 9 years ago
jjatria e36f4aa72b [biobiotv] Add extractor 9 years ago
Sergey M․ f1ced6df51 [cda] Improve and simplify (Closes #8805) 9 years ago
Kacper Michajłow 8b0d7a66ef [cda] Add new extractor for cda.pl
Fixes #8760
9 years ago
Sergey M․ 3aec71766d [safari:api] Separate extractor (Closes #8871) 9 years ago
Sergey M․ 16a8b7986b [downloader/fragment] Document fragment_retries 9 years ago
Sergey M․ 617e58d850 [downloader/{common,fragment}] Fix total retries reporting on python 2.6 9 years ago
Sergey M․ e33baba0dd [downloader/dash] Add fragment retry capability
YouTube may often return 404 HTTP error for a fragment causing the
whole download to fail. However if the same fragment is immediately
retried with the same request data this usually succeeds (1-2 attemps
is usually enough) thus allowing to download the whole file successfully.
So, we will retry all fragments that fail with 404 HTTP error for now.
9 years ago
Sergey M․ 721f26b821 [downloader/fragment] Add report_retry_fragment 9 years ago
Sergey M․ 52bb437e41 [options] Add --fragment-retries option 9 years ago
Jaime Marquínez Ferrándiz 782b1b5bd1 [utils] lookup_unit_table: Match word boundary instead of end of string 9 years ago
Sergey M․ 0d769bcb78 [extractor/generic] Fix missing byte literal prefix 9 years ago
remitamine 4cd70099ea [hbo] Add new extractor 9 years ago
Jaime Marquínez Ferrándiz 09fc33198a utils: lookup_unit_table: Use a stricter regex
In parse_count multiple units start with the same letter, so it would match different units depending on the order they were sorted when iterating over them.
9 years ago
John Peel d5aacf9a90 Added format_id to the filers on -f. 9 years ago
Sergey M․ 19e2617a6f [commonprotocols] Add generic support for rtmp URLs (Closes #8488) 9 years ago
Sergey M․ edd9b71c2c [extractor/generic] Add a test for m3u playlist served without proper Content-Type 9 years ago
Sergey M․ 5940862d5a [extractor/generic] Detect m3u playlists served without proper Content-Type 9 years ago
Sergey M․ de6c51e88e [extractor/generic] Fix direct link semantics 9 years ago
Sergey M․ 303dcdb995 [extractor/generic] Simplify upload_date extraction 9 years ago
Sergey M․ 20938f768b [extractor/generic] Add another test for generic m3u8 9 years ago
Sergey M․ 955737b2d4 [extractor/generic] Force Content-Type to lowecase 9 years ago
Sergey M․ 263eff9537 [extractor/generic] Properly extract format id from Content-Type
Fixes extraction for cases like: audio/x-mpegURL; charset=utf-8
9 years ago
Sergey M․ cae21032ab [theplatform] Improve geo restriction detection 9 years ago
remitamine 6187091532 [once] check http formats availability 9 years ago
Philipp Hagemeister 0d33166ec5 release 2016.03.18 9 years ago
remitamine 87c03c6bd2 [theplatform] remove unnecessary import 9 years ago
remitamine 4c92fd2e83 [theplatform] always force theplatform to return a smil for _extract_theplatform_smil 9 years ago
Sergey M․ e3d17b3c07 [noz] Fix extraction on python 2.6 by means of using compat_xpath 9 years ago
Sergey M․ 810c10baa1 [utils] Use compat_xpath 9 years ago
Sergey M․ 57f7e3c62d [compat] Add compat_xpath 9 years ago
Sergey M․ 0d0e282912 [animeondemand] Fix typo and improve 9 years ago
Sergey M․ 85e8f26b82 [animeondemand] Improve extraction 9 years ago
Sergey M․ b57fecfddd [animeondemand] Add test 9 years ago
Sergey M․ 8c97e7efb6 [animeondemand] Expand episode title regex (Closes #8875) 9 years ago
Sergey M․ cc162f6a0a [crunchyroll] Fix custom _download_webpage (Closes #8883) 9 years ago
remitamine cf45ed786e [wistia] extract more metadata 9 years ago
remitamine 574b2a7393 [nbc:nbcnews] improve extraction(fixes #6922)
- extract more metadata and formats
- relax regex
9 years ago
remitamine 9f02ff537c [theplatform] extract brightcove once formats 9 years ago
remitamine 0436ec0e7a [once] Add new format extractor 9 years ago
Yen Chi Hsuan 11f12195af [youtube] Added itag 91
Seen in https://www.youtube.com/watch?v=jMN4cxyhJjk
9 years ago
remitamine a646a8cf98 [sbs] improve extraction(fixes #3811)
- extract error messages
- force the platform smil url(previously the manifest param
in the query is not respected which make theplatform return non working
mp4 files for some videos)
9 years ago
remitamine 63f41d3821 [bravotv] Add new extractor(#4657) 9 years ago
Sergey M․ c5229f3926 [utils] PEP 8 9 years ago
Sergey M․ 96f4f796fb [brightcover] Remove unused import 9 years ago
Sergey M․ 70cab344c4 [udemy] Improve course id v4 regex 9 years ago
Quan Hua a7ba57dc17 [udemy] Update course id regex to cover v4 layout (Closes #8753, closes #8868, closes #8870) 9 years ago
remitamine 83548824c2 Merge pull request #8092 from bpfoley/twitter-thumbnail
[utils] Add extract_attributes for extracting html tag attributes
9 years ago
remitamine 354dbbd880 [brightcove:new] extract protocol-less embed URLs(closes #2914) 9 years ago
remitamine 23edc49509 [tv3] Add new extractor(closes #8059) 9 years ago
remitamine 48254c3f2c [brightcove] some improvements and fixes
- use FFmpeg downloader to download m3u8 formats extracted
from BrightcoveNew(some of the m3u8 media playlists use AES-128)
- update comment and update_url_query to handle url query
9 years ago
remitamine 2cab48704c [thestar] Add new extractor(closes #5955) 9 years ago
remitamine 64d4f31d78 [brightcove:new] update embed_in_page embeds regex to match non numeric ref id 9 years ago
remitamine 0c9ff24041 [noz] fix extraction in python 2.6 9 years ago
Yen Chi Hsuan 3ff8279e80 [kuwo:mv] Fix the test and extraction of georestricted MVs 9 years ago
remitamine cb6e477dfe [aljazeera] update the extractor to use BrightcoveNewIE 9 years ago
remitamine edfd93518e [svt] extract dashhbbtv formats(#8867) 9 years ago
remitamine 89807d6a82 [brightcove] extract dash formats and detect audio formats 9 years ago
remitamine 49dea4913b Merge pull request #8513 from remitamine/dash-sort
[extractor/common] fix dash formats sorting
9 years ago
Sergey M․ dec2cae0a7 [twitch:playlistbase] Clarify pagination bug
Pagination bug has been fixed by twitch on 15.03.2016.
9 years ago
remitamine cf6cd07396 [noz] extract f4m and m3u8 formats 9 years ago
remitamine 975b9c9ab0 [brightcove:new] detect m3u8 manifests by M2TS container 9 years ago
remitamine 8ac73bdbe4 [brightcove:new] Add support for non numeric ref: preffixed video ids 9 years ago