be6dfd1b49
[ted] Return a single info_dict for talks urls
...
It failed with the --list-subs option
11 years ago
231516b6c9
Merge pull request #1705 from iemejia/master
...
[ted] support for subtitles
11 years ago
fb53d58dcf
Merge pull request #1726 from saper/escaped
...
Fix AssertionError when og property not found
11 years ago
f470c6c812
[arte] Improve the format sorting
...
Also use the bitrate.
Prefer normal version and sourds/mal version over original version with subtitles.
11 years ago
566d4e0425
[arte] Make sure the format_id is unique ( closes #1739 )
...
Include the bitrate and use the height instead of the quality field.
11 years ago
81be02d2f9
[cnn] Accept www.cnn.com urls ( fixes #1740 )
11 years ago
c2b6a482d5
[brightcove] the format function requires to specify the index in python2.6
11 years ago
12c167c881
[soundcloud] Allow to download tracks marked as not 'streamable'
...
They use the rtmp protocol but if the are marked as 'downloadable' it can use the direct download link.
11 years ago
20aafee7fa
[kankan] Fix the video url
...
It now requires two additional parameters, one is a timestamp we get from the getCdnresource_flv page and the other is a key we have to build.
11 years ago
dd5bcdc4c9
[brightcove] Set the 'Referer' header if the url has the 'linkBaseUrl' parameter ( fixes #1553 )
11 years ago
b1a80ec1a9
[xnxx] Accept urls that start with 'www' ( fixes #1734 )
11 years ago
51040b72ed
[brightcove] Support redirected urls from bcove.me ( fixes #1732 )
...
'bctid' needs to be changed to '@videoPlayer', and 'bckey' to 'playerKey'.
11 years ago
4f045eef8f
[youtube:channel] Fix the extraction
...
The page don't include the 'load more' button anymore, now we directly get the 'c4_browse_ajax' pages.
11 years ago
5d7b253ea0
Add an extractor for eitb.tv ( fixes #1608 )
...
The BrighcoveExperience object doesn't contain the video id, the extractor adds it and passes the url to BrightcoveIE.
11 years ago
b0759f0c19
[brightcove] Extract all the available formats
11 years ago
065472936a
Add an extractor for space.com ( fixes #1718 )
...
It uses Brightcove, but requires some special process for getting a url with the playerKey field in some videos
11 years ago
fc4a0c2aec
[brightcove] Change the 'videoId' or 'videoID' field to '@videoPlayer' ( fixes #1697 )
...
It seems to be needed when using the htmlFederated page
11 years ago
eeb165e674
[brightcove] Add the extraction of the url from generic
11 years ago
9ee2b5f6f2
tests: don't run the test if any of the extractors listed in the 'add_ie' field is marked as not working
11 years ago
5137ebac0b
[tvp] Telewizja Polska: new extractor for tvp.pl, fixes #1719
...
Thanks-To: mplonski
https://github.com/mplonski/linux/blob/master/tvp-dl.py
11 years ago
a8eeb0597b
Fix AssertionError when og property not found
...
On tvp.pl some webpages contain OpenGraph
metadata and some don't.
If og property is not found, _og_search_description
fails with
WARNING: unable to extract OpenGraph description; please report this issue on http://yt-dl.org/bug
Traceback (most recent call last):
File "/usr/home/saper/bin/youtube-dl", line 18, in <module>
youtube_dl.main()
File "/usr/home/saper/sw/youtube-dl/youtube_dl/__init__.py", line 766, in main
_real_main(argv)
File "/usr/home/saper/sw/youtube-dl/youtube_dl/__init__.py", line 719, in _real_main
retcode = ydl.download(all_urls)
File "/usr/home/saper/sw/youtube-dl/youtube_dl/YoutubeDL.py", line 715, in download
videos = self.extract_info(url)
File "/usr/home/saper/sw/youtube-dl/youtube_dl/YoutubeDL.py", line 348, in extract_info
ie_result = ie.extract(url)
File "/usr/home/saper/sw/youtube-dl/youtube_dl/extractor/common.py", line 125, in extract
return self._real_extract(url)
File "/usr/home/saper/sw/youtube-dl/youtube_dl/extractor/tvp.py", line 56, in _real_extract
info['description'] = self._og_search_description(webpage)
File "/usr/home/saper/sw/youtube-dl/youtube_dl/extractor/common.py", line 331, in _og_search_description
return self._og_search_property('description', html, fatal=False, **kargs)
File "/usr/home/saper/sw/youtube-dl/youtube_dl/extractor/common.py", line 325, in _og_search_property
return unescapeHTML(escaped)
File "/usr/home/saper/sw/youtube-dl/youtube_dl/utils.py", line 494, in unescapeHTML
assert type(s) == type(u'')
AssertionError
The patch allows me to use:
try:
info['description'] = self._og_search_description(webpage)
info['thumbnail'] = self._og_search_thumbnail(webpage)
except RegexNotFoundError:
pass
11 years ago
4ed3e51080
[ted] fixed error in case of no subtitles present
...
I created a test, but I leave it commented since TED videos get
new subtitles frequently.
11 years ago
2dcf7d8f99
[GenericIE] Also detect youtube if src url of iframe is embedded in ' instaed of "
11 years ago
19b0668251
[canal2c] Accept more urls ( fixes #1723 )
...
The url only needs to have the 'idVideo' field in the query, in any position.
We have to set the 'void=oui' in the webpage url, so that we get the file name.
11 years ago
e7e6b54d8a
[teamcoco] Parse the xml file and extract all the formats
11 years ago
2a1a8ffe41
Merge pull request #1693 from alexvh/teamcoco_fix
...
[teamcoco] Fix video url extraction for some videos
11 years ago
08fb86c49b
[youtube] Add description for YoutubeSearchDateIE ( #1710 )
11 years ago
3633d77c0f
Merge remote-tracking branch 'CBGoodBuddy/ytsearchtime'
11 years ago
12ebdd1506
[viddler] Support non-digit IDs ( Fixes #1714 )
11 years ago
1baf9a5938
Merge pull request #1698 from rzhxeo/cinemassacre
...
[CinemassacreIE] Support more embed urls
11 years ago
a56f9de156
Style fixes for extractors: remove spaces around (,),{ and }
11 years ago
fa5d47af4b
Merge pull request #1679 from rzhxeo/mofosex
...
Add support for http://www.mofosex.com
11 years ago
d607038753
Merge pull request #1677 from rzhxeo/xtube
...
Add support for http://www.xtube.com
11 years ago
9ac6a01aaf
Merge pull request #1676 from rzhxeo/extremetube
...
Add support for http://www.extremetube.com
11 years ago
9103bbc5cd
Add the 'webpage_url' field to info_dict
...
The url for the video page, it must allow to reproduce the result.
It's automatically set by YoutubeDL if it's missing.
11 years ago
a3dd924871
Add YoutubeSearchDateIE extractor to youtube.py & __init__.py, which searches by publication date.
11 years ago
137bbb3e37
[XTubeIE] Add description to TEST
11 years ago
86ad94bb2e
[ExtremeTubeIE] Set age_limit to 18 and fix uploader extraction
11 years ago
3e56add7c9
Merge pull request #1678 from rzhxeo/keezmovies
...
[KeezMoviesIE] Detect URLs with numbers in the SEO part correct
11 years ago
f52f01b5d2
[brightcove] Don't set the extension
...
If the video only has the 'FLVFullLengthURL' key, it can still be an mp4 file.
11 years ago
98d7efb537
[exfm] skip tests
...
The site is down too often.
11 years ago
cf51923545
[youtube] Remove vevo test
...
The video is no longer available and it seems that vevo video don't use encrypted signatures anymore.
11 years ago
38fcd4597a
Merge remote-tracking branch 'iemejia/master'
11 years ago
165e3bb67a
[bambuser] Add an extractor for channels ( closes #1702 )
11 years ago
38db46794f
Merge branch 'ted_subtitles'
11 years ago
a9a3876d55
[ted] Added support for subtitle download
11 years ago
1f343eaabb
[subtitles] refactor to support websites with subtitle information the
...
webpage.
I added the parameter webpage, so now it's similar to the way automatic
captions are handled. This is an improvement needed for websites like
TED.
11 years ago
72a5b4f702
Add an extractor for bambuser.com ( #1702 )
11 years ago
0a43ddf320
[CinemassacreIE] Add live paramter to extracted info as a workaround
11 years ago
8eddf3e91d
[youtube] Encode subtitle track name in request ( Fixes #1700 )
11 years ago
60d142aa8d
Add an extractor for vk.com ( closes #1635 )
11 years ago
66cf3ac342
[metacafe] Fix support for age-restricted videos ( fixes #1696 )
...
The 'Content-Type' header must be set for disabling the family filter.
The 'flashversion' cookie is only needed for AnyClip videos.
Added tests for standard metacafe videos and for age-restricted videos.
Also set the 'age_limit' field.
11 years ago
ab4e151347
[CinemassacreIE] Support more embed urls
11 years ago
ac2547f5ff
[teamcoco] Fix video url extraction for some videos
...
Video url extraction failed for some videos,
e.g. http://teamcoco.com/video/old-time-baseball
The url extracted was also occasionally suboptimal quality,
e.g. http://teamcoco.com/video/louis-ck-interview-george-w-bush
11 years ago
5f1ea943ab
[livestream] fix the extraction of events
...
It now uses a json dictionary from the webpage.
11 years ago
9f1109a564
[dailymotion] Fix support for age-restricted videos ( Fixes #1688 )
11 years ago
72321ead7b
[vevo] Readd support for SMIL ( Fixes #1683 )
11 years ago
b5d0d817bc
Remove superfluous space
11 years ago
b9a836515f
Update the Vimeo test vector md5
...
confirmed that this is indeed the first 10241 (we went off by one with
byte range 0-10240) of the full, playing mp4, so they probably
reencoded or something
11 years ago
21c924f406
[arte] Download the 'Originalversion' version if it's the only one available ( fixes #1682 )
11 years ago
e54fd4b23b
[vevo] Add more format details
11 years ago
912cbf5d4e
[vevo] Fix timestamp handling
...
( / 1000 is implicit float division )
11 years ago
f7ff55aa78
Merge remote-tracking branch 'origin/master'
11 years ago
795f28f871
[youtube] Fix login ( Fixes #1681 )
11 years ago
321a01f971
[mtv] Remove the templates from the mediagen url
11 years ago
2563bcc85c
Add an extractor for MySpace ( closes #1666 )
11 years ago
dcc2a706ef
Add support for http://www.xtube.com
11 years ago
2bc67c35ac
[KeezMoviesIE] Detect URLs with numbers in the SEO part correct
11 years ago
77ae65877e
Add support for http://www.mofosex.com
11 years ago
32a35e4418
Add support for http://www.extremetube.com
11 years ago
1003d108d5
[vimeo] Support hash in URL ( Fixes #1669 )
11 years ago
c1002e96e9
Let extractors omit ext in formats
11 years ago
77d0a82fef
[addanime] Use new formats system
11 years ago
ebc14f251c
Merge remote-tracking branch 'origin/master'
11 years ago
d41e6efc85
New debug option --write-pages
11 years ago
8ffa13e03e
[Instagram] get the non-https link, as they are serving Akamai cert from a instagram.com domain
11 years ago
750e9833b8
Add the missing age_limit tags; added a devscript to do a superficial check for porn sites without the age_limit tag in the test
11 years ago
82f0ac657c
Merge pull request #1657 by @rzhxeo
...
[YouPornIE] Extract all encrypted links and remove doubles at the end
11 years ago
eb6a2277a2
Merge pull request #1659 by @rzhxeo
...
Add support for http://www.tube8.com
11 years ago
f8778fb0fa
Merge pull request #1663 by @rzhxeo
...
Add support for http://www.spankwire.com
11 years ago
e2f9de207c
Merge pull request #1664 by @rzhxeo
...
Add support for http://www.keezmovies.com
11 years ago
a93cc0d943
Merge pull request #1661 by @rzhxeo
...
Add support for http://www.pornhub.com
11 years ago
7d8c2e07f2
[Exfm] replace the failing Soundcloud test vector (broken also in browser)
11 years ago
efb4c36b18
Merge pull request #1660 from pyed/master
...
[addanime] try to download HQ before normal
11 years ago
29526d0d2b
Merge pull request #1656 from rzhxeo/xhamster
...
[XHamsterIE] Extract SD and HD video
11 years ago
198e370f23
[addanime] better regex.
11 years ago
c19f7764a5
[generic] Detect bandcamp pages that use custom domains ( closes #1662 )
...
They embed the original url in the 'og:url' property.
11 years ago
bc63d9d329
[rtlnow] Change the test for rtlnitronow
11 years ago
aa929c37d5
[generic] Fix test video's checksum
11 years ago
af4d506eb3
[faz] Use a regex for getting the description
...
The page cannot be parsed in python2.6 with the html parser.
11 years ago
5da0549581
[KeezMoviesIE] Correct return value for embedded videos
11 years ago
749a4fd2fd
[facebook] Don't recommend to report the issue if the video is private.
11 years ago
6f71ef580c
[facebook] Report a more meaningful message if the video cannot be accessed ( closes #1658 )
11 years ago
67874aeffa
[facebook] Fix the login process ( fixes #1244 )
11 years ago
3e6a330d38
[addanime] fix md5sum
11 years ago
aee5e18c8f
[addanime] catch 'RegexNotFoundError'
11 years ago
5b11143d05
Add support for http://www.keezmovies.com
11 years ago
7b2212e954
Add support for http://www.spankwire.com
11 years ago
71865091ab
[Tube8IE] Fix regex for uploader extraction
11 years ago
125cfd78e8
Add support for http://www.pornhub.com
11 years ago
8cb57d9b91
[Tube8IE] Escape dot in regex
11 years ago
14e10b2b6e
[addanime] try to download HQ before normal
11 years ago
6e76104d66
[YouPornIE] Make webpage download more robust
11 years ago
1d45a23b74
Add support for http://www.tube8.com
11 years ago
7df286540f
[YouPornIE] Extract all encrypted links and remove doubles at the end
11 years ago
5d0c97541a
[XHamsterIE] Extract SD and HD video
11 years ago
49a25557b0
[8tracks] Use track count instead of looking at at_last_track property
...
This fixes the error:
$ youtube-dl http://8tracks.com/vladmc/counting-stars
[8tracks] counting-stars: Downloading webpage
[8tracks] counting-stars: Downloading song information 1/4
[8tracks] counting-stars: Downloading song information 2/4
[8tracks] counting-stars: Downloading song information 3/4
[8tracks] counting-stars: Downloading song information 4/4
[8tracks] counting-stars: Downloading song information 5/4
Traceback (most recent call last):
File "/usr/lib/python2.7/runpy.py", line 162, in _run_module_as_main
"__main__", fname, loader, pkg_name)
File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
exec code in run_globals
File "/home/phihag/projects/youtube-dl/youtube_dl/__main__.py", line 18, in <module>
youtube_dl.main()
File "/home/phihag/projects/youtube-dl/youtube_dl/__init__.py", line 761, in main
_real_main(argv)
File "/home/phihag/projects/youtube-dl/youtube_dl/__init__.py", line 714, in _real_main
retcode = ydl.download(all_urls)
File "/home/phihag/projects/youtube-dl/youtube_dl/YoutubeDL.py", line 701, in download
videos = self.extract_info(url)
File "/home/phihag/projects/youtube-dl/youtube_dl/YoutubeDL.py", line 342, in extract_info
ie_result = ie.extract(url)
File "/home/phihag/projects/youtube-dl/youtube_dl/extractor/common.py", line 121, in extract
return self._real_extract(url)
File "/home/phihag/projects/youtube-dl/youtube_dl/extractor/eighttracks.py", line 111, in _real_extract
'id': track_data['id'],
KeyError: 'id'
11 years ago
600cc1a4f0
[youtube] Set the format_id field to the itag of the format ( closes #1624 )
11 years ago
ea32fbacc8
Fix the extensions of two tests with youtube videos
...
The best quality is now a mp4 video.
11 years ago
00fe14fc75
[youtube] Also use the 'adaptative_fmts' field from the /get_video_info page ( fixes #1649 )
...
The 'adaptative_fmts' field from the video page is not added to the 'url_encoded_fmt_stream_map'
11 years ago
fcc28edb2f
[cinemassacre] Simplify
...
* Remove some rtmp parameters that are not needed.
* Remove the md5 checksums, the video is not downloaded.
* Remove the code used before the current format system.
11 years ago
fac6be2dd5
Merge pull request #1632 from rzhxeo/cinemassacre
...
[Cinemassacre] Download video that is shown in flash player
11 years ago
cdec0190c4
[dailymotion] Extract all the available formats ( closes #1028 )
11 years ago
2450bcb28b
[nowvideo] Fix key extraction
...
Extract it from the embed page
11 years ago
93b22c7828
[vimeo] fix the extraction for videos protected with password
...
Added a test video.
11 years ago
55b3e45bba
[vimeo] Fix pro videos and player.vimeo.com urls
...
The old process can still be used for those videos.
Added RegexNotFoundError, which is raised by _search_regex if it can't extract the info.
11 years ago
365bcf6d97
Merge remote-tracking branch 'origin/master'
11 years ago
71907db3ba
[vimeo] Fix normal videos ( Fixes #1642 )
...
Vimeo Pro Videos are still broken
11 years ago
6803655ced
Merge pull request #1622 from rbrito/fix-extension
...
extractor: youtube: Set extension of AAC audio formats to m4a.
11 years ago
b028e96144
[arte.tv:creative] Update the title of the test
11 years ago
ce68b5907c
[nhl:videocenter] Fix playlist title extraction
11 years ago
a6387bfd3c
[vimeo] Implement the new format selection system (closes PR #996 )
...
Rebased and deleted some parts to use the new system instead of copying the one from YoutubeIE
11 years ago
f6a54188c2
[youtube] Use 'node is None' when checking if the video has automatic captions
...
It had stopped working and it reports a FutureWarning
11 years ago
cbbd9a9c69
Fix the duration field for the VideoDetective and InternetVideoArchive tests
...
Also remove the use of the old format system and the comment
11 years ago
685a9cd2f1
[googleplus] Fix upload_date extraction
11 years ago
182a107877
[arte] Set the format_note and the format_id fields ( closes #1628 )
11 years ago
8c51aa6506
The 'format' field now defaults to '{format_id} - {width}x{height}{format_note}'
...
Following the YoutubeIE format. The 'format_note' gives additional info about the format, for example '3D' or 'DASH video'.
11 years ago
f8b45beacc
Merge remote-tracking branch 'rbrito/set-age'
...
Conflicts:
youtube_dl/extractor/xhamster.py
11 years ago
9d92015d43
[xhamster] Add support for age_limit (Instead of #1627 )
11 years ago
50a6150ed9
extractor: Set age limit on some adult-related extractors.
...
More age limit of videos for adult-related sites.
Note that, for redtube, I explicitly left the variable containing the age
limit, since the comment justifying the age limit is a good thing to have.
That being said, I included the age limit field on the test, to better
reflect what the information extractor does (even if it may not break the
automated tests).
Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
11 years ago
b0505eb611
[CinemassacreIE] Fix information extraction
11 years ago
8ed6b34477
extractor: Set age limit on some adult-related extractors.
...
This is similar in spirit to what was done in commit 8e590a117f
11 years ago
f6f1fc9286
extractor: youtube: Fix extension of dash formats.
...
While we are at it, separate the audio formats from the video formats.
Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
11 years ago
8e590a117f
[xnxx] Add age_limit
11 years ago
16f36a6fc9
extractor: youtube: Set extension of AAC audio formats to m4a.
...
This, in particular, eases downloading both audio and videos in DASH formats
before muxing them, which alleviates the problem that I exposed on issue
Furthermore, one may argue that this is, indeed, the case for correctness's
sake.
Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
11 years ago
53c1d3ef49
Check for embedded YouTube player ( Fixes #1616 )
11 years ago
7c58ef3275
[tudou] Fix title regex ( Fixes #1614 )
11 years ago
416a5efce7
fix typos
11 years ago
d21ab29200
Add an extractor for techtalks.tv ( closes #1606 )
11 years ago
a733eb6c53
[youtube] Do not crash if caption info is missing altogether ( Fixes #1610 )
11 years ago
591454798d
[brightcove] Raise error if playlist is empty ( #1608 )
11 years ago
38604f1a4f
Merge remote-tracking branch 'origin/master'
11 years ago
2d0efe70a6
[brightcove] Fix more broken XML ( #1608 )
11 years ago
bfd14b1b2f
Add an extractor for rutube.ru ( closes #1136 )
...
It downloads with a m3u8 manifest, requires ffmpeg.
11 years ago
10eaae48ff
Merge branch 'master' of github.com:rg3/youtube-dl
11 years ago
9d4660cab1
[generic] Support embedded vimeo videos ( #1602 )
11 years ago
9d74e308f7
[sztvhu] Fix the title extraction
11 years ago
8381a92120
[websurg] Skipt the test
...
It needs login information.
11 years ago
4f41664de8
Merge remote-tracking branch 'Rudloff/websurg'
11 years ago
7cf67fbe29
[sztvhu] Simplify
11 years ago
Jaime Marquínez Ferrándiz