Commit Graph

841 Commits (b5349e8721d0580a50519593926726a2ea832c9b)

Author SHA1 Message Date
Filippo Valsorda 82f0ac657c Merge pull request #1657 by @rzhxeo
[YouPornIE] Extract all encrypted links and remove doubles at the end
11 years ago
Filippo Valsorda eb6a2277a2 Merge pull request #1659 by @rzhxeo
Add support for http://www.tube8.com
11 years ago
Filippo Valsorda f8778fb0fa Merge pull request #1663 by @rzhxeo
Add support for http://www.spankwire.com
11 years ago
Filippo Valsorda e2f9de207c Merge pull request #1664 by @rzhxeo
Add support for http://www.keezmovies.com
11 years ago
Filippo Valsorda a93cc0d943 Merge pull request #1661 by @rzhxeo
Add support for http://www.pornhub.com
11 years ago
Filippo Valsorda 7d8c2e07f2 [Exfm] replace the failing Soundcloud test vector (broken also in browser) 11 years ago
Filippo Valsorda efb4c36b18 Merge pull request #1660 from pyed/master
[addanime] try to download HQ before normal
11 years ago
Jaime Marquínez Ferrándiz 29526d0d2b Merge pull request #1656 from rzhxeo/xhamster
[XHamsterIE] Extract SD and HD video
11 years ago
Abdulelah Alfntokh 198e370f23 [addanime] better regex. 11 years ago
Jaime Marquínez Ferrándiz c19f7764a5 [generic] Detect bandcamp pages that use custom domains (closes #1662)
They embed the original url in the 'og:url' property.
11 years ago
Jaime Marquínez Ferrándiz bc63d9d329 [rtlnow] Change the test for rtlnitronow 11 years ago
Jaime Marquínez Ferrándiz aa929c37d5 [generic] Fix test video's checksum 11 years ago
Jaime Marquínez Ferrándiz af4d506eb3 [faz] Use a regex for getting the description
The page cannot be parsed in python2.6 with the html parser.
11 years ago
rzhxeo 5da0549581 [KeezMoviesIE] Correct return value for embedded videos 11 years ago
Jaime Marquínez Ferrándiz 749a4fd2fd [facebook] Don't recommend to report the issue if the video is private. 11 years ago
Jaime Marquínez Ferrándiz 6f71ef580c [facebook] Report a more meaningful message if the video cannot be accessed (closes #1658) 11 years ago
Jaime Marquínez Ferrándiz 67874aeffa [facebook] Fix the login process (fixes #1244) 11 years ago
Abdulelah Alfntokh 3e6a330d38 [addanime] fix md5sum 11 years ago
Abdulelah Alfntokh aee5e18c8f [addanime] catch 'RegexNotFoundError' 11 years ago
rzhxeo 5b11143d05 Add support for http://www.keezmovies.com 11 years ago
rzhxeo 7b2212e954 Add support for http://www.spankwire.com 11 years ago
rzhxeo 71865091ab [Tube8IE] Fix regex for uploader extraction 11 years ago
rzhxeo 125cfd78e8 Add support for http://www.pornhub.com 11 years ago
rzhxeo 8cb57d9b91 [Tube8IE] Escape dot in regex 11 years ago
pyed 14e10b2b6e [addanime] try to download HQ before normal 11 years ago
rzhxeo 6e76104d66 [YouPornIE] Make webpage download more robust 11 years ago
rzhxeo 1d45a23b74 Add support for http://www.tube8.com 11 years ago
rzhxeo 7df286540f [YouPornIE] Extract all encrypted links and remove doubles at the end 11 years ago
rzhxeo 5d0c97541a [XHamsterIE] Extract SD and HD video 11 years ago
Philipp Hagemeister 49a25557b0 [8tracks] Use track count instead of looking at at_last_track property
This fixes the error:

$ youtube-dl http://8tracks.com/vladmc/counting-stars
[8tracks] counting-stars: Downloading webpage
[8tracks] counting-stars: Downloading song information 1/4
[8tracks] counting-stars: Downloading song information 2/4
[8tracks] counting-stars: Downloading song information 3/4
[8tracks] counting-stars: Downloading song information 4/4
[8tracks] counting-stars: Downloading song information 5/4
Traceback (most recent call last):
  File "/usr/lib/python2.7/runpy.py", line 162, in _run_module_as_main
    "__main__", fname, loader, pkg_name)
  File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
    exec code in run_globals
  File "/home/phihag/projects/youtube-dl/youtube_dl/__main__.py", line 18, in <module>
    youtube_dl.main()
  File "/home/phihag/projects/youtube-dl/youtube_dl/__init__.py", line 761, in main
    _real_main(argv)
  File "/home/phihag/projects/youtube-dl/youtube_dl/__init__.py", line 714, in _real_main
    retcode = ydl.download(all_urls)
  File "/home/phihag/projects/youtube-dl/youtube_dl/YoutubeDL.py", line 701, in download
    videos = self.extract_info(url)
  File "/home/phihag/projects/youtube-dl/youtube_dl/YoutubeDL.py", line 342, in extract_info
    ie_result = ie.extract(url)
  File "/home/phihag/projects/youtube-dl/youtube_dl/extractor/common.py", line 121, in extract
    return self._real_extract(url)
  File "/home/phihag/projects/youtube-dl/youtube_dl/extractor/eighttracks.py", line 111, in _real_extract
    'id': track_data['id'],
KeyError: 'id'
11 years ago
Jaime Marquínez Ferrándiz 600cc1a4f0 [youtube] Set the format_id field to the itag of the format (closes #1624) 11 years ago
Jaime Marquínez Ferrándiz ea32fbacc8 Fix the extensions of two tests with youtube videos
The best quality is now a mp4 video.
11 years ago
Jaime Marquínez Ferrándiz 00fe14fc75 [youtube] Also use the 'adaptative_fmts' field from the /get_video_info page (fixes #1649)
The 'adaptative_fmts' field from the video page is not added to the 'url_encoded_fmt_stream_map'
11 years ago
Jaime Marquínez Ferrándiz fcc28edb2f [cinemassacre] Simplify
* Remove some rtmp parameters that are not needed.
* Remove the md5 checksums, the video is not downloaded.
* Remove the code used before the current format system.
11 years ago
Jaime Marquínez Ferrándiz fac6be2dd5 Merge pull request #1632 from rzhxeo/cinemassacre
[Cinemassacre] Download video that is shown in flash player
11 years ago
Jaime Marquínez Ferrándiz cdec0190c4 [dailymotion] Extract all the available formats (closes #1028) 11 years ago
Jaime Marquínez Ferrándiz 2450bcb28b [nowvideo] Fix key extraction
Extract it from the embed page
11 years ago
Jaime Marquínez Ferrándiz 93b22c7828 [vimeo] fix the extraction for videos protected with password
Added a test video.
11 years ago
Jaime Marquínez Ferrándiz 55b3e45bba [vimeo] Fix pro videos and player.vimeo.com urls
The old process can still be used for those videos.
Added RegexNotFoundError, which is raised by _search_regex if it can't extract the info.
11 years ago
Philipp Hagemeister 365bcf6d97 Merge remote-tracking branch 'origin/master' 11 years ago
Philipp Hagemeister 71907db3ba [vimeo] Fix normal videos (Fixes #1642)
Vimeo Pro Videos are still broken
11 years ago
Philipp Hagemeister 6803655ced Merge pull request #1622 from rbrito/fix-extension
extractor: youtube: Set extension of AAC audio formats to m4a.
11 years ago
Jaime Marquínez Ferrándiz b028e96144 [arte.tv:creative] Update the title of the test 11 years ago
Jaime Marquínez Ferrándiz ce68b5907c [nhl:videocenter] Fix playlist title extraction 11 years ago
Joshua Elsasser a6387bfd3c [vimeo] Implement the new format selection system (closes PR #996)
Rebased and deleted some parts to use the new system instead of copying the one from YoutubeIE
11 years ago
Jaime Marquínez Ferrándiz f6a54188c2 [youtube] Use 'node is None' when checking if the video has automatic captions
It had stopped working and it reports a FutureWarning
11 years ago
Jaime Marquínez Ferrándiz cbbd9a9c69 Fix the duration field for the VideoDetective and InternetVideoArchive tests
Also remove the use of the old format system and the comment
11 years ago
Jaime Marquínez Ferrándiz 685a9cd2f1 [googleplus] Fix upload_date extraction 11 years ago
Jaime Marquínez Ferrándiz 182a107877 [arte] Set the format_note and the format_id fields (closes #1628) 11 years ago
Jaime Marquínez Ferrándiz 8c51aa6506 The 'format' field now defaults to '{format_id} - {width}x{height}{format_note}'
Following the YoutubeIE format. The 'format_note' gives additional info about the format, for example '3D' or 'DASH video'.
11 years ago
Philipp Hagemeister f8b45beacc Merge remote-tracking branch 'rbrito/set-age'
Conflicts:
	youtube_dl/extractor/xhamster.py
11 years ago
Philipp Hagemeister 9d92015d43 [xhamster] Add support for age_limit (Instead of #1627) 11 years ago
Rogério Brito 50a6150ed9 extractor: Set age limit on some adult-related extractors.
More age limit of videos for adult-related sites.

Note that, for redtube, I explicitly left the variable containing the age
limit, since the comment justifying the age limit is a good thing to have.

That being said, I included the age limit field on the test, to better
reflect what the information extractor does (even if it may not break the
automated tests).

Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
11 years ago
rzhxeo b0505eb611 [CinemassacreIE] Fix information extraction 11 years ago
Rogério Brito 8ed6b34477 extractor: Set age limit on some adult-related extractors.
This is similar in spirit to what was done in commit 8e590a117f.

Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
11 years ago
Rogério Brito f6f1fc9286 extractor: youtube: Fix extension of dash formats.
While we are at it, separate the audio formats from the video formats.

Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
11 years ago
Philipp Hagemeister 8e590a117f [xnxx] Add age_limit 11 years ago
Rogério Brito 16f36a6fc9 extractor: youtube: Set extension of AAC audio formats to m4a.
This, in particular, eases downloading both audio and videos in DASH formats
before muxing them, which alleviates the problem that I exposed on issue

Furthermore, one may argue that this is, indeed, the case for correctness's
sake.

Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
11 years ago
Philipp Hagemeister 53c1d3ef49 Check for embedded YouTube player (Fixes #1616) 11 years ago
Philipp Hagemeister 7c58ef3275 [tudou] Fix title regex (Fixes #1614) 11 years ago
Philipp Hagemeister 416a5efce7 fix typos 11 years ago
Jaime Marquínez Ferrándiz d21ab29200 Add an extractor for techtalks.tv (closes #1606) 11 years ago
Philipp Hagemeister a733eb6c53 [youtube] Do not crash if caption info is missing altogether (Fixes #1610) 11 years ago
Philipp Hagemeister 591454798d [brightcove] Raise error if playlist is empty (#1608) 11 years ago
Philipp Hagemeister 38604f1a4f Merge remote-tracking branch 'origin/master' 11 years ago
Philipp Hagemeister 2d0efe70a6 [brightcove] Fix more broken XML (#1608) 11 years ago
Jaime Marquínez Ferrándiz bfd14b1b2f Add an extractor for rutube.ru (closes #1136)
It downloads with a m3u8 manifest, requires ffmpeg.
11 years ago
Philipp Hagemeister 10eaae48ff Merge branch 'master' of github.com:rg3/youtube-dl 11 years ago
Philipp Hagemeister 9d4660cab1 [generic] Support embedded vimeo videos (#1602) 11 years ago
Jaime Marquínez Ferrándiz 9d74e308f7 [sztvhu] Fix the title extraction 11 years ago
Jaime Marquínez Ferrándiz 8381a92120 [websurg] Skipt the test
It needs login information.
11 years ago
Philipp Hagemeister 4f41664de8 Merge remote-tracking branch 'Rudloff/websurg' 11 years ago
Philipp Hagemeister 7cf67fbe29 [sztvhu] Simplify 11 years ago
Philipp Hagemeister 3ddf1a6d01 Merge remote-tracking branch 'Elbandi/master' 11 years ago
Philipp Hagemeister 850555c484 Merge remote-tracking branch 'origin/master' 11 years ago
Philipp Hagemeister 9ed3bdc64d [tudou] Add support for youku links (Closes #1571) 11 years ago
Jaime Marquínez Ferrándiz c45aa56080 [gamespot] Fix video extraction (fixes #1587) 11 years ago
Philipp Hagemeister 7394b8db3b Merge remote-tracking branch 'origin/master' 11 years ago
Andras Elso f9b3d7af47 Add an extractor for Szombathelyi TV 11 years ago
Filippo Valsorda ea62a2da46 add VideoPremium.tv RTMP support 11 years ago
Jai Grimshaw 1fb07d10a3 [youtube] Adds #1312 Download annotations
Adds #1321 Download annotations from youtube
Annotations are downloaded and written to a .annotations.xml file using the https://www.youtube.com/annotations_invideo?features=1&legacy=1&video_id=$VIDEOID API.
Added unit test for annotations.
11 years ago
Philipp Hagemeister 9378ae6e1d [youku] Allow shortcut youku:ID and make non-matching groups non-matching (#1571) 11 years ago
Jaime Marquínez Ferrándiz 69a0c470b5 [arte] Add an extractor for future.arte.tv (closes #1593) 11 years ago
Jaime Marquínez Ferrándiz c40f5cf45c [arte] add an extractor for creative.arte.tv (#1593)
The +7 videos now use an independent extractor that is also used for the creative videos
11 years ago
Jaime Marquínez Ferrándiz 4b7b839f24 Add an extractor for rottentomatoes.com and improve InternetVideoArchiveIE to get the best quality 11 years ago
Jaime Marquínez Ferrándiz 3d60d33773 Add an extractor for videodetective.com (closes #262)
It uses the internetvideoarchive.com platform.
11 years ago
Jaime Marquínez Ferrándiz d7e66d39a0 Add an extractor for internetvideoarchive.com videos
It's used by videodetective.com
11 years ago
Filippo Valsorda f5e54a1fda add support for NowVideo.ch 11 years ago
Joey Adams 3283533149 Fix Brightcove detection when another Flash object is on the page
The regex used non-greedy match, but alas it failed on input like this:

    <object class="...> ... class="BrightcoveExperience"

It captured two objects and the intervening HTML.  This commit fixes this by
not allowing a ">" to appear before BrightcoveExperience.

Video in question: http://www.harpercollinschildrens.com/feature/petethecat/
11 years ago
Jaime Marquínez Ferrándiz 8032e31f2d Merge pull request #1558 from rzhxeo/cinemassacre
Add support for http://cinemassacre.com
11 years ago
Jaime Marquínez Ferrándiz d2f9cdb205 Merge branch 'cinemassacre' of github.com:rzhxeo/youtube-dl into rzhxeo-cinemassacre 11 years ago
Jaime Marquínez Ferrándiz 3823342d9d [arte] Prepare for generic format support (#980) 11 years ago
Jaime Marquínez Ferrándiz 91dbaef406 [nhl] Add an extractor for videocenter's categories (#1586)
It downloads the last 12 videos.
11 years ago
Jaime Marquínez Ferrándiz cb354c8f62 [yahoo] Download the info from another page
The 'meta' field is not always in the video webpage
11 years ago
Jaime Marquínez Ferrándiz 1cbb27b151 [gamespot] Mark as broken (#1587) 11 years ago
Jaime Marquínez Ferrándiz 0ab4ff6378 [mtv] Strip the description
There were some tabs and newlines added around the string.
11 years ago
Jaime Marquínez Ferrándiz 63da13e829 Add an extractor for faz.net (closes #1582) 11 years ago
Jaime Marquínez Ferrándiz 2e1fa03bf5 Add an extractor for video.nhl.com (closes #1586) 11 years ago
Philipp Hagemeister 57da92b7df [youtube] Do not recognize attribution link as user (Fixes #1573) 11 years ago
Jaime Marquínez Ferrándiz a34c2faae4 [youtube] set the 'name' parameter in the subtitles url (fixes #1577) 11 years ago
Jaime Marquínez Ferrándiz 88bd97e34c [vevo] Some improvements (fixes #1580)
Extract the info from http://videoplayer.vevo.com/VideoService/AuthenticateVideo?isrc={id}
Some videos don't have an smil manifest, extract the video urls directly from the json and use the last version of the video.
Extract all the available formats and set the 'formats' field of the result
11 years ago
Philipp Hagemeister faa6ef6bc8 [jeuxvideo] Improve code quality (fixes #1567) 11 years ago
Philipp Hagemeister 15870e90b0 Restore warning when user forgets to quote URL (#1396) 11 years ago
Jaime Marquínez Ferrándiz 387ae5f30b [vimeo] Recognize urls ending in a slash (fixes #1242) 11 years ago
Philipp Hagemeister 1310bf2474 [redtube] add age_limit 11 years ago
Philipp Hagemeister 2a69c6b879 Merge branch 'age_limit' 11 years ago
Philipp Hagemeister cfadd183c4 Call extracted property age_limit everywhere 11 years ago
Philipp Hagemeister e484c81f0c [generic] Clarify error messages 11 years ago
Philipp Hagemeister 41e8bca4d0 [viddler] Add basic support (Fixes #1520) 11 years ago
Philipp Hagemeister 8dbe9899a9 Allow users to specify an age limit (fixes #1545)
With these changes, users can now restrict what videos are downloaded by the intented audience, by specifying their age with --age-limit YEARS .
Add rudimentary support in youtube, pornotube, and youporn.
11 years ago
Philipp Hagemeister e94b783c74 [googleplus] Fix upload_date detection 11 years ago
Philipp Hagemeister 97dae9ae07 [bliptv] Make sure video ID is a string 11 years ago
rzhxeo ca215e0a4f [CinemassacreIE] Use MD5 to check in TEST description 11 years ago
rzhxeo 91a26ca559 [CinemassacreIE] Remove docstring from class 11 years ago
rzhxeo 1ece880d7c [CinemassacreIE] Add support for other embed methods 11 years ago
rzhxeo 400afddaf4 Add CinemassacreIE 11 years ago
Jaime Marquínez Ferrándiz c3fef636b5 [dailymotion] Fix playlist extraction
The html code has changed, make the video ids extraction more solid.
11 years ago
Philipp Hagemeister 46e28a84ca [brightcove] Fix up some broken HTML (#1553) 11 years ago
Philipp Hagemeister 17ad2b3fb1 [yahoo] Switch ext of test 11 years ago
Philipp Hagemeister 5e2a60db4a [yahoo] Fix test title 11 years ago
Philipp Hagemeister cd214418f6 [redtube] pep8 11 years ago
Philipp Hagemeister ba2d9f213e [jeuxvideo] fix video file md5sum 11 years ago
Philipp Hagemeister 7f8ae73a5d Include length in player cache ID
Some videos use the same player with IDs of multiple lengths.
See https://travis-ci.org/rg3/youtube-dl/jobs/12126506#L319 for an example.
11 years ago
Philipp Hagemeister 466880f531 [yahoo] Do not try to run rtmpdump on travis 11 years ago
Philipp Hagemeister 9f1f6d2437 [rtlnow] Skip test on travis 11 years ago
Philipp Hagemeister 9e0f897f6b [francetv] Use common format for ID of generation-quoi subextractor 11 years ago
Philipp Hagemeister c0f6aa876f Merge remote-tracking branch 'origin/master' 11 years ago
Philipp Hagemeister d93bdee9a6 [comedycentral] Prepare for generic video extraction (#980) 11 years ago
Philipp Hagemeister f13d09332d [mtv] Prepare for #980 11 years ago
Philipp Hagemeister 2f5865cc6d Clarify that url and ext are optional when formats is given (#980) 11 years ago
Philipp Hagemeister deefc05b88 Document formats (for #980) 11 years ago
Philipp Hagemeister 0d8cb1cc14 [ted] Prepare #980 merge 11 years ago
rzhxeo 829493439a [FlickrIE] Fix HTTPS url 11 years ago
Pierre Rudloff 73b4fafd82 Use self._download_webpage everywhere 11 years ago
Pierre Rudloff b039775057 Unused variable 11 years ago
Pierre Rudloff 5c1d63b737 Changes suggested by @phihag 11 years ago
Philipp Hagemeister 3cd022f6e6 Merge remote-tracking branch 'rzhxeo/rtl_ntv' 11 years ago
Philipp Hagemeister abefd1f7c4 Merge remote-tracking branch 'rzhxeo/rtl_upload_date' 11 years ago
Philipp Hagemeister c21315f273 [youtube] new static 82 signature 11 years ago
Philipp Hagemeister da0a5d2d6e [france2] Add support for URLs without video IDs (Fixes #1547) 11 years ago
Jaime Marquínez Ferrándiz ee6adb166c [ign] Support more urls and detect multiple videos in articles (fixes #1543) 11 years ago
Philipp Hagemeister c38b1e776d [youtube] Simplify cache_dir code (#1529) 11 years ago
Philipp Hagemeister 4f8bf17f23 Merge remote-tracking branch 'holomorph/master' 11 years ago
Philipp Hagemeister ca40186c75 [youtube] Fix static 82 signature (Closes #1539) 11 years ago
Philipp Hagemeister a8c6b24155 [youtube] Support videos without a title (Fixes #1391, Closes #1542) 11 years ago
Filippo Valsorda bd8e5c7ca2 Merge pull request #1531 from rg3/no-playlist
[youtube] implement --no-playlist to only download current video
11 years ago
Filippo Valsorda 7c61bd36bb [youtube] correct --no-playlist for python3 11 years ago
Jaime Marquínez Ferrándiz c54283824c [dailymotion] Detect vevo videos (fixes #1532)
All videos from the Vevo user, just embed videos from vevo.com
11 years ago
Philipp Hagemeister 44d466559e Properly handle stream meap not being present 11 years ago
Philipp Hagemeister f10503db67 Handle videos without url_encoded_fmt_stream_map (Fixes #1535) 11 years ago