Commit Graph

836 Commits (78fb87b2837e15124b5855734a951598dfe025fe)

Author SHA1 Message Date
Jaime Marquínez Ferrándiz d607038753 Merge pull request #1677 from rzhxeo/xtube
Add support for http://www.xtube.com
11 years ago
Jaime Marquínez Ferrándiz 9ac6a01aaf Merge pull request #1676 from rzhxeo/extremetube
Add support for http://www.extremetube.com
11 years ago
Jaime Marquínez Ferrándiz 9103bbc5cd Add the 'webpage_url' field to info_dict
The url for the video page, it must allow to reproduce the result.
It's automatically set by YoutubeDL if it's missing.
11 years ago
Craig Markwardt a3dd924871 Add YoutubeSearchDateIE extractor to youtube.py & __init__.py, which searches by publication date. 11 years ago
rzhxeo 137bbb3e37 [XTubeIE] Add description to TEST 11 years ago
rzhxeo 86ad94bb2e [ExtremeTubeIE] Set age_limit to 18 and fix uploader extraction 11 years ago
Jaime Marquínez Ferrándiz 3e56add7c9 Merge pull request #1678 from rzhxeo/keezmovies
[KeezMoviesIE] Detect URLs with numbers in the SEO part correct
11 years ago
Jaime Marquínez Ferrándiz f52f01b5d2 [brightcove] Don't set the extension
If the video only has the 'FLVFullLengthURL' key, it can still be an mp4 file.
11 years ago
Jaime Marquínez Ferrándiz 98d7efb537 [exfm] skip tests
The site is down too often.
11 years ago
Jaime Marquínez Ferrándiz cf51923545 [youtube] Remove vevo test
The video is no longer available and it seems that vevo video don't use encrypted signatures anymore.
11 years ago
Ismaël Mejía 38fcd4597a Merge remote-tracking branch 'iemejia/master' 11 years ago
Jaime Marquínez Ferrándiz 165e3bb67a [bambuser] Add an extractor for channels (closes #1702) 11 years ago
Ismaël Mejía 38db46794f Merge branch 'ted_subtitles' 11 years ago
Ismaël Mejía a9a3876d55 [ted] Added support for subtitle download 11 years ago
Ismaël Mejía 1f343eaabb [subtitles] refactor to support websites with subtitle information the
webpage.

I added the parameter webpage, so now it's similar to the way automatic
captions are handled. This is an improvement needed for websites like
TED.
11 years ago
Jaime Marquínez Ferrándiz 72a5b4f702 Add an extractor for bambuser.com (#1702) 11 years ago
rzhxeo 0a43ddf320 [CinemassacreIE] Add live paramter to extracted info as a workaround 11 years ago
Philipp Hagemeister 8eddf3e91d [youtube] Encode subtitle track name in request (Fixes #1700) 11 years ago
Jaime Marquínez Ferrándiz 60d142aa8d Add an extractor for vk.com (closes #1635) 11 years ago
Jaime Marquínez Ferrándiz 66cf3ac342 [metacafe] Fix support for age-restricted videos (fixes #1696)
The 'Content-Type' header must be set for disabling the family filter.
The 'flashversion' cookie  is only needed for AnyClip videos.
Added tests for standard metacafe videos and for age-restricted videos.
Also set the 'age_limit' field.
11 years ago
rzhxeo ab4e151347 [CinemassacreIE] Support more embed urls 11 years ago
Alex Van't Hof ac2547f5ff [teamcoco] Fix video url extraction for some videos
Video url extraction failed for some videos,
e.g. http://teamcoco.com/video/old-time-baseball

The url extracted was also occasionally suboptimal quality,
e.g. http://teamcoco.com/video/louis-ck-interview-george-w-bush
11 years ago
Jaime Marquínez Ferrándiz 5f1ea943ab [livestream] fix the extraction of events
It now uses a json dictionary from the webpage.
11 years ago
Philipp Hagemeister 9f1109a564 [dailymotion] Fix support for age-restricted videos (Fixes #1688) 11 years ago
Philipp Hagemeister 72321ead7b [vevo] Readd support for SMIL (Fixes #1683) 11 years ago
Philipp Hagemeister b5d0d817bc Remove superfluous space 11 years ago
Filippo Valsorda b9a836515f Update the Vimeo test vector md5
confirmed that this is indeed the first 10241 (we went off by one with
byte range 0-10240) of the full, playing mp4, so they probably
reencoded or something
11 years ago
Jaime Marquínez Ferrándiz 21c924f406 [arte] Download the 'Originalversion' version if it's the only one available (fixes #1682) 11 years ago
Philipp Hagemeister e54fd4b23b [vevo] Add more format details 11 years ago
Philipp Hagemeister 912cbf5d4e [vevo] Fix timestamp handling
( / 1000 is implicit float division )
11 years ago
Philipp Hagemeister f7ff55aa78 Merge remote-tracking branch 'origin/master' 11 years ago
Philipp Hagemeister 795f28f871 [youtube] Fix login (Fixes #1681) 11 years ago
Jaime Marquínez Ferrándiz 321a01f971 [mtv] Remove the templates from the mediagen url 11 years ago
Jaime Marquínez Ferrándiz 2563bcc85c Add an extractor for MySpace (closes #1666) 11 years ago
rzhxeo dcc2a706ef Add support for http://www.xtube.com 11 years ago
rzhxeo 2bc67c35ac [KeezMoviesIE] Detect URLs with numbers in the SEO part correct 11 years ago
rzhxeo 77ae65877e Add support for http://www.mofosex.com 11 years ago
rzhxeo 32a35e4418 Add support for http://www.extremetube.com 11 years ago
Philipp Hagemeister 1003d108d5 [vimeo] Support hash in URL (Fixes #1669) 11 years ago
Philipp Hagemeister c1002e96e9 Let extractors omit ext in formats 11 years ago
Philipp Hagemeister 77d0a82fef [addanime] Use new formats system 11 years ago
Philipp Hagemeister ebc14f251c Merge remote-tracking branch 'origin/master' 11 years ago
Philipp Hagemeister d41e6efc85 New debug option --write-pages 11 years ago
Filippo Valsorda 8ffa13e03e [Instagram] get the non-https link, as they are serving Akamai cert from a instagram.com domain 11 years ago
Filippo Valsorda 750e9833b8 Add the missing age_limit tags; added a devscript to do a superficial check for porn sites without the age_limit tag in the test 11 years ago
Filippo Valsorda 82f0ac657c Merge pull request #1657 by @rzhxeo
[YouPornIE] Extract all encrypted links and remove doubles at the end
11 years ago
Filippo Valsorda eb6a2277a2 Merge pull request #1659 by @rzhxeo
Add support for http://www.tube8.com
11 years ago
Filippo Valsorda f8778fb0fa Merge pull request #1663 by @rzhxeo
Add support for http://www.spankwire.com
11 years ago
Filippo Valsorda e2f9de207c Merge pull request #1664 by @rzhxeo
Add support for http://www.keezmovies.com
11 years ago
Filippo Valsorda a93cc0d943 Merge pull request #1661 by @rzhxeo
Add support for http://www.pornhub.com
11 years ago
Filippo Valsorda 7d8c2e07f2 [Exfm] replace the failing Soundcloud test vector (broken also in browser) 11 years ago
Filippo Valsorda efb4c36b18 Merge pull request #1660 from pyed/master
[addanime] try to download HQ before normal
11 years ago
Jaime Marquínez Ferrándiz 29526d0d2b Merge pull request #1656 from rzhxeo/xhamster
[XHamsterIE] Extract SD and HD video
11 years ago
Abdulelah Alfntokh 198e370f23 [addanime] better regex. 11 years ago
Jaime Marquínez Ferrándiz c19f7764a5 [generic] Detect bandcamp pages that use custom domains (closes #1662)
They embed the original url in the 'og:url' property.
11 years ago
Jaime Marquínez Ferrándiz bc63d9d329 [rtlnow] Change the test for rtlnitronow 11 years ago
Jaime Marquínez Ferrándiz aa929c37d5 [generic] Fix test video's checksum 11 years ago
Jaime Marquínez Ferrándiz af4d506eb3 [faz] Use a regex for getting the description
The page cannot be parsed in python2.6 with the html parser.
11 years ago
rzhxeo 5da0549581 [KeezMoviesIE] Correct return value for embedded videos 11 years ago
Jaime Marquínez Ferrándiz 749a4fd2fd [facebook] Don't recommend to report the issue if the video is private. 11 years ago
Jaime Marquínez Ferrándiz 6f71ef580c [facebook] Report a more meaningful message if the video cannot be accessed (closes #1658) 11 years ago
Jaime Marquínez Ferrándiz 67874aeffa [facebook] Fix the login process (fixes #1244) 11 years ago
Abdulelah Alfntokh 3e6a330d38 [addanime] fix md5sum 11 years ago
Abdulelah Alfntokh aee5e18c8f [addanime] catch 'RegexNotFoundError' 11 years ago
rzhxeo 5b11143d05 Add support for http://www.keezmovies.com 11 years ago
rzhxeo 7b2212e954 Add support for http://www.spankwire.com 11 years ago
rzhxeo 71865091ab [Tube8IE] Fix regex for uploader extraction 11 years ago
rzhxeo 125cfd78e8 Add support for http://www.pornhub.com 11 years ago
rzhxeo 8cb57d9b91 [Tube8IE] Escape dot in regex 11 years ago
pyed 14e10b2b6e [addanime] try to download HQ before normal 11 years ago
rzhxeo 6e76104d66 [YouPornIE] Make webpage download more robust 11 years ago
rzhxeo 1d45a23b74 Add support for http://www.tube8.com 11 years ago
rzhxeo 7df286540f [YouPornIE] Extract all encrypted links and remove doubles at the end 11 years ago
rzhxeo 5d0c97541a [XHamsterIE] Extract SD and HD video 11 years ago
Philipp Hagemeister 49a25557b0 [8tracks] Use track count instead of looking at at_last_track property
This fixes the error:

$ youtube-dl http://8tracks.com/vladmc/counting-stars
[8tracks] counting-stars: Downloading webpage
[8tracks] counting-stars: Downloading song information 1/4
[8tracks] counting-stars: Downloading song information 2/4
[8tracks] counting-stars: Downloading song information 3/4
[8tracks] counting-stars: Downloading song information 4/4
[8tracks] counting-stars: Downloading song information 5/4
Traceback (most recent call last):
  File "/usr/lib/python2.7/runpy.py", line 162, in _run_module_as_main
    "__main__", fname, loader, pkg_name)
  File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
    exec code in run_globals
  File "/home/phihag/projects/youtube-dl/youtube_dl/__main__.py", line 18, in <module>
    youtube_dl.main()
  File "/home/phihag/projects/youtube-dl/youtube_dl/__init__.py", line 761, in main
    _real_main(argv)
  File "/home/phihag/projects/youtube-dl/youtube_dl/__init__.py", line 714, in _real_main
    retcode = ydl.download(all_urls)
  File "/home/phihag/projects/youtube-dl/youtube_dl/YoutubeDL.py", line 701, in download
    videos = self.extract_info(url)
  File "/home/phihag/projects/youtube-dl/youtube_dl/YoutubeDL.py", line 342, in extract_info
    ie_result = ie.extract(url)
  File "/home/phihag/projects/youtube-dl/youtube_dl/extractor/common.py", line 121, in extract
    return self._real_extract(url)
  File "/home/phihag/projects/youtube-dl/youtube_dl/extractor/eighttracks.py", line 111, in _real_extract
    'id': track_data['id'],
KeyError: 'id'
11 years ago
Jaime Marquínez Ferrándiz 600cc1a4f0 [youtube] Set the format_id field to the itag of the format (closes #1624) 11 years ago
Jaime Marquínez Ferrándiz ea32fbacc8 Fix the extensions of two tests with youtube videos
The best quality is now a mp4 video.
11 years ago
Jaime Marquínez Ferrándiz 00fe14fc75 [youtube] Also use the 'adaptative_fmts' field from the /get_video_info page (fixes #1649)
The 'adaptative_fmts' field from the video page is not added to the 'url_encoded_fmt_stream_map'
11 years ago
Jaime Marquínez Ferrándiz fcc28edb2f [cinemassacre] Simplify
* Remove some rtmp parameters that are not needed.
* Remove the md5 checksums, the video is not downloaded.
* Remove the code used before the current format system.
11 years ago
Jaime Marquínez Ferrándiz fac6be2dd5 Merge pull request #1632 from rzhxeo/cinemassacre
[Cinemassacre] Download video that is shown in flash player
11 years ago
Jaime Marquínez Ferrándiz cdec0190c4 [dailymotion] Extract all the available formats (closes #1028) 11 years ago
Jaime Marquínez Ferrándiz 2450bcb28b [nowvideo] Fix key extraction
Extract it from the embed page
11 years ago
Jaime Marquínez Ferrándiz 93b22c7828 [vimeo] fix the extraction for videos protected with password
Added a test video.
11 years ago
Jaime Marquínez Ferrándiz 55b3e45bba [vimeo] Fix pro videos and player.vimeo.com urls
The old process can still be used for those videos.
Added RegexNotFoundError, which is raised by _search_regex if it can't extract the info.
11 years ago
Philipp Hagemeister 365bcf6d97 Merge remote-tracking branch 'origin/master' 11 years ago
Philipp Hagemeister 71907db3ba [vimeo] Fix normal videos (Fixes #1642)
Vimeo Pro Videos are still broken
11 years ago
Philipp Hagemeister 6803655ced Merge pull request #1622 from rbrito/fix-extension
extractor: youtube: Set extension of AAC audio formats to m4a.
11 years ago
Jaime Marquínez Ferrándiz b028e96144 [arte.tv:creative] Update the title of the test 11 years ago
Jaime Marquínez Ferrándiz ce68b5907c [nhl:videocenter] Fix playlist title extraction 11 years ago
Joshua Elsasser a6387bfd3c [vimeo] Implement the new format selection system (closes PR #996)
Rebased and deleted some parts to use the new system instead of copying the one from YoutubeIE
11 years ago
Jaime Marquínez Ferrándiz f6a54188c2 [youtube] Use 'node is None' when checking if the video has automatic captions
It had stopped working and it reports a FutureWarning
11 years ago
Jaime Marquínez Ferrándiz cbbd9a9c69 Fix the duration field for the VideoDetective and InternetVideoArchive tests
Also remove the use of the old format system and the comment
11 years ago
Jaime Marquínez Ferrándiz 685a9cd2f1 [googleplus] Fix upload_date extraction 11 years ago
Jaime Marquínez Ferrándiz 182a107877 [arte] Set the format_note and the format_id fields (closes #1628) 11 years ago
Jaime Marquínez Ferrándiz 8c51aa6506 The 'format' field now defaults to '{format_id} - {width}x{height}{format_note}'
Following the YoutubeIE format. The 'format_note' gives additional info about the format, for example '3D' or 'DASH video'.
11 years ago
Philipp Hagemeister f8b45beacc Merge remote-tracking branch 'rbrito/set-age'
Conflicts:
	youtube_dl/extractor/xhamster.py
11 years ago
Philipp Hagemeister 9d92015d43 [xhamster] Add support for age_limit (Instead of #1627) 11 years ago
Rogério Brito 50a6150ed9 extractor: Set age limit on some adult-related extractors.
More age limit of videos for adult-related sites.

Note that, for redtube, I explicitly left the variable containing the age
limit, since the comment justifying the age limit is a good thing to have.

That being said, I included the age limit field on the test, to better
reflect what the information extractor does (even if it may not break the
automated tests).

Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
11 years ago
rzhxeo b0505eb611 [CinemassacreIE] Fix information extraction 11 years ago
Rogério Brito 8ed6b34477 extractor: Set age limit on some adult-related extractors.
This is similar in spirit to what was done in commit 8e590a117f.

Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
11 years ago