Commit Graph

1206 Commits (bf6705f5840418999582c6cf5cc0e2e47901cf4f)

Author SHA1 Message Date
Philipp Hagemeister e9d8e302aa [xhamster] Change test checksum 11 years ago
Jaime Marquínez Ferrándiz cb7fb54600 Change the ie_name of YoutubeSearchDateIE
It produced a duplicate entry when listing the extractors with '--list-extractors' and generates noise in the commit log when generating the supported sites webpage (like in 09f355f73bf1657ecacfd05eda21d2c4bf1cc4a8)
11 years ago
Philipp Hagemeister aaebed13a8 [smotri] Simplify 11 years ago
dst 5270d8cb13 Added extractors for smotri.com 11 years ago
Jaime Marquínez Ferrándiz 55a10eab48 [vimeo] Add an extractor for users (closes #1871) 11 years ago
Philipp Hagemeister 355e4fd07e [generic] Find embedded dailymotion videos (Fixes #1848) 11 years ago
Philipp Hagemeister 5e09d6abbd [clipfish] Skip test on travis 11 years ago
Jaime Marquínez Ferrándiz 0a688bc0b2 [youtube] Add support for downloading top lists (fixes #1868)
It needs to know the channel and the title of the list, because the ids change every time you browse the channels and are attached to a 'VISITOR_INFO1_LIVE' cookie.
11 years ago
Jaime Marquínez Ferrándiz c5171c454b [yahoo] Force use of the http protocol for downloading the videos. 11 years ago
Jaime Marquínez Ferrándiz befd88b786 [yahoo] Add an extractor for yahoo news (closes #1849) 11 years ago
Jaime Marquínez Ferrándiz acf37ca151 [imdb] Fix the resolution values (fixes #1847)
We were using the size of the player, it was the same for all the formats
11 years ago
Philipp Hagemeister 677c18092d [podomatic] Add extractor 11 years ago
Jaime Marquínez Ferrándiz 3862402ff3 Add an extractor for Clipsyndicate (closes #1744) 11 years ago
Jaime Marquínez Ferrándiz b03d0d064c [imdb] Fix extraction in python 2.6
Using a regular expression because the html cannot be parsed.
11 years ago
Jaime Marquínez Ferrándiz d8d6148628 Add an extractor for Internet Movie Database trailers (closes #1832) 11 years ago
Philipp Hagemeister fc9e1cc697 [clipfish] Use FIFA trailer as testcase (#1842) 11 years ago
Philipp Hagemeister f8f60d2793 [clipfish] Fix imports (#1842) 11 years ago
Philipp Hagemeister 2a275ab007 [zdf] Use _download_xml 11 years ago
Philipp Hagemeister a2e6db365c [zdf] add a pseudo-testcase and fix URL matching 11 years ago
Philipp Hagemeister 9d93e7da6c Merge branch 'master' of github.com:rg3/youtube-dl 11 years ago
Jaime Marquínez Ferrándiz 0e44d8381a [youtube:feeds] Use the 'paging' value from the downloaded json information (fixes #1845) 11 years ago
Jaime Marquínez Ferrándiz 35907e23ec [yahoo] Fix video extraction and use the new format system exclusively 11 years ago
Jaime Marquínez Ferrándiz 76d1700b28 [youtube:playlist] Fix the extraction of the title for some mixes (#1844)
Like https://www.youtube.com/watch?v=g8jDB5xOiuE&list=RDIh2gxLqR7HM
11 years ago
Philipp Hagemeister dcca796ce4 [clipfish] Effect a better error message (#1842) 11 years ago
Filippo Valsorda 4b19e38954 [videopremium] support new .me domain 11 years ago
Jaime Marquínez Ferrándiz 652cdaa269 [youtube:playlist] Add support for YouTube mixes (fixes #1839) 11 years ago
Jaime Marquínez Ferrándiz e26f871228 Use the new '_download_xml' helper in more extractors 11 years ago
Jaime Marquínez Ferrándiz 6e47b51eef [youtube:playlist] Remove the link with index 0
It's not the first video of the playlist, it appears in the 'Play all' button (see the test course for an example)
11 years ago
Philipp Hagemeister fb04e40396 [soundcloud] Support for listing of audio-only files 11 years ago
Philipp Hagemeister 8b134b1062 Merge branch 'master' of github.com:rg3/youtube-dl 11 years ago
Jaime Marquínez Ferrándiz 1a62c18f65 [bambuser] Skip the download in the test
It doesn't respect the 'Range' header.
11 years ago
Philipp Hagemeister 2a15e7063b [soundcloud] Prefer HTTP over RTMP (#1798) 11 years ago
Philipp Hagemeister ea36cbac5e Merge remote-tracking branch 'rbrito/swap-dimensions' 11 years ago
Philipp Hagemeister de79c46c8f [viki] Fix subtitle extraction 11 years ago
Philipp Hagemeister 94ccb6fa2e [viki] Fix subtitles extraction 11 years ago
Philipp Hagemeister 07e4035879 [viki] Fix uploader extraction 11 years ago
Philipp Hagemeister 113577e155 [generic] Improve detection
Allow download of http://goo.gl/7X5tOk
Fixes #1818
11 years ago
Philipp Hagemeister 79d09f47c2 Merge branch 'opener-to-ydl' 11 years ago
Philipp Hagemeister c059bdd432 Remove quality_name field and improve zdf extractor 11 years ago
Philipp Hagemeister 02dbf93f0e [zdf/common] Use API in ZDF extractor.
This also comes with a lot of extra format fields
Fixes #1518
11 years ago
Philipp Hagemeister 1fb2bcbbf7 [viki] Make uploader field optional (#1813) 11 years ago
Jaime Marquínez Ferrándiz 66cfab4226 [comedycentral] Add support for comedycentral.com videos (closes #1824)
It's a subclass of MTVIE

The extractor for colbertnation.com and thedailyshow.com is called now ComedyCentralShowsIE
11 years ago
Philipp Hagemeister 6d88bc37a3 [viki] Skip travis test
Also provide a better error message for geoblocked videos.
11 years ago
Philipp Hagemeister b7553b2554 [vik] Clarify output 11 years ago
Philipp Hagemeister e03db0a077 Merge branch 'master' into opener-to-ydl 11 years ago
Jaime Marquínez Ferrándiz 267ed0c5d3 [collegehumor] Encode the xml before calling xml.etree.ElementTree.fromstring (fixes #1822)
Uses a new helper method in InfoExtractor: _download_xml
11 years ago
Jaime Marquínez Ferrándiz f459d17018 [youtube] Add an extractor for downloading the watch history (closes #1821) 11 years ago
Jaime Marquínez Ferrándiz dc65dcbb6d [mixcloud] The description field may be missing (fixes #1819) 11 years ago
Jaime Marquínez Ferrándiz d214fdb8fe [brightcove] Don't use 'or' with the xml nodes, use the 'value' attribute instead 11 years ago
Philipp Hagemeister 0c7c19d6bc [clipfish] Add extractor (Fixes #1760) 11 years ago
Philipp Hagemeister 382ed50e0e [viki] Add extractor (fixes #1813) 11 years ago
Philipp Hagemeister 66ec019240 [youtube] do not use variable name twice 11 years ago
Philipp Hagemeister bd49928f7a [niconico] Clarify download 11 years ago
Philipp Hagemeister 23e6d50d73 [bandcamp] Remove unused variable 11 years ago
Philipp Hagemeister 13ebea791f [niconico] Simplify and make work with old Python versions
The website requires SSLv3, otherwise it just times out during SSL negotiation.
11 years ago
Philipp Hagemeister 4c9c57428f Merge remote-tracking branch 'takuya0301/niconico' 11 years ago
Jaime Marquínez Ferrándiz 36de0a0e1a [brightcove] Set the 'videoPlayer' value to the 'videoId' if it's missing in the parameters (fixes #1815) 11 years ago
Philipp Hagemeister e5c146d586 [streamcloud] skip test on travis 11 years ago
Takuya Tsuchida 52ad14aeb0 Add support for niconico 11 years ago
Philipp Hagemeister 081640940e Merge branch 'master' of github.com:rg3/youtube-dl 11 years ago
Philipp Hagemeister 7012b23c94 Match --download-archive during playlist processing (Fixes #1745) 11 years ago
Jaime Marquínez Ferrándiz 9f79463803 [howcast] update test's checksum 11 years ago
Jaime Marquínez Ferrándiz d35dc6d3b5 [bandcamp] move the album test to the album extractor and return a single track instead of a playlist 11 years ago
Philipp Hagemeister 3f8ced5144 Merge remote-tracking branch 'jaimeMF/yt-playlists' 11 years ago
Philipp Hagemeister dca0872056 Move the opener to the YoutubeDL object.
This is the first step towards being able to just import youtube_dl and start using it.
Apart from removing global state, this would fix problems like #1805.
11 years ago
Philipp Hagemeister 15c3adbb16 Merge branch 'master' of github.com:rg3/youtube-dl 11 years ago
Philipp Hagemeister f143a42fe6 [bandcamp] Skip album test 11 years ago
Jaime Marquínez Ferrándiz 241650c7ff [vimeo] Fix the extraction of vimeo pro and player.vimeo.com videos 11 years ago
Philipp Hagemeister cffa6aa107 [bandcamp] Support trackinfo-style songs (Fixes #1270) 11 years ago
Philipp Hagemeister 02e4ebbbad [streamcloud] Add IE (Fixes #1801) 11 years ago
Philipp Hagemeister ab009f59ef [toutv] Fix a typo 11 years ago
Jaime Marquínez Ferrándiz 0980426559 [bandcamp] add support for albums (reported in #1270) 11 years ago
Jaime Marquínez Ferrándiz 64bb5187f5 [soundcloud] Retrieve the file url using the client_id for the iPhone (fixes #1798)
The desktop's client_id always give the rtmp url, but with the iPhone one it returns the http url if it's available.
11 years ago
Philipp Hagemeister 9e4f50a8ae [sztv] skip test, site is undergoing mid-term maintenance 11 years ago
Philipp Hagemeister 0190eecc00 [nhl] Make NHLVideocenter IE_DESC fit with other descriptions 11 years ago
Philipp Hagemeister ca872a4c0b [spankwire] Fix description search 11 years ago
Philipp Hagemeister f2e87ef4fa [anitube] Skip test (on travis) 11 years ago
Philipp Hagemeister 0ad97bbc05 [spankwire] fix check for description 11 years ago
Philipp Hagemeister c4864091a1 [videopremium] Support new crazy redirect scheme 11 years ago
Philipp Hagemeister 9a98a466b3 [toutv] really skip test 11 years ago
Philipp Hagemeister da6a795fdb [escapist] Fix title search 11 years ago
Philipp Hagemeister c5edcde21f [escapist] upper-case URL 11 years ago
Philipp Hagemeister 15ff3c831e [escapist] Fix syntax error 11 years ago
Philipp Hagemeister 100959a6d9 [escapist] Add support for HD format (Closes #1755) 11 years ago
Philipp Hagemeister 8f05351984 [anitube] Minor fixes (#1776) 11 years ago
Philipp Hagemeister 71791f414c Merge remote-tracking branch 'diffycat/master' 11 years ago
Philipp Hagemeister f3682997d7 Clean up unused imports and other minor mistakes 11 years ago
Philipp Hagemeister cc13cc0251 [teamcoco] Correct error 11 years ago
Philipp Hagemeister 5904088811 Add support for tou.tv (Fixes #1792) 11 years ago
Jaime Marquínez Ferrándiz 69545c2aff [d8] inherit from CanalplusIE
it reuses the same extraction process
11 years ago
Jaime Marquínez Ferrándiz 495da337ae Merge pull request #1758 from migbac/master
Add support for d8.tv
11 years ago
Philipp Hagemeister cb7dfeeac4 [youtube] only allow domain name to be upper-case (#1786) 11 years ago
Philipp Hagemeister 4113e6ab56 [auengine] Do not return unnecessary ext 11 years ago
Philipp Hagemeister 9906d397a0 [auengine] Simplify 11 years ago
Philipp Hagemeister 887c6acdf2 Support multiple embedded YouTube URLs (Fixes #1787) 11 years ago
Philipp Hagemeister 83aa529330 Support protocol-independent URLs (#1787) 11 years ago
Philipp Hagemeister fccd377198 Suppor embed-only videos (Fixes #1746) 11 years ago
Philipp Hagemeister 63b7b7224a [MTVIE] Try with RTMP URL if download fails
This fixes youtube-dl http://www.southpark.de/clips/155251/cartman-vs-the-dog-whisperer
11 years ago
rzhxeo 746f491f82 Add support for southpark.de 11 years ago
rzhxeo 1672647ade [SouthParkStudiosIE] Move from _TEST to _TESTS 11 years ago
rzhxeo 90b6bbc38c [SouthParkStudiosIE] Also detect urls without http:// or www 11 years ago
Philipp Hagemeister 1d699755e0 [youtube] Add view_count (Fixes #1781) 11 years ago
Philipp Hagemeister ddf49c6344 [arte] remove two typos 11 years ago
Anton Larionov ba3881dffd Add support for anitube.se (#1417) 11 years ago
Philipp Hagemeister d1c252048b [redtube] Do not test md5, seems to vary 11 years ago
Philipp Hagemeister eab2724138 [gamekings] Do not test md5 sum, precise file changes regularly 11 years ago
Philipp Hagemeister 21ea3e06c9 [gamekings] remove unnecessary import 11 years ago
Philipp Hagemeister 52d703d3d1 [tvp] Skip tests 11 years ago
Philipp Hagemeister ce152341a1 [bambuser] Do not test for MD5, seems to be flaky 11 years ago
Philipp Hagemeister f058e34011 [dailymotion] Fix playlists 11 years ago
Philipp Hagemeister 7150858d49 [spiegel] Implement format selection 11 years ago
Philipp Hagemeister 91c7271aab Add automatic generation of format note based on bitrate and codecs 11 years ago
Philipp Hagemeister fc2ef392be [ted] Fix playlists (Fixes #1770) 11 years ago
Philipp Hagemeister 463a908705 [ted] simplify 11 years ago
Jaime Marquínez Ferrándiz d24ffe1cfa [rtlnow] Remove the test for nitro
The videos expire.
11 years ago
Jaime Marquínez Ferrándiz 78fb87b283 Don't accept '>' inside the content attribute in OpenGraph regexes 11 years ago
Jaime Marquínez Ferrándiz ab2d524780 Improve the OpenGraph regex
* Do not accept '>' between the property and content attributes.
* Recognize the properties if the content attribute is before the property attribute using two regexes (fixes the extraction of the description for SlideshareIE).
11 years ago
Jaime Marquínez Ferrándiz 85d61685f1 [tvp] Update the title and the description of the test video 11 years ago
Jaime Marquínez Ferrándiz b9643eed7c [youtube:channel] Fix the extraction of autogenerated channels
The ajax pages are empty, now it looks directly in the channel's /videos page
11 years ago
Philipp Hagemeister 0e145dd541 Merge branch 'master' of github.com:rg3/youtube-dl 11 years ago
Philipp Hagemeister 9f9be844fc [youtube] Fix protocol-independent URLs (Fixes #1768) 11 years ago
Jaime Marquínez Ferrándiz e3b9ab5e18 [soundlcoud] Set the correct extension for the tracks (fixes #1766)
Some tracks are not in mp3 format, they can be wav files.
11 years ago
Jaime Marquínez Ferrándiz c66d2baa9c [livestream] Add an extractor for the original version of livestream (closes #1764)
The two versions use different systems.
11 years ago
Jaime Marquínez Ferrándiz ca715127a2 Don't assume the 'subtitlesformat' is set in the params dict (fixes #1750) 11 years ago
Jaime Marquínez Ferrándiz ea7a7af1d4 [gamekings] Fix the test video checksum 11 years ago
Jaime Marquínez Ferrándiz 880e1c529d [youtube:playlist] Login into youtube if requested (fixes #1757)
Allows to download private playlists
11 years ago
Jaime Marquínez Ferrándiz dcbb45803f [youtube:playlist] Don't use the gdata api (closes #1508)
Parse the playlist pages instead
11 years ago
Philipp Hagemeister c3a3028f9f [tvp] Minor improvements (#1730) 11 years ago
Philipp Hagemeister 6c5ad80cdc Merge remote-tracking branch 'saper/tvp' 11 years ago
Philipp Hagemeister 384b98cd8f [gamekings] Minor fixes (#1759) 11 years ago
Jelle van der Waa eb9b5bffef Add extractor for gamekings.tv 11 years ago
migbac 0bd59f3723 Add support for d8.tv 11 years ago
Jaime Marquínez Ferrándiz 8b8cbd8f6d [vine] Fix uploader extraction 11 years ago
Philipp Hagemeister eb0a839866 [common] Simplify og_search_property 11 years ago
Jaime Marquínez Ferrándiz 0ed05a1d2d Use the 'rtmp_live' field for the live parameter of rtmpdump 11 years ago
Jaime Marquínez Ferrándiz 1008bebade Merge remote-tracking branch 'rzhxeo/rtmpdump_live' 11 years ago
Jaime Marquínez Ferrándiz be6dfd1b49 [ted] Return a single info_dict for talks urls
It failed with the --list-subs option
11 years ago
Jaime Marquínez Ferrándiz 231516b6c9 Merge pull request #1705 from iemejia/master
[ted] support for subtitles
11 years ago
Jaime Marquínez Ferrándiz fb53d58dcf Merge pull request #1726 from saper/escaped
Fix AssertionError when og property not found
11 years ago
Jaime Marquínez Ferrándiz f470c6c812 [arte] Improve the format sorting
Also use the bitrate.
Prefer normal version and sourds/mal version over original version with subtitles.
11 years ago
Jaime Marquínez Ferrándiz 566d4e0425 [arte] Make sure the format_id is unique (closes #1739)
Include the bitrate and use the height instead of the quality field.
11 years ago
Jaime Marquínez Ferrándiz 81be02d2f9 [cnn] Accept www.cnn.com urls (fixes #1740) 11 years ago
Jaime Marquínez Ferrándiz c2b6a482d5 [brightcove] the format function requires to specify the index in python2.6 11 years ago
Jaime Marquínez Ferrándiz 12c167c881 [soundcloud] Allow to download tracks marked as not 'streamable'
They use the rtmp protocol but if the are marked as 'downloadable' it can use the direct download link.
11 years ago
Jaime Marquínez Ferrándiz 20aafee7fa [kankan] Fix the video url
It now requires two additional parameters, one is a timestamp we get from the getCdnresource_flv page and the other is a key we have to build.
11 years ago
rzhxeo c8434e8316 Add support for crunchyroll.com 11 years ago
Jaime Marquínez Ferrándiz dd5bcdc4c9 [brightcove] Set the 'Referer' header if the url has the 'linkBaseUrl' parameter (fixes #1553) 11 years ago
Jaime Marquínez Ferrándiz b1a80ec1a9 [xnxx] Accept urls that start with 'www' (fixes #1734) 11 years ago
Jaime Marquínez Ferrándiz 51040b72ed [brightcove] Support redirected urls from bcove.me (fixes #1732)
'bctid' needs to be changed to '@videoPlayer', and 'bckey' to 'playerKey'.
11 years ago
Jaime Marquínez Ferrándiz 4f045eef8f [youtube:channel] Fix the extraction
The page don't include the 'load more' button anymore, now we directly get the 'c4_browse_ajax' pages.
11 years ago
Jaime Marquínez Ferrándiz 5d7b253ea0 Add an extractor for eitb.tv (fixes #1608)
The BrighcoveExperience object doesn't contain the video id, the extractor adds it and passes the url to BrightcoveIE.
11 years ago
Jaime Marquínez Ferrándiz b0759f0c19 [brightcove] Extract all the available formats 11 years ago
Jaime Marquínez Ferrándiz 065472936a Add an extractor for space.com (fixes #1718)
It uses Brightcove, but requires some special process for getting a url with the playerKey field in some videos
11 years ago
Jaime Marquínez Ferrándiz fc4a0c2aec [brightcove] Change the 'videoId' or 'videoID' field to '@videoPlayer' (fixes #1697)
It seems to be needed when using the htmlFederated page
11 years ago
Jaime Marquínez Ferrándiz eeb165e674 [brightcove] Add the extraction of the url from generic 11 years ago
Jaime Marquínez Ferrándiz 9ee2b5f6f2 tests: don't run the test if any of the extractors listed in the 'add_ie' field is marked as not working 11 years ago
Marcin Cieślak 5137ebac0b [tvp] Telewizja Polska: new extractor for tvp.pl, fixes #1719
Thanks-To: mplonski

https://github.com/mplonski/linux/blob/master/tvp-dl.py
11 years ago
Marcin Cieślak a8eeb0597b Fix AssertionError when og property not found
On tvp.pl some webpages contain OpenGraph
metadata and some don't.

If og property is not found, _og_search_description
fails with

WARNING: unable to extract OpenGraph description; please report this issue on http://yt-dl.org/bug
Traceback (most recent call last):
  File "/usr/home/saper/bin/youtube-dl", line 18, in <module>
    youtube_dl.main()
  File "/usr/home/saper/sw/youtube-dl/youtube_dl/__init__.py", line 766, in main
    _real_main(argv)
  File "/usr/home/saper/sw/youtube-dl/youtube_dl/__init__.py", line 719, in _real_main
    retcode = ydl.download(all_urls)
  File "/usr/home/saper/sw/youtube-dl/youtube_dl/YoutubeDL.py", line 715, in download
    videos = self.extract_info(url)
  File "/usr/home/saper/sw/youtube-dl/youtube_dl/YoutubeDL.py", line 348, in extract_info
    ie_result = ie.extract(url)
  File "/usr/home/saper/sw/youtube-dl/youtube_dl/extractor/common.py", line 125, in extract
    return self._real_extract(url)
  File "/usr/home/saper/sw/youtube-dl/youtube_dl/extractor/tvp.py", line 56, in _real_extract
    info['description'] = self._og_search_description(webpage)
  File "/usr/home/saper/sw/youtube-dl/youtube_dl/extractor/common.py", line 331, in _og_search_description
    return self._og_search_property('description', html, fatal=False, **kargs)
  File "/usr/home/saper/sw/youtube-dl/youtube_dl/extractor/common.py", line 325, in _og_search_property
    return unescapeHTML(escaped)
  File "/usr/home/saper/sw/youtube-dl/youtube_dl/utils.py", line 494, in unescapeHTML
    assert type(s) == type(u'')
AssertionError

The patch allows me to use:

  try:
    info['description'] = self._og_search_description(webpage)
    info['thumbnail'] = self._og_search_thumbnail(webpage)
  except RegexNotFoundError:
    pass
11 years ago
Ismaël Mejía 4ed3e51080 [ted] fixed error in case of no subtitles present
I created a test, but I leave it commented since TED videos get
new subtitles frequently.
11 years ago
rzhxeo 2dcf7d8f99 [GenericIE] Also detect youtube if src url of iframe is embedded in ' instaed of " 11 years ago
Jaime Marquínez Ferrándiz 19b0668251 [canal2c] Accept more urls (fixes #1723)
The url only needs to have the 'idVideo' field in the query, in any position.
We have to set the 'void=oui' in the webpage url, so that we get the file name.
11 years ago
Jaime Marquínez Ferrándiz e7e6b54d8a [teamcoco] Parse the xml file and extract all the formats 11 years ago
Jaime Marquínez Ferrándiz 2a1a8ffe41 Merge pull request #1693 from alexvh/teamcoco_fix
[teamcoco] Fix video url extraction for some videos
11 years ago
Philipp Hagemeister 08fb86c49b [youtube] Add description for YoutubeSearchDateIE (#1710) 11 years ago
Philipp Hagemeister 3633d77c0f Merge remote-tracking branch 'CBGoodBuddy/ytsearchtime' 11 years ago
Philipp Hagemeister 12ebdd1506 [viddler] Support non-digit IDs (Fixes #1714) 11 years ago
Jaime Marquínez Ferrándiz 1baf9a5938 Merge pull request #1698 from rzhxeo/cinemassacre
[CinemassacreIE] Support more embed urls
11 years ago
Jaime Marquínez Ferrándiz a56f9de156 Style fixes for extractors: remove spaces around (,),{ and } 11 years ago
Jaime Marquínez Ferrándiz fa5d47af4b Merge pull request #1679 from rzhxeo/mofosex
Add support for http://www.mofosex.com
11 years ago
Jaime Marquínez Ferrándiz d607038753 Merge pull request #1677 from rzhxeo/xtube
Add support for http://www.xtube.com
11 years ago
Jaime Marquínez Ferrándiz 9ac6a01aaf Merge pull request #1676 from rzhxeo/extremetube
Add support for http://www.extremetube.com
11 years ago
Jaime Marquínez Ferrándiz 9103bbc5cd Add the 'webpage_url' field to info_dict
The url for the video page, it must allow to reproduce the result.
It's automatically set by YoutubeDL if it's missing.
11 years ago
Craig Markwardt a3dd924871 Add YoutubeSearchDateIE extractor to youtube.py & __init__.py, which searches by publication date. 11 years ago
rzhxeo 137bbb3e37 [XTubeIE] Add description to TEST 11 years ago
rzhxeo 86ad94bb2e [ExtremeTubeIE] Set age_limit to 18 and fix uploader extraction 11 years ago
Jaime Marquínez Ferrándiz 3e56add7c9 Merge pull request #1678 from rzhxeo/keezmovies
[KeezMoviesIE] Detect URLs with numbers in the SEO part correct
11 years ago
Jaime Marquínez Ferrándiz f52f01b5d2 [brightcove] Don't set the extension
If the video only has the 'FLVFullLengthURL' key, it can still be an mp4 file.
11 years ago
Jaime Marquínez Ferrándiz 98d7efb537 [exfm] skip tests
The site is down too often.
11 years ago
Jaime Marquínez Ferrándiz cf51923545 [youtube] Remove vevo test
The video is no longer available and it seems that vevo video don't use encrypted signatures anymore.
11 years ago
Ismaël Mejía 38fcd4597a Merge remote-tracking branch 'iemejia/master' 11 years ago
Jaime Marquínez Ferrándiz 165e3bb67a [bambuser] Add an extractor for channels (closes #1702) 11 years ago
Ismaël Mejía 38db46794f Merge branch 'ted_subtitles' 11 years ago
Ismaël Mejía a9a3876d55 [ted] Added support for subtitle download 11 years ago
Ismaël Mejía 1f343eaabb [subtitles] refactor to support websites with subtitle information the
webpage.

I added the parameter webpage, so now it's similar to the way automatic
captions are handled. This is an improvement needed for websites like
TED.
11 years ago
Jaime Marquínez Ferrándiz 72a5b4f702 Add an extractor for bambuser.com (#1702) 11 years ago
rzhxeo 0a43ddf320 [CinemassacreIE] Add live paramter to extracted info as a workaround 11 years ago
Philipp Hagemeister 8eddf3e91d [youtube] Encode subtitle track name in request (Fixes #1700) 11 years ago
Jaime Marquínez Ferrándiz 60d142aa8d Add an extractor for vk.com (closes #1635) 11 years ago
Jaime Marquínez Ferrándiz 66cf3ac342 [metacafe] Fix support for age-restricted videos (fixes #1696)
The 'Content-Type' header must be set for disabling the family filter.
The 'flashversion' cookie  is only needed for AnyClip videos.
Added tests for standard metacafe videos and for age-restricted videos.
Also set the 'age_limit' field.
11 years ago
rzhxeo ab4e151347 [CinemassacreIE] Support more embed urls 11 years ago
Alex Van't Hof ac2547f5ff [teamcoco] Fix video url extraction for some videos
Video url extraction failed for some videos,
e.g. http://teamcoco.com/video/old-time-baseball

The url extracted was also occasionally suboptimal quality,
e.g. http://teamcoco.com/video/louis-ck-interview-george-w-bush
11 years ago
Jaime Marquínez Ferrándiz 5f1ea943ab [livestream] fix the extraction of events
It now uses a json dictionary from the webpage.
11 years ago
Philipp Hagemeister 9f1109a564 [dailymotion] Fix support for age-restricted videos (Fixes #1688) 11 years ago
Philipp Hagemeister 72321ead7b [vevo] Readd support for SMIL (Fixes #1683) 11 years ago
Philipp Hagemeister b5d0d817bc Remove superfluous space 11 years ago
Filippo Valsorda b9a836515f Update the Vimeo test vector md5
confirmed that this is indeed the first 10241 (we went off by one with
byte range 0-10240) of the full, playing mp4, so they probably
reencoded or something
11 years ago
Jaime Marquínez Ferrándiz 21c924f406 [arte] Download the 'Originalversion' version if it's the only one available (fixes #1682) 11 years ago
Philipp Hagemeister e54fd4b23b [vevo] Add more format details 11 years ago
Philipp Hagemeister 912cbf5d4e [vevo] Fix timestamp handling
( / 1000 is implicit float division )
11 years ago
Philipp Hagemeister f7ff55aa78 Merge remote-tracking branch 'origin/master' 11 years ago
Philipp Hagemeister 795f28f871 [youtube] Fix login (Fixes #1681) 11 years ago
Jaime Marquínez Ferrándiz 321a01f971 [mtv] Remove the templates from the mediagen url 11 years ago
Jaime Marquínez Ferrándiz 2563bcc85c Add an extractor for MySpace (closes #1666) 11 years ago
rzhxeo dcc2a706ef Add support for http://www.xtube.com 11 years ago
rzhxeo 2bc67c35ac [KeezMoviesIE] Detect URLs with numbers in the SEO part correct 11 years ago
rzhxeo 77ae65877e Add support for http://www.mofosex.com 11 years ago
rzhxeo 32a35e4418 Add support for http://www.extremetube.com 11 years ago
Philipp Hagemeister 1003d108d5 [vimeo] Support hash in URL (Fixes #1669) 11 years ago
Philipp Hagemeister c1002e96e9 Let extractors omit ext in formats 11 years ago
Philipp Hagemeister 77d0a82fef [addanime] Use new formats system 11 years ago
Philipp Hagemeister ebc14f251c Merge remote-tracking branch 'origin/master' 11 years ago
Philipp Hagemeister d41e6efc85 New debug option --write-pages 11 years ago
Filippo Valsorda 8ffa13e03e [Instagram] get the non-https link, as they are serving Akamai cert from a instagram.com domain 11 years ago
Filippo Valsorda 750e9833b8 Add the missing age_limit tags; added a devscript to do a superficial check for porn sites without the age_limit tag in the test 11 years ago
Filippo Valsorda 82f0ac657c Merge pull request #1657 by @rzhxeo
[YouPornIE] Extract all encrypted links and remove doubles at the end
11 years ago
Filippo Valsorda eb6a2277a2 Merge pull request #1659 by @rzhxeo
Add support for http://www.tube8.com
11 years ago
Filippo Valsorda f8778fb0fa Merge pull request #1663 by @rzhxeo
Add support for http://www.spankwire.com
11 years ago
Filippo Valsorda e2f9de207c Merge pull request #1664 by @rzhxeo
Add support for http://www.keezmovies.com
11 years ago
Filippo Valsorda a93cc0d943 Merge pull request #1661 by @rzhxeo
Add support for http://www.pornhub.com
11 years ago
Filippo Valsorda 7d8c2e07f2 [Exfm] replace the failing Soundcloud test vector (broken also in browser) 11 years ago
Filippo Valsorda efb4c36b18 Merge pull request #1660 from pyed/master
[addanime] try to download HQ before normal
11 years ago
Jaime Marquínez Ferrándiz 29526d0d2b Merge pull request #1656 from rzhxeo/xhamster
[XHamsterIE] Extract SD and HD video
11 years ago
Abdulelah Alfntokh 198e370f23 [addanime] better regex. 11 years ago
Jaime Marquínez Ferrándiz c19f7764a5 [generic] Detect bandcamp pages that use custom domains (closes #1662)
They embed the original url in the 'og:url' property.
11 years ago
Jaime Marquínez Ferrándiz bc63d9d329 [rtlnow] Change the test for rtlnitronow 11 years ago
Jaime Marquínez Ferrándiz aa929c37d5 [generic] Fix test video's checksum 11 years ago
Jaime Marquínez Ferrándiz af4d506eb3 [faz] Use a regex for getting the description
The page cannot be parsed in python2.6 with the html parser.
11 years ago
rzhxeo 5da0549581 [KeezMoviesIE] Correct return value for embedded videos 11 years ago
Jaime Marquínez Ferrándiz 749a4fd2fd [facebook] Don't recommend to report the issue if the video is private. 11 years ago
Jaime Marquínez Ferrándiz 6f71ef580c [facebook] Report a more meaningful message if the video cannot be accessed (closes #1658) 11 years ago
Jaime Marquínez Ferrándiz 67874aeffa [facebook] Fix the login process (fixes #1244) 11 years ago
Abdulelah Alfntokh 3e6a330d38 [addanime] fix md5sum 11 years ago
Abdulelah Alfntokh aee5e18c8f [addanime] catch 'RegexNotFoundError' 11 years ago
rzhxeo 5b11143d05 Add support for http://www.keezmovies.com 11 years ago
rzhxeo 7b2212e954 Add support for http://www.spankwire.com 11 years ago
rzhxeo 71865091ab [Tube8IE] Fix regex for uploader extraction 11 years ago
rzhxeo 125cfd78e8 Add support for http://www.pornhub.com 11 years ago
rzhxeo 8cb57d9b91 [Tube8IE] Escape dot in regex 11 years ago
pyed 14e10b2b6e [addanime] try to download HQ before normal 11 years ago
rzhxeo 6e76104d66 [YouPornIE] Make webpage download more robust 11 years ago
rzhxeo 1d45a23b74 Add support for http://www.tube8.com 11 years ago
rzhxeo 7df286540f [YouPornIE] Extract all encrypted links and remove doubles at the end 11 years ago
rzhxeo 5d0c97541a [XHamsterIE] Extract SD and HD video 11 years ago
Philipp Hagemeister 49a25557b0 [8tracks] Use track count instead of looking at at_last_track property
This fixes the error:

$ youtube-dl http://8tracks.com/vladmc/counting-stars
[8tracks] counting-stars: Downloading webpage
[8tracks] counting-stars: Downloading song information 1/4
[8tracks] counting-stars: Downloading song information 2/4
[8tracks] counting-stars: Downloading song information 3/4
[8tracks] counting-stars: Downloading song information 4/4
[8tracks] counting-stars: Downloading song information 5/4
Traceback (most recent call last):
  File "/usr/lib/python2.7/runpy.py", line 162, in _run_module_as_main
    "__main__", fname, loader, pkg_name)
  File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
    exec code in run_globals
  File "/home/phihag/projects/youtube-dl/youtube_dl/__main__.py", line 18, in <module>
    youtube_dl.main()
  File "/home/phihag/projects/youtube-dl/youtube_dl/__init__.py", line 761, in main
    _real_main(argv)
  File "/home/phihag/projects/youtube-dl/youtube_dl/__init__.py", line 714, in _real_main
    retcode = ydl.download(all_urls)
  File "/home/phihag/projects/youtube-dl/youtube_dl/YoutubeDL.py", line 701, in download
    videos = self.extract_info(url)
  File "/home/phihag/projects/youtube-dl/youtube_dl/YoutubeDL.py", line 342, in extract_info
    ie_result = ie.extract(url)
  File "/home/phihag/projects/youtube-dl/youtube_dl/extractor/common.py", line 121, in extract
    return self._real_extract(url)
  File "/home/phihag/projects/youtube-dl/youtube_dl/extractor/eighttracks.py", line 111, in _real_extract
    'id': track_data['id'],
KeyError: 'id'
11 years ago
Jaime Marquínez Ferrándiz 600cc1a4f0 [youtube] Set the format_id field to the itag of the format (closes #1624) 11 years ago
Jaime Marquínez Ferrándiz ea32fbacc8 Fix the extensions of two tests with youtube videos
The best quality is now a mp4 video.
11 years ago
Jaime Marquínez Ferrándiz 00fe14fc75 [youtube] Also use the 'adaptative_fmts' field from the /get_video_info page (fixes #1649)
The 'adaptative_fmts' field from the video page is not added to the 'url_encoded_fmt_stream_map'
11 years ago
Jaime Marquínez Ferrándiz fcc28edb2f [cinemassacre] Simplify
* Remove some rtmp parameters that are not needed.
* Remove the md5 checksums, the video is not downloaded.
* Remove the code used before the current format system.
11 years ago
Jaime Marquínez Ferrándiz fac6be2dd5 Merge pull request #1632 from rzhxeo/cinemassacre
[Cinemassacre] Download video that is shown in flash player
11 years ago
Jaime Marquínez Ferrándiz cdec0190c4 [dailymotion] Extract all the available formats (closes #1028) 11 years ago
Jaime Marquínez Ferrándiz 2450bcb28b [nowvideo] Fix key extraction
Extract it from the embed page
11 years ago
Jaime Marquínez Ferrándiz 93b22c7828 [vimeo] fix the extraction for videos protected with password
Added a test video.
11 years ago
Jaime Marquínez Ferrándiz 55b3e45bba [vimeo] Fix pro videos and player.vimeo.com urls
The old process can still be used for those videos.
Added RegexNotFoundError, which is raised by _search_regex if it can't extract the info.
11 years ago
Philipp Hagemeister 365bcf6d97 Merge remote-tracking branch 'origin/master' 11 years ago
Philipp Hagemeister 71907db3ba [vimeo] Fix normal videos (Fixes #1642)
Vimeo Pro Videos are still broken
11 years ago
Philipp Hagemeister 6803655ced Merge pull request #1622 from rbrito/fix-extension
extractor: youtube: Set extension of AAC audio formats to m4a.
11 years ago
Jaime Marquínez Ferrándiz b028e96144 [arte.tv:creative] Update the title of the test 11 years ago
Jaime Marquínez Ferrándiz ce68b5907c [nhl:videocenter] Fix playlist title extraction 11 years ago
Joshua Elsasser a6387bfd3c [vimeo] Implement the new format selection system (closes PR #996)
Rebased and deleted some parts to use the new system instead of copying the one from YoutubeIE
11 years ago
Jaime Marquínez Ferrándiz f6a54188c2 [youtube] Use 'node is None' when checking if the video has automatic captions
It had stopped working and it reports a FutureWarning
11 years ago
Jaime Marquínez Ferrándiz cbbd9a9c69 Fix the duration field for the VideoDetective and InternetVideoArchive tests
Also remove the use of the old format system and the comment
11 years ago
Jaime Marquínez Ferrándiz 685a9cd2f1 [googleplus] Fix upload_date extraction 11 years ago
Jaime Marquínez Ferrándiz 182a107877 [arte] Set the format_note and the format_id fields (closes #1628) 11 years ago
Jaime Marquínez Ferrándiz 8c51aa6506 The 'format' field now defaults to '{format_id} - {width}x{height}{format_note}'
Following the YoutubeIE format. The 'format_note' gives additional info about the format, for example '3D' or 'DASH video'.
11 years ago
Philipp Hagemeister f8b45beacc Merge remote-tracking branch 'rbrito/set-age'
Conflicts:
	youtube_dl/extractor/xhamster.py
11 years ago
Philipp Hagemeister 9d92015d43 [xhamster] Add support for age_limit (Instead of #1627) 11 years ago
Rogério Brito 50a6150ed9 extractor: Set age limit on some adult-related extractors.
More age limit of videos for adult-related sites.

Note that, for redtube, I explicitly left the variable containing the age
limit, since the comment justifying the age limit is a good thing to have.

That being said, I included the age limit field on the test, to better
reflect what the information extractor does (even if it may not break the
automated tests).

Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
11 years ago
Rogério Brito d5a9bb4ea9 extractor: youtube: Swap video dimensions to match standard practice.
While working on this, I thought about simplifying things like changing
480x854 to 480p, and that seemed like a good option, until I realized that
people (me included) usually link the concept of some number followed by a p
with the video being 16:9.

So, we would be losing some information and, as we all know,
[explicit is better than implicit][*].

[*]: http://www.python.org/dev/peps/pep-0020/

This closes #1446.

Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
11 years ago
rzhxeo b0505eb611 [CinemassacreIE] Fix information extraction 11 years ago
Rogério Brito 8ed6b34477 extractor: Set age limit on some adult-related extractors.
This is similar in spirit to what was done in commit 8e590a117f.

Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
11 years ago
Rogério Brito f6f1fc9286 extractor: youtube: Fix extension of dash formats.
While we are at it, separate the audio formats from the video formats.

Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
11 years ago
Philipp Hagemeister 8e590a117f [xnxx] Add age_limit 11 years ago
Rogério Brito 16f36a6fc9 extractor: youtube: Set extension of AAC audio formats to m4a.
This, in particular, eases downloading both audio and videos in DASH formats
before muxing them, which alleviates the problem that I exposed on issue

Furthermore, one may argue that this is, indeed, the case for correctness's
sake.

Signed-off-by: Rogério Brito <rbrito@ime.usp.br>
11 years ago
Philipp Hagemeister 53c1d3ef49 Check for embedded YouTube player (Fixes #1616) 11 years ago
Philipp Hagemeister 7c58ef3275 [tudou] Fix title regex (Fixes #1614) 11 years ago
Philipp Hagemeister 416a5efce7 fix typos 11 years ago
Jaime Marquínez Ferrándiz d21ab29200 Add an extractor for techtalks.tv (closes #1606) 11 years ago
Philipp Hagemeister a733eb6c53 [youtube] Do not crash if caption info is missing altogether (Fixes #1610) 11 years ago
Philipp Hagemeister 591454798d [brightcove] Raise error if playlist is empty (#1608) 11 years ago
Philipp Hagemeister 38604f1a4f Merge remote-tracking branch 'origin/master' 11 years ago
Philipp Hagemeister 2d0efe70a6 [brightcove] Fix more broken XML (#1608) 11 years ago
Jaime Marquínez Ferrándiz bfd14b1b2f Add an extractor for rutube.ru (closes #1136)
It downloads with a m3u8 manifest, requires ffmpeg.
11 years ago
Philipp Hagemeister 10eaae48ff Merge branch 'master' of github.com:rg3/youtube-dl 11 years ago
Philipp Hagemeister 9d4660cab1 [generic] Support embedded vimeo videos (#1602) 11 years ago
Jaime Marquínez Ferrándiz 9d74e308f7 [sztvhu] Fix the title extraction 11 years ago
Jaime Marquínez Ferrándiz 8381a92120 [websurg] Skipt the test
It needs login information.
11 years ago
Philipp Hagemeister 4f41664de8 Merge remote-tracking branch 'Rudloff/websurg' 11 years ago
Philipp Hagemeister 7cf67fbe29 [sztvhu] Simplify 11 years ago
Philipp Hagemeister 3ddf1a6d01 Merge remote-tracking branch 'Elbandi/master' 11 years ago
Philipp Hagemeister 850555c484 Merge remote-tracking branch 'origin/master' 11 years ago
Philipp Hagemeister 9ed3bdc64d [tudou] Add support for youku links (Closes #1571) 11 years ago
Jaime Marquínez Ferrándiz c45aa56080 [gamespot] Fix video extraction (fixes #1587) 11 years ago
Philipp Hagemeister 7394b8db3b Merge remote-tracking branch 'origin/master' 11 years ago
Andras Elso f9b3d7af47 Add an extractor for Szombathelyi TV 11 years ago
Filippo Valsorda ea62a2da46 add VideoPremium.tv RTMP support 11 years ago
Jai Grimshaw 1fb07d10a3 [youtube] Adds #1312 Download annotations
Adds #1321 Download annotations from youtube
Annotations are downloaded and written to a .annotations.xml file using the https://www.youtube.com/annotations_invideo?features=1&legacy=1&video_id=$VIDEOID API.
Added unit test for annotations.
11 years ago
Philipp Hagemeister 9378ae6e1d [youku] Allow shortcut youku:ID and make non-matching groups non-matching (#1571) 11 years ago
Jaime Marquínez Ferrándiz 69a0c470b5 [arte] Add an extractor for future.arte.tv (closes #1593) 11 years ago
Jaime Marquínez Ferrándiz c40f5cf45c [arte] add an extractor for creative.arte.tv (#1593)
The +7 videos now use an independent extractor that is also used for the creative videos
11 years ago
Jaime Marquínez Ferrándiz 4b7b839f24 Add an extractor for rottentomatoes.com and improve InternetVideoArchiveIE to get the best quality 11 years ago