Commit Graph

1411 Commits (91264ce5728bbe7e560c13dc7a047b083dd67d7e)

Author SHA1 Message Date
Philipp Hagemeister 0f2999fe2b Merge pull request #2221 from Rudloff/master
Removed websurg extractor
11 years ago
sahutd 53bfd6b24c Added support for Discovery Issue #2227 11 years ago
Jaime Marquínez Ferrándiz 5700e7792a [youtube] Encode the data when submitting the form for confirming the age
Needed on python 3
11 years ago
Jaime Marquínez Ferrándiz 38c2e5b8d5 [youtube] Use https: in more urls 11 years ago
Jaime Marquínez Ferrándiz beddbc2ad1 [youtube:toplist] Make the regex for finding the playlist link more flexible
`title={foo}` may not be at the end of the `href` string.
11 years ago
Jaime Marquínez Ferrándiz 944d65c762 [extractor/common] Encode the url when calculating the md5 with `—write-pages` option
This doesn’t cause any problem in python 2.*, but on python 3 the `md5` function only accepts bytes.
11 years ago
Philipp Hagemeister f945612bd0 [rtlnow] Simplify 11 years ago
Jaime Marquínez Ferrándiz 59188de113 Properly escape ‘.’ in some _VALID_URL properties 11 years ago
Jaime Marquínez Ferrándiz 352d08e3e5 Add an extractor for freespeech.org (closes #2234) 11 years ago
Pornophage bacb5e4f44 Minor fixes
Remove empty description
Set correct md5 test
11 years ago
Pornophage 008af8660b Add cliphunter extractor 11 years ago
Philipp Hagemeister 2c5bae429a [youtube] Fix new formats 11 years ago
Philipp Hagemeister 1394ce65b4 [youtube] Add new formats (Fixes #2221) 11 years ago
Pierre Rudloff 67ccb77197 Removed websurg extractor 11 years ago
Philipp Hagemeister 0b65e5d40f [youtube] Do not break upon unknown formats 11 years ago
Philipp Hagemeister 975d35dbab [youtube:truncated_url] Also match mail subscription links (#2214) 11 years ago
Jaime Marquínez Ferrándiz 8b769664c4 [sina] Recognize http://video.sina.com.cn/v/b/{id}-*.html urls (fixes #2212) 11 years ago
Jaime Marquínez Ferrándiz 76f270a46a [sina] use unicode_literals 11 years ago
Philipp Hagemeister 924f47f7b6 [rottentomatoes] Use unicode_literals 11 years ago
Philipp Hagemeister 22ff1c4a93 [xhamster] Futher simplification 11 years ago
Philipp Hagemeister 35409e1101 [xhamster] Use unicode_literals 11 years ago
Mike Col 65d781128a [xhamster] Add support for hd video
Signed-off-by: Philipp Hagemeister <phihag@phihag.de>
11 years ago
Philipp Hagemeister 066f6a0630 [nowness] Add support 11 years ago
Philipp Hagemeister 12ed57418c [gamespot] Fix regexp 11 years ago
Philipp Hagemeister 4919603f66 [youtube] Make DASH manifest download conditional for now
DASH download fails on many videos (all with encrypted signatures? not sure yet), for example 07FYdnEawAQ, with a 403.
11 years ago
Philipp Hagemeister bd2d82a5d3 [newgrounds] Simplify 11 years ago
Philipp Hagemeister 65697b3bf3 Merge branch 'paged-lists'
Conflicts:
	test/test_utils.py
	youtube_dl/extractor/youtube.py
11 years ago
Philipp Hagemeister 50317b111d Merge branch 'youtube-dash-manifest'
Conflicts:
	youtube_dl/extractor/youtube.py
11 years ago
Philipp Hagemeister d7975ea287 [xvideos] Simplify 11 years ago
Mike Col 714d709a31 [xvideos] Fix thumbnail extraction
Signed-off-by: Philipp Hagemeister <phihag@phihag.de>
11 years ago
Philipp Hagemeister 11577ec054 [cspan] Disable test
It works fine from all my machines, no matter where, but from travis, we get lots of 403s.
Maybe another project is scraping CSPAN from travis and they're blocking the travis machines?
11 years ago
Philipp Hagemeister 04b4d394d9 Add new --default-search option (#2193) 11 years ago
Jaime Marquínez Ferrándiz 130f12985a [comedycentral] Use the generic `_real_extract` provided by the base class 11 years ago
Jaime Marquínez Ferrándiz 4ca5d43cd8 Merge pull request #2195 from dstftw/master
[space] Add support for mobile URLs
11 years ago
Jaime Marquínez Ferrándiz 4bbf139aa7 [southparkstudios] Use the generic `_real_extract` provided by the base class 11 years ago
dst 47739636a9 [space] Add support for mobile URLs 11 years ago
Jaime Marquínez Ferrándiz 407ae733ab [cspan] Make ‘www’ optional and improve the regex for extracting the id (fixes #2194) 11 years ago
Jaime Marquínez Ferrándiz c39f7013e1 [gametrailers] Use the generic `_real_extract` provided by the base class 11 years ago
Philipp Hagemeister a4a028323e [comedycentral] Use unicode_literals 11 years ago
Philipp Hagemeister 780ee4e501 [comedycentral] Adapt testcase
In contrast to other sites, ComedyCentral seems to understand how to sensibly use MTV IE, but the additional text shouldn't hurt.
11 years ago
Philipp Hagemeister d7b51547c0 [imdb:list] Switch to loading the webpage
The RSS method seems to be defunct.
11 years ago
Philipp Hagemeister 43030f36db [d8] typo 11 years ago
Philipp Hagemeister 48c63f1653 [d8] disable test; video got deleted 11 years ago
Philipp Hagemeister 90f479b6d5 [novamov] Skip tests 11 years ago
Philipp Hagemeister d3a1c71917 [ringtv] Fix and add news extraction 11 years ago
Philipp Hagemeister af1588c05f [mtv] Update tests and xpath function for new title extraction 11 years ago
Philipp Hagemeister 2250865fb0 [Wimp] Use new URL relay method 11 years ago
Philipp Hagemeister 99f770caa8 [hotnewhiphop] Retrieve media key 11 years ago
Philipp Hagemeister a70515c0fd [servingsys] Do not run test on travis
Apparantly, even the advertisers do geoblocking now!?
From the US, this isn't outright blocked, but there are no videos returned.
11 years ago
Philipp Hagemeister 6562df768d Merge branch 'master' of github.com:rg3/youtube-dl
Conflicts:
	youtube_dl/extractor/mtv.py
11 years ago
Philipp Hagemeister 06769acd71 [gametrailers] Use unicode_literals
Conflicts:
	youtube_dl/extractor/gametrailers.py
11 years ago
Philipp Hagemeister 32dac6943d [mtv] Use unicode_literals 11 years ago
Philipp Hagemeister 90834c78fe [mtv] Fix title for gametrailers (Fixes #2188)
We now prefer the title including the category, because that title is what is presented at the actual sites.
11 years ago
Jaime Marquínez Ferrándiz 47917f24c4 [brightcove] Fix extraction of embedded videos
There was a leading ‘:’ in the regex.
The ‘flashvars’ parameter is not always available.
11 years ago
Jaime Marquínez Ferrándiz d614aa40e3 [brightcove] Fix check for url in the result
It may have the ‘formats’ field instead of ‘url’.
11 years ago
Jaime Marquínez Ferrándiz bc4ba05fcb [mtv] Add an extractor for mtviggy.com (#2072) 11 years ago
Jaime Marquínez Ferrándiz 8d9453b9e8 Add an extractor for spike.com (#2072)
Added a generic _real_extract to MTVServicesInfoExtractor
11 years ago
Jaime Marquínez Ferrándiz e4f320a4d0 [mtv] Check for geo-blocked videos in the xml document, not in the xml’s string
Allows to use the `_download_xml` method
11 years ago
Jaime Marquínez Ferrándiz ef9f2ba7af [mtv] Use unicode_literals 11 years ago
Philipp Hagemeister 913f32929b [vk] Add support for HQ videos (Fixes #2187) 11 years ago
Philipp Hagemeister 9834872bf6 [facebook] Add support for embeds
Example URL: http://www.hostblogger.de/blog/archives/6181-Auto-jagt-Betonmischer.html
11 years ago
Philipp Hagemeister 94a23d2a1e [vk] Use unicode_literals 11 years ago
Philipp Hagemeister 608bf69880 [vk] avoid built-in names 11 years ago
Philipp Hagemeister 032b3df5af [redtube] Use unicode_literals 11 years ago
Mike Col 9d11a41fe4 [redtube] Add support for thumbnails
Signed-off-by: Philipp Hagemeister <phihag@phihag.de>
11 years ago
Philipp Hagemeister 7b0817e8e1 [servingsys] Add support
This also adds support for brightcove advertisements.
Fixes #2181
11 years ago
Philipp Hagemeister 9d4288b2d4 [extractor/common] Clarify when and when not we generate the filename 11 years ago
Philipp Hagemeister 3486df383b [generic] Improve testcase 11 years ago
Philipp Hagemeister b60016e831 Deal with implicitly UTF-16 decoded webpages
These webpages don't specify an encoding and rely on the BOM
11 years ago
Philipp Hagemeister 5aafe895fc Correct XML ampersand fixup 11 years ago
Philipp Hagemeister b7ab059084 Add infrastructure for paged lists
This commit allows to download pages in playlists as needed instead of all at once.
Before this commit,
    youtube-dl http://www.youtube.com/user/ANNnewsCH/videos --playlist-end 2 --skip-download
took quite some time - now it's almost instantaneous.
As an example, the youtube:user extractor has been converted.
Fixes #2175
11 years ago
Philipp Hagemeister c91778f8c0 [youtube] Fall back to header if playlist title is not available
Sometimes (in about 10% of requests), the og:title is missing for a weird reason.
See #2170 for an example
11 years ago
Philipp Hagemeister 5016f3eac8 [myspace] More robust mediatype check 11 years ago
Jaime Marquínez Ferrándiz efb1bb90a0 [myspace] Add support for song urls (fixes #2040) 11 years ago
Philipp Hagemeister 4cf393bb4b [dropbox] Correct test case (#2171) 11 years ago
Philipp Hagemeister ce4e242a6f [dropbox] PEP8 and simplify (#2171) 11 years ago
sahutd 6b79f40c3d Added support for Dropbox 11 years ago
Philipp Hagemeister dd27fd1739 [youtube] Download DASH manifest
If given, download and parse the DASH manifest file, in order to get ultra-HQ formats.
Fixes #2166
11 years ago
sahutd 2a7c35dd46 added dropbox support 11 years ago
sahutd 8da531359e Added dropbox support. issue #2055 11 years ago
Philipp Hagemeister 3ec05685f7 [extractor/common] Limit --write-pages filename to 200 chars
This avoids problems with very long URLs.
11 years ago
Philipp Hagemeister 877bfd69d1 [cnn] Improve test 11 years ago
Philipp Hagemeister f68cd00fe3 [kankan] Skip test 11 years ago
Philipp Hagemeister ca70d215cf [kankan] Simplify 11 years ago
Philipp Hagemeister d0390a0c92 [mixcloud] Use unicode_literals 11 years ago
Philipp Hagemeister dd2535c38a [mixcloud] Fix URL extraction 11 years ago
Philipp Hagemeister b78d180170 [mpora] Fix uploader name extraction 11 years ago
Philipp Hagemeister 26dca1661e [ted] Updated checksums 11 years ago
Philipp Hagemeister f853f8594d [ted] Use unicode_literals 11 years ago
Philipp Hagemeister d0da491e1e [condenast] Allow multiple formats, and sort centralized 11 years ago
Philipp Hagemeister 6e249060cf [condenast] Use unicode_literals 11 years ago
Philipp Hagemeister fbcd7b5f83 [soundcloud] Use unicode_literals and centralized sorting 11 years ago
Philipp Hagemeister 9ac0a67581 [spankwire] Use centralized format sorting and unicode_literals 11 years ago
Philipp Hagemeister befdc8f3b6 [teamcoco] Use centralized sorting 11 years ago
Philipp Hagemeister bb198c95e2 [teamcoco] Use unicode_literals 11 years ago
Philipp Hagemeister c1195541b7 [gamespot] Use unicode_literals 11 years ago
Philipp Hagemeister 26844eb57b [franceinter] Remove superfluous whitespace 11 years ago
Philipp Hagemeister 677b3ce82f [franceinter] Minor improvements (#2152) 11 years ago
Philipp Hagemeister fabfe17d5e [flickr] Use unicode literals 11 years ago
Philipp Hagemeister 82696d5d5d Merge remote-tracking branch 'sahutd/master' 11 years ago
Philipp Hagemeister 484aaeb204 [everyonesmixtape] Add support (Fixes #2161) 11 years ago
Philipp Hagemeister 2f21eb2db6 [generic] Do not fetch XML URLs (Fixes #2162) 11 years ago
Jaime Marquínez Ferrándiz c11529618a [redtube] Make ‘http:’ not optional (closes #2160)
If the url doesn’t specify the protocol we can’t directly use it to download the webpage, we would need to build a new url.
Instead, we let the generic extractor add the protocol.
11 years ago
sahutd c8650f7ecd Made modification as suggested on https://github.com/rg3/youtube-dl/pull/2151 11 years ago
Saimadhav Heblikar 14e7543a5a franceinter [Issue #2105]
Added franceinterIE import to reflect addition of FranceInter support. Issue #2105
11 years ago
Saimadhav Heblikar bf6705f584 Added franceinter [Issue #2105] 11 years ago
Filippo Valsorda a9f53ce7ea Add a couple of missing http:// in test URLs 11 years ago
Philipp Hagemeister 5d8683a5cd [nowvideo] Add support for .sx version (Fixes #2127) 11 years ago
dst 7ee40b5d1c [lynda] Add support for member accounts and paid videos (Closes #2125) 11 years ago
Jaime Marquínez Ferrándiz db22af36ec [brightcove] The ‘id’ attribute is not always present in the object tag (fixes #2132)
It looks like the ‘flashId’ parameter is not needed.
11 years ago
Philipp Hagemeister f8b5ab8cfa [bandcamp] Make thumbnail and uploader optional
Fixes #2129
11 years ago
Jaime Marquínez Ferrándiz 298f16f954 [bandcamp] Fix variable name 11 years ago
Philipp Hagemeister ce6b9a2dba [youtube] Add a pseudo format for rtmp videos (#2123) 11 years ago
Philipp Hagemeister c3197e3e5c [youtube] Correct subtitle URL (Fixes #2120) 11 years ago
Philipp Hagemeister 3fabeaa1f4 [vimeo] Support protocol-relative URLs 11 years ago
Jaime Marquínez Ferrándiz 9d6192a5b8 [bloomberg] Fix ooyala url extraction 11 years ago
Jaime Marquínez Ferrándiz 469ec9416a [francetv] Add extractor for Culturebox (closes #2117) 11 years ago
dst 5f59ee7942 [novamov] Remove superfluous tabs 11 years ago
dst 8f89e68781 [novamov] Add embedded player support 11 years ago
Philipp Hagemeister 10bff13a66 [novamov] Simplify 11 years ago
Philipp Hagemeister 166ff8a3c7 Merge remote-tracking branch 'dstftw/novamov' 11 years ago
Philipp Hagemeister b4622a328b Use double quotes in error message (#2112)
On Windows, double quotes are required, because single quotes get served to youtube-dl. (Yes, cmd.exe is crazy like that).
On other system, both double and single quotes are fine, unless the string contains a dollar sign (then you need single quotes).
Since virtually no URLs contain dollar signs, double quotes should do.
11 years ago
dst cc253000e4 [novamov] Add support for novamov.com (Fixes #2035) 11 years ago
Philipp Hagemeister 42e4fcf23a [generic] Fix regexes 11 years ago
Philipp Hagemeister 9c63128668 [metacritic] Use centralized sorting and unicode_literals 11 years ago
Philipp Hagemeister 9933b57430 [pornhub] Use centralized sorting 11 years ago
Philipp Hagemeister 84c92dc00f [c56] Add suppot for multiple formats 11 years ago
Philipp Hagemeister 42154ad5bc [archiveorg] Use centralized sorting 11 years ago
Philipp Hagemeister 3798eadccd More unicode literals 11 years ago
Philipp Hagemeister 0eecc6a417 [vimeo] Add support for passwords for player. URLs
Fixes #2053
11 years ago
Philipp Hagemeister 0dc13f4c4a Correctly set IE_NAME field 11 years ago
Philipp Hagemeister f577e0ce15 switch more to unicode_literals 11 years ago
Philipp Hagemeister ecfef3e5bf +unicode_literals 11 years ago
Philipp Hagemeister 3d3538e422 [khanacademy] Add support (Fixes #2066) 11 years ago
Philipp Hagemeister c93c2ab1c3 [mpora] Add support (Fixes #2096) 11 years ago
Philipp Hagemeister 7b09a4d847 [lynda] Fix download if subtitles were not requested 11 years ago
Philipp Hagemeister 73a25b30ea [lynda] Remove superfluous space 11 years ago
Philipp Hagemeister ac260dd81e [lynda] Remove useless u"" 11 years ago
Philipp Hagemeister 48a2034671 [vimeo] Fix playlist URL matching 11 years ago
Philipp Hagemeister 4f81667d76 [orf] Remove unused variable name 11 years ago
Philipp Hagemeister 79f8295303 Use original Referer URL in Brightcove requests (Fixes #2110) 11 years ago
Philipp Hagemeister 400e58103d [brightcove] Use unicode_literals 11 years ago
Philipp Hagemeister fcee8ee784 [vimeo] Use _search_regex 11 years ago
Philipp Hagemeister 9148eb002b [vimeo] Use unicode_literals 11 years ago
Philipp Hagemeister 559e370f44 [vimeo] Proper warning when password is required (Fixes #2053)
In player. URLs, the password warning is different.
11 years ago
Philipp Hagemeister 9a6422a81e Merge remote-tracking branch 'origin/master' 11 years ago
Philipp Hagemeister fcea44c6d5 [vimeo] Add support for review pages
Since the regexp is already overboarding and review pages have a distinct URL format (with non-trivial stuff after the ID), use a dedicated IE.
Fixes #2106
11 years ago
Philipp Hagemeister 5d73273f6f [orf] Use new extraction method (Fixes #2057) 11 years ago
Philipp Hagemeister c11a0611d9 [veehd] Send requests twice (Fixes #2102) 11 years ago
Philipp Hagemeister 796495886e [generic] Use unicode_literals instead of duplicating the u' 11 years ago