f37bdbe537
[extractor/generic] Add test for tvc embed
10 years ago
2da09ff8b0
[extractor/generic] Fix tvc ie_key
10 years ago
954c1d0529
[tvc] Refactor extractor names
10 years ago
494f20cbdc
[extractor/generic] Add support for tvc embeds
10 years ago
97b570a94c
[generic] Improve rtl.nl embeds detection ( Closes #5950 )
10 years ago
b26733ba7f
[brightcove] Allow single quotes in Brightcove URLs ( fixes #5901 )
10 years ago
c5138a7ce4
[extractor/generic] Clarify test comment
10 years ago
c5fa81fe81
[extractor/generic] Put all direct link tests near to each other for better navigation
10 years ago
a074e92296
[extractor/generic] Add test for large compressed media
10 years ago
1ddb9456c4
[extractor/generic] Use compat_urllib_parse_unquote for unquoting video_id and title from URL
10 years ago
58bde34a23
[extractor/generic] Force Accept-Encoding to any for extraction pass
10 years ago
339516072b
[extractor/generic] Unescape video_id and title extracted from URL
10 years ago
25c3a7348f
[generic] Fix typo
10 years ago
b827a6015c
[generic] Add test for sportbox embeds
10 years ago
d40a3b5b55
[generic] Add support for sportbox embeds
10 years ago
3b5f65a64c
[mlb] Fix extraction of articles
...
And move test from generic, since it's directly handled by MLBIE
10 years ago
dc455a5f88
[extractor/generic] Add test for svt embed
10 years ago
bab19a8e91
[extractor/generic] Add support for svt embeds ( Closes #5622 )
10 years ago
406224be52
[extractor/generic] Fix following incomplete redirects ( #5640 )
10 years ago
8001607e90
[generic] Detect more MLB videos ( fixes #5443 )
10 years ago
0954cd8aa4
[Cinemassacre] Add detection for videos from blip.tv
10 years ago
2fe1b5bd2a
[CSpan] Add detection for Senate ISVP. Closes #5302
10 years ago
6225984681
[generic] Update pladform embed test
10 years ago
d6fd958c5f
[generic] Extract videos from SMIL manifests ( closes #5145 and fixes #5135 )
10 years ago
c798f15b98
[generic] Add test for playwire embed ( #5430 )
10 years ago
2dcc114f84
[generic] Add support for playwire embeds ( Closes #5430 )
10 years ago
01c58f8473
[generic] Fix test generic_51
...
The website replaced the original video with a new one
10 years ago
edfcf7abe2
[generic] Support another type of Ooyala embedded video
10 years ago
a4257017ef
[generic] Add tests for Crooks and Liars embeds
10 years ago
18153f1b32
[generic] Add support for Crooks and Liars embeds
10 years ago
0a1603634b
[utils] Remove url_infer_protocol
10 years ago
418c5cc3fc
[udn] Add new extractor
10 years ago
facecb84a1
[generic] Add working NBC Sports vplayer test
10 years ago
a2edf2e7ff
[NBC/ThePlatform/Generic] Add a generic detector for NBCSportsVPlayer and enhance error detection in ThePlatformIE
10 years ago
ad320e9b83
[generic] Add support for 5min embeds ( #5310 )
10 years ago
2051acdeb2
[extractor/generic] Add test for Libsyn embed
10 years ago
cefdf970cc
[extractor/generic] Support Libsyn embeds
10 years ago
3378d67a18
[generic] Add support for nytimes embeds ( Closes #5234 )
10 years ago
ed9a25dd61
[generic] Generalize redirect regex
10 years ago
84f8101606
[generic] Follow redirects specified by `Refresh` HTTP header
10 years ago
f838875726
[pladform] Add support for embeds
10 years ago
d47ae7f620
[eagleplatform] Add support for ClipYou embeds
10 years ago
135c9c42bf
[eagleplatform] Add support for embeds
10 years ago
76c73715fb
[generic] Parse RSS enclosure URLs ( Fixes #5091 )
10 years ago
e3216b82bf
[generic] Support dynamic Kaltura embeds ( #5016 ) ( #5073 )
10 years ago
13d8fbef30
[generic] Don't set the 'title' if it's not defined in the entry ( closes #5061 )
...
Some of them may be an 'url' result, which in general don't have the 'title' field.
10 years ago
255fca5eea
[generic] Add support for Zapiks embeds ( #5014 )
10 years ago
f37e3f99f0
[generic] Correct test case
...
Video has been reuploaded / edited
10 years ago
11e611a7fa
Extend various playlist tests
10 years ago
59b8ab5834
[rtlnl|generic] Add support for rtl.nl embeds ( Fixes #4959 )
10 years ago
e98b8e79ea
[generic] Improve SBS detection ( Fixes #4899 )
10 years ago
a0f7198544
[generic] Add support for jwPlayer YouTube videos
...
This makes nationalarchives.gov.uk work (Fixes #4907 , fixes #4876 )
10 years ago
f076b63821
[generic/ooyala] Add support for Ooyala embeds on SBN network websites ( Fixes #4859 )
10 years ago
52585fd6dc
The opening curly brace `{` is a regex reserved [control character]( http://stackoverflow.com/a/400316/1106367 ), so it needs to be escaped.
10 years ago
cb454b333d
[generic] Improve some regexes
10 years ago
796df3c631
fixed viddler support - needed a Referer header; also added a viddler
...
generic extractor
10 years ago
b1b0b1ca30
[generic] Improve description testcase in rss test
10 years ago
501f13fbf3
[generic] Add support for Cinerama player ( Fixes #4752 )
10 years ago
61ca9a80b3
[generic] Add support for BOMs ( Fixes #4753 )
10 years ago
d7cc31b63e
[generic] PEP8
10 years ago
cd791a5ea0
[ted] Add support for embed-ssl.ted.com embedded videos
10 years ago
87830900a9
[generic] Update some tests
10 years ago
faa4ea68c0
[generic] Add BBC iPlayer playlist test
10 years ago
476eae0c2a
[generic] Generalize BBC iPlayer playlist extraction
10 years ago
8399267671
[generic] Make getter None by default
10 years ago
db546cf87f
[generic] Add support for BBC iPlayer embeds ( Closes #4619 )
10 years ago
416c7fcbce
Add documentation about supported sites ( Fixes #4503 )
10 years ago
42bdd9d051
[cinchcast] Add new extractor ( Fixes #4428 )
10 years ago
4e262a8838
[generic] Detect direct video links ( Fixes #4149 , #4313 )
10 years ago
65f3a228b1
[generic] Add support for LazyYT embeds ( Fixes #4306 )
10 years ago
b74e86f48a
Fix all PEP8 issues except E501
10 years ago
9e1a5b8455
PEP8: applied even more rules
10 years ago
2514d2635e
PEP8: E225,E227
10 years ago
8bcc875676
PEP8: more applied
10 years ago
5f6a1245ff
PEP8 applied
10 years ago
9b32eca3ce
[generic] Add support for single quotes in HTML5 videos ( Fixes #4265 )
10 years ago
af63fed7d8
[generic] Add support for livestream embeds ( Fixes #4185 )
10 years ago
9908e03528
Merge pull request #4076 from ghedo/direct_type
...
[generic] indicate when a direct video has been extracted
10 years ago
37aab27808
[brightcove] Extract m3u8 formats ( #3541 )
10 years ago
bdf9701729
[generic/brightcove] Add a new test case for kijk.nl ( #3541 )
10 years ago
8c25f81bee
[util] Move compatibility functions out of util
...
utils is large enough without these compatibility functions.
Everything that is present in newer versions of Python (i.e. with dev Python it's just an import) goes into compat.py .
Everything else (i.e. youtube-dl-specific helpers) goes into utils.py .
10 years ago
ccdd0ffb80
[generic] indicate when a direct video has been extracted
...
Fixes #4052 .
10 years ago
5263cdfcf9
[generic] Improve MLB iframe regex
10 years ago
ac645ac7d0
[generic] Allow soundcloud embeds with additional attributes
10 years ago
48a24ab746
[generic] Fix HTML5 video regexp
10 years ago
d6d9186f0d
[generic] Fix test title
10 years ago
37d66e7f1e
[generic] Correct call to _webpage_read_full_content
10 years ago
70b7e3fbb6
[generic] Add a test case for direct links with broken HEAD ( #4032 )
10 years ago
23be51d8ce
[generic] Handle audio streams that do not implement HEAD ( Fixes #4032 )
10 years ago
a7e97f6db1
[generic] Allow new SWFObject()-style imports
...
This embed style is used on http://www.bitburger-open.de/ , but that is not included as a test case since the format is likely to be temporary.
10 years ago
f2f2c0c2c6
[generic] Allow --default-search without colon
10 years ago
281d3f1d68
[generic/wistia] Improve regex
10 years ago
85d7b76586
[thoughtworks] wistia regex modified
10 years ago
52cffcb186
[thoughtworks] wistia support added
10 years ago
9471c44405
[generic] Make sure Wistia embed URLs contain the protocol ( Closes #3977 )
...
Also, improve detection (Addresses #3662 )
10 years ago
09a42738fc
[generic] Correct handling of embedded vimeo players ( #3955 )
10 years ago
1419fafd36
[condenast] Add support for embedded videos ( Closes #3929 )
10 years ago
ced659bb4d
[generic] Ignore some non-video file extensions during generic extraction ( Closes #3900 )
10 years ago
8489578df4
[generic] Support embedded Dailymotion playlists ( fixes #3822 )
10 years ago
07e764439a
[generic] Delete test case
...
The page is not available any more.
10 years ago
761e1645e0
[generic] Remove unstable test checksum
10 years ago
a8eb5a8e61
[generic] Fix testcases
10 years ago
d6e6a42256
[vimeo:likes] Add new extractor ( Fixes #3835 )
10 years ago
c6e90caaa6
Merge remote-tracking branch 'naglis/wistia'
10 years ago
6b08cdf626
[youtube] Support for embedded /p players ( Fixes #3821 )
10 years ago
3b2f933b01
[generic] Allow embedded YoutubePlaylists ( Fixes #3821 )
10 years ago
746c67d72f
[wistia] Use API and make more generic
10 years ago
a04aa7a9e6
[generic] The url in the <meta redirect> doesn't need to be enclosed in single quotes ( fixes #3770 )
...
See the examples in https://en.wikipedia.org/wiki/Meta_refresh or the shortened urls from https://t.co/ .
10 years ago
1bf5423e82
[generic/youtube] Recognize youtube nocookie embeds ( Closes #3713 )
10 years ago
1a94ff6865
[mlb] Add support for embedded videos ( Closes #3653 )
10 years ago
b759a0d4d2
fix up imports
10 years ago
22a6f15061
Move playlist tests to extractors.
...
From now on, test_download will run these tests. That means we benefit not only from the networking setup in there, but also from the other tests (for example test_all_urls to find problems with _VALID_URLs).
10 years ago
aff216edf4
[generic] Prevent <video> search from skipping over empty sources ( #3546 )
10 years ago
1cb6dcdbbe
[generic] Do not download images as videos by accident
10 years ago
f971dcbba0
Merge branch 'master' of github.com:rg3/youtube-dl
10 years ago
0990305d2a
[generic] Fix rss under Python 2.x and move test to extractor
10 years ago
bcc069a937
[generic] Remove debug statement
10 years ago
5f90042bd6
[generic] remove unused imports
10 years ago
ebab4520ff
[generic] Use default opener for HEAD request ( Fixes #3528 )
10 years ago
4d805e063c
[generic] Automatic detection of flow player and age_limit ( Fixes #3576 )
10 years ago
4d54ef20a2
[ministrygrid] Add extractor ( Fixes #2900 )
10 years ago
1f8b6af773
[bip.tv] Allow underscore in lookup ids ( Fixes #3573 )
10 years ago
10eaeb20c5
[generic] Require og:video URLs to contain a dot
10 years ago
fa8deaf38b
[generic] Prevent from downloading a .swf as a video
...
We're seeing quite a number of people who do not put a video file in the og:video field, but the player URL. Try to detect some of these and filter them out.
10 years ago
c8e9a235d9
[generic] Add support for camtasia videos ( Fixes #3574 )
10 years ago
2ef6fcb5d8
[sbs] Add new extractor ( Fixes #3566 )
10 years ago
ed2d6a1960
[generic] Simplify playlist support ( #2948 )
10 years ago
c71dfccc98
Merge remote-tracking branch 'anovicecodemonkey/generic-data-video-url'
...
Conflicts:
youtube_dl/extractor/generic.py
10 years ago
49807b4ac6
[yahoo] Add support for embedded videos ( Closes #3525 )
10 years ago
1f7ccb9014
[generic] Add --default-search fixup_error
...
This restores the ability to enter URLs without a scheme (and default to http), but still fail if the input is a search term.
10 years ago
eef4a7a304
Fix typo: “ytseach” → “ytsearch”
10 years ago
7571c02c8a
[generic] Set default-search to error
...
This prevents users from submitting bug reports where they mistyped a URL, and prevents me from getting a weird video when holding shift and thus searching for :Tds
10 years ago
0364fa8b65
[generic] Add support for ivi.ru embedded player
10 years ago
c5cd249e41
[generic] Extract mtvservices embedded videos
11 years ago
826ec77fb2
[Vulture] Add support for vulture.com
11 years ago
2b88feedf7
[generic] Add support for <embed YouTube
11 years ago
37e3cbe22e
Move duplicate check to generic.py
11 years ago
610134730a
Add a _TEST_
11 years ago
0e67ab0d8e
[generic] Abort if user passes in URL "url" ( #2942 )
11 years ago
3442b30ab2
[generic] Support data-video-url for YouTube embeds ( Fixes #2862 )
11 years ago
8dfa187b8a
[generic] Support pagespeed_iframe for NovaMov embeds
11 years ago
a5a45015ba
[generic] Fix redirect
11 years ago
2099125333
[soundcloud/generic] Add support for playlists
11 years ago
669f0e7cda
[generic] Fix wrong entries index
11 years ago
b30b8698ea
[generic] Allow multiple matches for generic hits ( Fixes #2818 )
11 years ago
ebd3c7b370
[generic] Add support for protocol-independent URLs ( Fixes #2810 )
11 years ago
c0292e8ab7
[generic] Improve jwplayer detection ( Fixes #2731 )
11 years ago
48099643cc
[generic] Be more relaxed when looking for aparat embeds ( Fixes #2784 )
11 years ago
fa35cdad02
[condenast|generic] Add support for condenast embeds ( Fixes #2783 )
11 years ago
fd50bf623c
[generic] Modernize tests
11 years ago
d360a14678
[generic] Update test
11 years ago
15c0e8e7b2
[generic] Generalize novamov based embeds
11 years ago
7cd3bc5f99
[nowvideo] Support more domains
11 years ago
50f566076f
[generic] Add support for videoweed embeds
11 years ago
ca6aada48e
Fix _TEST for Ustream embed URLs
11 years ago
5c38625259
[UstreamIE] [generic] Added support for Ustream embed URLs ( Fixes #2694 )
11 years ago
9ad400f75e
[generic] Remove test case that has become a 404
11 years ago
0479c625a4
[brightcove] Encode object_str with utf-8
11 years ago
9c1fc022ae
[generic] Warn before fallback to automatic search
11 years ago
cb3ac1c610
[smotri] Modernize and add support for emdebbed videos ( Closes #2585 )
11 years ago
893f8832b5
[arte] Add support for embedded videos ( Fixes #2620 )
11 years ago
7e2ede9891
[generic] Run TED detection before JW Player detection
...
Otherwise it overwrittes the `mobj` variable.
11 years ago
0f2a2ba14b
Merge remote-tracking branch 'dstftw/generic-webpage-unescape'
...
Conflicts:
youtube_dl/extractor/generic.py
11 years ago
750f9020ae
[generic] Recognize more Ooyala embedded videos ( #2569 )
11 years ago
aab74fa106
[ted] Simplify embed code ( #2587 )
11 years ago
8d7c0cca13
[generic] Add support for embeded TED videos
11 years ago
ecbe1ad207
[generic] Fix access to removed function in python 3.4
...
The `Request.get_origin_req_host` method was deprecated in 3.3, use the
`origin_req_host` property if it's not available, see http://docs.python.org/3.3/library/urllib.request.html#urllib.request.Request.get_origin_req_host .
11 years ago
93d020dd65
[generic] Add support for embedded rutv player
11 years ago
15fd51b37c
[generic] More generic support for embedded vimeo player ( #1602 )
11 years ago
d95e35d659
[generic] Add nowvideo test hidden behind percent encoding
11 years ago
1439073049
[generic] Add comment for unescaping webpage contents
11 years ago
1f7659dbe9
[generic] Unescape webpage contents
11 years ago
60cc4dc4b4
[generic/funnyordie] Add support for funnyordie embeds ( Fixes #2546 )
11 years ago
bcf89ce62c
[generic] Suppress warning about doctypes in RSS parser
11 years ago
0a5bce566f
[generic] Add all test attributes for embedly ( #2447 )
...
In the future, we may want to not only print something, but throw an error for untested properties.
11 years ago
8012bd2424
[generic] Get a better ID
11 years ago
f55a1f0a88
Merge remote-tracking branch 'rzhxeo/embedly'
...
Conflicts:
youtube_dl/extractor/generic.py
11 years ago
ca97a56e4b
[vk] Add support for embedded videos ( Closes #2473 )
11 years ago
1b86cc41cf
Add support for embed.ly
11 years ago
89ef304bed
[generic] Add support for <meta redirect>
...
Fixes #413
11 years ago
b1c6c32f78
[generic] Add support for nowvideo embedded videos
11 years ago
f7300c5c90
[generic] Fix on python 2.6
...
`ParseError` is not available, it raises `xml.parsers.expat.ExpatError`.
The webpage needs to be encoded.
11 years ago
4fc946b546
[generic] Add support for RSS feeds ( Fixes #667 )
11 years ago
99877772d0
[generic] Add support for multiple brightcove URLs ( Fixes #2283 )
11 years ago
ab083b08ab
[generic] remove testcase
...
The video seems to have been removed from the site.
11 years ago
9f8928d032
[generic] Match JWPlayerOptions
...
This adds support for The Guardian, among others
Closes #2271 , fixes #2267
11 years ago
c3f51436bf
Improve some regexes for embedded players
11 years ago
17ab4d3b5e
[brightcove] Move test to generic
11 years ago
db1f388878
[huffpost] Add support
11 years ago
04b4d394d9
Add new --default-search option ( #2193 )
11 years ago
9834872bf6
[facebook] Add support for embeds
...
Example URL: http://www.hostblogger.de/blog/archives/6181-Auto-jagt-Betonmischer.html
11 years ago
3486df383b
[generic] Improve testcase
11 years ago
2f21eb2db6
[generic] Do not fetch XML URLs ( Fixes #2162 )
11 years ago
3fabeaa1f4
[vimeo] Support protocol-relative URLs
11 years ago
5f59ee7942
[novamov] Remove superfluous tabs
11 years ago
8f89e68781
[novamov] Add embedded player support
11 years ago
42e4fcf23a
[generic] Fix regexes
11 years ago
c93c2ab1c3
[mpora] Add support ( Fixes #2096 )
11 years ago
79f8295303
Use original Referer URL in Brightcove requests ( Fixes #2110 )
11 years ago
796495886e
[generic] Use unicode_literals instead of duplicating the u'
11 years ago
fc9713a1d2
[youtube] Support jwplayer with YouTube URLs ( Closes #2075 )
11 years ago
d981cef6b9
[generic] Support gorillavid.in
...
Previously, we were a little bit over-eager and got a random swf file.
Fixes #2084 .
11 years ago
aff24732b9
Merge remote-tracking branch 'rzhxeo/blip'
...
Conflicts:
youtube_dl/extractor/bliptv.py
11 years ago
19dab5e6cc
[GenericIE] Outsource embedded blip.tv player video id extraction to BlipTVIE and fix minor errors in RegEx
11 years ago
c1d1facd06
[generic] Output something before making network requests
11 years ago
7115ca84aa
[vimeo/generic] Add support for embedded SWF vimeo videos
11 years ago
aa94a6d315
[aparat] Add support ( Fixes #2012 )
11 years ago
1f9da9049b
[generic] Support YouTube swf embed ( Fixes #2010 )
11 years ago
c0d0b01f0e
[generic] Detect ooyala videos ( fixes #2013 )
11 years ago
3e78514568
[generic] Support application/ogg for direct links
...
Also remove some debugging code.
11 years ago
42393ce234
Add support for direct links to a video ( #1973 )
11 years ago
cecaaf3f58
[generic] Do not use compatibility result fallback
11 years ago
f25571ffbf
Add support for embedded vevo player ( Fixes #1957 )
11 years ago
ee3e63e477
[GenericIE] Add support for embedded blip.tv
11 years ago
ef4fd84857
[wistia] Add extractor
11 years ago
355e4fd07e
[generic] Find embedded dailymotion videos ( Fixes #1848 )
11 years ago
113577e155
[generic] Improve detection
...
Allow download of http://goo.gl/7X5tOk
Fixes #1818
11 years ago
0980426559
[bandcamp] add support for albums (reported in #1270 )
11 years ago
887c6acdf2
Support multiple embedded YouTube URLs ( Fixes #1787 )
11 years ago
dd5bcdc4c9
[brightcove] Set the 'Referer' header if the url has the 'linkBaseUrl' parameter ( fixes #1553 )
11 years ago
eeb165e674
[brightcove] Add the extraction of the url from generic
11 years ago
9ee2b5f6f2
tests: don't run the test if any of the extractors listed in the 'add_ie' field is marked as not working
11 years ago
2dcf7d8f99
[GenericIE] Also detect youtube if src url of iframe is embedded in ' instaed of "
11 years ago
c19f7764a5
[generic] Detect bandcamp pages that use custom domains ( closes #1662 )
...
They embed the original url in the 'og:url' property.
11 years ago
aa929c37d5
[generic] Fix test video's checksum
11 years ago
53c1d3ef49
Check for embedded YouTube player ( Fixes #1616 )
11 years ago
9d4660cab1
[generic] Support embedded vimeo videos ( #1602 )
11 years ago
3283533149
Fix Brightcove detection when another Flash object is on the page
...
The regex used non-greedy match, but alas it failed on input like this:
<object class="...> ... class="BrightcoveExperience"
It captured two objects and the intervening HTML. This commit fixes this by
not allowing a ">" to appear before BrightcoveExperience.
Video in question: http://www.harpercollinschildrens.com/feature/petethecat/
11 years ago
e484c81f0c
[generic] Clarify error messages
11 years ago
592882aa9f
[brightcove] Support videos that only provide flv versions ( fixes #1504 )
...
Moved the test from generic.py to brightcove.py
11 years ago
a7130543fa
[generic] If the url doesn't specify the protocol, then try to extract prepending 'http://'
11 years ago
08e291b54d
[generic] Recognize html5 video in the format '<video src=".+?"' and only unquote the url when extracting the id ( fixes #1372 )
11 years ago
a5caba1eb0
[generic] simply use urljoin
11 years ago
ae3531adf9
[generic] Fix URL concatenation
...
When the url is something like http://example.org/foo/bar?x=y and the added is file/video.mp4 , we want http://example.org/foo/file/video.mp4
Fixes #1268 .
11 years ago
627a91a9a8
[generic] small typo
11 years ago
9585f890f8
[generic] add support for relative URLs ( Fixes #1308 )
11 years ago
0838239e8e
[generic] Support double slash URLs ( Fixes #1309 )
11 years ago
7fea7156cb
[generic] support HTML5 video
11 years ago
3093468977
[generic] Ignore stupid HTTP servers ( #1284 )
11 years ago
232eb88bfe
GenericIE: allow to match declaration of the Brightocove parameters that use ' instead of "
11 years ago
117adb0f0f
GenericIE: detect more Brightcove videos
...
In some sites "class" contains more that BrightcoveExperience
11 years ago
cfe50f04ed
GenericIE: Detect videos from Brightcove
...
Brightcove videos info is usually found in an <object class="BrightcoveExperience"></object> node, this is passed to a new method of BrightcoveIE that builds a url to extract the video.
11 years ago
5c44c15438
GenericIE: match titles that spread across multiple lines (related #904 )
12 years ago
0f81866329
Add --list-extractor-descriptions (human-readable list of IEs)
12 years ago
4269e78a80
Merge branch 'master' of github.com:rg3/youtube-dl
12 years ago
6f5ac90cf3
Move tests to the IE definitions
12 years ago
27473d18da
Made 'video' the default title for generic IE
12 years ago
52c8ade4ad
Made generic IE handle more cases
...
Added a possible quote after file, so it can now handle cases like:
'file': 'http://www.a.com/b.mp4 '
12 years ago
9b122384e9
Move GenericIE into its own file
12 years ago
Sergey M․