Commit Graph

381 Commits (397b305cfe1a7ec2957331602727edb009c71e99)

Author SHA1 Message Date
Sergey M․ bf94d763ba [extractor/generic] Add test for #6485 9 years ago
Sergey M․ 8a37aa1517 [extractor/generic] Expand ooyala regex (Closes #6485) 9 years ago
Sergey M․ 54a9328b20 [generic] Expand jwplayer support 9 years ago
Sergey M․ 8765222d22 [extractor/generic] Add generic SMIL tests 9 years ago
Sergey M․ e5e8d20a3a [extractor/generic] Improve generic SMIL detection 9 years ago
Sergey M․ 88ed52aec9 [bbc] Add support for direct bbc.co.uk embeds 9 years ago
remitamine 653789afc7 add google drive embeds 9 years ago
Jaime Marquínez Ferrándiz b37317d8b0 [generic] Unescape HTML escape sequences in redirect urls (fixes #6311) 9 years ago
Yen Chi Hsuan a1b85269a4 [extractor/generic] Support vid.me embeds 9 years ago
Sergey M․ cbd55ade68 [extractor/generic] Add support for francetv embeds 9 years ago
Sergey M․ f7e6f7fa23 [extractor/generic] Use compat_urllib_parse_unquote 9 years ago
fnord 45eedbe58c Generic: use compat_urllib_parse_unquote to prevent utf8 mangling
of the entire page in python 2.

-requires- fixed compat_urllib_parse_unquote

example - the following will save with a mangled playlist title,
 instead of the kanji for 'tsunami'. This affects all utf8encoded
 urls as well

youtube-dl -f18 -o '%(playlist_title)s-%(title)s.%(ext)s' \
  61c14c1e3a/tsunami.html
9 years ago
Sergey M․ bf20b9c540 [extractor/generic] Add test for myvi embed 9 years ago
Sergey M․ 6dd94d3a79 [myvi:embed] Rename to myvi 9 years ago
Sergey M․ e6c2d9ad29 [extractor/generic:myvi] Add support for myvi embeds 9 years ago
Sergey M․ 66e568de3b [extractor/generic] Improve kaltura embeds support (Closes #6137) 9 years ago
Sergey M․ b8c1cc1a51 [extractor/generic] Add test for snagfilms embeds 10 years ago
Sergey M․ eedd20ef96 [extractor/generic] Add support for snagfilms embeds 10 years ago
Sergey M․ 8084be78c5 [extractor/generic] Add test for OnionStudios embeds 10 years ago
Sergey M․ 1ac1c4c26e [extractor/generic] Add support for OnionStudios embeds (Closes #5841) 10 years ago
Sergey M. 3c3b4176bd Merge pull request #5961 from dstftw/force-generic-extractor
Add --force-generic-extractor
10 years ago
Sergey M․ 2fece970b8 [extractor/generic] Clarify generic extraction warning 10 years ago
Yen Chi Hsuan a5158f38a3 [generic/adobetv] Support AdobeTVVideo embeds (#6039) 10 years ago
Sergey M․ c76799c555 [extractor/generic] Add test for xhamster embed 10 years ago
Sergey M․ 2bb5b6d0a1 [generic] Add support for xhamster embeds 10 years ago
Yen Chi Hsuan 756f574e4e [dailymotion/generic] Add DailymotionCloudIE 10 years ago
Yen Chi Hsuan b407e173e4 [vimeo/generic] Move detection logic from GenericIE to VimeoIE 10 years ago
Sergey M․ 78e2b74bb9 [tumblr] Add support for pornhub embeds (Closes #5963) 10 years ago
Sergey M․ 65d161c480 [extractor/generic] Add support for pornhub embeds 10 years ago
Sergey M․ d22dec74ff Add `--force-generic-extractor`
For some extractors that are hard to workout a good _VALID_URL we use very vague and unrestrictive ones,
e.g. just allowing anything after hostname and capturing part of URL as id.
If some of these extractors happen to have an video embed of some different hoster or platform
and this scenario was not handled in extractor itself we end up with inability to download this embed
until extractor is fixed to support embed of this kind.
Forcing downloader to use the generic extractor can be a neat temporary solution for this problem.
Example: FiveTV extractor with Tvigle embed - http://www.5-tv.ru/rabota/broadcasts/48/
10 years ago
Sergey M․ 9872d3110c [extractor/generic] Add support for tvigle embeds 10 years ago
Sergey M․ b859971873 [extractor/generic] Rename tvc embed url variable 10 years ago
Sergey M․ f37bdbe537 [extractor/generic] Add test for tvc embed 10 years ago
Sergey M․ 2da09ff8b0 [extractor/generic] Fix tvc ie_key 10 years ago
Sergey M․ 954c1d0529 [tvc] Refactor extractor names 10 years ago
Sergey M․ 494f20cbdc [extractor/generic] Add support for tvc embeds 10 years ago
Sergey M․ 97b570a94c [generic] Improve rtl.nl embeds detection (Closes #5950) 10 years ago
Yen Chi Hsuan b26733ba7f [brightcove] Allow single quotes in Brightcove URLs (fixes #5901) 10 years ago
Sergey M․ c5138a7ce4 [extractor/generic] Clarify test comment 10 years ago
Sergey M․ c5fa81fe81 [extractor/generic] Put all direct link tests near to each other for better navigation 10 years ago
Sergey M․ a074e92296 [extractor/generic] Add test for large compressed media 10 years ago
Sergey M․ 1ddb9456c4 [extractor/generic] Use compat_urllib_parse_unquote for unquoting video_id and title from URL 10 years ago
Sergey M․ 58bde34a23 [extractor/generic] Force Accept-Encoding to any for extraction pass 10 years ago
Sergey M․ 339516072b [extractor/generic] Unescape video_id and title extracted from URL 10 years ago
Sergey M․ 25c3a7348f [generic] Fix typo 10 years ago
Sergey M․ b827a6015c [generic] Add test for sportbox embeds 10 years ago
Sergey M․ d40a3b5b55 [generic] Add support for sportbox embeds 10 years ago
Jaime Marquínez Ferrándiz 3b5f65a64c [mlb] Fix extraction of articles
And move test from generic, since it's directly handled by MLBIE
10 years ago
Sergey M․ dc455a5f88 [extractor/generic] Add test for svt embed 10 years ago
Sergey M․ bab19a8e91 [extractor/generic] Add support for svt embeds (Closes #5622) 10 years ago
Sergey M․ 406224be52 [extractor/generic] Fix following incomplete redirects (#5640) 10 years ago
Yen Chi Hsuan 8001607e90 [generic] Detect more MLB videos (fixes #5443) 10 years ago
Yen Chi Hsuan 0954cd8aa4 [Cinemassacre] Add detection for videos from blip.tv 10 years ago
Yen Chi Hsuan 2fe1b5bd2a [CSpan] Add detection for Senate ISVP. Closes #5302 10 years ago
Sergey M․ 6225984681 [generic] Update pladform embed test 10 years ago
Yen Chi Hsuan d6fd958c5f [generic] Extract videos from SMIL manifests (closes #5145 and fixes #5135) 10 years ago
Sergey M․ c798f15b98 [generic] Add test for playwire embed (#5430) 10 years ago
Sergey M․ 2dcc114f84 [generic] Add support for playwire embeds (Closes #5430) 10 years ago
Yen Chi Hsuan 01c58f8473 [generic] Fix test generic_51
The website replaced the original video with a new one
10 years ago
Yen Chi Hsuan edfcf7abe2 [generic] Support another type of Ooyala embedded video 10 years ago
Sergey M․ a4257017ef [generic] Add tests for Crooks and Liars embeds 10 years ago
Sergey M․ 18153f1b32 [generic] Add support for Crooks and Liars embeds 10 years ago
Yen Chi Hsuan 0a1603634b [utils] Remove url_infer_protocol 10 years ago
Yen Chi Hsuan 418c5cc3fc [udn] Add new extractor 10 years ago
Sergey M․ facecb84a1 [generic] Add working NBC Sports vplayer test 10 years ago
Yen Chi Hsuan a2edf2e7ff [NBC/ThePlatform/Generic] Add a generic detector for NBCSportsVPlayer and enhance error detection in ThePlatformIE 10 years ago
Naglis Jonaitis ad320e9b83 [generic] Add support for 5min embeds (#5310) 10 years ago
Sergey M․ 2051acdeb2 [extractor/generic] Add test for Libsyn embed 10 years ago
Sergey M․ cefdf970cc [extractor/generic] Support Libsyn embeds 10 years ago
Sergey M․ 3378d67a18 [generic] Add support for nytimes embeds (Closes #5234) 10 years ago
Sergey M․ ed9a25dd61 [generic] Generalize redirect regex 10 years ago
Sergey M․ 84f8101606 [generic] Follow redirects specified by `Refresh` HTTP header 10 years ago
Sergey M․ f838875726 [pladform] Add support for embeds 10 years ago
Sergey M․ d47ae7f620 [eagleplatform] Add support for ClipYou embeds 10 years ago
Sergey M․ 135c9c42bf [eagleplatform] Add support for embeds 10 years ago
Philipp Hagemeister 76c73715fb [generic] Parse RSS enclosure URLs (Fixes #5091) 10 years ago
Naglis Jonaitis e3216b82bf [generic] Support dynamic Kaltura embeds (#5016) (#5073) 10 years ago
Jaime Marquínez Ferrándiz 13d8fbef30 [generic] Don't set the 'title' if it's not defined in the entry (closes #5061)
Some of them may be an 'url' result, which in general don't have the 'title' field.
10 years ago
Sergey M․ 255fca5eea [generic] Add support for Zapiks embeds (#5014) 10 years ago
Philipp Hagemeister f37e3f99f0 [generic] Correct test case
Video has been reuploaded / edited
10 years ago
Philipp Hagemeister 11e611a7fa Extend various playlist tests 10 years ago
Philipp Hagemeister 59b8ab5834 [rtlnl|generic] Add support for rtl.nl embeds (Fixes #4959) 10 years ago
Philipp Hagemeister e98b8e79ea [generic] Improve SBS detection (Fixes #4899) 10 years ago
Philipp Hagemeister a0f7198544 [generic] Add support for jwPlayer YouTube videos
This makes nationalarchives.gov.uk work (Fixes #4907, fixes #4876)
10 years ago
naglis f076b63821 [generic/ooyala] Add support for Ooyala embeds on SBN network websites (Fixes #4859) 10 years ago
codesparkle 52585fd6dc The opening curly brace `{` is a regex reserved [control character](http://stackoverflow.com/a/400316/1106367), so it needs to be escaped. 10 years ago
Sergey M․ cb454b333d [generic] Improve some regexes 10 years ago
Shaya G 796df3c631 fixed viddler support - needed a Referer header; also added a viddler
generic extractor
10 years ago
Philipp Hagemeister b1b0b1ca30 [generic] Improve description testcase in rss test 10 years ago
Philipp Hagemeister 501f13fbf3 [generic] Add support for Cinerama player (Fixes #4752) 10 years ago
Philipp Hagemeister 61ca9a80b3 [generic] Add support for BOMs (Fixes #4753) 10 years ago
Philipp Hagemeister d7cc31b63e [generic] PEP8 10 years ago
Jaime Marquínez Ferrándiz cd791a5ea0 [ted] Add support for embed-ssl.ted.com embedded videos 10 years ago
Jaime Marquínez Ferrándiz 87830900a9 [generic] Update some tests 10 years ago
Sergey M․ faa4ea68c0 [generic] Add BBC iPlayer playlist test 10 years ago
Sergey M․ 476eae0c2a [generic] Generalize BBC iPlayer playlist extraction 10 years ago
Sergey M․ 8399267671 [generic] Make getter None by default 10 years ago
Sergey M․ db546cf87f [generic] Add support for BBC iPlayer embeds (Closes #4619) 10 years ago
Philipp Hagemeister 416c7fcbce Add documentation about supported sites (Fixes #4503) 10 years ago
Philipp Hagemeister 42bdd9d051 [cinchcast] Add new extractor (Fixes #4428) 10 years ago
Philipp Hagemeister 4e262a8838 [generic] Detect direct video links (Fixes #4149, #4313) 10 years ago
Philipp Hagemeister 65f3a228b1 [generic] Add support for LazyYT embeds (Fixes #4306) 10 years ago
Philipp Hagemeister b74e86f48a Fix all PEP8 issues except E501 10 years ago
Jouke Waleson 9e1a5b8455 PEP8: applied even more rules 10 years ago
Jouke Waleson 2514d2635e PEP8: E225,E227 10 years ago
Jouke Waleson 8bcc875676 PEP8: more applied 10 years ago
Jouke Waleson 5f6a1245ff PEP8 applied 10 years ago
Philipp Hagemeister 9b32eca3ce [generic] Add support for single quotes in HTML5 videos (Fixes #4265) 10 years ago
Philipp Hagemeister af63fed7d8 [generic] Add support for livestream embeds (Fixes #4185) 10 years ago
Jaime Marquínez Ferrándiz 9908e03528 Merge pull request #4076 from ghedo/direct_type
[generic] indicate when a direct video has been extracted
10 years ago
Naglis Jonaitis 37aab27808 [brightcove] Extract m3u8 formats (#3541) 10 years ago
Naglis Jonaitis bdf9701729 [generic/brightcove] Add a new test case for kijk.nl (#3541) 10 years ago
Philipp Hagemeister 8c25f81bee [util] Move compatibility functions out of util
utils is large enough without these compatibility functions.

Everything that is present in newer versions of Python (i.e. with dev Python it's just an import) goes into compat.py .
Everything else (i.e. youtube-dl-specific helpers) goes into utils.py .
10 years ago
Alessandro Ghedini ccdd0ffb80 [generic] indicate when a direct video has been extracted
Fixes #4052.
10 years ago
Sergey M․ 5263cdfcf9 [generic] Improve MLB iframe regex 10 years ago
Philipp Hagemeister ac645ac7d0 [generic] Allow soundcloud embeds with additional attributes 10 years ago
Philipp Hagemeister 48a24ab746 [generic] Fix HTML5 video regexp 10 years ago
Philipp Hagemeister d6d9186f0d [generic] Fix test title 10 years ago
Philipp Hagemeister 37d66e7f1e [generic] Correct call to _webpage_read_full_content 10 years ago
Philipp Hagemeister 70b7e3fbb6 [generic] Add a test case for direct links with broken HEAD (#4032) 10 years ago
Philipp Hagemeister 23be51d8ce [generic] Handle audio streams that do not implement HEAD (Fixes #4032) 10 years ago
Philipp Hagemeister a7e97f6db1 [generic] Allow new SWFObject()-style imports
This embed style is used on http://www.bitburger-open.de/ , but that is not included as a test case since the format is likely to be temporary.
10 years ago
Philipp Hagemeister f2f2c0c2c6 [generic] Allow --default-search without colon 10 years ago
Sergey M․ 281d3f1d68 [generic/wistia] Improve regex 10 years ago
dinesh 85d7b76586 [thoughtworks] wistia regex modified 10 years ago
dinesh 52cffcb186 [thoughtworks] wistia support added 10 years ago
Naglis Jonaitis 9471c44405 [generic] Make sure Wistia embed URLs contain the protocol (Closes #3977)
Also, improve detection (Addresses #3662)
10 years ago
Philipp Hagemeister 09a42738fc [generic] Correct handling of embedded vimeo players (#3955) 10 years ago
Sergey M․ 1419fafd36 [condenast] Add support for embedded videos (Closes #3929) 10 years ago
Sergey M․ ced659bb4d [generic] Ignore some non-video file extensions during generic extraction (Closes #3900) 10 years ago
Naglis Jonaitis 8489578df4 [generic] Support embedded Dailymotion playlists (fixes #3822) 10 years ago
Philipp Hagemeister 07e764439a [generic] Delete test case
The page is not available any more.
10 years ago
Philipp Hagemeister 761e1645e0 [generic] Remove unstable test checksum 10 years ago
Philipp Hagemeister a8eb5a8e61 [generic] Fix testcases 10 years ago
Philipp Hagemeister d6e6a42256 [vimeo:likes] Add new extractor (Fixes #3835) 10 years ago
Philipp Hagemeister c6e90caaa6 Merge remote-tracking branch 'naglis/wistia' 10 years ago
Philipp Hagemeister 6b08cdf626 [youtube] Support for embedded /p players (Fixes #3821) 10 years ago
Philipp Hagemeister 3b2f933b01 [generic] Allow embedded YoutubePlaylists (Fixes #3821) 10 years ago
Naglis Jonaitis 746c67d72f [wistia] Use API and make more generic 10 years ago
Jaime Marquínez Ferrándiz a04aa7a9e6 [generic] The url in the <meta redirect> doesn't need to be enclosed in single quotes (fixes #3770)
See the examples in https://en.wikipedia.org/wiki/Meta_refresh or the shortened urls from https://t.co/.
10 years ago
Sergey M․ 1bf5423e82 [generic/youtube] Recognize youtube nocookie embeds (Closes #3713) 10 years ago
Sergey M․ 1a94ff6865 [mlb] Add support for embedded videos (Closes #3653) 10 years ago
Philipp Hagemeister b759a0d4d2 fix up imports 10 years ago
Philipp Hagemeister 22a6f15061 Move playlist tests to extractors.
From now on, test_download will run these tests. That means we benefit not only from the networking setup in there, but also from the other tests (for example test_all_urls to find problems with _VALID_URLs).
10 years ago
Philipp Hagemeister aff216edf4 [generic] Prevent <video> search from skipping over empty sources (#3546) 10 years ago
Philipp Hagemeister 1cb6dcdbbe [generic] Do not download images as videos by accident 10 years ago
Philipp Hagemeister f971dcbba0 Merge branch 'master' of github.com:rg3/youtube-dl 10 years ago
Philipp Hagemeister 0990305d2a [generic] Fix rss under Python 2.x and move test to extractor 10 years ago
Jaime Marquínez Ferrándiz bcc069a937 [generic] Remove debug statement 10 years ago
Philipp Hagemeister 5f90042bd6 [generic] remove unused imports 10 years ago