Commit Graph

10970 Commits (84c237fb8a2afa06fd3c36f7da9517682e63480e)

Author SHA1 Message Date
TRox1972 6ae938b295
[Vine] Extract view count 9 years ago
Sergey M․ cf40fdf5c1
release 2016.06.22 9 years ago
Sergey M․ 23bdae0955
[svt] Various improvements
+ [svt:play] Add fallback path looking for video id and fix extraction for oppetarkiv
* [svt:base] Detect geo restriction
* [svt:base] Extract series related metadata
9 years ago
Shai Coleman ca74c90bf5 Fix issue downloading facebook videos
youtube-dl expects the format items to be returned as a list,
but when there's only one item Facebook returns a dict instead,
this wraps the dict in a list if necessary
9 years ago
Sergey M․ 7cfc1e2a10
[gametrailers] Remove extractor
gametrailers closed (see http://www.polygon.com/2016/2/8/10944452/gametrailers-shuts-down-after-13-year-run)
9 years ago
Remita Amine 1ac5705f62 [gamespot] extract all formats 9 years ago
Yen Chi Hsuan e4f90ea0a7
[svt] Fix extraction for SVTPlay (closes #9809) 9 years ago
Sergey M․ cdfc187cd5
[cbs] Remove unused import 9 years ago
Sergey M․ feef925f49
[streamcloud] Capture error message (#9840) 9 years ago
Sergey M․ 19e2d1cdea
release 2016.06.20 9 years ago
Sergey M․ 8369a4fe76
[downloader/hls] Simplify and carry long lines 9 years ago
Philipp Hagemeister 1f749b6658 Revert "[jsinterp] Avoid double key lookup for setting new key"
This reverts commit 7c05097633.
9 years ago
Remita Amine 819707920a [cbs] fix _VALID_URL 9 years ago
Remita Amine 43518503a6 [cbs,cbsnews,cbssports] reduce requests while extracting all formats 9 years ago
Remita Amine 5839d556e4 [theplatform] reduce requests for theplatform feed info extraction 9 years ago
Yen Chi Hsuan 6c83e583b3
[radiojavan] PEP8
E275 is added in pycodestyle 2.6

See https://github.com/PyCQA/pycodestyle/pull/491
9 years ago
Yen Chi Hsuan 6aeb64b673 Merge pull request #8201 from remitamine/hls-aes
[downloader/hls] Add support for AES-128 encrypted segments in hlsnative downloader
9 years ago
Remita Amine 6cd64b6806 [foxsports] extract http formats 9 years ago
remitamine e154c65128 [downloader/hls] Add support for AES-128 encrypted segments in hlsnative downloader 9 years ago
Sergey M․ a50fd6e026
release 2016.06.19.1 9 years ago
Sergey M․ 6a55bb66ee
[vimeo] Fix rented videos (Closes #9830) 9 years ago
Lucas Moura 7c05097633
[jsinterp] Avoid double key lookup for setting new key
In order to add a new key to both __objects and __functions dicts on jsinterp.py, it is
necessary to first verify if a key was present and if not, create the key and
assign it to a value.

However, this can be done with a single step using dict setdefault method.
9 years ago
Sergey M․ 589568789f
release 2016.06.19 9 years ago
Sergey M․ 7577d849a6
[r7] Fix extraction and add support for articles (Closes #9826) 9 years ago
Sergey M․ cb23192bc4
[closertotruth] Update and improve (Closes #8680) 9 years ago
Steven Gosseling 41c1023300
[closertotruth] Add extractor
Removed print statement from code.

Replaced two regex searches with the corret ones.

Removed some unnecessary semicolumns

fixed title extraction

refactored everything to search_regex

processed comments on commit 5650b0d, fixed feedback from flake8

Improved regexes and returns info dict now.

Added support for closertotruth interview URL

Added support for episodes page
9 years ago
Sergey M․ 90b6288cce
[arte:+7] Simplify _VALID_URL 9 years ago
Sergey M․ d7c6c656c5
[arte:+7] Expand _VALID_URL (Closes #9820) 9 years ago
Yen Chi Hsuan b0b128049a
[extractors] Update references to sportschau (#9799) 9 years ago
Yen Chi Hsuan e8f13f2637
[sportschau.de] Fix extraction and moved to its own file (closes #9799) 9 years ago
Yen Chi Hsuan b5aad37f6b
[ard] Remove SportschauIE, which is now based on WDR (#9799) 9 years ago
Yen Chi Hsuan 6d0d4fc26d
[wdr] Add WDRBaseIE, for Sportschau (#9799) 9 years ago
Yen Chi Hsuan 0278aa443f
[br] Skip invalid tests 9 years ago
Yen Chi Hsuan 1f35745758
[azubu] Don't fail on optional fields 9 years ago
Yen Chi Hsuan 573c35272f
[bbc] Skip a geo-restricted test case 9 years ago
Yen Chi Hsuan 09e3f91e40
[arte] Update _TESTS and fix for pages with multiple YouTube videos
Some tests are from #6895 and #6613
9 years ago
Yen Chi Hsuan 1b6cf16be7
[aftonbladet] Fix extraction 9 years ago
Yen Chi Hsuan 26264cb056
[adobetv] Use embedded data in the webpage
Sometimes the HTML webpage is returned even with '?format=json'
9 years ago
Yen Chi Hsuan a72df5f36f
[mtvservices] Fix ext for RTMP streams 9 years ago
Yen Chi Hsuan c878e635de
[bet] Moved to MTVServices 9 years ago
Sergey M․ 0f47cc2e92
release 2016.06.18.1 9 years ago
Sergey M․ 5fc2757682
release 2016.06.18 9 years ago
Sergey M․ e3944c2621
[pornhd] Add working test 9 years ago
Sergey M․ 667d96480b
[pornhd] Detect removed videos and modernize 9 years ago
Sergey M․ e6fe993c31
[pornhd] Improve formats extraction 9 years ago
Sergey M․ d0d93f76ea
[pornhd] Fix metadata extraction 9 years ago
Sergey M․ 20a6a154fe
[mtv] Use compat_xpath and fix FutureWarning 9 years ago
Sergey M․ f011876076
[nickde] Add extractor (Closes #9778) 9 years ago
Sergey M․ 6929569403
[mitele] Extract series metadata and make title more robust (Closes #9758) 9 years ago
Sergey M․ eb451890da
[carambatv] Add extractor (Closes #9815) 9 years ago
Sergey M․ ded7511a70
[bbccouk] Add support for playlists (Closes #9812) 9 years ago
Sergey M․ d2161cade5
release 2016.06.16 9 years ago
Sergey M․ 27e5fa8198
[cda] Fix extraction (Closes #9803) 9 years ago
Yen Chi Hsuan efbd1eb51a
[wimp] Fix extraction and update _TESTS 9 years ago
Yen Chi Hsuan 369ff75081
[jwplatform] Improved JWPlayer support 9 years ago
Yen Chi Hsuan 47212f7bcb
[utils] Don't transform numbers not starting with a zero
Fix test_Viidea and maybe others
9 years ago
Sergey M․ 4c93ee8d14
[imdb] Improve _VALID_URL (Closes #9788) 9 years ago
Yen Chi Hsuan 8bc4dbb1af
[wrzuta.pl] Detect error and update _TESTS 9 years ago
Sergey M․ 6c3760292c
[pornhub] Improve title extraction (Closes #9777) 9 years ago
Sergey M․ ff4af6ec59
[lynda] Remove superfluous _NETRC_MACHINE 9 years ago
Sergey M․ d01fb21d4c release 2016.06.14 9 years ago
Sergey M․ 1759672eed
[wrzuta:playlist] Improve and simplify (Closes #9341) 9 years ago
venth fea55ef4a9
[wrzuta.pl:playlist] Added playlist extraction from wrzuta.pl 9 years ago
Sergey M․ 16b6bd01d2
[rockstargames] Improve and add Youtube fallback (Closes #9737) 9 years ago
Dracony 14d0f4e0f3
Added extractor for rockstargames.com 9 years ago
Sergey M․ 778f969447
[twitch:clips] Add extractor (Closes #9767) 9 years ago
Sergey M․ 33b72ce64e
[xfileshare] Improve removed videos detection 9 years ago
Sergey M․ cf2bf840ba
[xfileshare] Fix test 9 years ago
Sergey M․ bccdac6874
[xfileshare:xvidstage] Add support for videos with packed codes (Closes #4335) 9 years ago
Sergey M․ e69f9f5d68
[downloader/external] Decode error string before writing to stderr 9 years ago
Sergey M․ 77a9a9c295 release 2016.06.12 9 years ago
Sergey M․ 84dcd1c4e4
[streamcloud] Detect removed videos (Closes #3768) 9 years ago
Sergey M․ 971e3b7520
[nrk:skole] Fix extraction 9 years ago
Sergey M․ 4e79011729
[nrktv] Fix tests 9 years ago
Sergey M․ 98960c911c
[instagram] Extract metadata from JSON 9 years ago
Sergey M․ 329ca3bef6
[utils] Add try_get
To reduce boilerplate when accessing JSON
9 years ago
Sergey M․ 2c3322e36e
[youporn] Fix metadata extraction 9 years ago
Sergey M․ 80ae228b34
[matchtv] Modernize 9 years ago
Yen Chi Hsuan 6d28c408cf
[viki] Do not use a fallback language for title in the first try
In test_Viki_3, 'titles' gives a Hebrew title.
9 years ago
Yen Chi Hsuan c83b35d4aa
[viki] Update _TESTS 9 years ago
Yen Chi Hsuan 94e5d6aedb
[viki] Skip a geo-restricted test 9 years ago
Yen Chi Hsuan 531a74968c
[vimeo] Fix extraction for VimeoReview videos 9 years ago
Yen Chi Hsuan c5edd147d1
[generic] Remove an invalid test
Now handled by telewebion.py
9 years ago
Yen Chi Hsuan 856150d056
[telewebion] Add new extractor (closes #5135) 9 years ago
Paul Henning 15d106787e [utils] Change Firefox 44 to 47
See commit title.
9 years ago
Yen Chi Hsuan 7aab3696dd
[kuwo] Update _TESTS 9 years ago
Yen Chi Hsuan 47787efa2b
[leeco] Recognize Le Sports URLs (fixes #9750) 9 years ago
Sergey M․ 4a420119a6 release 2016.06.11.3 9 years ago
Sergey M․ 33751818d3 release 2016.06.11.2 9 years ago
Sergey M․ fe458b6596
[limelight] Extract ttml subtitles (Closes #9739) 9 years ago
Sergey M․ 21ac1a8ac3
[limelight] Fix typo 9 years ago
Sergey M․ 79027c0ea0
[limelight] Improve _VALID_URLs 9 years ago
Sergey M․ 4cad2929cd
[limelight] Fix _VALID_URLs 9 years ago
Sergey M․ 62666af99f
[indavideo] Fix formats' height (Closes #9744) 9 years ago
Sergey M․ 6626c214e1 release 2016.06.11.1 9 years ago
Sergey M․ d845622b2e release 2016.06.11 9 years ago
Sergey M 1058f56e96 Merge pull request #9747 from TRox1972/lynda
[Lynda] Extract course description
9 years ago
TRox1972 0434358823 [Lynda] Extract course description 9 years ago
Sergey M․ 3841256c2c
[lynda] Skip login if already logged in 9 years ago
Sergey M․ bdf16f8140
[lynda] Add support for new authentication (Closes #9740) 9 years ago
Yen Chi Hsuan 836ab0c554
[compat] Import html5 entities correctly 9 years ago
Yen Chi Hsuan 6c0376fe4f
[dw] Skip an invalid test
DW documentaries only last for one or two weeks. See #9475
9 years ago
Yen Chi Hsuan 1fa309da40
[generic] Update test_Generic_40
The original link now redirects to an YouTube user channel.
9 years ago
Yen Chi Hsuan daa0df9e8b
[youtube:user] Support another URL form
Such an URL comes from http://www.gametrailers.com/. This is originally
a test case in GenericIE, but now seems all GameTrailers videos are on
YouTube.
9 years ago
Yen Chi Hsuan 09728d5fbc
[audiomack:album] Force video_id to be strings
Related: be6217b261
9 years ago
Yen Chi Hsuan c16f8a4659
[voicerepublic] Force video_id to be strings
Related: be6217b261
9 years ago
Yen Chi Hsuan a225238530
[vporn] Improve error detection and update _TESTS 9 years ago
Yen Chi Hsuan 55b2f099c0
[utils] Decode HTML5 entities
Used in test_Vporn_1. Also related to #9270
9 years ago
Yen Chi Hsuan 9631a94fb5
[compat] Add compat_html_entities_html5
Used in tset_Vporn_1. Also Related to #9270
9 years ago
Yen Chi Hsuan cc4444662c [generic] Remove Vulture embed detection
Vulture.com videos now hosts on YouTube, Vimeo, MTV, NBC News or Hulu.
Here's an example of Hulu:
http://www.vulture.com/2016/06/kimmel-interviews-mariah-carey-in-a-bathtub.html
9 years ago
Yen Chi Hsuan de3eb07ed6
[generic] Detect NBC News embeds 9 years ago
Yen Chi Hsuan 5de008e8c3
[nbcnews] Support embed widgets
Used in some Vulture videos
9 years ago
Yen Chi Hsuan 3e74b444e7
[vulture] Remove the extractor
The first 10 URLs in google search "site:http://video.vulture.com/video"
is dead. I guess Vulture does not host videos on their own anymore.
9 years ago
Yen Chi Hsuan e1e0a10c56
[weibo] Remove the extractor
The Weibo weishipin (微視頻, tiny videos) service is dead and now all
videos are hosted on Sina videos, which is covered by sina.py
9 years ago
Yen Chi Hsuan 436214baf7
[xfileshare] Skip an invalid test 9 years ago
Yen Chi Hsuan 506d0e9693
[xuite] Skip the invalid test 9 years ago
Yen Chi Hsuan 55290788d3 [yahoo] Yahoo doesn't like region names in lower cases
Fix test_Yahoo_7
9 years ago
Yen Chi Hsuan bc7e7adf51 [wdr] Subtitles are TTML 9 years ago
Sergey M․ b0aebe702c
[godtv] Relax _VALID_URL 9 years ago
Sergey M․ 416878f41f
[godtv] Add more tests 9 years ago
Sergey M․ c0fed3bda5
[godtv] Improve and add support for playlists (Closes #9608) 9 years ago
TRox1972 bb1e44cc8e
[godtv] Add extractor
[GodTV] Improvements
9 years ago
N1k145 21efee5f8b
[openload] Relax _VALID_URL
[openload] added to _TESTS, removed escape
9 years ago
Yen Chi Hsuan e2713d32f4
[openload] Fix extraction. Thanks @perron375 for the solution
Closes #9706
9 years ago
Yen Chi Hsuan e21c26daf9 Merge pull request #9395 from pmrowla/afreecatv
[afreecatv] Add new extractor for afreecatv.com VODs
9 years ago
Yen Chi Hsuan 1594a4932f
[wdr] Misc changes 9 years ago
Yen Chi Hsuan 6869d634c6
[wdr] Simplify extraction 9 years ago
Yen Chi Hsuan 50918c4ee0
[wdr] Support radio players (closes #6147) 9 years ago
Yen Chi Hsuan 6c33d24b46
[utils] Add audio/mpeg to mimetype2ext()
Used in WDR live radios (#6147)
9 years ago
Sergey M․ be6217b261
[YoutubeDL] Force string conversion on non string video ids 9 years ago
Sergey M․ 9d51a0a9a1
[vessel] Make hls formats non fatal 9 years ago
Sergey M․ 39da509f67
[vessel] Extract DASH formats 9 years ago
Sergey M․ a479b8f687
[vessel] Use native hls by default 9 years ago
Sergey M․ 48a5eabc48
[extractor/generic] Add support vessel embeds (Closes #7083) 9 years ago
Sergey M․ 11380753b5
[vessel] Add support for embed urls and improve extraction 9 years ago
Yen Chi Hsuan 411c590a1f
[youku:show] Add new extractor 9 years ago
Yen Chi Hsuan 6da8d7de69
[twitter] Update _TESTS 9 years ago
Yen Chi Hsuan c6308b3153
[twitter] Fix extraction for videos with HLS streams
Closes #9623
9 years ago
Yen Chi Hsuan fc0a45fa41
[twitter] Detect suspended accounts and update _TESTS 9 years ago
Yen Chi Hsuan e6e90515db
[nbc] Add the test case from #9578
Closes #9578
9 years ago
Yen Chi Hsuan 22a0a95247
[theplatform] Some NBC videos require an additional cookie
Related: #9578
9 years ago
Yen Chi Hsuan 50ce1c331c
[downloader/external] Add another env for proxies in ffmpeg/avconv
Related sources:
https://git.libav.org/?p=libav.git;a=blob;f=libavformat/http.c;h=8fe8d11e1edfdbb04a8726db2c49cfef3f572aac;hb=HEAD#l152
https://git.libav.org/?p=libav.git;a=blob;f=libavformat/tls.c;h=fab243e93e20034e88e619188c13a44a5d8ccdb9;hb=HEAD#l63
https://github.com/FFmpeg/FFmpeg/blob/f8e89d8/libavformat/http.c#L191
https://github.com/FFmpeg/FFmpeg/blob/f8e89d8/libavformat/tls.c#L92
9 years ago
Yen Chi Hsuan 7264e38591
[bilibili] Fix for videos without upload time (closes #9710) 9 years ago
Sergey M․ 33d9f3707c
[thesixtyone] Relax _VALID_URL (Closes #9714) 9 years ago
Sergey M․ a26a9d6239
[livestream:event] Ensure video id is string (Closes #9721) 9 years ago
Yen Chi Hsuan a4a8201c02
[wdr] Update _TESTS 9 years ago
Yen Chi Hsuan a6571f1073
[common] Fix <bootstrapInfo> detection in F4M manifests
Regression since 0a5685b26f
9 years ago
Sergey M․ 57b6e9652e
[canal+] Add support for d17.tv 9 years ago
Sergey M․ 3d9b3605a3
[canal+] Update tests 9 years ago
Sergey M․ 74193838f7
[canal+] Improve extraction (Closes #9718) 9 years ago
Sergey M fb94e260b5 Merge pull request #9720 from Kagami/vlive-new-statuses
[vlive] Acknowledge vlive+ streams statuses
9 years ago
Kagami Hiiragi 345dec937f [vlive] Acknowledge vlive+ streams statuses
Same as common statuses just with "PRODUCT_" prefix:
PRODUCE_LIVE_END, PRODUCT_COMING_SOON, etc.
9 years ago
Philipp Hagemeister 4315f74fa8 Merge remote-tracking branch 'Boris-de/wdrmaus_fix#8562' 9 years ago
Jaime Marquínez Ferrándiz e67f688025 [compat] Add 'compat_input' to __all__ 9 years ago
Sergey M․ 244fe977fe
[options] Add --load-info-json alias for symmetry with --write-info-json 9 years ago
Sergey M․ 7b0d1c2859
[__init__] Use write_string instead of compat_string (Closes #9689) 9 years ago
Sergey M․ 633b444fd2
[downloader/hls] Correct comment on twitch vods 9 years ago
Sergey M․ 51c4d85ce7
[downloader/hls] PEP 8 9 years ago
Sergey M․ 631d4c87ee
[twitch:vod] Use native hls 9 years ago
Sergey M․ 1e236d7e23
[downloader/hls] Do not rely on EXT-X-PLAYLIST-TYPE:EVENT 9 years ago
Sergey M․ 2c34735267
[youtube] Add itags 256 and 258 9 years ago
Sergey M․ 1ae6c83bce
[compat] Add compat_input 9 years ago
Sergey M․ 0fc832e1b2
[vidio] Improve (Closes #9562) 9 years ago
TRox1972 7def35712a
[vidio] Add extractor (Closes #7195)
[Vidio] fix fallback value and wrap duration in int_or_none

[Vidio] don't use video_id for _html_search_regex()
9 years ago
Sergey M․ 762d44c956
[channel9] Add support for rss links (Closes #9673) 9 years ago
Sergey M․ 4d8856d511
[loc] Extract direct download links 9 years ago
Sergey M․ c917106be4
[loc] Extract subtites 9 years ago
Sergey M․ 76e9cd7f24
[loc] Add support for another URL schema and simplify 9 years ago
Sergey M․ bf4c6a38e1 release 2016.06.03 9 years ago
Sergey M․ 7f3c3dfa52
[loc] Improve (Closes #9521) 9 years ago
TRox1972 9c3c447eb3
[loc] Add extractor (Closes #3188)
Added extractor of loc.gov, which closes #3188. I am not an experienced programmer, so I am sure I did a bunch of mistakes, but the extractor works (for me at least).

[LibraryOfCongress] don't use video_id for _search_regex()

[LibraryOfCongress] Improvements
9 years ago
Yen Chi Hsuan ad73083ff0
[bilibili] Add _part%d suffixes back (closes #9660) 9 years ago
bzc6p c88270271e Added sanitization support for Hungarian letters Ő and Ű 9 years ago
Yen Chi Hsuan 9a4aec8b7e [utils] Use bytes-like objects as header values on Python 2 9 years ago
Yen Chi Hsuan 0ea590076f [utils] Always decode Location header
escape_url is broken for bytes-like objects
9 years ago
Remita Amine 4a684895c0 [seeker] Add new extractor(closes #9619) 9 years ago
Remita Amine f4e4aa9b6b [revision3:embed] Add new extractor 9 years ago
Sergey M․ 5e3856a2c5 release 2016.06.02 9 years ago
Sergey M․ 6e6b9f600f
[arte] Add support for playlists and rework tests (Closes #9632) 9 years ago
Sergey M․ 6a1df4fb5f
[spankwire] Add support for new URL format (Closes #9657) 9 years ago
Yen Chi Hsuan dde1ce7c06
[tf1] Fix a regular expression (closes #9656)
This is a Python bug fixed in 2.7.6 [1]

[1] https://github.com/rg3/youtube-dl/issues/9656#issuecomment-222968594
9 years ago
Yen Chi Hsuan 811586ebcf
[generic] Update the UDNEmbed test case 9 years ago
Yen Chi Hsuan 0ff3749bfe
[udn] Fix m3u8 and f4m extraction as well as improve 9 years ago
Yen Chi Hsuan 28bab13348
[generic,viewlift] Move a test case to the specialized extractor 9 years ago
Yen Chi Hsuan 877032314f
[generic] Improve Kaltura detection
Closes #4004
9 years ago
Peter Rowlands e7d85c4ef7 use /track/video/file to determine if video exists 9 years ago
Sergey M․ 8ec2b2c41c
[options] Add --limit-rate alias for rate limiting option
Closes #9644
In order to follow regular --verb-noun pattern and better conformity with wget and curl
9 years ago
Sergey M․ 197a5da1d0
[yandexmusic] Improve captcha detection 9 years ago
Sergey M․ abbb2938fa release 2016.05.30.2 9 years ago
Sergey M․ f657b1a5f2 release 2016.05.30.1 9 years ago
Sergey M․ 8267423652 release 2016.05.30 9 years ago
Yen Chi Hsuan 9ed6d8c6c5
[youku] Extract resolution 9 years ago
Yen Chi Hsuan 6461f2b7ec
[bilibili] Fix extraction, improve and cleanup 9 years ago
Sergey M․ 807cf7b07f
[udemy] Fix authentication for localized layout (Closes #9594) 9 years ago
Sergey M․ de7d76af52
[coub] Add another test 9 years ago
Sergey M․ 11c70deba7
[coub] Add extractor (Closes #9609) 9 years ago
Sergey M․ f36532404d
[vk] Remove superfluous code 9 years ago
Sergey M․ 77b8b4e696
[extractor/common] Borrow quality metadata from parent set-level manifest for f4m 9 years ago
Sergey M․ 2615fa7584
[downloader/f4m] Simply select format when it's the only one 9 years ago
Boris Wachtmeister 3a686853e1 [WDR] fixed parsing of playlists 9 years ago