Commit Graph

11841 Commits (b811b4c93bd21c5a053f7deddd3c0a3fe2486184)

Author SHA1 Message Date
Yen Chi Hsuan bd26441205
[utils] Fix xattr error handling 8 years ago
Yen Chi Hsuan b19e275d99
[__init__] Fix lost xattr if --embed-thumbnail used
Reported at
https://github.com/rg3/youtube-dl/issues/9054#issuecomment-250451823
8 years ago
Sergey M․ f6ba581f89
[byutv:event] Add extractor 8 years ago
Sergey M․ 6d2549fb4f
[byutv] Fix id and display id 8 years ago
Déstin Reed 4da4516973
[byutv] Rely on _match_id and _parse_json 8 years ago
Sergey M․ e1e97c2446
[periscope:user] Fix extraction (Closes #10820) 8 years ago
Yen Chi Hsuan 53a7e3d287
[utils] Support xattr as well as pyxattr
Closes #9054

There are two xattr packages in Python, pyxattr [1] and xattr [2]. They
have different APIs.

In old days pyxattr supports Linux only and xattr supports Linux, Mac,
FreeBSD and Solaris, and pyxattr supports Linux only. Recently pyxattr
adds support for Mac OS X. [3]

An old version of [2] is shipped with Mac OS X. However, some Linux
distributions have pyxattr only, for example PLD-Linux [4] and old Arch
Linux. [5] As a result, supporting both is the way to go.

[1] https://github.com/iustin/pyxattr
[2] https://github.com/xattr/xattr
[3] https://github.com/iustin/pyxattr/pull/9
[4] https://github.com/rg3/youtube-dl/issues/5498
[5] https://git.archlinux.org/svntogit/community.git/commit/?id=427c4c76401e386d865ccddea4fbfdc74df80492
    https://git.archlinux.org/svntogit/community.git/commit/?id=59b40da7b69622a6761d364a8b07909e9cccaa56
    python-xattr is added on 2016/06/29 while pyxattr is there for more
    than 6 years
8 years ago
Yen Chi Hsuan d54739a2e6
[downloader/http] xattr values should be bytes 8 years ago
Yen Chi Hsuan 63e0fd5bcc Merge pull request #10818 from TRox1972/criterion_match_id
[criterion] Rely on _match_id, improve regex and add thumbnail to test
8 years ago
Déstin Reed 9c51a24642 [criterion] Rely on _match_id, improve regex and add thumbnail to test 8 years ago
Yen Chi Hsuan 9bd7bd0b80
[twitch] Skip a 404 test 8 years ago
Yen Chi Hsuan 4a76b73c6c Merge pull request #10817 from TRox1972/clubic_match_id
[clubic] Rely on _match_id and _parse_json
8 years ago
Yen Chi Hsuan e295618f9e
[dctp] Fix extraction (closes #10734) 8 years ago
Yen Chi Hsuan d7753d1948
[downloader/http] Use write_xattr function for --xattr-set-filesize 8 years ago
Déstin Reed eaf9b22f94 [clubic] Rely on _match_id and _parse_json 8 years ago
Sergey M․ a1001f47fc
[instagram] PEP 8 8 years ago
Déstin Reed 1609782258
[Instagram] Extract video dimensions 8 years ago
Sergey M․ de6babf922
[tvland] Extend _VALID_URL (Closes #10812) 8 years ago
Sergey M․ b0582fc806
[vgtv] Add support for tv.aftonbladet.se (Closes #10800) 8 years ago
Sergey M․ af33dd8ee7
[aftonbladet] Remove extractor 8 years ago
Sergey M․ 70d7b323b6
[vk] Improve view count extraction 8 years ago
Sergey M․ a7ee8a00f4
[vk] Extract timestamp (Closes #10760) 8 years ago
Sergey M․ c6eed6b8c0
[utils] Lower priority for rare date formats and add tests 8 years ago
Kacper Michajłow 3aa3953d28
[vk] Fix date and view count extraction. 8 years ago
Yen Chi Hsuan efa97bdcf1
Move write_xattr to utils.py
There are some other places that use xattr functions. It's better to
move it to a common place so that others can use it.
8 years ago
Sergey M․ 475f8a4580
[vk] Add support for running live streams (Closes #10799) 8 years ago
Sergey M․ 93aa0b6318
[vk] Add support for finished live streams (#10799) 8 years ago
Yen Chi Hsuan 0ce26ef228 Merge pull request #10788 from TRox1972/instagram_comments
[Instagram] Extract comments
8 years ago
Yen Chi Hsuan 0d72ff9c51
[leeco] Recognize more Le Sports URLs (#10794) 8 years ago
Déstin Reed a56e74e271 [Instagram] Extract comments 8 years ago
Sergey M․ f533490bb7
[ketnet] Extract mzsource formats (#10770) 8 years ago
Remita Amine 8bfda726c2 [limelight:media] improve http formats extraction 8 years ago
Sergey M․ 8f0cf20ab9
release 2016.09.27 8 years ago
Sergey M․ cdfcc4ce95
[mtv] Improve _VALID_URL 8 years ago
Kacper Michajłow e384552590
[vk] Add support for dailymotion embeds
Fixes #10661
8 years ago
Sergey M․ 1a2fbe322e
[periscope] Treat timed_out state as finished stream 8 years ago
Sergey M․ f9dd86a112
[npo] Clarify IE_NAMEs (Closes #10775) 8 years ago
Remita Amine 2342733f85 fix tests related to 1978540a5122c53012e17a78841f3da0df77fd34(closes #10774) 8 years ago
Remita Amine 93933c9819 [awaan:video] fix test(closes #10773) 8 years ago
Yen Chi Hsuan d75d9e343e
[einthusan] Fix extraction (closes #10714) 8 years ago
Sergey M․ 72c3d02d29
[promptfile] Improve and modernize 8 years ago
Ondřej Bárta d3dbb46330
[promptfile] Fix extraction (Closes #10634) 8 years ago
Sergey M․ fffb9cff94
[kaltura] Speed up embed regexes (#10764) 8 years ago
Sergey M․ 2d5b4af007
[extractors] Add import for anderetijden extractor 8 years ago
Sergey M․ 5742c18bc1
[npo] Add support for anderetijden.nl (Closes #10754) 8 years ago
Sergey M․ ddb19772d5
[vpro] Fix playlist title extraction and update tests 8 years ago
Sergey M․ a3d8b38168
[npo] Generalize playlist extractors 8 years ago
stepshal 2d3d29976b
[youtube] Change test URLs from http to https 8 years ago
Sergey M․ 493353c7fd
[prosiebensat1] Add support for advopedia 8 years ago
Sergey M․ 0a078550b9
[prosiebensat1] Improve _VALID_URL 8 years ago
Sergey M․ f92bb612c6
[mwave] Relax _VALID_URLs (Closes #10735, closes #10748) 8 years ago
Sergey M․ ddde91952f
[prosiebensat1] Fix playlist support (Closes #10745) 8 years ago
Sergey M․ 63c583eb2c
[prosiebensat1] Add support for sat1gold (#10745) 8 years ago
Remita Amine 7fd57de6fb [cbsnews:livevideo] fix extraction and extract m3u8 formats 8 years ago
Remita Amine e71a450956 [common] add hdcore sign to akamai f4m formats 8 years ago
Remita Amine 27e99078d3 [brightcove:new] add support for live streams 8 years ago
Remita Amine 6f126d903f [download/hls] Delegate downloading to ffmpeg for live streams 8 years ago
Sergey M․ 7518a61d41
[soundcloud] Fix typo in playlist base class name 8 years ago
Sergey M․ 8e45e1cc4d
[soundcloud] Generalize playlist entries extraction (#10733) 8 years ago
Yen Chi Hsuan f0bc5a8609
[twitter] Support Periscope embeds (closes #10737)
Also update _TESTS
8 years ago
Remita Amine a54ffb8aa7 [mtv] add common IE_NAME prefix for MTVIE and MTVVideoIE 8 years ago
Remita Amine 8add4bfecb [mtv] add support for new website urls(closes #8169)(closes #9808) 8 years ago
Yen Chi Hsuan 0711995bca
[openload] Support subtitles (closes #10625) 8 years ago
Yen Chi Hsuan 5968d7d2fe
[extractor/common] Improved support for HTML5 subtitles
Ref: #10625

In a strict sense, <track>s with kind=captions are not subtitles. [1]
openload misuses this attribute, and I guess there will be more
examples, so I add it to common.py.

Also allow extracting information for subtitles-only <video> or <audio>
tags, which is the case of openload.

[1] https://www.w3.org/TR/html5/embedded-content-0.html#attr-track-kind
8 years ago
Sergey M․ e6332059ac
release 2016.09.24 8 years ago
Sergey M․ 24628cf7db
[soundcloud:playlist] Provide video id for playlist entries (Closes #10733) 8 years ago
Sergey M․ 71ad00c09f
[prosiebensat1] Add support for kabeleinsdoku (Closes #10732) 8 years ago
Remita Amine 45cae3b021 [cbs] extract info from thunder videoPlayerService(closes #10728) 8 years ago
Yen Chi Hsuan 4ddcb5999d
[openload] Fix extraction (closes #10408, closes #10727)
Thanks to @daniel100097 for providing a working version
8 years ago
Yen Chi Hsuan e3d6bdc8fc
[ustream] Support HLS streams (closes #10698) 8 years ago
Sergey M․ 0a439c5c4c
[udemy] Stringify video id 8 years ago
Remita Amine 1978540a51 [ooyala] extract all hls formats 8 years ago
Sergey M․ 12f211d0cb
[videomore] Fix embed regex 8 years ago
Remita Amine 3a5a18705f [adobepass] add support MSO that depend on watchTVeverywhere(closes #10709) 8 years ago
Remita Amine 1ae0ae5db0 [cartoonnetwork] add support Adobe Pass auth 8 years ago
Sergey M․ f62a77b99a
[soundcloud] Modernize 8 years ago
coolsa 4bfd294e2f
[soundcloud] Extract license metadata 8 years ago
Remita Amine e33a7253b2 [fox] add support for Adobe Pass auth(closes #8584) 8 years ago
Remita Amine c38f06818d add support for Adobe Pass auth in tbs,tnt and trutv extractors(fixes #10642)(closes #10222)(closes #10519) 8 years ago
Sergey M․ cb57386873
release 2016.09.19 8 years ago
Sergey M․ 70b4cf9b1b
[crunchyroll] Check if already logged in (Closes #10700) 8 years ago
Sergey M․ cc764a6da8
[twitch:stream] Remove fallback to profile extraction when stream is offline
Main page does not contain profile videos anymore
8 years ago
Yen Chi Hsuan d8dbf8707d
[thisav] Improve title extraction (closes #10682)
I didn't add a test case as the one in #10682 looks like a copyrighted
product.
8 years ago
Sergey M․ a1da888d0c
[vyborymos] Improve station info extraction 8 years ago
Sergey M․ 3acff9423d
release 2016.09.18 8 years ago
Sergey M․ 14ae11efab
[vyborymos] Add extractor (Closes #10692) 8 years ago
Sergey M․ 190d2027d0
[xfileshare] Add title regex for streamin.to and fallback to video id (Closes #10646) 8 years ago
Sergey M․ 26394d021d
[globo:article] Add support for multiple videos (Closes #10653) 8 years ago
Sergey M․ 30d0b549be
[extractor/common] Add manifest_url for hls and hds formats 8 years ago
Sergey M․ 86f4d14f81
Refactor fragments interface and dash segments downloader
- Eliminate segment_urls and initialization_url
+ Introduce manifest_url (manifest may contain unfragmented data in this case url will be used for direct media URL and manifest_url for manifest itself correspondingly)
* Rewrite dashsegments downloader to use fragments data
* Improve generic mpd extraction
8 years ago
Sergey M․ 21d21b0c72
[svt] Fix DASH formats extraction 8 years ago
Sergey M․ b4c1d6e800
[extractor/common] Expose fragments interface for dashsegments formats 8 years ago
Sergey M․ a0d5077c8d
[extractor/common] Introduce fragments interface 8 years ago
Yen Chi Hsuan 584d6f3457
[thisav] Recognize jwplayers (closes #10447) 8 years ago
Yen Chi Hsuan e14c82bd6b
[jwplatform] Use js_to_json to detect more JWPlayers 8 years ago
Sergey M․ c51a7f0b2f
[franceinter] Fix upload date extraction 8 years ago
Remita Amine d05ef09d9d [mangomolo] fix domain regex 8 years ago
Remita Amine 30d9e20938 [postprocessor/ffmpeg] apply FFmpegFixupM3u8PP only for videos with aac codec(#5591) 8 years ago
Remita Amine fc86d4eed0 [mangomolo] fix typo 8 years ago
Remita Amine 7d273a387a [mangomolo] add support for Mangomolo embeds 8 years ago
Remita Amine 6ad0219556 [common] add helper method for Wowza Streaming Engine format extraction 8 years ago
Remita Amine 98b7506e96 [toutv] add support for authentication(closes #10669) 8 years ago
Sergey M․ 52dc8a9b3f
[franceinter] Fix upload date extraction 8 years ago
Sergey M․ 9d8985a165
[tv4] Fix hls and hds formats (Closes #10659) 8 years ago
Sergey M․ f5e008d134
release 2016.09.15 8 years ago
stepshal 490b755769
Improve some id regexes 8 years ago
Sergey M․ 1dec2c8a0e
[adobepass] Change mvpd cache section name
In order to better emphasize it's relation to Adobe Pass
8 years ago
Sergey M․ dcce092e0a
[extractor/common] Simplify _get_netrc_login_info and carry long lines 8 years ago
Sergey M․ 32443dd346
[extractor/common] Update _get_login_info's comment 8 years ago
Sergey M․ 2133565cec
[extractor/common] Simplify _get_login_info 8 years ago
Sergey M․ 1da50aa34e
[YoutubeDL] Improve Adobe Pass options' wording 8 years ago
Sergey M․ d2522b86ac
[options] Actually print Adobe Pass options sections in --help 8 years ago
Sergey M․ 537f753399
[options] Improve Adobe Pass wording 8 years ago
Sergey M․ c849836854
[utils] Improve _hidden_inputs 8 years ago
Sergey M․ eb5b1fc021
[crunchyroll] Fix authentication (Closes #10655) 8 years ago
Sergey M․ 95be29e1c6
[twitch] Fix api calls (Closes #10654, closes #10660) 8 years ago
Remita Amine c035dba19e [bellmedia] add support for more sites 8 years ago
Remita Amine 87148bb711 [adobepass] rename --ap-mso-list option to --ap-list-mso 8 years ago
Remita Amine 797c636bcb [ap] improve adobe pass names and parse error handling 8 years ago
Sergey M․ 0002962f3f
[franceinter] Improve extraction (Closes #10538) 8 years ago
Sergey M․ 3e4185c396
[utils] Use native french month names 8 years ago
Sergey M․ f6717dec8a
[utils] Improve month_by_name and add tests 8 years ago
renalid a942d6cb48
[utils,franceinter] Add french months' names and fix extraction
Update of the "FranceInter" radio extractor : webpages HTML structure
had changed, the extractor didn't work. So I updated this extractor to
get the mp3 URL and all details.
8 years ago
Yen Chi Hsuan 961516bfd1
[kwuo:song] Improve error detection (closes #10650) 8 years ago
Yen Chi Hsuan 6db354a9f4
[kuwo] Update _TESTS 8 years ago
Remita Amine 353f340e11 [go] fix typo 8 years ago
Remita Amine 014b7e6b25 [go] add support for free full episodes(#10439) 8 years ago
stepshal 925194022c
Improve some _VALID_URLs 8 years ago
Sergey M․ b690ea15eb
[viafree] Fix test 8 years ago
Remita Amine 5712c0f426 [adobepass] remove unnecessary option 8 years ago
Yen Chi Hsuan 86d68f906e
[bilibili] Fix extraction for videos without backup_url (#10647) 8 years ago
Yen Chi Hsuan 4875ff6847
[bilibili] Remove copyrighted test cases
I can't find any English or Chinese material that claims BiliBili has
bought legal redistribution permissions for copyrighted products from
copyrighted holders.

References for removed test cases:
"刀语": https://en.wikipedia.org/wiki/Katanagatari, by White Fox
"哆啦A梦": https://en.wikipedia.org/wiki/Doraemon, by Shin-Ei Animation
"岳父岳母真难当": https://en.wikipedia.org/wiki/Serial_(Bad)_Weddings, by Les films du 24
"混沌武士": https://en.wikipedia.org/wiki/Samurai_Champloo, by Manglobe

I shouldn't have added them to _TESTS
8 years ago
Remita Amine 1b6712ab23 [adobepass] add specific options for adobe pass authentication
- add --ap-username and --ap-password option to specify
TV provider username and password in the cmd line
- add --ap-retries option to limit the number of retries
- add --list-ap-msi-ids to list the supported TV Providers
8 years ago
Sergey M․ 8414c2da31
[adobepass] PEP 8 8 years ago
Sergey M․ 45396dd2ed
[nhk] Fix extraction (Closes #10633) 8 years ago
Remita Amine 7a7309219c [adobepass] add an option to specify mso_id and support for ROGERS TV Provider(closes #10606) 8 years ago
Sergey M․ a6ccc3e518
[safari] Improve ids regexes (#10617) 8 years ago
Sergey M․ 1d16035bb4
[kaltura] Improve audio detection 8 years ago
Sergey M․ e8bcd982cc
[kaltura] Skip chun format 8 years ago
Sergey M․ a5ff05df1a
[extractor/generic] Add vimeo embed that requires Referer passed 8 years ago
Sergey M․ d002e91986
[vimeo:ondemand] Pass Referer along with embed URL (#10624) 8 years ago
Yen Chi Hsuan be45730226
[nbc] Add new extractor for NBC Olympics (#10295, #10361) 8 years ago
Sergey M․ ee7e672eb0
[tube8] Remove proxy settings from test 8 years ago
Sergey M․ 0307d6fba6
release 2016.09.11.1 8 years ago
Sergey M․ 1c81476cbb
release 2016.09.11 8 years ago
Sergey M․ bc9186c882
[tvplay] Remove unused import 8 years ago
Sergey M․ 6599c72527
[tube8] Extract categories and tags (Closes #10579) 8 years ago
Yen Chi Hsuan 6bb05b32a9
[pornhub] Extract categories and tags (closes #10499) 8 years ago
Yen Chi Hsuan fea74acad8
[foxnews] Revert to old extractor names 8 years ago
Yen Chi Hsuan f01115c933 [openload] Temporary fix (#10408) 8 years ago
Yen Chi Hsuan 2cdbc06a1f
[foxnews] Support Fox News Articles (closes #10598) 8 years ago
Sergey M․ 2cb93afcd8
[viafree] Improve video id extraction (Closes #10615) 8 years ago
Yen Chi Hsuan bfcda07a27
[abc:iview] Skip the test. They are removed soon 8 years ago
Yen Chi Hsuan 001a5fd3d7
[iwara] Fix extraction after relaunch
Closes #10462, closes #3215
8 years ago
Remita Amine 1e35999c1e [tfo] Add new extractor 8 years ago
Sergey M․ 2512b17493
[lrt] Fix audio extraction (Closes #10566) 8 years ago
Sergey M․ 56c0ead4d3
[9now] Improve video data extraction (Closes #10561) 8 years ago
Scott Leggett 7324243750
[9now] Fix extraction 8 years ago
Sergey M․ 84a18e9b90
[polskieradio:category] Improve extraction 8 years ago
Sergey M․ b29f842e0e
[canalplus] Add support for c8.fr (Closes #10577) 8 years ago
Sergey M․ f009fcac0d
Merge branch 'master' of github.com:rg3/youtube-dl 8 years ago
Yen Chi Hsuan 6c3affcb18
[newgrounds] Fix uploader extraction
Closes #10584

Also change test URLs to HTTPS, as proposed by
@stepshal in #10593.

Closes #10593
8 years ago
Sergey M․ 1e19ff2984
Merge branch 'polskie-radio-programme' of https://github.com/JakubAdamWieczorek/youtube-dl 8 years ago
Sergey M․ c6129feb7f
[ketnet] Add extractor (Closes #10343) 8 years ago
Sergey M․ bb5ebd4453
[canvas] Add support for een.be (Closes #10605) 8 years ago
Remita Amine cb9cbd84ed [extractors] add import for TeleQuebecIE 8 years ago
Remita Amine 4d5726b0d7 [telequebec] Add new extractor(closes #1999) 8 years ago
Remita Amine 4614ad7b59 [parliamentliveuk] fix extraction(closes #9137) 8 years ago
Sergey M․ b717837190
release 2016.09.08 8 years ago
Sergey M․ ad0e2b3359
[abcotvs] Add support for ABC Owned Television Stations 8 years ago
Sergey M․ 37720844f6
[jwplatform] Extract height from label 8 years ago
Sergey M․ 6cfcb8ac36
[tvnoe] Do not capture unused groups in _VALID_URL 8 years ago
Remita Amine 7a979da8cb [yahoo] Look for Brightcove Legacy Studio embeds(closes #9345) 8 years ago
Sergey M․ 2fdc7b0e04
[viafree] PEP 8 8 years ago
Sergey M․ 010d034fca
[videomore] Fix extraction (Closes #10592) 8 years ago
stepshal 25042f7372 Add missing r prefix for _VALID_URLs 8 years ago
Yen Chi Hsuan 3f612f0767
Fix _VALID_URLs further (#10594) 8 years ago
Yen Chi Hsuan 17bf6e71cc Merge pull request #10594 from stepshal/https_support
Add support for https for rest of the exctractors.
8 years ago
stepshal 89f257d6e5 Add support for https for rest of the exctractors. 8 years ago
Yen Chi Hsuan e78a5428b6
[foxgay] Fix extraction (closes #10480) 8 years ago
Remita Amine 6656a82481 [rmcdecouverte] Add new extractor(closes #9709) 8 years ago
Remita Amine d7e794928d [tlc] fix query string parsing 8 years ago
Yen Chi Hsuan f87feb4b68
[miaopai] Coding style (#10556) 8 years ago
Yen Chi Hsuan 2841bdcebb
Merge branch 'miaopai' of https://github.com/xyb/youtube-dl into xyb-miaopai 8 years ago
Yen Chi Hsuan 84b91dd4e3
[gamestar] Fix metadata extraction (closes #10479) 8 years ago
Yen Chi Hsuan 92c9c2a88b
[moevideo] Skip another removed test (#10474) 8 years ago
Remita Amine 9d54b02bae [puls4] fix extraction(closes #10583) 8 years ago
Remita Amine 846d8b76a0 [cctv] Add new extractor(closes #8153) 8 years ago
Remita Amine 8258f4457c [lci] Add new extractor(closes #10573) 8 years ago
Remita Amine 948cd5b72d [wat] extract dash formats 8 years ago
Jakub Adam Wieczorek 8d3737cda7 [polskieradio] Add support for downloading whole programmes.
This extends the Polskie Radio (the Polish national radio) extractor to
enable the user to download all the broadcasts of a single programme.
8 years ago
Sergey M․ 155bc674c4
[viafree] Improve video id detection (Closes #10569) 8 years ago
Remita Amine c33c962adf [trutv] Add new extractor(#10519) 8 years ago
Remita Amine bdcc046d12 [turner] use android secure hls host and catch token extraction errors 8 years ago
Xie Yanbo a493f10208 using _parse_html5_media_entries to parse video tag 8 years ago
Sergey M․ f3eeaacb4e
[nick] Add test for #10559 8 years ago
Sergey M․ b4d6a85d60
[nick] Add support for nickelodeon.nl (Closes #10559) 8 years ago
Remita Amine 0b36a96212 [abcotvs] extend _VALID_URL and add support for clips.abcotvs.com(closes #9551) 8 years ago
Yen Chi Hsuan 1f85029d82
[bilibili] Simplify 8 years ago
Xie Yanbo 95be19d436 [miaopai] Add new extractor 8 years ago