Commit Graph

11586 Commits (490b755769a364ca0624390453e36321d5182d3e)

Author SHA1 Message Date
Sergey M․ a249ab83cb
[pyvideo] Remove debugging code 8 years ago
Sergey M․ f7043ef39c
[soundcloud] Fix _VALID_URL clashes with sets (Closes #10505) 8 years ago
Sergey M․ 64fc49aba0
[bandcamp:album] Fix title extraction (Closes #10455) 8 years ago
Sergey M․ 245023a861
[pyvideo] Fix extraction (Closes #10468) 8 years ago
Remita Amine 3c77a54d5d [turner] keep video id intact 8 years ago
Remita Amine da30a20a4d [turner,cnn] move a check for wrong timestamp to CNNIE 8 years ago
Remita Amine 1fe48afea5 [cnn] update _TEST for CNNBlogsIE and CNNArticleIE(closes #10489) 8 years ago
Remita Amine 42e05be867 [ctv] add support for (tsn,bnn,thecomedynetwork).ca websites(#10016) 8 years ago
Remita Amine fe45b0e060 [9c9media] fix multiple stacks extraction and extract more metadata(#10016) 8 years ago
Sergey M․ a06e1498aa
[kusi] Update test 8 years ago
Sergey M․ 5a80e7b43a
[turner] Skip invalid subtitles' URLs 8 years ago
Sergey M․ 3fb2a23029
[adultswim] Extract video info from onlineOriginals (Closes #10492) 8 years ago
PeterDing 7be15d4097 [bilibili] Support episodes
[extractor/bilibili] add md5 for testing

[extractor/bilibili] remove unnecessary headers

[extractor/bilibili] correct _TESTS; find thumbnail for episode

[extractor/bilibili] [Fix] restore removed tests
8 years ago
Sergey M․ cd10b3ea63
[turner] Extract all formats 8 years ago
Sergey M․ 547993dcd0
[turner] Fix subtitles extraction 8 years ago
Yen Chi Hsuan 6c9b71bc08
[downloader/external] Recommend --hls-prefer-native for SOCKS users
Related: #10490
8 years ago
Remita Amine 93b8404599 [generic,vodplatform] improve embed regex 8 years ago
Sergey M․ 9ba1e1dcc0
[played] Remove extractor (Closes #10470) 8 years ago
Remita Amine b8079a40bc [turner] fix secure m3u8 formats downloading 8 years ago
Remita Amine 5bc8a73af6 [cartoonnetwork] make extraction work for more videos in the website
some videos require `networkName=CN2` to be present in the feed url
8 years ago
Remita Amine b3eaeded12 [tbs] Add new extractor(#10222) 8 years ago
Remita Amine ec65b391cb [cartoonnetwork] Add new extractor(#10110) 8 years ago
Remita Amine 2982514072 [turner,nba,cnn,adultswim] add base extractor to parse cvp feeds 8 years ago
Yen Chi Hsuan 98908bcf7c
[openload] Update algorithm again (#10408) 8 years ago
Yen Chi Hsuan 04b32c8f96
[bilibili] Fix extraction (closes #10375)
Thanks @gdkchan for the algorithm
8 years ago
Yen Chi Hsuan 40eec6b15c
[openload] Fix extraction (closes #10408)
Thanks to @yokrysty again!
8 years ago
Yen Chi Hsuan 39efc6e3e0 [generic] Update some _TESTS 8 years ago
Sergey M․ 1198fe14a1
release 2016.08.28 8 years ago
Sergey M․ 92c27a0dbf
[periscope:user] Fix extraction (Closes #10453) 8 years ago
Yen Chi Hsuan 3b4b82d4ce
[douyutv] Simplify 8 years ago
Yen Chi Hsuan 545ef4f531
Merge branch 'patch-2' of https://github.com/steven7851/youtube-dl into steven7851-patch-2 8 years ago
Yen Chi Hsuan 906b87cf5f
[crackle] Revert to template-based thumbnail extraction
To reduce to number of HTTP requests
8 years ago
steven7851 b281aad2dc [douyutv] Use new api
use lapi for flv info, and html5 api for room info
#10153 #10318
8 years ago
Sergey M․ 6b18a24e6e
[tnaflix] Fix extraction (Closes #10434) 8 years ago
Sergey M․ f9b373afda
[nhk:vod] Improve extraction (Closes #10424) 8 years ago
Aleksander Nitecki 298a120ab7
[nhk] Add extractor for VoD. 8 years ago
Sergey M․ e3faecde30
[trutube] Remove extractor (Closes #10438) 8 years ago
Remita Amine a0f071a50d [usanetwork] Add new extractor 8 years ago
Yen Chi Hsuan 20bad91d76
[downloader/external] Clarify that ffmpeg doesn't support SOCKS
Ref: #10304
8 years ago
Yen Chi Hsuan b54a2da433
[crackle] Fix extraction and update _TESTS (closes #10333) 8 years ago
Yen Chi Hsuan dc2c37f316
[spankbang] Fix description and uploader (closes #10339) 8 years ago
Remita Amine d37708fc86 [YoutubeDL] check only for None Value in thumbnails sorting 8 years ago
Remita Amine 5c13c28566 raise unexpected error when no stream found 8 years ago
Remita Amine f70e9229e6 [discoverygo] detect when video needs authentication(closes #10425) 8 years ago
Remita Amine 30afe4aeb2 [cbc] Add support for watch.cbc.ca 8 years ago
Remita Amine 75fa990dc6 [YoutubeDL] add fallback value for thumbnails values in thumbnails sorting 8 years ago
Remita Amine f39ffc5877 [common] extract formats from #EXT-X-MEDIA tags 8 years ago
Remita Amine 07ea9c9b05 [downloader/hls] fill IV with zeros for IVs shorter than 16-octet 8 years ago
Remita Amine 073ac1225f [utils] add ac-3 to the list of audio codecs in parse_codecs 8 years ago
Yen Chi Hsuan 08773689f3 [kickstarter] Silent the warning for og:description
Closes #10415
8 years ago
Yen Chi Hsuan 0c75abbb7b [mtvservices:embedded] Use another endpoint to get feed URL
Closes #10363

In the original mtvservices:embedded test case, config.xml is still used
to get the feed URL. Some other examples, including test_Generic_40
(http://www.vulture.com/2016/06/new-key-peele-sketches-released.html),
and the video mentioned in #10363, use another endpoint to get the feed
URL. The 'index.html' approach works for the original test case, too. So
I didn't keep the old approach.
8 years ago
Yen Chi Hsuan 97653f81b2 [bilibili] Mark as broken
Bilibili now uses emscripten, which is very difficult for reverse
engineering. I don't expect it to be fixed in near future, so I mark
it as broken.

Ref: #10375
8 years ago
Sergey M․ d38b27dd9b
release 2016.08.24.1 8 years ago
Sergey M․ 30317f4887
[pluralsight] Modernize and make more robust 8 years ago
Sergey M․ 8c3e35dd44
[pluralsight] Add support for subtitles (Closes #9681) 8 years ago
Sergey M․ c86f51ee38
release 2016.08.24 8 years ago
Sergey M․ 05bddcc512
[youtube] Fix authentication (2) (Closes #10392) 8 years ago
Sergey M․ 1212e9972f
[youtube] Fix authentication (#10392) 8 years ago
Remita Amine ccb6570e9e [syfy,bravotv] restrict drupal settings regex 8 years ago
Yen Chi Hsuan 18b6216150
[openload] Fix extraction (closes #10408)
Thanks @yokrysty for the algorithm
8 years ago
Remita Amine fb009b7f53 [bravotv] correct clip info extraction and add support for adobe pass auth(closes #10407) 8 years ago
Sergey M․ 3083e4dc07
[eagleplatform] Improve detection of embedded videos (Closes #10409) 8 years ago
Remita Amine 7367bdef23 [awaan] fix extraction, modernize, rename the extractors and add test for live stream 8 years ago
Remita Amine ad31642584 [nrk,abc:iview] use _extract_akamai_formats 8 years ago
Remita Amine c7c43a93ba [common] add helper method to extract akamai m3u8 and f4m formats 8 years ago
Yen Chi Hsuan 96229e5f95
[mtvservices:embedded] Update config URL
All starts from #10363. The test case in mtvservices:embedded uses
config.xml, while the video from #10363 and the test case in generic.py
is broken. Both uses index.html for fetching the feed URL.
8 years ago
Remita Amine 55d119e2a1 [abc:iview] Add new extractor(closes #6148) 8 years ago
Sergey M․ 6d2679ee26
release 2016.08.22 8 years ago
Sergey M․ 3d897cc791
[ivi] Fix episode number extraction 8 years ago
Sergey M․ cf143c4d97
[ivi] Add support for 720p and 1080p 8 years ago
Yen Chi Hsuan ad120ae1c5
[extractor/common] Change the default m3u8 protocol in HTML5
Helper functions should have consistent default values
8 years ago
Remita Amine d0fa172e5f [firsttv] keep a test videos with multiple formats 8 years ago
Yen Chi Hsuan f97f9f71e5
Merge branch 'TRox1972-charlierose' 8 years ago
Yen Chi Hsuan 526656726b
[charlierose] Simplify and improve 8 years ago
Remita Amine 9b8c554ea7 [firsttv] fix extraction(closes #9249) 8 years ago
Yen Chi Hsuan d13bfc07b7
Merge branch 'charlierose' of https://github.com/TRox1972/youtube-dl into TRox1972-charlierose 8 years ago
Sergey M․ efe470e261
[twitch] Renew authentication 8 years ago
Sergey M․ e3f6b56909
[twitch] Refactor API calls 8 years ago
Sergey M․ b1e676fde8
[twitch] Modernize 8 years ago
Sergey M․ 92d4cfa358
[kaltura] Fallback ext calculation on caption's format 8 years ago
Remita Amine 3d47ee0a9e [zingmp3] fix extraction and add support for video clips(closes #10041) 8 years ago
Déstin Reed db29af6d36 [charlierose] Add new extractor 8 years ago
Sergey M․ 2c6acdfd2d
[kaltura] Add test for #10279 8 years ago
Sergey M․ fddaa76a59
[kaltura] Assume ttml to be default subtitles' extension 8 years ago
Sergey M․ a809446750
[kaltura] Add subtitles support when entry_id is unknown beforehand (Closes #10279) 8 years ago
Sergey M․ d8f30a7e66
[kaltura] Remove unused code 8 years ago
Sergey M․ 5b1d85754e
[YoutubeDL] Autocalculate ext when ext is None 8 years ago
Remita Amine e25586e471 [cultureunplugged] fix extraction(closes #10330) 8 years ago
Remita Amine 292a2301bf [cnn] add support for money.cnn.com videos(closes #2797) 8 years ago
Remita Amine dabe15701b [cbs, cbsnews] fix extraction(fixes #10393) 8 years ago
Sergey M․ 4245f55880
[dotsub] Replace test (Closes #10386) 8 years ago
Déstin Reed 5b9d187cc6
[imdb] Improve title extraction and make thumbnail non-fatal 8 years ago
Yen Chi Hsuan 39e1c4f08c
[litv] Support 'promo' URLs (closes #10385) 8 years ago
Yen Chi Hsuan 19f35402c5
[snotr] Fix extraction (closes #10338) 8 years ago
Yen Chi Hsuan 70852b47ca
[utils] Recognize units with full names in parse_filename
Reference: https://en.wikipedia.org/wiki/Template:Quantities_of_bytes
8 years ago
Yen Chi Hsuan a9a3b4a081
[miomio] Adapt to the new API and update _TESTS
The test case is from #9680
8 years ago
Yen Chi Hsuan ecc90093f9
[vuclip] Adapt to the new API and update _TEST 8 years ago
Yen Chi Hsuan 520251c093
[extractor/common] Recognize m3u8 manifests in HTML5 multimedia tags 8 years ago
Yen Chi Hsuan 55af45fcab
[radiobremen] Update _TEST (closes #10337) 8 years ago
Yen Chi Hsuan b82232036a
[n-tv.de] Fix extraction (closes #10331) 8 years ago
Yen Chi Hsuan e4659b4547
[utils] Correct octal/hexadecimal number detection in js_to_json 8 years ago
Sergey M․ 9e5751b9fe
[globo:article] Relax _VALID_URL and video id regex (Closes #10379) 8 years ago
Sergey M․ bd1bcd3ea0
release 2016.08.19 8 years ago
Sergey M․ 8b2dc4c328
[options] Remove output template description from --help
Same reasons as for --format
8 years ago
Sergey M․ 850837b67a
[porncom] Add extractor (Closes #2251, closes #10251) 8 years ago
Sergey M․ 13585d7682
[utils] Recognize lowercase units in parse_filesize 8 years ago
Sergey M․ fd3ec986a4
[generic] Fix dbtv test (Closes #10364) 8 years ago
Sergey M․ b0d578ff7b
[dbtv] Relax embed regex 8 years ago
Déstin Reed b0c8f2e9c8
[DBTV:generic] Add support for embeds 8 years ago
Sergey M․ 51815886a9
[vk:wallpost] Fix audio extraction 8 years ago
Sergey M․ 08a42f9c74
[vk] Fix authentication on python3 8 years ago
Sergey M․ e15ad9ef09
[keezmovies] PEP 8 8 years ago
Sergey M․ 4e9fee1015
[hgtvcom:show] Add extractor (Closes #10365) 8 years ago
Remita Amine 7273e5849b [discoverygo] extend _VALID_URL to support other networks 8 years ago
Sergey M․ b505e98784
[extremetube] Revert display_id 8 years ago
Sergey M․ 92cd9fd565
[keezmovies] Make display_id optional 8 years ago
Sergey M․ b3d7dce429
release 2016.08.17 8 years ago
Sergey M․ ab19b46b88
[extremetube] Modernize 8 years ago
Sergey M․ 8804f10e6b
[tube8] Modernize 8 years ago
Sergey M․ 6be17c0870
[mofosex] Extract all formats and modernize (Closes #10335) 8 years ago
Sergey M․ 8652770bd2
[keezmovies] Improve and modernize 8 years ago
Sergey M․ 2a1321a272
[vbox7:generic] Add support for vbox7 embeds 8 years ago
Sergey M․ 9c0fa60bf3
[vbox7] Add support for embed URLs 8 years ago
Sergey M․ 502d87c546
[mtg] Improve view count extraction 8 years ago
Sergey M․ b35b0d73d8
[viafree] Add extractor (Closes #10358) 8 years ago
Sergey M․ 6e7e4a6edf
[mtg] Add support for viafree URLs (#10358) 8 years ago
Remita Amine 53fef319f1 [fxnetworks] extend _VALID_URL to support simpsonsworld.com 8 years ago
Remita Amine 2cabee2a7d [amcnetworks] fix typo 8 years ago
Remita Amine 11f502fac1 [theplatform] extract subtitles with multiple formats from the metadata 8 years ago
Sergey M․ 98affc1a48
[xvideos] Fix test 8 years ago
Sergey M․ 70a2829fee
[xvideos] Fix HLS extraction (Closes #10356) 8 years ago
Remita Amine 837e56c8ee [amcnetworks] extract episode metadata 8 years ago
Remita Amine b5ddee8c77 [amcnetworks] Add new extractor 8 years ago
Sergey M․ fb64adcbd3
[adobepass] PEP 8 8 years ago
Sergey M․ 4f640f2890
[bbc:playlist] Fix tests 8 years ago
Sergey M․ 254e64a20a
[bbc:playlist] Add support for pagination (Closes #10349) 8 years ago
Remita Amine 818ac213eb [adobepass] add IE suffix to the extractor and remove duplicate constant 8 years ago
Remita Amine cbef4d5c9f [fxnetworks] add test and check geo restriction 8 years ago
Remita Amine bf90c46790 [fxnetworks] Add new extractor(closes #9462) 8 years ago
Yen Chi Hsuan 69eb4d699f
[cbsnews] Remove invalid tests. CBS Live videos gets deleted soon. 8 years ago
Yen Chi Hsuan 760845ce99
[cbslocal] Adapt to SendtoNewsIE 8 years ago
Yen Chi Hsuan 5c2d087221
[sendtonews] Fix extraction 8 years ago
Yen Chi Hsuan b6c4e36728
[jwplatform] Parse video_id from JWPlayer data
And remove a mysterious comma from 115c65793a
8 years ago
Sergey M․ 1a57b8c18c
[zippcast] Remove extractor (Closes #10332)
ZippCast is shut down
8 years ago
Remita Amine 24eb13b1c6 [uplynk,viceland] update tests and change uplynk extractors names 8 years ago
Remita Amine 525e0316c0 [adobepass] fix check for pendingLogout errors 8 years ago
Remita Amine 7e60ce9cf7 [adobepass] clear cache in case of pendingLogout errors 8 years ago
Remita Amine e811bcf8f8 [viceland] raise ExtractorError for errors other than HTTP 400 8 years ago
Remita Amine 6103f59095 [viceland] remove outdated comment 8 years ago
Remita Amine 9fa5789279 [viceland] fix info extraction(closes #8799) 8 years ago
Remita Amine d2ac04674d [viceland] Add new extractor(#8799) 8 years ago
Remita Amine 1fd6e30988 [adobepass] create separate class for adobe pass authentication 8 years ago
Sergey M․ 884cdb6cd9
[life:embed] Improve extraction 8 years ago
Remita Amine 9771b1f901 [theplatform] use _get_netrc_login_info and fix session expiration check(#10345) 8 years ago
Remita Amine 2118fdd1a9 [common] add separate method for getting netrc ligin info 8 years ago
Sergey M․ 320d597c21
[vgtv] Detect geo restricted videos (#10348) 8 years ago
Remita Amine aaf44a2f47 [uplynk] Add new extractor 8 years ago
phi 097eba019d bug fix for extractor xiami.py
Before applying this patch, when downloading resources from xiami.com, it crashes with these:
Traceback (most recent call last):
  File "/home/phi/.local/bin/youtube-dl", line 11, in <module>
    sys.exit(main())
  File "/home/phi/.local/lib/python3.5/site-packages/youtube_dl/__init__.py", line 433, in main
    _real_main(argv)
  File "/home/phi/.local/lib/python3.5/site-packages/youtube_dl/__init__.py", line 423, in _real_main
    retcode = ydl.download(all_urls)
  File "/home/phi/.local/lib/python3.5/site-packages/youtube_dl/YoutubeDL.py", line 1786, in download
    url, force_generic_extractor=self.params.get('force_generic_extractor', False))
  File "/home/phi/.local/lib/python3.5/site-packages/youtube_dl/YoutubeDL.py", line 691, in extract_info
    ie_result = ie.extract(url)
  File "/home/phi/.local/lib/python3.5/site-packages/youtube_dl/extractor/common.py", line 347, in extract
    return self._real_extract(url)
  File "/home/phi/.local/lib/python3.5/site-packages/youtube_dl/extractor/xiami.py", line 116, in _real_extract
    return self._extract_tracks(self._match_id(url))[0]
  File "/home/phi/.local/lib/python3.5/site-packages/youtube_dl/extractor/xiami.py", line 43, in _extract_tracks
    '%s/%s%s' % (self._API_BASE_URL, item_id, '/type/%s' % typ if typ else ''), item_id)
  File "/home/phi/.local/lib/python3.5/site-packages/youtube_dl/extractor/common.py", line 562, in _download_json
    json_string, video_id, transform_source=transform_source, fatal=fatal)
  File "/home/phi/.local/lib/python3.5/site-packages/youtube_dl/extractor/common.py", line 568, in _parse_json
    return json.loads(json_string)
  File "/usr/lib/python3.5/json/__init__.py", line 312, in loads
    s.__class__.__name__))
TypeError: the JSON object must be str, not 'NoneType'

This patch solves exactly this problem.
8 years ago
Sergey M․ 73a85620ee
release 2016.08.13 8 years ago
Sergey M․ 5ec5461e1a
[pbs] Clarify comment on http formats 8 years ago
Sergey M․ 542130a5d9
[pbs] Fix description extraction and update tests 8 years ago
Sergey M․ 82997dad57
[franceculture] Fix extraction (Closes #10324) 8 years ago
Sergey M․ 647a7bf5e8
[pornotube] Fix extraction (Closes #10322) 8 years ago
Sergey M․ 77afa008dd
[4tube] Fix metadata extraction (Closes #10321) 8 years ago
Yen Chi Hsuan db535435b3
[bigflix] Remove an invalid test
There's no video anymore
8 years ago
Sergey M․ c2a453b461
[imgur] Fix width and height extraction (Closes #10325) 8 years ago
Sergey M․ cd29eaab95
[vbox7] Remove unused imports 8 years ago
Sergey M․ e97c55ee6a
[expotv] Improve extraction and update test 8 years ago
Remita Amine acfccacad5 [downloader/external:curl] Clarify why CurlFD should not capture stderr 8 years ago
Sergey M․ cb55908e51
[vbox7] Fix extraction (Closes #10309) 8 years ago
Yen Chi Hsuan e581224843
[tapely] Remove extractor. It's shut down
Closes #10323
8 years ago
Remita Amine f50365e91c [pbs] add test for videos with undocumented http formats and remove unused import 8 years ago
Sergey M․ c366f8d30a
[24video] Add support for me and xxx TLDs 8 years ago
Sergey M․ 6a26c5f9d5
[muenchentv] Fix extraction (Closes #10313) 8 years ago
Sergey M․ bd6fb007de
[24video] Fix comment count extraction 8 years ago
Sergey M․ b69b2ff736
[sunporno] Add support for embed URLs 8 years ago
Sergey M․ 794e5dcd7e
[sunporno] Fix metadata extraction (Closes #10316) 8 years ago
Remita Amine f0d3669437 [hgtv] Add new extractor(closes #3999) 8 years ago
Remita Amine 98e698f1ff [external/curl] respect more downloader options and display progress 8 years ago
Remita Amine 3cddb8d6a7 [pbs] check all http formats and remove unnecessary request
- some of the quality that not reported in the documentation
are available(4500k, 6500k)
- the videoInfo request doesn't work for a long time
8 years ago
Sergey M․ 990d533ee4
[crunchyroll] Add support for HLS (Closes #10301) 8 years ago
Sergey M․ b0081562d2
release 2016.08.12 8 years ago
Sergey M․ a3be69b7f0
[viu] Remove from extractors 8 years ago
Sergey M․ 0fd1b1624c
[goldenmoustache] Remove extractor (Closes #10298)
Now uses dailymotion
8 years ago
Sergey M․ 367976d49f
[drtuber] Improve title extraction 8 years ago
Sergey M․ 0aef0771f8
[drtuber] Make dislike count optional (Closes #10297) 8 years ago
Sergey M․ 0c070681c5
[chirbit] Fix extraction (Closes #10296) 8 years ago
Sergey M․ 30b25d382d
[francetvinfo] Relax _VALID_URL 8 years ago
Yen Chi Hsuan e2e84aed7e
Merge branch 'lkho-pr/#10268' 8 years ago
Yen Chi Hsuan b1927f4e8a
[YoutubeDL] Disable newline conversion when writing subtitles
By default io.open() convert all '\n' occurrences to '\r\n' when writing
files. If the content already contains '\r\n', it will be converted to
'\r\r\n', breaking some video players.
8 years ago
Yen Chi Hsuan 3b9323d96e
Merge branch 'pr/#10268' of https://github.com/lkho/youtube-dl into lkho-pr/#10268 8 years ago
lkho 7f832413d6 Preserve line endings for downloaded subtitle files 8 years ago
Sergey M․ 7f2ed47595
[rtlnl] Relax _VALID_URL (Closes #10282) 8 years ago
Sergey M․ c3fa77bdef
[formula1] Relax _VALID_URL (Closes #10283) 8 years ago
Remita Amine 57ce8a6d08 [wat] improve extraction(#10281)
add alternative method to extract http formats
works even if the video is geo-restricted or removed
from public access(most of the cases)
8 years ago
Yen Chi Hsuan 69d8eeeec5
[ctsnews] Fix extraction 8 years ago
Yen Chi Hsuan 81c13222c6
[utils] Recognize more formats in unified_timestamp
Used in CtsNews
8 years ago
Sergey M․ b1ce2ba197
release 2016.08.10 8 years ago
Remita Amine 20ef4123b9 [uol] remove unused import 8 years ago
Remita Amine 4e62d26aa2 [uol] Add new extractor(#4263) 8 years ago