Commit Graph

10084 Commits (81da8cbc4513df16d0d04dc2992d6de9ab0f4038)

Author SHA1 Message Date
remitamine 354dbbd880 [brightcove:new] extract protocol-less embed URLs(closes #2914) 9 years ago
remitamine 23edc49509 [tv3] Add new extractor(closes #8059) 9 years ago
remitamine 48254c3f2c [brightcove] some improvements and fixes
- use FFmpeg downloader to download m3u8 formats extracted
from BrightcoveNew(some of the m3u8 media playlists use AES-128)
- update comment and update_url_query to handle url query
9 years ago
remitamine 2cab48704c [thestar] Add new extractor(closes #5955) 9 years ago
remitamine 64d4f31d78 [brightcove:new] update embed_in_page embeds regex to match non numeric ref id 9 years ago
remitamine 0c9ff24041 [noz] fix extraction in python 2.6 9 years ago
Yen Chi Hsuan 3ff8279e80 [kuwo:mv] Fix the test and extraction of georestricted MVs 9 years ago
remitamine cb6e477dfe [aljazeera] update the extractor to use BrightcoveNewIE 9 years ago
remitamine edfd93518e [svt] extract dashhbbtv formats(#8867) 9 years ago
remitamine 89807d6a82 [brightcove] extract dash formats and detect audio formats 9 years ago
remitamine 49dea4913b Merge pull request #8513 from remitamine/dash-sort
[extractor/common] fix dash formats sorting
9 years ago
Sergey M․ dec2cae0a7 [twitch:playlistbase] Clarify pagination bug
Pagination bug has been fixed by twitch on 15.03.2016.
9 years ago
remitamine cf6cd07396 [noz] extract f4m and m3u8 formats 9 years ago
remitamine 975b9c9ab0 [brightcove:new] detect m3u8 manifests by M2TS container 9 years ago
remitamine 8ac73bdbe4 [brightcove:new] Add support for non numeric ref: preffixed video ids 9 years ago
remitamine 877f440f7b [rice] Add new extractor(closes #1736) 9 years ago
remitamine d13bdc3824 [brightcove] raise ExtractorError on 403 errors and fix regex to work with tenplay 9 years ago
remitamine 744daf9418 [gameinformer] remove unused imports 9 years ago
remitamine bf475e1990 [tlc] fix extraction and update extractor to use BrightcoveNewIE 9 years ago
remitamine 203f3d779a [gameinformer] update the extractor to use BrightcoveNewIE 9 years ago
remitamine 4230c4894d [external/downloader] fix rtmp downloading using FFmpegFD 9 years ago
Philipp Hagemeister 6bb266693f release 2016.03.14 9 years ago
remitamine 5d53c32701 [usatoday] Add new extractor(closes #8655) 9 years ago
remitamine 2e7e561c1d Merge pull request #8611 from remitamine/ffmpegfd
[downloader/external] Add FFmpegFD
9 years ago
remitamine d8515fd41c [downloader/external] pass configuration args to ffmpeg 9 years ago
remitamine 694c47b261 [external/downloader] don't pass -t and -ss to ffmpeg 9 years ago
remitamine 77dea16ac8 [downloader/external] check for ffmpeg availablity when it used for m3u8 download 9 years ago
remitamine 6ae27bed01 [download/external] move the check for multiple selected formats to get_suitable_downloader 9 years ago
remitamine da1973a038 [extractor/__init__] disable time range downloading 9 years ago
remitamine be24916a7f [downloader/rtsp] Add rtsp and mms downloader 9 years ago
remitamine 2cb99ebbd0 [downloader/external] add can_download mathod for checking downloader availibilty and support 9 years ago
remitamine 91ee320bfa [downloader/external] wrap available_opt in a list 9 years ago
remitamine 8fb754bcd0 Merge pull request #8821 from remitamine/list-thumbnails-order
[YoutubeDL] check for --list-thumbnails immediately after processing them
9 years ago
remitamine b7b72db9ad [YoutubeDL] check for --list-thumbnails immediately after processing them 9 years ago
remitamine 634415ca17 [downloader/external] skip FFmpegFD when requesting multiple formats 9 years ago
Sergey M․ 2f7ae819ac [utils] PEP 8 9 years ago
Sergey M․ 0a477f8731 [vice:show] Add extractor (Closes #8847) 9 years ago
remitamine a755f82549 [ffmpeg] convert format ext to ffmpeg output formats codes 9 years ago
Sergey M․ 7f4173ae7c [mixcloud] Fix view count extraction (Closes #8831, closes #8845) 9 years ago
Sergey M․ fb47597b09 [bbc] Generalize unit table lookup and add parse_count 9 years ago
Sergey M․ 450b233cc2 [bbc] Update test 9 years ago
Sergey M․ b7d7674f1e [bbc] Update test 9 years ago
Sergey M․ 0e832c2c97 [bbc] Improve title and description extraction (Closes #8826, closes #8822) 9 years ago
Benjamin Congdon 8e4aa7bf18 [bbc] Fix BBC Extractor to work with 'School Report' 9 years ago
remitamine a42dfa629e [makerschannel] Add new extractor(closes #8839) 9 years ago
remitamine b970dfddaf [minoto] Add new extractor 9 years ago
Sergey M․ 46a4ea8276 [safari] Remove unused imports 9 years ago
Sergey M․ 3f2f4a94aa [extractor/generic] Extract f4m formats from final URLs 9 years ago
Sergey M․ f930e0c76e [extractor/generic] Extract f4m formats and refactor common info 9 years ago
Sergey M․ 0fdbb3322b [extractor/common] Add _parse_f4m_formats routine 9 years ago
Sergey M․ e9c8999ede [safari] Fix authentication 9 years ago
Sergey M․ 73cbd709f9 [safari] Respect kaltura session (Closes #7491) 9 years ago
Sergey M․ 9dce3c095b [kaltura] Respect kaltura session 9 years ago
remitamine e5a2e17a9c [kaltura] optimize url info extraction 9 years ago
remitamine 0ec589fac3 Merge pull request #8827 from remitamine/safari
[safari] extract free and preview videos(#7491)
9 years ago
remitamine 36bb63e084 [dw] add support for article pages(closes #8790) 9 years ago
remitamine 91d6aafb48 [dw] add support for audio pages 9 years ago
remitamine c8868a9d83 [dw] Add new extractor 9 years ago
remitamine 09f572fbc0 [extractor/common] add transform_source to _download_smil and _extract_smil_formats 9 years ago
Sergey M․ 58e6d097d8 [googledrive] Relax _VALID_URL (Closes #8829) 9 years ago
remitamine 15bf934de5 Merge pull request #8819 from remitamine/simple-webpage-requests
[extractor/common] simplify using data, headers and query params with _download_* methods
9 years ago
remitamine cdfee16818 [extractor/common] add data, headers and query params to _request_webpage 9 years ago
remitamine bcb668de18 [safari] extract free and preview videos(#7491) 9 years ago
remitamine fac7e79277 [kaltura] add support for videos with reference id 9 years ago
Yen Chi Hsuan a6c8b75904 [common] Use mimeType to determine file extensions (#8766) 9 years ago
Yen Chi Hsuan 25cb05bda9 [utils] Remove codec2ext
This function is orignally used for determining file extensions of DASH
formats. Now in DASH, ext is determined by mime_type. See #8766 for more
information.
9 years ago
Sergey M․ 883c052378 [audioboom] Improve robustness and extract uploader (Closes #8812) 9 years ago
Benjamin Congdon 61f317c24c Added extractor for AudioBoom.com 9 years ago
Yen Chi Hsuan 64f08d4ff2 Merge pull request #8766 from yan12125/dash-detect-ext
Detect file extensions of DASH formats from their codecs
9 years ago
Yen Chi Hsuan e738e43358 [facebook] Support videos in groups
Viewing/Downloading videos in groups requires logging in, even for
those in public groups.

Fixes #6951.
9 years ago
Jaime Marquínez Ferrándiz f6f6217a98 [facebook] Don't override variable in list comprehension 9 years ago
Yen Chi Hsuan 31db8709bf [iqiyi] Update enc_key 9 years ago
Yen Chi Hsuan 5080cbf9fd [facebook] Handle escaped swf params
Fixes #8713
9 years ago
Yen Chi Hsuan 9880124196 [facebook] Fix for m.facebook.com URLs 9 years ago
Yen Chi Hsuan 9c7b509b2a [facebook] Merge FacebookPostIE into FacebookIE
Fixes #8713
9 years ago
Sergey M․ 5d583bdf6c [YoutubeDL] Improve _format_note 9 years ago
Sergey M․ 1e501364d5 [vimeo:ondemand] Clarify IE_NAME 9 years ago
Sergey M․ 74278def2e [vimeo:ondemand] Separate ondemand extractor (Closes #8330, closes #8801) 9 years ago
Sergey M․ e375a149e1 [livestream] Properly build smil URLs (#8794) 9 years ago
Benjamin Congdon ac45505528 Added flag for 'allow_audio_only' format in Twitch queries 9 years ago
Sergey M․ 46c329d6f6 [arte] Improve extraction (Closes #8768) 9 years ago
Sergey M․ 1818e4c2b4 [arte] Fix typo 9 years ago
Sergey M․ e7bd17373d [sexu] Improve extraction (Closes #8782) 9 years ago
aystroganov@gmail.com c58e74062f [Sexu] fix extractor 9 years ago
Yen Chi Hsuan 6d210f2090 [utils] Add more codecs to codec2ext
BBC uses avc3. Here's an example (thanks to @remitamine for this example)

http://rdmedia.bbc.co.uk/dash/ondemand/bbb/2/client_manifest-common_init.mpd

See also https://trac.ffmpeg.org/ticket/5217
9 years ago
Yen Chi Hsuan af7d5a63b2 [common] Document protocol http_dash_segments 9 years ago
Yen Chi Hsuan e41acb6364 [safari] Don't pollute std_headers (#8778) 9 years ago
Philipp Hagemeister bdf7f13954 release 2016.03.06 9 years ago
Yen Chi Hsuan 0f56a4b443 [vimeo] Don't pollute std_headers
Fixes #8778
9 years ago
Sergey M․ 1b5284b13f [downloader/fragment] Make speed more smooth
At the beginning of every segment there was a drop to Unknown speed due to timeslice being too small to calculate speed.
Now last speed from the previous fragment is used.
9 years ago
Sergey M․ d1e4a464cd [YoutubeDL] Carry long lines and improve readability 9 years ago
Sergey M․ ff059017c0 [YoutubeDL] Fix typo in m3u8_native fixup 9 years ago
remitamine f22ba4bd60 update tests related to the change in youtube http format sorting
the change was done in 82156fdbf0
9 years ago
remitamine 1db772673e [cinemassacre] update tests 9 years ago
remitamine 75313f2baa [cnet] fix info extraction 9 years ago
remitamine 090eb8e25f Merge pull request #8718 from remitamine/m3u8-fixup
Add fixup for media files produced by HlsNative downloader(fixes #4776)
9 years ago
remitamine a9793f58a1 Merge pull request #8754 from remitamine/5min
update 5min related web sites info extraction and add support for Aol features.
9 years ago
remitamine 7177fd24f8 [vgtv] support ap.vgtv.no and fix old videos extraction(fixes #8719) 9 years ago
Sergey M․ 1e501f6c40 [jeuxvideo] Fix config URL extraction (Closes #8774) 9 years ago
remitamine 2629a3802c [revison3] fix video_id for --download-archive 9 years ago
Sergey M․ 51ce91174b [YoutubeDL] Fix resolution with missing height in output template dict 9 years ago
remitamine 107d0c421a [revision3] add support for pages of type tag 9 years ago
remitamine 18b0b23992 [revision3] add support pages of type embed 9 years ago
Sergey M․ d1b29d1342 [elpais] Add support for alternative layout (Closes #8744) 9 years ago
Yen Chi Hsuan 2def60c5f3 [common] Use codec2ext for DASH formats (#8764) 9 years ago
Yen Chi Hsuan 19a17d4623 [utils] Add codec2ext 9 years ago
Yen Chi Hsuan 845817aadf [twitter] Provide more metadata 9 years ago
Jaime Marquínez Ferrándiz 3233a68fbb [utils] update_url_query: Encode the strings in the query dict
The test case with {'test': '第二行тест'} was failing on python 2 (the non-ascii characters were replaced with '?').
9 years ago
remitamine cf074e5ddd [foxnews] update test 9 years ago
Sergey M․ 002c755248 [youporn] Fix sources regex 9 years ago
Sergey M․ d627cec608 [youporn] Fix quality extraction (Closes #8758) 9 years ago
remitamine 1315224cbb [bleacherreport] update tests 9 years ago
remitamine 7760b9ff4d [audimedia] update _VALID_URL and video_id regex and improve http format_id 9 years ago
Yen Chi Hsuan 28559564b2 [kusi] Correct test_KUSI 9 years ago
Yen Chi Hsuan fa880d20ad [kusi] Two fixes
Thanks @dstftw for pointing out those
9 years ago
Sergey M․ ae7d31af1c [yandexmusic] Capture and output API errors 9 years ago
Yen Chi Hsuan 5f1688f271 [kusi] Simplify and improve 9 years ago
remitamine 1d4c9ed90c [aol] imporve extraction
- add support for aol features
- remove support for legacy urls
9 years ago
remitamine d48352fb5d [engadget] remove support for legacy urls 9 years ago
remitamine 6d6536acb2 [fivemin] improve extraction
- skip m3u8 formats(404 error)
- skip unavailable test
- download embed page only when it's needed
- update _VALID_URL regex(joystiq.com redirect to engadget.com)
9 years ago
Yen Chi Hsuan b6f94d81ea [kusi] Add a test for the alternative form of URL 9 years ago
Yen Chi Hsuan 8477a69283 Merge branch 'kusi' of https://github.com/mutantmonkey/youtube-dl into mutantmonkey-kusi 9 years ago
Yen Chi Hsuan d58cb3ec7e [leeco] Skip an invalid test. test_LePlaylist_1 is sufficient 9 years ago
Yen Chi Hsuan 8a370aedac [leeco] format_id should be strings 9 years ago
Yen Chi Hsuan 24ca0e9c0b [douyutv] Fix tests 9 years ago
Sergey M․ e1dd521e49 [livestream] Fix FutureWarning (Closes #8742) 9 years ago
remitamine 1255733945 Merge pull request #8739 from remitamine/update_url_params
[utils] add update_url_query function to create or update query string params
9 years ago
Sergey M․ d0ff690d68 [indavideo:embed] Fix tags extraction (Closes #8738) 9 years ago
remitamine 38f9ef31dc [utils] add update_url_query function 9 years ago
Sergey M․ a8276b2680 [twitch:playlistbase] Fix all at once fetch 9 years ago
Sergey M․ ececca6cde [twitch:playlistbase] Restore original _PAGE_LIMIT 9 years ago
Sergey M․ 8bbb4b56ee [twitch:playlistsbase] Use orderedSet 9 years ago
Sergey M․ 539a1641c6 [twitch] Workaround broken paging (Closes #8740) 9 years ago
Yen Chi Hsuan e9c0cdd389 [jython] Introduce compat_os_name
os.name is always 'java' on Jython
9 years ago
Yen Chi Hsuan 0cae023b24 Merge branch 'jython-support'
Closes #8302
9 years ago
Yen Chi Hsuan 8ee239e921 [utils] Jython support - handle filenames correctly
Now test:youtube downloads
9 years ago
Brian Foley 8bb56eeeea [utils] Add extract_attributes for extracting html tag attributes
This is much more robust than just using regexps, and handles all
the common scenarios, such as empty/no values, repeated attributes,
entity decoding, mixed case names, and the different possible value
quoting schemes.
9 years ago
remitamine fa9e259fd9 [extractor/common] use compat_parse_qs in update_url_params 9 years ago
remitamine f3bdae76de [extractor/common] add update_url_params helper method to add or update query string params 9 years ago
Yen Chi Hsuan 03879ff054 [twitter] Media info is not always in the first entity
Fixes #8704
9 years ago
Yen Chi Hsuan c8398a9b87 [twitter] Now Twitter serves the same file for Firefox and Chrome 9 years ago
Yen Chi Hsuan b8972bd69d [twitter] Fix extraction of test_Twitter and test_Twitter_1 9 years ago
Yen Chi Hsuan 0ae937a798 [twitter] Support twitter.com/i/videos/tweet/ URLS
Closes #8737
9 years ago
remitamine 4459bef203 [thepltform] detect other types of errors 9 years ago
remitamine e07237f640 [utils] remove check for val from find_xpath_attr 9 years ago
Yen Chi Hsuan 8c5a994424 [leeco] Letv renamed to LeEco
LeEco is the company name and Le is the domain name.

For more information see the Chinese news post
http://www.techorz.com/company-news/letv-renamed-to-leeco-and-new-logo/
9 years ago
Yen Chi Hsuan 2eb25b256b [letv] Merge LetvTvIE into LetvPlaylistIE
And
1. Add more URL examples
2. Improve the matching pattern
9 years ago
Yen Chi Hsuan f3bc19a989 [letv] Correct regular expressions and fix a typo 9 years ago
Yen Chi Hsuan 7a8fef3173 [letv] Order imports alphabetically 9 years ago
Yen Chi Hsuan 7465e7e42d [letv] Keep videos' order in playlists 9 years ago
Yen Chi Hsuan 5e73a67d44 [letv] Domain name changed 9 years ago
Sergey M․ 2316dc2b9a [twitch:playlistbase] Mark broken
Twitch paging mechanism is completely broken on twitch side serving all videos all the time and making our travis builds stall.
9 years ago
Sergey M․ a2d7797cee [vimeo] Extract uploader_url (Closes #8727) 9 years ago
Sergey M․ fd050249af [youtube] Extract uploader_url (Closes #8724) 9 years ago
Sergey M․ 7bcd2830dd [extractor/common] Document uploader_url 9 years ago
Sergey M․ 7caf9830b0 [youtube] Extract license (Closes #8725) 9 years ago
Sergey M․ 2bc0c46f98 [extractor/common] Document license metafield 9 years ago
remitamine 3318832e9d [youtube] improve width and height extraction from fmt_list 9 years ago
remitamine e7d2084568 Merge branch 'master' of github.com:rg3/youtube-dl 9 years ago
remitamine c2d3cb4c63 Revert "[youtube] add tbr to _formats extracted from watch_as3.swf"
This reverts commit 4a5ba28a87.
9 years ago
remitamine c48dd4400f Revert "[youtube] add basic info for some unknown formats extracted from watch_as3.swf"
This reverts commit 85ca019d96.
9 years ago
Sergey M․ e38cafe986 [YoutubeDL] Skip postprocessing and archive report when outputting to stdout (Closes #8729) 9 years ago
remitamine 85ca019d96 [youtube] add basic info for some unknown formats extracted from watch_as3.swf 9 years ago
remitamine 4a5ba28a87 [youtube] add tbr to _formats extracted from watch_as3.swf 9 years ago
remitamine 82156fdbf0 [youtube] extract width and height from fmt_list 9 years ago
Sergey M․ 6114090418 [nrk:skole] Relax _VALID_URL 9 years ago
Sergey M․ 3099b31276 [nrk:skole] Add extractor (Closes #8728) 9 years ago
remitamine f17f86513e Add fixup for media files produced by HlsNative downloader(fixes #4776) 9 years ago
Sergey M․ 90f794c6c3 [options] Add --no-mark-watched (#5054) 9 years ago
Sergey M․ 66ca2cfddd [wistia] Fix extraction (Closes #8707) 9 years ago
Sergey M 269dd2c6a7 Merge pull request #8703 from dstftw/mark-watched
Add --mark-watched feature (Closes #5054)
9 years ago
Sergey M․ e7998f59aa [lifenews] Fix extraction and improve (Closes #2482, closes #8714) 9 years ago
Yen Chi Hsuan 9fb556eef0 [iqiyi] SWF URLs are not used anymore
Since automatic detection of enc_key failed

Closes #8705
9 years ago
Philipp Hagemeister e781ab63db release 2016.03.01 9 years ago
Jaime Marquínez Ferrándiz 3e76968220 [rtve.es:live] Fix extraction
* Update _VALID_URL to match the current URLs
* Use the m3u8 manifest since I haven't figured out how to use the rtmp stream
9 years ago
Sergey M․ 2812c24c16 [mdr] Fix extraction (Closes #8702) 9 years ago
Sergey M․ d77ab8e255 Add --mark-watched feature (Closes #5054) 9 years ago
Sergey M․ 4b3cd7316c [tf1] Improve wat id regex (Closes #8691) 9 years ago
Sergey M․ 6dae56384a [screenwavemedia] Check formats' URLs 9 years ago
Sergey M․ 2b2dfae83e [screenwavemedia] Improve formats sorting 9 years ago
Sergey M․ 6c10dbeae9 [screenwavemedia] Improve formats extraction 9 years ago
Jaime Marquínez Ferrándiz 9173202b84 [zdf] Ignore hls manifests that use https (closes #8665)
The certificates are misconfigured, you get the following error mesage:

    ssl.CertificateError: hostname u'zdf-hdios-none-i.zdf.de' doesn't match either of 'a248.e.akamai.net', '*.akamaihd.net', '*.akamaihd-staging.net', '*.akamaized.net', '*.akamaized-staging.net'
9 years ago
Sergey M․ 8870bb4653 [webofstories] Tolerate malforder og:title (Closes #8417) 9 years ago
Philipp Hagemeister da665ddc25 release 2016.02.27 9 years ago
Sergey M․ 5add979d91 [dplay] Add support for dplay.no 9 years ago
Sergey M․ 940b606a07 [dplay] Improve, extract all formats and metadata (Closes #8463) 9 years ago
Aidan Rowe 9505053704 [dplay] add support for it.dplay.com and dplay.dk 9 years ago
Sergey M․ 2c9ca78281 [extractor/generic] Add support for tnaflix network embeds (Closes #7505) 9 years ago
Sergey M․ 63719a8ac3 [tnaflixnetwork:embed] Add _extract_urls 9 years ago
Sergey M․ 8fab62482a [tnaflixnetwork] Fallback age limit to 18 9 years ago
Sergey M․ d6e9c2706f [tnaflixnetwork:embed] Add extractor 9 years ago
Sergey M․ f7f2e53a0a [imdb] Recognize 1080p formats (Closes #8677) 9 years ago
Sergey M․ 9cdffeeb3f [extractor/common] Clarify rationale on media playlist detection 9 years ago
Sergey M․ fbb6edd298 [extractor/common] Properly extract audio only formats in master m3u8 playlists 9 years ago
Yen Chi Hsuan 5eb6bdced4 [utils] Multiple changes to base_n()
1. Renamed to encode_base_n()
2. Allow tables longer than 62 characters
3. Raise ValueError instead of AssertionError for invalid input data
4. Return the first character in the table instead of '0' for number 0
5. Add tests
9 years ago
Yen Chi Hsuan 5633b4d39d [infoq] Use BokeCC extractor function 9 years ago
Yen Chi Hsuan 4435c6e98e [bokecc] Add new extractor (#2336) 9 years ago
Yen Chi Hsuan 2ebd2eac88 [letv] Speedup M3U8 decryption 9 years ago
Sergey M․ b78b292f0c [youtube] Add alternative automatic captions extraction approach (Closes #8667) 9 years ago
Yen Chi Hsuan efbd6fb8bb [vidzi] Use decode_packed_codes
Javascript codes found on Vidzi are slightly different from those found
in VideoMega and iQiyi. Nevertheless, the difference has no effects on
the final result.
9 years ago