Commit Graph

370 Commits (master)

Author SHA1 Message Date
Sergey M․ 073cca3df8
[downloader/common] Add whitespace 6 years ago
Sergey M․ b91a7a4e5e
[downloader/http] Randomize HTTP chunk size 6 years ago
Sergey M․ 00c97e3e7a
[downloader/http] Add ability to pass downloader options via info dict 6 years ago
Sergey M․ cf7259bc93
[downloader/http] Fix 302 infinite loops by not reusing requests 6 years ago
Sergey M․ b54d4a5ce8
Document http_chunk_size 6 years ago
Sergey M․ ba515388b8
Introduce --http-chunk-size 6 years ago
Sergey M․ 65220c3bd6
Add support for IronPython 6 years ago
Sergey M․ c989bdbef8
[downloader/ism] Fix Python 3.2 support 6 years ago
Sergey M․ cf2820710d
Switch codebase to use compat_b64decode 6 years ago
Sergey M․ 538d4f8681
[downloader/hls] Use HTTP headers for key request 6 years ago
Sergey M․ 99081da90c
[downloader/fragment] Encode filename of fragment being removed (closes #15020) 7 years ago
Sergey M․ bec49996c6
[downloader/http] Return actual download result (closes #14971) 7 years ago
Sergey M․ 593f2f7989
[downloader/fragment] Commit part file after each fragment
In order to obtain correct resume_len on next iteration
7 years ago
Sergey M․ 48107c198b
[f4m] Prefer baseURL for relative URLs (closes #14660) 7 years ago
Sergey M․ 6f3b4a98c9
[downloader/fragment] Report warning instead of error on inconsistent download state 7 years ago
Sergey M․ a9ee4f6e49
[downloader/hls] Fix total fragments count when ad fragments exist 7 years ago
Sergey M․ 74c42d9ec3
[downloader/hls] Ignore anvato ad fragments (closes #14496) 7 years ago
Sergey M․ 5efaf43c93
[downloader/fragment] Output ad fragment count 7 years ago
Sergey M․ e7c3e33456
[downloader/fragment] Restart inconsistent incomplete fragment downloads (#13731) 7 years ago
Sergey M․ a3c3a1e128
[http] Rework HTTP downloader
* Simplify code and split into separate routines to facilitate maintaining
* Make retry mechanism work on errors during actual download not only during connection establishment phase
* Retry on ECONNRESET and ETIMEDOUT during reading data from network
* Retry on content too short and various timeout errors
* Show error description on retry
* Closes #506, closes #809, closes #2849, closes #4240, closes #6023, closes #8625, closes #9483
7 years ago
Sergey M․ 1141e9104b
Use relative paths for DASH fragments (closes #12990)
10x reduced JSON size
refs #13810
7 years ago
Sergey M․ c5a49ff084
[downloader/hls] Use redirect URL as manifest base (#13755) 7 years ago
Robin Neatherway 2583c0b54e Fix bugs caused by typos 7 years ago
Sergey M․ 1433734c35
[downloader/common] Use utils.shell_quote for debug command line 7 years ago
Sergey M․ a609e61a90
[downloader/external] Pass -loglevel to ffmpeg downloader (closes #13183) 7 years ago
Sergey M․ 50534b7158
[downloader/fragment] PEP 8 7 years ago
Sergey M․ e7db6759e4
[downloader/external] Properly handle live stream downloading cancellation (closes #8932) 7 years ago
Sergey M․ c0fa4245ce
[downloader/fragment] Remove assert for resume_len when no fragments downloaded
This may be incorrect due some header (e.g. flv header in f4m downloader)
7 years ago
Sergey M․ 85f6de25e4
[downloader/fragment] Clarify current_fragment's index and mark as experimental 7 years ago
Sergey M․ 290f64dbaa
[downloader/fragment] Improve .ytdl format and start documenting 7 years ago
Sergey M․ adb4b03cd5
[downloader/fragment] Don't process ytdl file when it's not needed yet 7 years ago
Sergey M․ 0eee52f34b
Introduce --keep-fragments 7 years ago
Sergey M․ d3f0687cf7
[downloader/fragment] Use temp file for current fragment 7 years ago
Remita Amine 4abdba643c [downloader/fragment] remove unused code 7 years ago
Remita Amine 3e0304fe6e [downloader/fragment] use the documented names for fragment progress_hooks fields 7 years ago
Remita Amine ea0c2f219c [downloader/fragment] use a general file to store fragment download context 7 years ago
Remita Amine 75a2485407 [fragment,hls,f4m,dash,ism] improve fragment downloading
- resume immediately
- no need to concatenate segments and decrypt them on every resume
- no need to save temp files for segments

and for hls downloader:
- no need to download keys for segments that already downloaded
7 years ago
Remita Amine f59746372a [downloader/hls] add basic support for EXT-X-BYTERANGE tag(#10955) 7 years ago
Remita Amine 40fcba5edb improve coding style 7 years ago
Remita Amine 2bfaf89b6c [downloader/hls] move check for m3u8 live streams to get_suitable_downloader 7 years ago
Remita Amine fb4fc44928 [downloader/hls] immediately delegate downloading to ffmpeg in case live stream 7 years ago
Sergey M․ a50862b735
[downloader/external] Add missing import and PEP8 7 years ago
John Hawkinson 6d0fe752bf [external:ffmpeg] In test harness, limit to 10k download size
Otherwise, if you screw up a playlist test by including a playlist
dictionary key, you'll be there for eons while it downloads all the
files before erroring out.
7 years ago
Pratyush Singh d374d943f3
[downloader/common] Limit displaying 2 digits after decimal point in sleep interval message 7 years ago
Sergey M․ de64e23c56
[downloader/ism] Honor HTTP headers when downloading fragments 7 years ago
Sergey M․ 553f6dbac7
[downloader/dash] Honor HTTP headers when downloading fragments
For example, https://www.oppetarkiv.se/video/1196142/natten-ar-dagens-mor
7 years ago
Remita Amine be670b8e8f [external:ffmpeg] do not assume that ffmpeg unknown version format is new 7 years ago
Sergey M․ 7097bffba6
[downloader/fragment] Respect --no-part 7 years ago
Remita Amine 36fce54816 [turner] fix downloading of secure hls formats using ffmpeg(closes #11358)(closes #11373)(closes #11800) 7 years ago
Remita Amine 8bdc149441 [downloader/external:ffmpeg] minimize the use of aac_adtstoasc filter 7 years ago
Remita Amine bfa1073e11 [uplynk] force downloading using hls native downloader(closes #11496) 8 years ago
Yen Chi Hsuan 582be35847
Update coding style after pycodestyle 2.1.0
In pycodestyle 2.1.0, E305 was introduced, which requires two blank
lines after top level declarations, too.

See https://github.com/PyCQA/pycodestyle/issues/400

See also #10689; thanks @stepshal for first mentioning this issue and
initial patches
8 years ago
Sergey M․ 690355551c
[downoader/fragment,f4m,hls] Add internal support for custom HTTP headers 8 years ago
Sergey M․ 9d64e1dcdc
[downloader/ism] Fix typo 8 years ago
Remita Amine 10380e55de [downloader/ism] fix AVC Decoder Configuration Record creation in python 3 8 years ago
Remita Amine b2758123c5 add Basic support for Smooth Streaming protocol(#8118) 8 years ago
Sergey M․ bcd6276520
[downloader/common] Remove debug output 8 years ago
Yen Chi Hsuan d54739a2e6
[downloader/http] xattr values should be bytes 8 years ago
Yen Chi Hsuan d7753d1948
[downloader/http] Use write_xattr function for --xattr-set-filesize 8 years ago
Remita Amine 6f126d903f [download/hls] Delegate downloading to ffmpeg for live streams 8 years ago
Sergey M․ 86f4d14f81
Refactor fragments interface and dash segments downloader
- Eliminate segment_urls and initialization_url
+ Introduce manifest_url (manifest may contain unfragmented data in this case url will be used for direct media URL and manifest_url for manifest itself correspondingly)
* Rewrite dashsegments downloader to use fragments data
* Improve generic mpd extraction
8 years ago
Yen Chi Hsuan 919cf1a62f
[downloader/dash] Abort if the first segment fails
Closes #10497, Closes #10542
8 years ago
Sergey M․ 4a69fa04e0
[downloader/dash] Abort download immediately after giving up on some fragment 8 years ago
Sergey M․ 2e99cd30c3
[downloader/dash:hls] Report exact fragment error on retry 8 years ago
Sergey M․ 25afc2a783
[downloader/dash:hls] Respect --fragment-retries and --skip-unavailable-fragments (Closes #10165, closes #10448) 8 years ago
Sergey M․ 9603b66012
Introduce --skip-unavailable-fragments 8 years ago
Yen Chi Hsuan 6c9b71bc08
[downloader/external] Recommend --hls-prefer-native for SOCKS users
Related: #10490
8 years ago
Remita Amine b8079a40bc [turner] fix secure m3u8 formats downloading 8 years ago
Yen Chi Hsuan 20bad91d76
[downloader/external] Clarify that ffmpeg doesn't support SOCKS
Ref: #10304
8 years ago
Remita Amine 07ea9c9b05 [downloader/hls] fill IV with zeros for IVs shorter than 16-octet 8 years ago
Remita Amine aaf44a2f47 [uplynk] Add new extractor 8 years ago
Remita Amine acfccacad5 [downloader/external:curl] Clarify why CurlFD should not capture stderr 8 years ago
Remita Amine 98e698f1ff [external/curl] respect more downloader options and display progress 8 years ago
Sergey M․ 1ad6b891b2
Add more checks for --min/max-sleep-interval arguments and use more idiomatic naming 8 years ago
singh-pratyush96 065bc35489
Add --max-sleep-interval (Closes #9930) 8 years ago
Yen Chi Hsuan 477b7a8474
[downloader/f4m] Fix for Rai live streams 8 years ago
Sergey M․ 8369a4fe76
[downloader/hls] Simplify and carry long lines 8 years ago
remitamine e154c65128 [downloader/hls] Add support for AES-128 encrypted segments in hlsnative downloader 8 years ago
Sergey M․ e69f9f5d68
[downloader/external] Decode error string before writing to stderr 8 years ago
Yen Chi Hsuan 50ce1c331c
[downloader/external] Add another env for proxies in ffmpeg/avconv
Related sources:
https://git.libav.org/?p=libav.git;a=blob;f=libavformat/http.c;h=8fe8d11e1edfdbb04a8726db2c49cfef3f572aac;hb=HEAD#l152
https://git.libav.org/?p=libav.git;a=blob;f=libavformat/tls.c;h=fab243e93e20034e88e619188c13a44a5d8ccdb9;hb=HEAD#l63
https://github.com/FFmpeg/FFmpeg/blob/f8e89d8/libavformat/http.c#L191
https://github.com/FFmpeg/FFmpeg/blob/f8e89d8/libavformat/tls.c#L92
8 years ago
Sergey M․ 633b444fd2
[downloader/hls] Correct comment on twitch vods 8 years ago
Sergey M․ 51c4d85ce7
[downloader/hls] PEP 8 8 years ago
Sergey M․ 1e236d7e23
[downloader/hls] Do not rely on EXT-X-PLAYLIST-TYPE:EVENT 8 years ago
Sergey M․ 2615fa7584
[downloader/f4m] Simply select format when it's the only one 8 years ago
Yen Chi Hsuan 1b405bb47d
[downloader/f4m] Tolerate truncate segments when testing
Replaces #9216

Fixes #9214 and test_Bloomberg partially
8 years ago
Yen Chi Hsuan edaa23f822
[compat] Rename struct_(un)pack to compat_struct_(un)pack 8 years ago
Yen Chi Hsuan dab0daeeb0
[utils,compat] Move struct_pack and struct_unpack to compat.py 8 years ago
Sergey M․ 2937590e8b
[downloader/hls] PEP 8 8 years ago
Sergey M․ e62d9c5caa
[downloader/external] Call ffmpeg with with HTTP_PROXY env variable set (#9437) 8 years ago
Sergey M․ 6104cc2985
[downloader/hls] Add event media playlists to unsupported features of hlsnative 8 years ago
Sergey M․ c15c47d19b
[downloader/hls] Remove EXT-X-MEDIA-SEQUENCE from unsupported features for hlsnative 8 years ago
Sergey M eb785b856f Merge pull request #9358 from dstftw/hls-native-to-ffmpeg-delegation
[downloader/hls] Delegate extraction to ffmpeg when unsupported features detected
8 years ago
Sergey M․ f5436c5d9e
[downloader/external] Add temp fix ffmpeg m3u8 downloads (Closes #9394) 8 years ago
Sergey M․ 0d66bd0eab
[downloader/hls] Delegate extraction to ffmpeg when unsupported features detected 8 years ago
Sergey M․ bf09af3acb
Add --hls-prefer-ffmpeg 8 years ago
remitamine d868f43c58 [ffmpeg] check for - file name in _ffmpeg_filename_argument 8 years ago
remitamine ce599d5a7e [downloader/external] enable piping for FFmpegFD(closes #2124) 8 years ago
Yen Chi Hsuan f5d8743e0a
[downloader/rtsp] Print the command 8 years ago
Sergey M․ f7df343b4a [downloader/f4m] Extract routine for removing unsupported encrypted media 8 years ago
Sergey M․ 16a8b7986b [downloader/fragment] Document fragment_retries 8 years ago