74c42d9ec3
[downloader/hls] Ignore anvato ad fragments ( closes #14496 )
7 years ago
5efaf43c93
[downloader/fragment] Output ad fragment count
7 years ago
e7c3e33456
[downloader/fragment] Restart inconsistent incomplete fragment downloads ( #13731 )
7 years ago
a3c3a1e128
[http] Rework HTTP downloader
...
* Simplify code and split into separate routines to facilitate maintaining
* Make retry mechanism work on errors during actual download not only during connection establishment phase
* Retry on ECONNRESET and ETIMEDOUT during reading data from network
* Retry on content too short and various timeout errors
* Show error description on retry
* Closes #506 , closes #809 , closes #2849 , closes #4240 , closes #6023 , closes #8625 , closes #9483
7 years ago
1141e9104b
Use relative paths for DASH fragments ( closes #12990 )
...
10x reduced JSON size
refs #13810
7 years ago
c5a49ff084
[downloader/hls] Use redirect URL as manifest base ( #13755 )
7 years ago
2583c0b54e
Fix bugs caused by typos
7 years ago
1433734c35
[downloader/common] Use utils.shell_quote for debug command line
7 years ago
a609e61a90
[downloader/external] Pass -loglevel to ffmpeg downloader ( closes #13183 )
8 years ago
50534b7158
[downloader/fragment] PEP 8
8 years ago
e7db6759e4
[downloader/external] Properly handle live stream downloading cancellation ( closes #8932 )
8 years ago
c0fa4245ce
[downloader/fragment] Remove assert for resume_len when no fragments downloaded
...
This may be incorrect due some header (e.g. flv header in f4m downloader)
8 years ago
85f6de25e4
[downloader/fragment] Clarify current_fragment's index and mark as experimental
8 years ago
290f64dbaa
[downloader/fragment] Improve .ytdl format and start documenting
8 years ago
adb4b03cd5
[downloader/fragment] Don't process ytdl file when it's not needed yet
8 years ago
0eee52f34b
Introduce --keep-fragments
8 years ago
d3f0687cf7
[downloader/fragment] Use temp file for current fragment
8 years ago
4abdba643c
[downloader/fragment] remove unused code
8 years ago
3e0304fe6e
[downloader/fragment] use the documented names for fragment progress_hooks fields
8 years ago
ea0c2f219c
[downloader/fragment] use a general file to store fragment download context
8 years ago
75a2485407
[fragment,hls,f4m,dash,ism] improve fragment downloading
...
- resume immediately
- no need to concatenate segments and decrypt them on every resume
- no need to save temp files for segments
and for hls downloader:
- no need to download keys for segments that already downloaded
8 years ago
f59746372a
[downloader/hls] add basic support for EXT-X-BYTERANGE tag( #10955 )
8 years ago
40fcba5edb
improve coding style
8 years ago
2bfaf89b6c
[downloader/hls] move check for m3u8 live streams to get_suitable_downloader
8 years ago
fb4fc44928
[downloader/hls] immediately delegate downloading to ffmpeg in case live stream
8 years ago
a50862b735
[downloader/external] Add missing import and PEP8
8 years ago
6d0fe752bf
[external:ffmpeg] In test harness, limit to 10k download size
...
Otherwise, if you screw up a playlist test by including a playlist
dictionary key, you'll be there for eons while it downloads all the
files before erroring out.
8 years ago
d374d943f3
[downloader/common] Limit displaying 2 digits after decimal point in sleep interval message
8 years ago
de64e23c56
[downloader/ism] Honor HTTP headers when downloading fragments
8 years ago
553f6dbac7
[downloader/dash] Honor HTTP headers when downloading fragments
...
For example, https://www.oppetarkiv.se/video/1196142/natten-ar-dagens-mor
8 years ago
be670b8e8f
[external:ffmpeg] do not assume that ffmpeg unknown version format is new
8 years ago
7097bffba6
[downloader/fragment] Respect --no-part
8 years ago
36fce54816
[turner] fix downloading of secure hls formats using ffmpeg( closes #11358 )( closes #11373 )( closes #11800 )
8 years ago
8bdc149441
[downloader/external:ffmpeg] minimize the use of aac_adtstoasc filter
8 years ago
bfa1073e11
[uplynk] force downloading using hls native downloader( closes #11496 )
8 years ago
582be35847
Update coding style after pycodestyle 2.1.0
...
In pycodestyle 2.1.0, E305 was introduced, which requires two blank
lines after top level declarations, too.
See https://github.com/PyCQA/pycodestyle/issues/400
See also #10689 ; thanks @stepshal for first mentioning this issue and
initial patches
8 years ago
690355551c
[downoader/fragment,f4m,hls] Add internal support for custom HTTP headers
8 years ago
9d64e1dcdc
[downloader/ism] Fix typo
8 years ago
10380e55de
[downloader/ism] fix AVC Decoder Configuration Record creation in python 3
8 years ago
b2758123c5
add Basic support for Smooth Streaming protocol( #8118 )
8 years ago
bcd6276520
[downloader/common] Remove debug output
8 years ago
d54739a2e6
[downloader/http] xattr values should be bytes
8 years ago
d7753d1948
[downloader/http] Use write_xattr function for --xattr-set-filesize
8 years ago
6f126d903f
[download/hls] Delegate downloading to ffmpeg for live streams
8 years ago
86f4d14f81
Refactor fragments interface and dash segments downloader
...
- Eliminate segment_urls and initialization_url
+ Introduce manifest_url (manifest may contain unfragmented data in this case url will be used for direct media URL and manifest_url for manifest itself correspondingly)
* Rewrite dashsegments downloader to use fragments data
* Improve generic mpd extraction
8 years ago
919cf1a62f
[downloader/dash] Abort if the first segment fails
...
Closes #10497 , Closes #10542
8 years ago
4a69fa04e0
[downloader/dash] Abort download immediately after giving up on some fragment
8 years ago
2e99cd30c3
[downloader/dash:hls] Report exact fragment error on retry
8 years ago
25afc2a783
[downloader/dash:hls] Respect --fragment-retries and --skip-unavailable-fragments ( Closes #10165 , closes #10448 )
8 years ago
9603b66012
Introduce --skip-unavailable-fragments
8 years ago
6c9b71bc08
[downloader/external] Recommend --hls-prefer-native for SOCKS users
...
Related: #10490
8 years ago
b8079a40bc
[turner] fix secure m3u8 formats downloading
8 years ago
20bad91d76
[downloader/external] Clarify that ffmpeg doesn't support SOCKS
...
Ref: #10304
8 years ago
07ea9c9b05
[downloader/hls] fill IV with zeros for IVs shorter than 16-octet
8 years ago
aaf44a2f47
[uplynk] Add new extractor
8 years ago
acfccacad5
[downloader/external:curl] Clarify why CurlFD should not capture stderr
8 years ago
98e698f1ff
[external/curl] respect more downloader options and display progress
8 years ago
1ad6b891b2
Add more checks for --min/max-sleep-interval arguments and use more idiomatic naming
8 years ago
065bc35489
Add --max-sleep-interval ( Closes #9930 )
8 years ago
477b7a8474
[downloader/f4m] Fix for Rai live streams
8 years ago
8369a4fe76
[downloader/hls] Simplify and carry long lines
8 years ago
e154c65128
[downloader/hls] Add support for AES-128 encrypted segments in hlsnative downloader
8 years ago
e69f9f5d68
[downloader/external] Decode error string before writing to stderr
9 years ago
50ce1c331c
[downloader/external] Add another env for proxies in ffmpeg/avconv
...
Related sources:
https://git.libav.org/?p=libav.git;a=blob;f=libavformat/http.c;h=8fe8d11e1edfdbb04a8726db2c49cfef3f572aac;hb=HEAD#l152
https://git.libav.org/?p=libav.git;a=blob;f=libavformat/tls.c;h=fab243e93e20034e88e619188c13a44a5d8ccdb9;hb=HEAD#l63
https://github.com/FFmpeg/FFmpeg/blob/f8e89d8/libavformat/http.c#L191
https://github.com/FFmpeg/FFmpeg/blob/f8e89d8/libavformat/tls.c#L92
9 years ago
633b444fd2
[downloader/hls] Correct comment on twitch vods
9 years ago
51c4d85ce7
[downloader/hls] PEP 8
9 years ago
1e236d7e23
[downloader/hls] Do not rely on EXT-X-PLAYLIST-TYPE:EVENT
9 years ago
2615fa7584
[downloader/f4m] Simply select format when it's the only one
9 years ago
1b405bb47d
[downloader/f4m] Tolerate truncate segments when testing
...
Replaces #9216
Fixes #9214 and test_Bloomberg partially
9 years ago
edaa23f822
[compat] Rename struct_(un)pack to compat_struct_(un)pack
9 years ago
dab0daeeb0
[utils,compat] Move struct_pack and struct_unpack to compat.py
9 years ago
2937590e8b
[downloader/hls] PEP 8
9 years ago
e62d9c5caa
[downloader/external] Call ffmpeg with with HTTP_PROXY env variable set ( #9437 )
9 years ago
6104cc2985
[downloader/hls] Add event media playlists to unsupported features of hlsnative
9 years ago
c15c47d19b
[downloader/hls] Remove EXT-X-MEDIA-SEQUENCE from unsupported features for hlsnative
9 years ago
eb785b856f
Merge pull request #9358 from dstftw/hls-native-to-ffmpeg-delegation
...
[downloader/hls] Delegate extraction to ffmpeg when unsupported features detected
9 years ago
f5436c5d9e
[downloader/external] Add temp fix ffmpeg m3u8 downloads ( Closes #9394 )
9 years ago
0d66bd0eab
[downloader/hls] Delegate extraction to ffmpeg when unsupported features detected
9 years ago
bf09af3acb
Add --hls-prefer-ffmpeg
9 years ago
d868f43c58
[ffmpeg] check for - file name in _ffmpeg_filename_argument
9 years ago
ce599d5a7e
[downloader/external] enable piping for FFmpegFD( closes #2124 )
9 years ago
f5d8743e0a
[downloader/rtsp] Print the command
9 years ago
f7df343b4a
[downloader/f4m] Extract routine for removing unsupported encrypted media
9 years ago
16a8b7986b
[downloader/fragment] Document fragment_retries
9 years ago
617e58d850
[downloader/{common,fragment}] Fix total retries reporting on python 2.6
9 years ago
e33baba0dd
[downloader/dash] Add fragment retry capability
...
YouTube may often return 404 HTTP error for a fragment causing the
whole download to fail. However if the same fragment is immediately
retried with the same request data this usually succeeds (1-2 attemps
is usually enough) thus allowing to download the whole file successfully.
So, we will retry all fragments that fail with 404 HTTP error for now.
9 years ago
721f26b821
[downloader/fragment] Add report_retry_fragment
9 years ago
4230c4894d
[external/downloader] fix rtmp downloading using FFmpegFD
9 years ago
2e7e561c1d
Merge pull request #8611 from remitamine/ffmpegfd
...
[downloader/external] Add FFmpegFD
9 years ago
d8515fd41c
[downloader/external] pass configuration args to ffmpeg
9 years ago
694c47b261
[external/downloader] don't pass -t and -ss to ffmpeg
9 years ago
77dea16ac8
[downloader/external] check for ffmpeg availablity when it used for m3u8 download
9 years ago
6ae27bed01
[download/external] move the check for multiple selected formats to get_suitable_downloader
9 years ago
da1973a038
[extractor/__init__] disable time range downloading
9 years ago
be24916a7f
[downloader/rtsp] Add rtsp and mms downloader
9 years ago
2cb99ebbd0
[downloader/external] add can_download mathod for checking downloader availibilty and support
9 years ago
91ee320bfa
[downloader/external] wrap available_opt in a list
9 years ago
634415ca17
[downloader/external] skip FFmpegFD when requesting multiple formats
9 years ago
a755f82549
[ffmpeg] convert format ext to ffmpeg output formats codes
9 years ago
1b5284b13f
[downloader/fragment] Make speed more smooth
...
At the beginning of every segment there was a drop to Unknown speed due to timeslice being too small to calculate speed.
Now last speed from the previous fragment is used.
9 years ago
Sergey M․