4bba371644
[YoutubeDL] Autocalculate ext for subtitles when missing
9 years ago
6a3f4c3f82
[YoutubeDL] Use custom cookie processor
9 years ago
4abf617b9c
[YoutubeDL] Ensure bool params always present in downloader
9 years ago
d3d89c3256
[YoutubeDL] Encode thumbnail filename ( Closes #6714 )
9 years ago
671302b5c0
[YoutubeDL] Remove unused imports
9 years ago
51f267d9d4
[YoutubeDL:utils] Move percent encode non-ASCII URLs workaround to http_request and simplify ( Closes #6457 )
9 years ago
232541df44
[YoutubeDL] format spec: correctly handle dashes and other unused operators
...
'mp4-baseline-16x9' must be handled as a single string, but the '-' was treated as an operator.
9 years ago
d96d604e53
YoutubeDL: format spec: don't accept a bare '/' ( #6124 )
9 years ago
03950c90f7
Merge remote-tracking branch 'jaimemf/format_spec_groups' ( closes #6124 )
9 years ago
8250c32f49
[YoutubeDL] don't default to 'bestvideo+bestaudio/best' for live videos
...
Doesn't work currently.
9 years ago
f72b0a6032
Revert xvid to avi and make docs to be similar to existing external downloader option
9 years ago
ac9ed061ec
Merge branch 'master' of https://github.com/aurium/youtube-dl into aurium-master
9 years ago
0a31a35098
[YoutubeDL] format spec: add additional checks for invalid syntax
9 years ago
bb8e553662
[YoutubeDL] format spec: Do not fail when a filter gives an empty result
...
For example with 'best[height<40]' we ended getting a 'IndexError: list index out of range'.
10 years ago
f5f4a27a96
[YoutubeDL] format spec: fix handling of '/' with ','
...
When using 'bestvideo/best,bestaudio', 'bestvideo/best' must be set as the current_selector (instead of appending it to the selectors), otherwise when it gets the ',' it would append 'None' to the selectors.
10 years ago
1866432db7
Rename --pp-params to --postprocessor-args and access value as super class attribute
10 years ago
cf2ac6df68
[YoutubeDL] format spec: Fix handling of '+' with '/'
...
'bestvideo+bestaudio/best' was incorrectly interpreted as 'bestvideo+(bestaudio/best)', so it would fail if 'bestaudio' doesn't exist instead of falling back to 'best'.
10 years ago
0130afb76e
[YoutubeDL] format spec: allow grouping specifiers with parentheses
10 years ago
5acfa126c8
[YoutubeDL] format spec: treat 'all' like a normal specifier
...
So you can use filters with it, for example 'all[width>=400][width<=600]'.
10 years ago
67134eaba1
[YoutubeDL] rework how the format spec is processed
...
The spec string is processed using 'tokenize.tokenize' to split it in words and operators, the filters are still processed using regular expressions.
This should make easier to allow grouping operators with parens.
10 years ago
9603e8a7d9
[YoutubeDL] Handle None width and height similarly to formats
10 years ago
3c3b4176bd
Merge pull request #5961 from dstftw/force-generic-extractor
...
Add --force-generic-extractor
10 years ago
14835de9fb
Use shlex.split for --pp-params and update related docs.
10 years ago
0501bfa159
[YoutubeDL] Youku extractor now uses the standard format selection
10 years ago
180940e02d
spelling mistake corrected
...
acces changed to accessing
10 years ago
0072afca8e
[YoutubeDL] Remove force_generic_extractor arg from process_ie_result
10 years ago
61aa5ba36e
[YoutubeDL] Remove global state for force_generic_extractor flag in favor of passing argument
10 years ago
9f4323252a
[YoutubeDL] Fix for multiple URLs
10 years ago
d22dec74ff
Add `--force-generic-extractor`
...
For some extractors that are hard to workout a good _VALID_URL we use very vague and unrestrictive ones,
e.g. just allowing anything after hostname and capturing part of URL as id.
If some of these extractors happen to have an video embed of some different hoster or platform
and this scenario was not handled in extractor itself we end up with inability to download this embed
until extractor is fixed to support embed of this kind.
Forcing downloader to use the generic extractor can be a neat temporary solution for this problem.
Example: FiveTV extractor with Tvigle embed - http://www.5-tv.ru/rabota/broadcasts/48/
10 years ago
a55e36f48d
[YoutubeDL] Handle out-of-range timestamps ( #5826 )
10 years ago
df15ef8dab
[YoutubeDL] Tweak select_format for video only media
10 years ago
931bc3c3a7
[YoutubeDL] Do not loose request method information
10 years ago
181c7053e3
[YoutubeDL] Make sure all formats have unique format_id
10 years ago
71646e4653
[YoutubeDL] Initialize `files_to_delete` ( Closes #5797 )
10 years ago
4a5a898a8f
[YoutubeDL] Clarify incompatible formats merge message
...
When `-f` is not specified it's misleading to see `You have requested ...` as user did not actually request any formats.
10 years ago
3884dcf313
YoutubeDL: ignore indexes from 'playlist_items' that are not in the list ( fixes #5706 )
...
We ignore them instead of failing to match the behaviour of the 'playliststart' parameter.
10 years ago
82245a6de7
[YoutubeDL] Restore filename for thumbnails
10 years ago
98b8ec8616
Merge branch 'best-fallback-on-outdated-avconv' of https://github.com/dstftw/youtube-dl into dstftw-best-fallback-on-outdated-avconv
...
Conflicts:
youtube_dl/YoutubeDL.py
10 years ago
8e59539752
[postprocessor/embedthumbnail] Use thumbnails downloaded by YoutubeDL
10 years ago
3749e36e9f
[YoutubeDL] Fix PEP8 W503
10 years ago
97fcf1bbd0
[YoutubeDL] Check if merger can actually merge
10 years ago
7fcb605b82
[YoutubeDL] Fallback to `-f best` when merger is outdated
10 years ago
95c5534f8e
ExecAfterDownloadPP, YoutubeDL: remove unused parameters
10 years ago
3799834dcf
[YoutubeDL] Do not force bestvideo+bestaudio when outtmpl is stdout ( #5627 )
10 years ago
2699da8041
[YoutubeDL] Improve description file naming
10 years ago
98727e123f
[YoutubeDL] Improve annotations file naming
10 years ago
b29e0000e6
[YoutubeDL] Improve JSON info file naming
10 years ago
666a9a2b95
[YoutubeDL] Improve audio/video-only file naming
10 years ago
38c6902b90
[YoutubeDL] Ensure correct extension is always present for a merged file ( Closes #5535 )
10 years ago
cb202fd286
[YoutubeDL] Filter requested info fields on `--load-info` as well
...
In order to properly handle JSON info files generated by youtube-dl versions prior to 4070b458ec
10 years ago
df8301fef5
[YoutubeDL] pep8: use 'k not in' instead of 'not k in'
10 years ago
4070b458ec
[YoutubeDL] Do not write requested info in info JSON file ( Closes #5562 , closes #5564 )
10 years ago
e01c56f9e1
[YoutubeDL] Generalize best/worst format match behavior
10 years ago
8dd5418803
Make 'best' format only match non-DASH formats ( closes #5554 )
...
Otherwise it's impossible to only download non-DASH formats, for example `best[height=?480]/best` would download a DASH video if it's the only one with height=480, instead for falling back to the second format specifier.
For audio only urls (soundcloud, bandcamp ...), the best audio will be downloaded as before.
10 years ago
5456d78f0c
Typo "incompatible" instead of "uncompatible"
10 years ago
9f3fa89f7c
Remove the --max-quality option
...
It doesn't work well with 'bestvideo' and 'bestaudio' because they are usually before the max quality.
Format filters should be used instead, they are more flexible and don't require the requested quality to exist for each video.
10 years ago
8be2bdfabd
[YoutubeDL] Remove the redundant assignment to old_filename
...
Caused by commmit 592e97e855
10 years ago
6728187ac0
[YoutubeDL] mp3 is compatible with mp4
10 years ago
17c8675853
[YoutubeDL] Allow bestvideo+bestaudio/best strategy for ted extractor
10 years ago
c0dea0a782
[YoutubeDL] Respect explicit `--merge-format-output` for uncompatible formats as well
10 years ago
81cd954a51
[YoutubeDL] Merge incompatible formats into mkv ( #5456 )
10 years ago
feccf29c87
[YoutubeDL] Make `bestvideo+bestaudio/best` default format when merger is available
10 years ago
5b5fbc0867
Detect already merged videos
...
Without the '--keep-video' option the two files would be downloaded again and even using the option, ffmpeg would be run again, which for some videos can take a long time.
We use a temporary file with ffmpeg so that the final file only exists if it success
10 years ago
d47aeb2252
FFmpegMergerPP: use the new system for specifying which files can be delete
10 years ago
592e97e855
Postprocessors: use a list for the files that can be deleted
...
We could only know if we had to delete the original file, but this system allows to specify us more files (like subtitles).
10 years ago
ecc6bd1341
YoutubeDL.post_process: simplify keep_video handling
...
Since keep_video started as None we always set it to keep_video_wish unless it was None, so in the end keep_video == keep_video_wish. This should have been changed in f3ff1a3696
10 years ago
c36a959549
[YoutubeDL] Try to download worst audio+video served by a single file first ( Closes #5408 )
10 years ago
8e4b83b96b
Remove check for ssl certs
...
When it uses a capath instead of a cafile, 'get_ca_certs' or 'cert_store_stats' only returns certificates already used in a connection.
(see #5364 )
10 years ago
a3c7019e06
[YoutubeDL] Check for `get_ca_certs` availability
...
`get_ca_certs` is not available in python <3.4
10 years ago
1a944d8a2a
Print a warning if no ssl certificates are loaded
10 years ago
70a1165b32
Don't use bare 'except:'
...
They catch any exception, including KeyboardInterrupt, we don't want to catch it.
10 years ago
179d6678b1
Remove the 'stitle' field
...
A warning has been printed for more than 2 years (since 97cd3afc75
10 years ago
613b2d9dc6
Fix mistyped docstring indent
10 years ago
486dd09e0b
[YoutubeDL] Check for bytes instead of unicode output templates ( #5192 )
...
Also adapt the embedding examples for those poor souls still using 2.x.
10 years ago
3a77719c5a
Don't accept '-1' as format, 'all' is clearer
10 years ago
e5a11a2293
[YoutubeDL] Sanitize path before creating non-existent paths ( Closes #4324 )
10 years ago
1bb5c511a5
[YoutubeDL] Sanitize outtmpl as path
10 years ago
7dcad95d4f
[YoutubeDL] Sanitize outtmpl as it may contain forbidden characters
10 years ago
2461f79d2a
[utils] Correct per-request proxy handling
10 years ago
91410c9bfa
[letv] Add --cn-verification-proxy ( Closes #5077 )
10 years ago
c75f0b361a
[downloader/external] Add support for custom options ( Fixes #4885 , closes #5098 )
10 years ago
31bd39256b
--load-info: Use the fileinput module
...
It automatically handles the '-' filename as stdin
10 years ago
003c69a84b
Use shutil.get_terminal_size for getting the terminal width if it's available (python >= 3.3)
10 years ago
0f2c0d335b
[YoutubeDL] Use the InfoExtractor._download_webpage method for getting the subtitles
...
It handles encodings better, for example for 'http://www.npo.nl/nos-journaal/14-02-2015/POW_00942207 '
10 years ago
bfc993cc91
Merge branch 'subtitles-rework'
...
(Closes PR #4964 )
10 years ago
b531cfc019
[YoutubeDL] remove compatiblity with the old subtitles system
10 years ago
98c70d6fc7
[YoutubeDL] only add normal subtitles to the 'requested_subtitles' field if 'writesubtitles' is True
10 years ago
4d17184817
[YoutubeDL] don't set the 'requested_subtitles' without writesubtitles or writeautomaticsub
10 years ago
8fb3ac3649
PEP8: W503
10 years ago
b81a359eb6
[YoutubeDL] Use render_table for format listing
10 years ago
edab9dbf4d
[YoutubeDL] use the 'render_table' function for listing the subtitles
10 years ago
5cda4eda72
[YoutubeDL] Use a progress hook for progress reporting
...
Instead of every downloader calling two helper functions, let our progress report be an ordinary progress hook like everyone else's.
Closes #4875 .
10 years ago
f9216ed6ad
Merge remote-tracking branch 'origin/master'
10 years ago
f740fae2a4
[ffmpeg] Make available a property
10 years ago
662435f728
[YoutubeDL] Use a Request object for getting the cookies ( fixes #4970 )
...
So that we don't have to implement all the methods used by the cookiejar.
10 years ago
85729c51af
[downloader] Add --hls-prefer-native to use the native HLS downloader ( #4966 )
10 years ago
360e1ca5cc
[youtube] Convert to new subtitles system
...
The automatic captions are stored in the 'automactic_captions' field, which is used if no normal subtitles are found for an specific language.
10 years ago
c84dd8a90d
[YoutubeDL] store the subtitles to download in the 'requested_subtitles' field
...
We need to keep the orginal subtitles information, so that the '--load-info' option can be used to list or select the subtitles again.
We'll also be able to have a separate field for storing the automatic captions info.
10 years ago
a504ced097
Improve subtitles support
...
For each language the extractor builds a list with the available formats sorted (like for video formats), then YoutubeDL selects one of them using the '--sub-format' option which now allows giving the format preferences (for example 'ass/srt/best').
For each format the 'url' field can be set so that we only download the contents if needed, or if the contents needs to be processed (like in crunchyroll) the 'data' field can be used.
The reasons for this change are:
* We weren't checking that the format given with '--sub-format' was available, checking it in each extractor would be repetitive.
* It allows to easily support giving a format preference.
* The subtitles were automatically downloaded in the extractor, but I think that if you use for example the '--dump-json' option you want to finish as fast as possible.
Currently only the ted extractor has been updated, but the old system still works.
10 years ago
73fac4e911
[ffmpeg] Add --ffmpeg-location
10 years ago
442c37b7a9
[YoutubeDL] Do not perform filter matching on partial results ( Fixes #4921 )
10 years ago
7e5db8c930
[options] Add --no-color
10 years ago
347de4931c
[YoutubeDL] Add generic video filtering ( Fixes #4916 )
...
This functionality is intended to eventually encompass the current format filtering.
10 years ago
43f244b6d5
[YoutubeDL] Do not show worst in --list-formats output
...
Nobody wants to know what the worst possible format is. And if they do, they can still provide -f worst.
10 years ago
2ec19e9558
[YoutubeDL] Allow filtering by audio sampling rate
10 years ago
9ddb6925bf
[YoutubeDL] Allow filtering by string properties ( #4906 )
10 years ago
b3a286d69d
[YoutubeDL] _calc_cookies: add get_header method to _PseudoRequest ( #4861 )
10 years ago
300753a069
[YoutubeDL] Fix video+audio format field ( Closes #4880 )
10 years ago
f6c24009be
[YoutubeDL] Calculate thumbnail IDs automatically
10 years ago
8f9312c387
Appease pyflakes8-3
10 years ago
6d593c3276
[YoutubeDL] Fix video+audio format_id ( Closes #4824 )
10 years ago
5468ff4d91
Remove duplicate dictionary keys
10 years ago
a7a14d9586
[YoutubeDL] set the 'thumbnails' field if the info_dict has the 'thumbnails' field
...
Since the '--write-thumbnail' uses the 'thumbnails' field and we didn't updated the info_dict, it wouldn't detect the thumbnail. (fixes #4812 )
10 years ago
dcf53d4408
[YoutubeDL] Set format_id for video+audio ( Closes #3634 )
10 years ago
3a0d2f520a
[YoutubeDL] Temporary fix for subprocess encoding issues on python2 @ Windows ( Closes #4787 )
...
For now filenames will be encoded with preferrefencoding before written to disk
10 years ago
9f0df77ab1
[YoutubeDL] Allow format filtering by fps
10 years ago
e72c7e4123
[YoutubeDL] Always set the '_filename' field in the info_dict (reported in #4053 )
...
It's also useful when you use the '--write-info-json' option.
10 years ago
ee69b99af6
[YoutubeDL] clarify hook documentation
10 years ago
881e6a1f5c
Add --xattr-set-filesize option ( Fixes #1348 )
10 years ago
c14e88f0f5
[YoutubeDL] Add --playlist-items option ( Fixes #2662 )
10 years ago
ec82d85acd
[YoutubeDL] Implement --write-all-thumbnails ( Closes #2269 )
10 years ago
cfb56d1af3
Add --list-thumbnails
10 years ago
1070711d60
[YoutubeDL._calc_cookies] Restore the 'is_unverifiable'
...
I should have check everything was copied before commiting 4b405cfc6e
10 years ago
4b405cfc6e
[YoutubeDL._calc_cookies] Restore the 'has_header' method
...
I didn't copied it from downloader/external
10 years ago
e5660ee6ae
[YoutubeDL] Fill the info dict 'http_headers' field with all the headers available
...
Useful for external tools using the json output.
The methods '_calc_headers' and '_calc_cookies' have been copied from the downloader/external, now they just use "info_dict['http_headers']".
10 years ago
222516d97d
[downloader] Lay groundwork for external downloaders.
...
This comes with a very simply implementation for wget; the real work is in setting up the infrastructure.
10 years ago
a055469faf
[downloader] Improve downloader selection
10 years ago
62cd676c74
[youtube] Fixup DASH m4a headers
...
This fixes #2288 , #2506 , #2607 , #3681 , #4741 , #4767 .
10 years ago
5f0d813d93
Merge remote-tracking branch 'rupertbaxter2/master'
...
Conflicts:
youtube_dl/__init__.py
youtube_dl/downloader/common.py
10 years ago
083c9df93b
[YoutubeDL] Allow filtering by properties ( Fixes #4584 )
10 years ago
4340decad2
check for overwriting files in the downloader ( fixes #3916 , closes #3829 )
10 years ago
f3ff1a3696
YoutubeDL: Make the decision about removing the original file after each postprocessor is run ( fixes #2261 )
...
If one of the processors said the file should be kept, it wouldn't pay
attention to the response from the following processors. This was wrong if the
'keep_video' option was False, if the first extractor modifies the original file
and then we extract its audio we don't want to keep the original video file.
10 years ago
8bfa75451b
[options] Add --no-call-home
...
While we're at it, also drop "experimental" moniker for --call-home - should work fine.
10 years ago
58b1f00d19
[YoutubeDL] Add new --call-home option for debugging
10 years ago
be4a824d74
Add new option --source-address
...
Closes #3618 , fixes #721 , fixes #2481 , fixes #4551 , closes #1020 .
10 years ago
6271f1cad9
[youtube|ffmpeg] Automatically correct video with non-square pixels ( Fixes #4674 )
10 years ago
45598f1578
Merge remote-tracking branch 'aft90/merge-output-format'
...
Conflicts:
youtube_dl/YoutubeDL.py
10 years ago
d02115f837
Use the option in preparing the merge output filename
10 years ago
f90ad27375
[YoutubeDL] Copy over format metadata when merging ( Fixes #4671 )
10 years ago
0217c78377
[YoutubeDL] Allow selection by more extensions
10 years ago
0590062925
Respect age_limit when listing extractors ( Fixes #4653 )
10 years ago
e65566a9cc
[youtube] Correct handling when DASH manifest is not necessary to find all formats
10 years ago
f00fd51dae
Don't write the description file if info_dict['description'] is None ( #3166 )
10 years ago
0e4cb4f406
YoutubeDL: style fix
10 years ago
cd58dc3e56
Update YoutubeDL.py
10 years ago
c33bcf2051
only add video-id to archive, when successful
...
Example:
no space left--> youtube-dl adds the id to archive, but the video isn't fully downloaded
10 years ago
734ea11e3c
Drop hash character in downloader output ( #4484 )
10 years ago
d86007873e
[YoutubeDL] Document where details for format can be found
10 years ago
71b640cc5b
[YoutubeDL] Add declarative version of progress hooks
10 years ago
4f026fafbc
[YoutubeDL] Make postprocessors declarative
...
Instead of having to configure PPs in code, this allows us and embedding programs not to worry about imports or finer details, similarly to how we handle IEs.
10 years ago
Sergey M․