Jaime Marquínez Ferrándiz
bb8e553662
[YoutubeDL] format spec: Do not fail when a filter gives an empty result
...
For example with 'best[height<40]' we ended getting a 'IndexError: list index out of range'.
9 years ago
Jaime Marquínez Ferrándiz
f5f4a27a96
[YoutubeDL] format spec: fix handling of '/' with ','
...
When using 'bestvideo/best,bestaudio', 'bestvideo/best' must be set as the current_selector (instead of appending it to the selectors), otherwise when it gets the ',' it would append 'None' to the selectors.
9 years ago
Jaime Marquínez Ferrándiz
cf2ac6df68
[YoutubeDL] format spec: Fix handling of '+' with '/'
...
'bestvideo+bestaudio/best' was incorrectly interpreted as 'bestvideo+(bestaudio/best)', so it would fail if 'bestaudio' doesn't exist instead of falling back to 'best'.
9 years ago
Jaime Marquínez Ferrándiz
0130afb76e
[YoutubeDL] format spec: allow grouping specifiers with parentheses
10 years ago
Jaime Marquínez Ferrándiz
5acfa126c8
[YoutubeDL] format spec: treat 'all' like a normal specifier
...
So you can use filters with it, for example 'all[width>=400][width<=600]'.
10 years ago
Jaime Marquínez Ferrándiz
67134eaba1
[YoutubeDL] rework how the format spec is processed
...
The spec string is processed using 'tokenize.tokenize' to split it in words and operators, the filters are still processed using regular expressions.
This should make easier to allow grouping operators with parens.
10 years ago
Jaime Marquínez Ferrándiz
4c8fea92f3
[test/aes] Fix on python 3.3 and higher
...
Since 878563c847
the aes functions only accepts the base64 data as a unicode string.
10 years ago
Yen Chi Hsuan
f0bfaa2d7d
[nrk] Update subtitles test
...
Subtitle conversion routine is removed, so the subtitles are TTML now. See
1c7e2e64f6
10 years ago
Yen Chi Hsuan
1b0427e6c4
[utils] Support TTML without default namespace
...
In a strict sense such TTML is invalid, but Yahoo uses it.
10 years ago
Jaime Marquínez Ferrándiz
e9eaf3fbcf
[test/YoutubeDL] Add tests for 'playliststart', 'playlistend' and 'playlist_items'
10 years ago
Yen Chi Hsuan
7dff03636a
[utils] Support 'dur' field in TTML
10 years ago
Yen Chi Hsuan
d39e0f05db
[utils] Remove sanitize_url_path_consecutive_slashes()
...
This function is used only in SohuIE, which is updated to use a new
extraction logic.
10 years ago
Yen Chi Hsuan
0fe2ff78e6
[NBC] Enhance embedURL extraction ( closes #2549 )
10 years ago
Sergey M․
b3ed15b760
[utils] Add replace_extension
10 years ago
Sergey M․
a4bcaad773
[test_utils] Add tests for prepend_extension
10 years ago
Jaime Marquínez Ferrándiz
8dd5418803
Make 'best' format only match non-DASH formats ( closes #5554 )
...
Otherwise it's impossible to only download non-DASH formats, for example `best[height=?480]/best` would download a DASH video if it's the only one with height=480, instead for falling back to the second format specifier.
For audio only urls (soundcloud, bandcamp ...), the best audio will be downloaded as before.
10 years ago
Sergey M.
40b96352c9
Merge pull request #5523 from jaimeMF/remove-format-limit
...
Remove the --max-quality option
10 years ago
Yen Chi Hsuan
bf6427d2fb
[ffmpeg] Add dfxp (TTML) subtitles support ( #3432 , #5146 )
10 years ago
Jaime Marquínez Ferrándiz
9f3fa89f7c
Remove the --max-quality option
...
It doesn't work well with 'bestvideo' and 'bestaudio' because they are usually before the max quality.
Format filters should be used instead, they are more flexible and don't require the requested quality to exist for each video.
10 years ago
Sergey M․
70947ea7b1
[parameters.json] Set default `format` parameter to `best`
10 years ago
Yen Chi Hsuan
880ee801cf
[tests] Allow multi_video to be tested as playlists
10 years ago
Jaime Marquínez Ferrándiz
592e97e855
Postprocessors: use a list for the files that can be deleted
...
We could only know if we had to delete the original file, but this system allows to specify us more files (like subtitles).
10 years ago
Yen Chi Hsuan
0a1603634b
[utils] Remove url_infer_protocol
10 years ago
Yen Chi Hsuan
418c5cc3fc
[udn] Add new extractor
10 years ago
Sergey M․
ff02a228e3
[test_execution] Fix test under python 2 @ windows
10 years ago
Sergey M․
8cf70de428
[test_utils] Add test for unified_strdate
10 years ago
Sergey M․
ba9e68f402
[utils] Drop trailing comma before closing brace
10 years ago
Jaime Marquínez Ferrándiz
157e9e5aa5
[youtube:watchlater] Remove unused properties and fix tests
10 years ago
Naglis Jonaitis
91757b0f37
[utils] Escape all HTML entities written in hexadecimal form
10 years ago
Philipp Hagemeister
f5e2efbbf0
[options] Handle special characters in argv ( Fixes #5157 )
10 years ago
Jaime Marquínez Ferrándiz
f9544f6e8f
[test/aes] Test aes_decrypt_text with 256 bit
10 years ago
Jaime Marquínez Ferrándiz
5379a2d40d
[test/utils] Test xpath_text
10 years ago
Jaime Marquínez Ferrándiz
a7d9ded45d
[test] Add tests for aes
10 years ago
Jaime Marquínez Ferrándiz
531980d89c
[test/YoutubeDL] test match_filter
10 years ago
Jaime Marquínez Ferrándiz
f20bf146e2
[test/YoutubeDL] split in two classes
...
The name was misleading
10 years ago
Jaime Marquínez Ferrándiz
01218f919b
[test/http] Add test for proxy support
10 years ago
Sergey M․
92a4793b3c
[utils] Place sanitize url function near other sanitizing functions
10 years ago
Sergey M․
dc03a42537
Merge branch 'sohu_fix' of https://github.com/yan12125/youtube-dl into yan12125-sohu_fix
10 years ago
Jaime Marquínez Ferrándiz
8508557e77
[test/YoutubeDL] Use valid urls
...
It failed on python 3.4 when building the http_headers field
10 years ago
Jaime Marquínez Ferrándiz
4d1652484f
[test/unicode_literals] Don't look into the .git and .tox directories
...
The .tox directory contains python code that we can't control
10 years ago
Jaime Marquínez Ferrándiz
88cf6fb368
[metadatafromtitle] Some improvements and cleanup
...
* Remove the 'songtitle' field, 'title' can be used instead.
* Remove newlines in the help text, for consistency with other options.
* Add 'from __future__ import unicode_literals'.
* Call '__init__' from the parent class.
* Add test for the format_to_regex method
10 years ago
Jaime Marquínez Ferrándiz
3946864c8a
[vimeo] Use https for all vimeo.com urls
...
Unfortunately vimeopro.com doesn't support it yet.
10 years ago
Sergey M․
7e195d0e92
[funnyordie] Add subtitles test
10 years ago
Sergey M․
2ebfeacabc
[utils] Keep dot and dotdot unmodified ( Closes #5171 )
10 years ago
Sergey M․
f18ef2d144
[utils] Disallow trailing dot in sanitize_path for a path part
10 years ago
Sergey M․
a2aaf4dbc6
[utils] Add sanitize_path
10 years ago
Yen Chi Hsuan
55969016e9
[utils] Add a function to sanitize consecutive slashes in URLs
10 years ago
Philipp Hagemeister
499bfcbfd0
Make sure netrc works for all extractors with login support
...
Fixes #5112
10 years ago
Philipp Hagemeister
a7440261c5
[utils] Streap leading dots
...
Fixes #2865 , closes #5087
10 years ago
Philipp Hagemeister
3e675fabe0
[airmozilla] Be more tolerant when nonessential items are missing ( #5030 )
10 years ago
Philipp Hagemeister
5a42414b9c
[utils] Prevent hyphen at beginning of filename ( Fixes #5035 )
10 years ago
Jaime Marquínez Ferrándiz
25ac63ed71
[rtve] Extract subtitles
10 years ago
Jaime Marquínez Ferrándiz
bfc993cc91
Merge branch 'subtitles-rework'
...
(Closes PR #4964 )
10 years ago
Jaime Marquínez Ferrándiz
80970e531b
[test/subtitles] Update checksum for Viki
10 years ago
Jaime Marquínez Ferrándiz
b7bb76df05
[test/subtitles] Remove some tests
...
Test only with 'allsubtitles', the language selection is already tested in test_YoutubeDL.py
10 years ago
Jaime Marquínez Ferrándiz
98c70d6fc7
[YoutubeDL] only add normal subtitles to the 'requested_subtitles' field if 'writesubtitles' is True
10 years ago
Jaime Marquínez Ferrándiz
ab84349b16
[test/YoutubeDL] Add test for subtitles
...
Updated the offlinetest make target to not skip it
10 years ago
Jaime Marquínez Ferrándiz
4d17184817
[YoutubeDL] don't set the 'requested_subtitles' without writesubtitles or writeautomaticsub
10 years ago
Philipp Hagemeister
8fb3ac3649
PEP8: W503
10 years ago
Jaime Marquínez Ferrándiz
8807f1277f
[theplatform] Convert to new subtitles system
10 years ago
Philipp Hagemeister
d305dd73a3
[utils] Fix js_to_json
...
Previously, the runtime could be atrocious for longer inputs.
10 years ago
Jaime Marquínez Ferrándiz
4f7cea6c53
[viki] Convert to new subtitles system
10 years ago
Jaime Marquínez Ferrándiz
afbdd3acc3
[rai] Convert to new subtitles system
10 years ago
Philipp Hagemeister
9789d7535d
[xtube] Fix test case
10 years ago
Jaime Marquínez Ferrándiz
01561da142
[nrk] Convert to new subtitles system
10 years ago
Jaime Marquínez Ferrándiz
0af25f784b
[mtv] Convert to new subtitles system
10 years ago
Jaime Marquínez Ferrándiz
b9b42f2ea0
[npo] Convert to new subtitles system
10 years ago
Jaime Marquínez Ferrándiz
311c393838
[lynda] Convert to new subtitles system
10 years ago
Philipp Hagemeister
3eff81fbf7
[jsinterp] Disable comment support
...
We need a proper lexer to be able to understand YouTube's code, which contains /* inside of strings.
For now it's sufficient to just disable comment support altogether.
Fixes #4976 , fixes #4979 , fixes #4980 , fixes #4981 , fixes #4982 .
Closes #4977 .
10 years ago
Philipp Hagemeister
f21e915fb9
[test/helper] Render info_dict with a final comma
10 years ago
Philipp Hagemeister
6f53c63df6
[test/helper] Only output a newline for forgotten keys if keys are really missing
10 years ago
Jaime Marquínez Ferrándiz
85920dd01d
[bliptv] Convert to new subtitles system
10 years ago
Jaime Marquínez Ferrándiz
360e1ca5cc
[youtube] Convert to new subtitles system
...
The automatic captions are stored in the 'automactic_captions' field, which is used if no normal subtitles are found for an specific language.
10 years ago
Jaime Marquínez Ferrándiz
a1f2a06b34
[dailymotion] Convert to new subtitles system
10 years ago
Jaime Marquínez Ferrándiz
c84dd8a90d
[YoutubeDL] store the subtitles to download in the 'requested_subtitles' field
...
We need to keep the orginal subtitles information, so that the '--load-info' option can be used to list or select the subtitles again.
We'll also be able to have a separate field for storing the automatic captions info.
10 years ago
Jaime Marquínez Ferrándiz
65469a7f8b
[vimeo] Convert to new subtitles system
...
Removed some tests, the behaviour should be checked in a test for the YoutubeDL class
10 years ago
Jaime Marquínez Ferrándiz
a504ced097
Improve subtitles support
...
For each language the extractor builds a list with the available formats sorted (like for video formats), then YoutubeDL selects one of them using the '--sub-format' option which now allows giving the format preferences (for example 'ass/srt/best').
For each format the 'url' field can be set so that we only download the contents if needed, or if the contents needs to be processed (like in crunchyroll) the 'data' field can be used.
The reasons for this change are:
* We weren't checking that the format given with '--sub-format' was available, checking it in each extractor would be repetitive.
* It allows to easily support giving a format preference.
* The subtitles were automatically downloaded in the extractor, but I think that if you use for example the '--dump-json' option you want to finish as fast as possible.
Currently only the ted extractor has been updated, but the old system still works.
10 years ago
Jaime Marquínez Ferrándiz
8fb474fb17
[test/subtitles] Fix some tests
...
The checksym for the CeskaTelevize subtitles has changed again, so we just test that it has a reasonable length.
10 years ago
Jaime Marquínez Ferrándiz
36e7a4ca2e
[test/subtitles] Update checksums
10 years ago
Jaime Marquínez Ferrándiz
d304209a85
[test/parameters.json] Set 'fixup' to 'never'
...
The fixed audio files for Youtube have a size lower that the minimum required.
10 years ago
Philipp Hagemeister
6a78740211
[test/test_youtube_signature] Use fake YDL
10 years ago
Philipp Hagemeister
347de4931c
[YoutubeDL] Add generic video filtering ( Fixes #4916 )
...
This functionality is intended to eventually encompass the current format filtering.
10 years ago
Jaime Marquínez Ferrándiz
0161353d7d
[test/test_YoutubeDL] Remove debug print call
10 years ago
Jaime Marquínez Ferrándiz
2b4ecde2c8
[test/YoutubeDL] Add a simple test for postprocesors
...
Just checks that the 'keepvideo' option works as intended.
10 years ago
Philipp Hagemeister
9bb8e0a3f9
[wsj] Add new extractor ( Fixes #4854 )
10 years ago
Philipp Hagemeister
23d9ded655
[franceculture] Rewrite for new HTML scheme ( Fixes #4853 )
10 years ago
Philipp Hagemeister
8f4b58d70e
[ntvde] Add new extractor ( Fixes #4850 )
10 years ago
Philipp Hagemeister
9e3f19919a
[jsinterp] Beef up and add tests
...
In preparation for #4822 , extend jsinterp by a lot. (We may even have to/want to write a proper interpreter with actual parsing)
10 years ago
Philipp Hagemeister
4e980275b5
[test_download] Remove references to "file" in test definitions
10 years ago
Philipp Hagemeister
dc35bfd2d5
[test/helper] Clarify which keys have to be added
10 years ago
Philipp Hagemeister
03d8d4df38
[test_http] PEP8
10 years ago
Philipp Hagemeister
83fda3c000
Add a test for --no-check-certificate
10 years ago
Philipp Hagemeister
7d346331b5
[audiomack:album] Update testcase
10 years ago
Philipp Hagemeister
cfb56d1af3
Add --list-thumbnails
10 years ago
Philipp Hagemeister
61ca9a80b3
[generic] Add support for BOMs ( Fixes #4753 )
10 years ago
Philipp Hagemeister
083c9df93b
[YoutubeDL] Allow filtering by properties ( Fixes #4584 )
10 years ago
Philipp Hagemeister
78111136db
[twitch] Move URL matching tests into extractor
10 years ago
Philipp Hagemeister
650ab5beeb
[comedycentral:shows] Remove references to colbert report
10 years ago
Naglis Jonaitis
a69801e2c6
[utils] Add additional format to unified_strdate
10 years ago
Sergey M․
a5fb718c50
[test_utils] Add more tests for parse_duration
10 years ago
Philipp Hagemeister
2aeb06d6dc
[utils] Improve colon handling ( Fixes #4683 )
10 years ago
Philipp Hagemeister
dd622d7c4e
[netzkino] Add new extractor ( Fixes #4669 )
10 years ago
Philipp Hagemeister
5fbf25a681
[test_age_restriction] remove misbehaving test
...
We now test for the age_limit being set right in test_download, so we don't need more than two tests for the actual age limit handling.
10 years ago
Philipp Hagemeister
0217c78377
[YoutubeDL] Allow selection by more extensions
10 years ago
Philipp Hagemeister
bec2248141
[InfoExtractor/common] Correct and test meta tag matching
10 years ago
Philipp Hagemeister
e4a8eae701
Merge commit '8ee3415'
10 years ago
Philipp Hagemeister
0590062925
Respect age_limit when listing extractors ( Fixes #4653 )
10 years ago
Sergey M․
0b54a5b10a
[ceskatelevize] Add subtitles tests
10 years ago
Philipp Hagemeister
c11125f9ed
[tests] Remove format 138 from tests ( #4559 )
10 years ago
Jaime Marquínez Ferrándiz
7d900ef1bf
[youtube] Add support for automatically translated subtitles ( fixes #4555 )
...
They have a manually uploaded subtitles track and YouTube can transtale it.
10 years ago
Sergey M․
f74b341dde
expect_info_dict actual-expected argument consistency
10 years ago
Jaime Marquínez Ferrándiz
2cb5b03e53
[test/test_unicode_literals] Remove duplicated imports
10 years ago
Philipp Hagemeister
cae97f6521
Improve and test ffmpeg version detection
10 years ago
Philipp Hagemeister
6cbf345f28
Remove test/write_info_json
...
This is now covered by every single test_download testcase anyways :)
10 years ago
Philipp Hagemeister
da4d4191a9
Merge branch 'master' of github.com:rg3/youtube-dl
10 years ago
Philipp Hagemeister
8bdcb436f9
[test_unicode_literals] Fix test
10 years ago
Philipp Hagemeister
42bdd9d051
[cinchcast] Add new extractor ( Fixes #4428 )
10 years ago
Philipp Hagemeister
47d7c64274
[test_utils] Make test more realistically ( #4377 )
10 years ago
Philipp Hagemeister
5f9b83944d
[ffmpeg] Improve version check and call it from hls ( Fixes #4377 )
10 years ago
Philipp Hagemeister
e8df5cee12
[minhateca] Fix duration parsing
10 years ago
Philipp Hagemeister
4349c07dd7
[minhateca] Add extractor ( Fixes #4094 )
10 years ago
Jaime Marquínez Ferrándiz
4472f84f0c
[test/test_subtitles] Update checksum for vimeo subtitle file
10 years ago
Philipp Hagemeister
155f9550c0
[test/helper] Fix newlines in output of missing test fields
10 years ago
Philipp Hagemeister
dcddc10a50
[test_unicode_literals] Arm unicode_literals check
...
From now on, the line
from __future__ import unicode_literals
should be contained in every single Python file lest we run into any more 2.x/3.x issues.
Going forward, we're likely to develop on 3.x only and would likely miss subtle bugs otherwise.
10 years ago
Philipp Hagemeister
e075a44afb
[tests] Remove useless u prefixes
10 years ago
Philipp Hagemeister
be64b5b098
[xminus] Simplify and extend ( #4302 )
10 years ago
Jouke Waleson
9e1a5b8455
PEP8: applied even more rules
10 years ago
Jouke Waleson
8bcc875676
PEP8: more applied
10 years ago
Jouke Waleson
5f6a1245ff
PEP8 applied
10 years ago
Philipp Hagemeister
7d4111ed14
Provide guidance when called with a YouTube ID starting with a dash.
...
Reported at https://news.ycombinator.com/item?id=8648121
10 years ago
Jaime Marquínez Ferrándiz
f56875f271
[test/test_compat] Restore the old value of the HOME environment variable
...
If the test was run before the YoutubeIE tests (for example by running
"nosetests -v test/test_compat.py test/test_download.py -m 'Youtube_1|compat_expand'"),
it wrote the signatures cache to the 'C:\Documents and Settings\тест\Application Data' folder.
It failed due to a problem in the cache code and the write_json_file function (fixed in f03e33b89a622af13fa5275c46b63aaa4814c499)
10 years ago
Philipp Hagemeister
fbf94a7815
[swfinterp] Add more builtins and improve static variables
10 years ago
Philipp Hagemeister
cd9ad1d7e8
[swfinterp] Basic support for constants (only ints for now)
10 years ago
Philipp Hagemeister
33a266f4ba
[swfinterp] Implement charCodeAt
10 years ago
Philipp Hagemeister
8d05f2c16a
[swfinterp] Add support for void methods
10 years ago
Philipp Hagemeister
eb5376044c
[swfinterp] Implement equals opcode
10 years ago
Philipp Hagemeister
3cbcff8a2d
[swfinterp] Implement String basics
10 years ago
Philipp Hagemeister
e983cf5277
[swfinterp] Interpret yet more opcodes
10 years ago
Philipp Hagemeister
0ab1ca5501
[swfinterp] Better error message
10 years ago
Philipp Hagemeister
4baafa229d
[swfinterp] Intepret more multinames
10 years ago
Philipp Hagemeister
7f3e33a147
[swfinterp] Implement member assignment
10 years ago
Philipp Hagemeister
a0f59cdcb4
[tests] Modernize
10 years ago
Philipp Hagemeister
6a68bb574a
[eporner] Fix duration ( Closes #4188 )
10 years ago
Philipp Hagemeister
609a61e3e6
[npo] Improve npo.nl ( Fixes #4173 )
10 years ago
Philipp Hagemeister
4c0924bb24
[utils] Fix intlist_to_bytes in Python 2 ( #4181 )
10 years ago
Philipp Hagemeister
e4bdb37ec6
[spiegel] Add support for embeds
10 years ago
Philipp Hagemeister
3e6e4999ca
[test/helper] Improve output
10 years ago
Michael Käufl
498942f187
[test_youtube_signature] Fix import
...
Broken in commit 8c25f81bee
10 years ago
Philipp Hagemeister
12ea2f30cf
[utils] Remove unused get_meta_content function
10 years ago
Philipp Hagemeister
278143df5b
[test_compat] Ignore unicode_literals
10 years ago
Jaime Marquínez Ferrándiz
ac35c26686
[tests] Don't auto init YoutubeDL
...
It would print the debug headers for each test.
And nose uses a StringIO object for stdout, which in python 2.x doesn't have the 'encoding' attribute.
10 years ago
Philipp Hagemeister
42f7d2f588
[test_download] Fix import
10 years ago
Philipp Hagemeister
39f0a2a6b7
[test_swfinterp] Correct compilation on modern mxmlc versions
10 years ago
Philipp Hagemeister
8c25f81bee
[util] Move compatibility functions out of util
...
utils is large enough without these compatibility functions.
Everything that is present in newer versions of Python (i.e. with dev Python it's just an import) goes into compat.py .
Everything else (i.e. youtube-dl-specific helpers) goes into utils.py .
10 years ago
Philipp Hagemeister
7d11297f3f
Merge branch 'master' of github.com:rg3/youtube-dl
10 years ago
Philipp Hagemeister
6ad4013d40
[drtv] Allow fractional timestamps ( Fixes #4059 )
10 years ago
Jaime Marquínez Ferrándiz
8abec2c8bb
[test_utils] Fix compat_getenv and compat_expanduser tests on python 3.x
10 years ago
Philipp Hagemeister
f744c0f398
[test_download] Improve error message
10 years ago
Philipp Hagemeister
70b7e3fbb6
[generic] Add a test case for direct links with broken HEAD ( #4032 )
10 years ago
Sergey M․
f889cea109
Merge branch 'compat-getenv-and-expanduser' of https://github.com/dstftw/youtube-dl into dstftw-compat-getenv-and-expanduser
...
Conflicts:
test/test_utils.py
youtube_dl/__init__.py
10 years ago
Philipp Hagemeister
c64ed2a310
[viddler] Use API
10 years ago
Sergey M
4510d14f0a
[twitch] Update tests
10 years ago
Sergey M․
0ca41c3d9c
[walla] Fix typo
10 years ago
Sergey M․
7bc8780c57
[walla] Fix extractor and add subtitle tests
10 years ago
Philipp Hagemeister
e7b6d12254
[utils] Improve and test js_to_json
10 years ago
Philipp Hagemeister
410f3e73ab
[utils] Fix js_to_json
10 years ago
Sergey M․
4644ac5527
[core] Decode environment variables with filesystem encoding ( Fixes #3854 , Fixes #3217 , Fixes #2918 )
...
Introduces compat versions of os.getenv and os.path.expanduser
10 years ago
Philipp Hagemeister
c0f64ac689
[test/helper] Improve output of missing test definition dictionaries
10 years ago
Philipp Hagemeister
7a08ad7d59
[test/helper] Modernize
10 years ago
Philipp Hagemeister
99b67fecc5
[arte] Fix upload date extraction
10 years ago
Philipp Hagemeister
6be451f422
[youtube] Remove swf signature test cases
...
These files are now 0 Bytes
10 years ago
Philipp Hagemeister
9c44d2429b
[vimeo:likes] Support large like lists ( Fixes #3847 )
10 years ago
Philipp Hagemeister
d6e6a42256
[vimeo:likes] Add new extractor ( Fixes #3835 )
10 years ago
Philipp Hagemeister
cdc628a498
[youtube] Move more tests to extractors
10 years ago
Philipp Hagemeister
0003a5c416
Merge remote-tracking branch 'dstftw/escape-non-ascii-in-urls'
...
Conflicts:
test/test_utils.py
10 years ago
Philipp Hagemeister
a020a0dc20
[facebook] Fix support for untitled videos ( Fixes #3757 )
10 years ago
Sergey M․
d05cfe0600
[YoutubeDL/utils] Clarify rationale for URL escaping in comment, move escape routines to utils and add some tests
10 years ago
Philipp Hagemeister
9291475f7d
[youtube] Move more tests to Playlist IE, and simply suitable.
10 years ago
Philipp Hagemeister
5df921b0e3
[test_cache] Add a dot in the file name
10 years ago
Philipp Hagemeister
a0e07d3161
[youtube] Move cache into its own module
10 years ago
Philipp Hagemeister
7260ea0705
[comedycentral] Move tests to the extractor itself
10 years ago
Sergey M․
ca7b3246b6
[utils] Improve parse_duration
10 years ago
Sergey M․
08a36c3569
[test_download] Check expected file minsize and md5 only when download is not skipped
10 years ago
Philipp Hagemeister
753727cded
[test_download] Expect a minimum file size
...
This should detect when we're downloading a small text file by accident.
10 years ago
Philipp Hagemeister
22a6f15061
Move playlist tests to extractors.
...
From now on, test_download will run these tests. That means we benefit not only from the networking setup in there, but also from the other tests (for example test_all_urls to find problems with _VALID_URLs).
10 years ago
Philipp Hagemeister
4e408e479b
[utils] Modernize tests
10 years ago
Philipp Hagemeister
2857084000
[test_download] Improve playlist handling
10 years ago
Philipp Hagemeister
2929b3e71d
[vimeo] Move all testcases to extractors and clean up
...
Previously, these extractors all defined their own suitable methods.
No test_all_urls tests that everything is in order, automatically :)
10 years ago
Philipp Hagemeister
22449fa624
Improve test_all_urls output
10 years ago
Philipp Hagemeister
0990305d2a
[generic] Fix rss under Python 2.x and move test to extractor
10 years ago
Philipp Hagemeister
829476b80a
[googlesearch] Move test to extractor
10 years ago
Philipp Hagemeister
7adcbe7594
[rtlnl] Extract duration
10 years ago
Philipp Hagemeister
28028629b9
[gameone:playlist] Move test to extractor
10 years ago
Philipp Hagemeister
11f75cac3d
Merge remote-tracking branch 'olebowle/gameone'
10 years ago
Philipp Hagemeister
a053c3493a
[test_YoutubeDL] Reorder formats ( #3542 )
10 years ago
Philipp Hagemeister
266c71f971
Deprecate test_playlists
10 years ago
Philipp Hagemeister
e8ee972c6e
Allow playlist test definitions in test_download.
...
This moves playlist tests where they belong, i.e. to the extractors themselves.
Additionally, all our network interaction configuration for tests in test_download now applies to playlist tests as well.
10 years ago
Jaime Marquínez Ferrándiz
a6da7b6b96
[facebook] Allow '?' before '#!' ( fixes #3477 )
10 years ago
Jaime Marquínez Ferrándiz
173a7026d5
[test/test_utils] Fix typo in method name
10 years ago
Sergey M․
a954584f63
[bandcamp] Replace 404 playlist test
10 years ago
Philipp Hagemeister
4bc7009e8a
[jsinterp] Add new testcase
10 years ago
Philipp Hagemeister
42f4dcfe41
[test_youtube_signatures] Modernize
10 years ago
Jaime Marquínez Ferrándiz
ebe832dc37
[jsinterp] 'reverse' modifies the array in place ( fixes #3334 )
10 years ago
Ole Ernst
71b6065009
[gameone] add playlist test
10 years ago
Philipp Hagemeister
0c92b57398
Remove unused imports
10 years ago
Philipp Hagemeister
9f43890bcd
[jsinterp] Allow digits in function names
10 years ago
Philipp Hagemeister
d82ba23ba5
[soundcloud:playlist] Fix test description
10 years ago
Philipp Hagemeister
0fd7fd71b4
[test/helper] Do not use deprecated method
10 years ago
Philipp Hagemeister
d8624e6a80
[test_playlist] Add and use assertGreaterEqual
10 years ago
Philipp Hagemeister
54330a1c3c
[swfinterp] Fix imports
10 years ago
Philipp Hagemeister
b6ea11b967
[youtube] Add swf signature test case ( #3270 )
10 years ago
Philipp Hagemeister
7fd48d0413
[youtube] Correct signature testcase
10 years ago
Philipp Hagemeister
decf2ae400
[swfinterp] Correct array access
10 years ago
Philipp Hagemeister
0d989011ff
[swfinterp] Add support for calling methods on objects
10 years ago
Philipp Hagemeister
01b4b74574
[swfinterp] Add support for calls to instance methods
10 years ago
Philipp Hagemeister
70f767dc65
[swfinterp] Add support for multiple classes
10 years ago
Philipp Hagemeister
e75c24e889
[swfinterp] Extend tests and fix parsing
10 years ago
Philipp Hagemeister
0cb2056304
[swfinterp] Start working on basic tests
10 years ago
Philipp Hagemeister
5425626790
[youtube] Move swfinterp into its own file
10 years ago
Jaime Marquínez Ferrándiz
ad25aee245
[youtube & jsinterp] Fix signature extraction ( fixes #3255 )
...
Some functions are defined now inside an object, the jsinterp will search its definition if the variable is not defined in the local namespace.
10 years ago
Sergey M․
345e37831c
[youtube] Update nosubtitles test
10 years ago
Sergey M․
00ac799b68
[vine:user] Update test
10 years ago
Philipp Hagemeister
ebf361ce18
Merge remote-tracking branch 'azeem/soundcloud_likes'
10 years ago
Philipp Hagemeister
f64ebfe3e5
[youtube] Correct signature test
10 years ago
Philipp Hagemeister
6f9d4d542f
[youtube] Add test for new signature scheme ( #3232 )
10 years ago
azeem
3941669d69
[soundcloud] Adding likes support to SoundcloudUserIE
10 years ago
Philipp Hagemeister
dc2fc73691
[youtube:truncated_url] Move test to extractor
11 years ago
Petr Půlpán
31a196d7f5
[TeacherTube] add user + collection, removed classrooms
11 years ago
Jaime Marquínez Ferrándiz
78338f71ca
[livestream:original] Add support for folder urls ( closes #2631 )
...
The webpage only contains shortened links for the videos, since the server
doesn't support HEAD requests, we use an specific extractor for them.
11 years ago
Sergey M․
fd69098a45
[rutube] Update playlist tests
11 years ago
Petr Půlpán
a14e1538fe
[ustream:channel] replace test for an updated channel
11 years ago
Philipp Hagemeister
24f5251cce
Merge remote-tracking branch 'pulpe/teachertube'
...
Conflicts:
youtube_dl/extractor/__init__.py
11 years ago
Jaime Marquínez Ferrándiz
24577db241
[test/test_youtube_lists] Replace mix list
...
The old video doesn't have a mix anymore.
11 years ago
pulpe
b4e7447458
[TeacherTubeIE] Add extractor for teachertube.com videos + classrooms ( fixes #3046 )
11 years ago
Jaime Marquínez Ferrándiz
0d69795014
Merge pull request #2962 from simonwjackson/patch-1
...
Update test_age_restriction.py
11 years ago
Sergey M․
6ebb46c106
[ivi] Replace tests
11 years ago
Sergey M․
cc5ada6f4c
[ivi] Update playlist tests
11 years ago
Simon W. Jackson
8ae980807a
Update test_age_restriction.py
...
typo
11 years ago
codesparkle
1c783bca88
fixed (what I assume was a typo) that caused test_format_note to always fail.
...
This test was introduced in c57f775710
.
11 years ago
Philipp Hagemeister
7b93c2c204
Merge remote-tracking branch 'jnormore/vine_user'
11 years ago
Philipp Hagemeister
d0a122348e
[test/helper] Clarify which field failed an assertion
11 years ago
Jason Normore
ea783d01e1
Added VineUserIE extractor for vine user timeline
...
Added vine user timeline extractor using unofficial
vine api user profile and timeline api endpoints.
11 years ago
Philipp Hagemeister
2099125333
[soundcloud/generic] Add support for playlists
11 years ago
Philipp Hagemeister
c57f775710
[YoutubeDL] Add simple tests for format_note ( Closes #2825 )
11 years ago
Philipp Hagemeister
0321213c11
[test_subtitles] Allow more subtitles for TED videos
11 years ago
Philipp Hagemeister
b9ba5dfa28
[test helper] Correct only_matching test gathering
11 years ago
Sergey M․
3a9d6790ad
[ivi] Update playlist tests
11 years ago
Philipp Hagemeister
52fadd5fb2
[test_all_urls] Add support for distributed URL matching test definition
11 years ago
Philipp Hagemeister
5367fe7f4d
[test_all_urls] Simplify
11 years ago
Philipp Hagemeister
de906ef543
[aol] Add support for playlists ( Fixes #2730 )
11 years ago
Philipp Hagemeister
b9c76aa1a9
[youtube] Add support for cleanvideosearch.com ( Fixes #2734 )
11 years ago
Philipp Hagemeister
7753cadbfa
[comedycentral:shows] Add support for TDS special editions ( Fixes #2733 )
11 years ago
Philipp Hagemeister
4be9f8c814
[ninegag] Add support for p/ URLs
11 years ago
Philipp Hagemeister
29e3e682af
[comedycentral] Match more URLs
...
Looks like they only offer clips instead of full episodes now. We'll need to add new parsing code as well.
11 years ago
Philipp Hagemeister
a355b70f27
[cspan] Do not test number of playlist entries
...
Apparently, CSpan switches between single-file and multiple-file results. Either one is fine as long as we get the full four hours.
11 years ago
Philipp Hagemeister
676eb3f2dd
Fix unicode_escape ( Fixes #2695 )
11 years ago
Philipp Hagemeister
c8edf47b3a
[yahoo] Support https and -uploader URLs ( Fixes #2701 )
11 years ago
Philipp Hagemeister
3537b93d8a
[tests] Fix YoutubeDL tests
...
Since bec1fad
, the id, title, and url (also in formats) keys are mandatory. Change the tests to reflect that.
11 years ago
Philipp Hagemeister
968ed2a777
[comedycentral] Add test for #2677
11 years ago
Philipp Hagemeister
aea6e7fc3c
[cspan] Support multiple segments ( Fixes #2674 )
11 years ago
Philipp Hagemeister
651486621d
[comedycentral] Allow URLs with query parts ( fixes #2661 )
11 years ago
Philipp Hagemeister
16f4eb723a
[comedycentral] Add support for /videos URLs ( Fixes #2660 )
11 years ago
Philipp Hagemeister
69c01a9f68
[comedycentral] Add a testcase for extended-interviews URLs ( #2636 )
11 years ago
Philipp Hagemeister
fac55558ad
[washingtonpost] Add extractor ( Fixes #2622 )
11 years ago
Philipp Hagemeister
912b38b428
[instagram] Fix info_dict key name
11 years ago
Philipp Hagemeister
ea38e55fff
[instagram] Add support for user profiles ( Fixes #2606 )
11 years ago
Philipp Hagemeister
257cfebfe6
[test] Move expect_info_dict out of test_download
11 years ago
fiocfun
9f5809b3e8
[xtube] user playlist extractor
11 years ago
Philipp Hagemeister
231f76b530
[toypics] Separate user and video extraction ( #2601 )
11 years ago
Philipp Hagemeister
a9c2896e22
Make missing test definition fields an error
...
If the result is not testable (for example, because a description changes often), either pass in a type or a regular expression (a string starting with 're:')
11 years ago
Philipp Hagemeister
773c0b4bb8
[pbs] Add support for widget URLs ( Fixes #2594 )
11 years ago
Philipp Hagemeister
ff14fc4964
[test] Rename get_testcases to gettestcases
...
Apparently, newer versions of nosetests are somewhat over-eager in their test discovery.
11 years ago
Jaime Marquínez Ferrándiz
bc6d597828
Add bestvideo and worstvideo to special format names ( #2163 )
11 years ago
Philipp Hagemeister
955c451456
Rename upload_timestamp to timestamp
11 years ago
Philipp Hagemeister
2a1db721d4
[test_download] Move assertions before debugging output
11 years ago
Philipp Hagemeister
c3d36f134f
[googlesearch] Fix next page indicator check
11 years ago
Philipp Hagemeister
84769e708c
[ninegag] Fix extraction
11 years ago
Jaime Marquínez Ferrándiz
b1ff87224c
[vimeo] Now VimeoIE doesn't match urls of channels with a numeric id ( fixes #2552 )
11 years ago
Philipp Hagemeister
6a72423955
[generic] Use a different URL for the generic RSS test ( Closes #2532 )
11 years ago
Jaime Marquínez Ferrándiz
1471956573
Add a basic test suite for the InfoExtractor class
11 years ago
Jaime Marquínez Ferrándiz
957688cee6
[ustream:channel] Update test's number of entries
11 years ago
Jaime Marquínez Ferrándiz
b74fa8cd2c
[facebook] Fix login process
...
It was broken and didn't work in python 3.
And use `_download_webpage` instead of `compat_urllib_request.urlopen`.
11 years ago
Jaime Marquínez Ferrándiz
ca1fee34f2
[ted] Fix playlist extraction and add a test
11 years ago
Philipp Hagemeister
c9ae7b9565
[youtube] Add support for search result URLs ( Fixes #2495 )
11 years ago
Philipp Hagemeister
2437fbca64
[tests] Raise an exception if test definition is invalid (Found in #2460 )
11 years ago
Jaime Marquínez Ferrándiz
ea5a0be811
Skip youtube toptracks test
...
All the playlists return 500 errors.
11 years ago
Philipp Hagemeister
62e609ab77
Ignore BOM in batch files ( Fixes #2450 )
11 years ago
Jaime Marquínez Ferrándiz
9e57ce716f
[academicearth] Fix extraction
...
The courses seems to be no longer available, changed the test to a playlist.
11 years ago
Philipp Hagemeister
491ed3dda2
[trutube] Support multiple formats ( #2433 )
11 years ago
Philipp Hagemeister
4fc946b546
[generic] Add support for RSS feeds ( Fixes #667 )
11 years ago
Philipp Hagemeister
2eb5d315d4
[youtube] Match more truncated URLs ( Closes #2402 )
11 years ago
Sergey M.
2db806b4aa
Improve parse_duration
11 years ago
Philipp Hagemeister
b53466e168
Fix f4m downloading on Python 2.6
11 years ago
Jaime Marquínez Ferrándiz
99043c2ea5
Replace test for dailymotion users
11 years ago
Philipp Hagemeister
026fcc0495
Fix #2355 (date parsing with dashes)
11 years ago
Philipp Hagemeister
9766538124
[jadorecettepub] Add extractor ( Fixes #2148 )
11 years ago
Philipp Hagemeister
bf5f610099
[pbs] Add support for viralplayer links ( Fixes #2350 )
11 years ago
Jaime Marquínez Ferrándiz
d67cc9fa7c
[youtube:playlist] Recognize ‘top tracks’ urls ( closes #2332 )
...
The list parameter starts with ‘MC’ and can have more characters after it, including dots
11 years ago
Philipp Hagemeister
dcf3eec47a
[test_download] Skip over BadStatusLine errors
...
An error like https://travis-ci.org/rg3/youtube-dl/jobs/18317799#L449 is almost certainly the server's fault.
11 years ago
Philipp Hagemeister
ccf9114e84
[googlesearch] Fix start, and skip playlists ( Fixes #2329 )
11 years ago
Jaime Marquínez Ferrándiz
bc4850908c
[test/youtube_signature] Add a test with the last player
...
To verify it correctly handles function with “$” in their names.
11 years ago
Philipp Hagemeister
56dced2670
remove accidentally duplicated test file
11 years ago
Philipp Hagemeister
22e7f1a6ec
[pbs] Add support for article pages ( Fixes #870 )
11 years ago
Philipp Hagemeister
99877772d0
[generic] Add support for multiple brightcove URLs ( Fixes #2283 )
11 years ago
Sergey M.
b0268cb6ce
[vimeo] Remove superfluous whitespace
11 years ago
Sergey M.
4edff4cfa8
[vimeo] Add subtitle tests
11 years ago
Philipp Hagemeister
b4bcffefa3
[blip.tv] Add support for subtitles ( #2274 )
11 years ago
Philipp Hagemeister
456895d9cf
[tumblr] Test new URL format ( #2255 )
11 years ago
Philipp Hagemeister
4857beba3a
Merge remote-tracking branch 'dstftw/rutube-channel'
11 years ago
dst
98669ed79c
[imdb] Fix playlist test
11 years ago
dst
87fac3238d
[rutube] Add channel test
11 years ago
Jaime Marquínez Ferrándiz
48f9678a32
[test/youtube_lists] Change the list used for testing the Top Lists extractor
...
The ‘Top tracks’ list is not always present in the channel page
11 years ago
Philipp Hagemeister
65697b3bf3
Merge branch 'paged-lists'
...
Conflicts:
test/test_utils.py
youtube_dl/extractor/youtube.py
11 years ago
Philipp Hagemeister
8908741806
Use unicode_literals in test_YoutubeDL
11 years ago
Philipp Hagemeister
ba7678f9cc
Add -f bestaudio ( Fixes #2163 )
11 years ago
Philipp Hagemeister
5aafe895fc
Correct XML ampersand fixup
11 years ago
Philipp Hagemeister
b7ab059084
Add infrastructure for paged lists
...
This commit allows to download pages in playlists as needed instead of all at once.
Before this commit,
youtube-dl http://www.youtube.com/user/ANNnewsCH/videos --playlist-end 2 --skip-download
took quite some time - now it's almost instantaneous.
As an example, the youtube:user extractor has been converted.
Fixes #2175
11 years ago
Philipp Hagemeister
26dca1661e
[ted] Updated checksums
11 years ago
Philipp Hagemeister
8307aa73fb
Remove youtube swf signature test
...
Apparently, swf players are no longer in use. If we find one, we'll readd it.
11 years ago
Philipp Hagemeister
484aaeb204
[everyonesmixtape] Add support ( Fixes #2161 )
11 years ago
Philipp Hagemeister
ecfef3e5bf
+unicode_literals
11 years ago
Philipp Hagemeister
3d3538e422
[khanacademy] Add support ( Fixes #2066 )
11 years ago
Philipp Hagemeister
48a2034671
[vimeo] Fix playlist URL matching
11 years ago
Philipp Hagemeister
01c62591d1
[setup.py] Do not use unicode literals
...
See http://bugs.python.org/issue13943 for context
11 years ago
Philipp Hagemeister
28ab2e48ae
fix typo
11 years ago
Philipp Hagemeister
6febd1c1df
Prepare widespread unicode literal use
11 years ago
Jaime Marquínez Ferrándiz
4fb757d1e0
Merge pull request #2041 from dstftw/imdb-list
...
[imdb] Add support for IMDb list (#2033 )
11 years ago
Philipp Hagemeister
608d11f515
[cnn] Add multiple formats, duration, and upload_date
11 years ago
dst
41cc67c542
[imdb] Add playlist test
11 years ago
Philipp Hagemeister
3d4a70b821
Add more tests for format selection
11 years ago
Philipp Hagemeister
00b2685b9c
Merge remote-tracking branch 'origin/master'
11 years ago
Philipp Hagemeister
8e3e03229e
[YoutubeDL] fix tests ( Closes #2036 )
11 years ago
Jaime Marquínez Ferrándiz
9d8d675e0e
[subtitles-tests] Fix youtube test
...
It returns now a single info_dict
11 years ago
Jaime Marquínez Ferrándiz
933605d7e8
YoutubeDL: rename `_fd_progress_hooks` back to `_progress_hooks`
...
In the future it may report more things.
11 years ago
Philipp Hagemeister
9fc3bef87a
Merge remote-tracking branch 'jaimeMF/split-downloaders'
11 years ago
dst
5ce54a8205
[ivi] Neat import
11 years ago
dst
8c21b7c647
[ivi] Add playlist tests
11 years ago
Philipp Hagemeister
d6c7a367e8
[utils] Fix url_basename
11 years ago
Philipp Hagemeister
29eb517403
Add webpage_url_basename info_dict field ( Fixes #1938 )
11 years ago
Philipp Hagemeister
d6756d3758
[playlist-test] require a string
11 years ago
Philipp Hagemeister
d90df974c3
[academicearth] Add support for courses ( #1976 )
11 years ago
Philipp Hagemeister
8c8e3eec79
[facebook] Recognize #! URLs ( Fixes #1988 )
11 years ago
Jaime Marquínez Ferrándiz
8ab470f1b2
Now a new FileDownloader is created when downloading a video
...
The progress hooks can be added using the method "add_downloader_progress_hook"
11 years ago
Jaime Marquínez Ferrándiz
26e6393134
Set 'NA' as the default value for missing fields in the output template ( fixes #1931 )
...
Remove the `except KeyError` clause, it won't get raised anymore
11 years ago
Philipp Hagemeister
4ff50ef846
[soundcloud] Do not match sets ( Fixes #1930 )
11 years ago
Philipp Hagemeister
977887469c
Lower number of expected entries in top list
11 years ago
Philipp Hagemeister
ffa8f0df0a
Merge remote-tracking branch 'jaimeMF/yt-toplists'
11 years ago
Jaime Marquínez Ferrándiz
fb30ec22fd
[vimeo] Add an extractor for groups
11 years ago
Jaime Marquínez Ferrándiz
5cc14c2fd7
[vimeo] Add an extractor for albums ( closes #1911 )
11 years ago
Jaime Marquínez Ferrándiz
f53c966a73
[dailymotion] Extract view count ( #1895 )
11 years ago
Jaime Marquínez Ferrándiz
6a656a843a
Update description value for the write_info_json test (required after 27dcce1904
)
11 years ago
Philipp Hagemeister
25939ffe56
Merge branch 'smotri.com' of https://github.com/dstftw/youtube-dl
11 years ago
dst
5270d8cb13
Added extractors for smotri.com
11 years ago
Philipp Hagemeister
a9be0cc736
Merge branch 'master' of github.com:rg3/youtube-dl
11 years ago
Jaime Marquínez Ferrándiz
55a10eab48
[vimeo] Add an extractor for users ( closes #1871 )
11 years ago
Philipp Hagemeister
e344693b65
Make socket timeout configurable, and bump default to 10 minutes ( #1862 )
11 years ago
Jaime Marquínez Ferrándiz
0a688bc0b2
[youtube] Add support for downloading top lists ( fixes #1868 )
...
It needs to know the channel and the title of the list, because the ids change every time you browse the channels and are attached to a 'VISITOR_INFO1_LIVE' cookie.
11 years ago
Philipp Hagemeister
4e0084d92e
[youtube/subtitles] Change MD5 of vtt subtitle in test
11 years ago
Jaime Marquínez Ferrándiz
652cdaa269
[youtube:playlist] Add support for YouTube mixes ( fixes #1839 )
11 years ago
Philipp Hagemeister
d0efb9ec9a
[tests] Remove global_setup function
11 years ago
Jaime Marquínez Ferrándiz
16e055849e
Update the keywords tests for the rename of the old ComedyCentralIE
11 years ago
Jaime Marquínez Ferrándiz
f459d17018
[youtube] Add an extractor for downloading the watch history ( closes #1821 )
11 years ago
Philipp Hagemeister
081640940e
Merge branch 'master' of github.com:rg3/youtube-dl
11 years ago
Philipp Hagemeister
7012b23c94
Match --download-archive during playlist processing ( Fixes #1745 )
11 years ago
Jaime Marquínez Ferrándiz
d3b30148ed
[bambuser:channel] Update test
11 years ago
Philipp Hagemeister
3f8ced5144
Merge remote-tracking branch 'jaimeMF/yt-playlists'
11 years ago
Jaime Marquínez Ferrándiz
0980426559
[bandcamp] add support for albums (reported in #1270 )
11 years ago
Jaime Marquínez Ferrándiz
a6a173c2fd
utils.shell_quote: Convert the args to unicode strings
...
The youtube test video failed with `UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 34: ordinal not in range(128)`, the problem was with the filenames being encoded.
11 years ago
Philipp Hagemeister
f99e0f1ed6
Adapt age restriction tests to new .info.json filenames
11 years ago
Philipp Hagemeister
4eb92208a3
Adapt test to changed .info.json name
11 years ago
Janez Troha
08bc37cdd0
Update test_write_info_json.py
11 years ago
Jaime Marquínez Ferrándiz
dcbb45803f
[youtube:playlist] Don't use the gdata api ( closes #1508 )
...
Parse the playlist pages instead
11 years ago
Jaime Marquínez Ferrándiz
ae84f879d7
Merge all the subtitles test into a single file
...
They reuse a base class
11 years ago
Jaime Marquínez Ferrándiz
be6dfd1b49
[ted] Return a single info_dict for talks urls
...
It failed with the --list-subs option
11 years ago
Jaime Marquínez Ferrándiz
231516b6c9
Merge pull request #1705 from iemejia/master
...
[ted] support for subtitles
11 years ago
Jaime Marquínez Ferrándiz
12c167c881
[soundcloud] Allow to download tracks marked as not 'streamable'
...
They use the rtmp protocol but if the are marked as 'downloadable' it can use the direct download link.
11 years ago
Jaime Marquínez Ferrándiz
9ee2b5f6f2
tests: don't run the test if any of the extractors listed in the 'add_ie' field is marked as not working
11 years ago
Ismaël Mejía
4ed3e51080
[ted] fixed error in case of no subtitles present
...
I created a test, but I leave it commented since TED videos get
new subtitles frequently.
11 years ago
Jaime Marquínez Ferrándiz
be97abc247
Set the 'extractor_key' field in the info_dict
...
It's the string returned by the class method 'ie_key', which allows to retrieve the extractor with 'get_info_extractor'
11 years ago
Jaime Marquínez Ferrándiz
9103bbc5cd
Add the 'webpage_url' field to info_dict
...
The url for the video page, it must allow to reproduce the result.
It's automatically set by YoutubeDL if it's missing.
11 years ago
Jaime Marquínez Ferrándiz
b6c45014ae
Set the extra_info inside YoutubeDL.process_ie_result and set only if the keys are missing
11 years ago
Ismaël Mejía
38fcd4597a
Merge remote-tracking branch 'iemejia/master'
11 years ago
Jaime Marquínez Ferrándiz
165e3bb67a
[bambuser] Add an extractor for channels ( closes #1702 )
11 years ago
Ismaël Mejía
38db46794f
Merge branch 'ted_subtitles'
11 years ago
Ismaël Mejía
a9a3876d55
[ted] Added support for subtitle download
11 years ago
Jaime Marquínez Ferrándiz
0ef7ad5cd4
Fix the test for dailymotion subtitles
...
The extractor returns a single info_dict now.
11 years ago
Filippo Valsorda
f6cc16f5d8
[tests] a HTTP 503 is a transient issue
11 years ago
Philipp Hagemeister
646e17a53d
Fix YouTubeDL test
11 years ago
Filippo Valsorda
dd508b7c4f
[tests] don't fail on network errors
...
This is suboptimal, but at least this way we will need to look at the logs
only to check for network errors that happen too often, instead of
parsing a ton of lines each time to see if there is some true test failing
11 years ago
Jaime Marquínez Ferrándiz
702665c085
tests: build the filename from the info_dict if the 'file' key is missing
...
It will need to have the 'id' and 'ext' keys to work.
11 years ago
Jaime Marquínez Ferrándiz
49e86983e7
Allow to use the extension for the format selection
...
The best format with the extension is downloaded.
11 years ago
Jaime Marquínez Ferrándiz
a9c58ad945
Accept requested formats to be in the format 35/best ( closes #1552 )
...
The format selection code is now an independent function.
11 years ago
Philipp Hagemeister
f4d96df0f1
Extend #980 with --max-quality support
11 years ago
Philipp Hagemeister
5d254f776a
Fix test
11 years ago
Philipp Hagemeister
1c1218fefc
Merge remote-tracking branch 'jaimeMF/format_selection'
11 years ago
Philipp Hagemeister
10eaae48ff
Merge branch 'master' of github.com:rg3/youtube-dl
11 years ago
Philipp Hagemeister
9d4660cab1
[generic] Support embedded vimeo videos ( #1602 )
11 years ago
Jaime Marquínez Ferrándiz
e772692ffd
Fix an import in the tests and the Youtube Shows test
11 years ago
Philipp Hagemeister
44a5f1718a
Simplify tests
...
* Make them directly executable again
* Move common stuff (md5, parameters) to helper
* Never import *
* General clean up
11 years ago
Jai Grimshaw
1fb07d10a3
[youtube] Adds #1312 Download annotations
...
Adds #1321 Download annotations from youtube
Annotations are downloaded and written to a .annotations.xml file using the https://www.youtube.com/annotations_invideo?features=1&legacy=1&video_id=$VIDEOID API.
Added unit test for annotations.
11 years ago
Jaime Marquínez Ferrándiz
d7e66d39a0
Add an extractor for internetvideoarchive.com videos
...
It's used by videodetective.com
11 years ago
Filippo Valsorda
d3f46b9aa5
Add support for single-test tox runs
...
Use a sintax like
tox test.test_download:TestDownload.test_NowVideo
to run the specific test on all the tox environments (Python versions)
11 years ago
Jaime Marquínez Ferrándiz
e028d0d1e3
Implement the prefer_free_formats in YoutubeDL
11 years ago
Jaime Marquínez Ferrándiz
91dbaef406
[nhl] Add an extractor for videocenter's categories ( #1586 )
...
It downloads the last 12 videos.
11 years ago
Philipp Hagemeister
b2ad967e45
Simplify test setup
11 years ago
Philipp Hagemeister
8dbe9899a9
Allow users to specify an age limit ( fixes #1545 )
...
With these changes, users can now restrict what videos are downloaded by the intented audience, by specifying their age with --age-limit YEARS .
Add rudimentary support in youtube, pornotube, and youporn.
11 years ago
Philipp Hagemeister
f4aac741d5
Move try_rm to test helpers
11 years ago
Filippo Valsorda
8932a66e49
[fixup] remove unnecessary commented function
11 years ago
Filippo Valsorda
00fcc17aee
add capability to suppress expected warnings in tests
11 years ago
Filippo Valsorda
7c61bd36bb
[youtube] correct --no-playlist for python3
11 years ago
Filippo Valsorda
d4d9920a26
add test for --no-playlist
11 years ago
Philipp Hagemeister
45f4a76dbc
Work around nosetests nosiness
11 years ago
Philipp Hagemeister
95dbd2f990
Change test target (Verified with node.js)
11 years ago
Philipp Hagemeister
e0df6211cc
Restore accidentally deleted commits
...
That's what happens if you let Windows machines write :(
11 years ago
Jaime Marquínez Ferrándiz
b00ca882a4
[livestream] Fix events extraction ( fixes #1467 )
11 years ago
Jaime Marquínez Ferrándiz
39baacc49f
[dailymotion] Add an extractor for users ( closes #1476 )
11 years ago
Jaime Marquínez Ferrándiz
e69ae5b9e7
[youtube] support youtube.googleapis.com/v/* urls ( fixes #1425 )
11 years ago
Jaime Marquínez Ferrándiz
92790f4e54
[soundcloud] Add an extractor for users ( closes #1426 )
11 years ago
Jaime Marquínez Ferrándiz
0b7f31184d
Now --all-sub is a modifier to --write-sub and --write-auto-sub ( closes #1412 )
...
For keeping backwards compatibility --all-sub sets --write-sub if --write-auto-sub is not given
11 years ago
Jaime Marquínez Ferrándiz
a921f40799
[ustream] Simplify channel extraction
...
the ChannelParser has been moved to a new function in utils get_meta_content
Instead of the SocialStreamParser now it uses a regex
11 years ago
Jaime Marquínez Ferrándiz
74ac9bdd82
Merge pull request #1413 from tewe/master
...
Add Ustream channel support
11 years ago
Ismael Mejia
cf1dd0c59e
Merge branch 'master' into subtitles_rework
11 years ago
Jaime Marquínez Ferrándiz
8963d9c266
[youtube] Modify the regex to match ids of length 11 ( fixes #1396 )
...
In urls like http://www.youtube.com/watch?v=BaW_jenozKcsharePLED17F32AD9753930 you can't split the query string and ids always have that length.
11 years ago
Ismael Mejia
72836fcee4
Merge branch 'master' into subtitles_rework
11 years ago
Ismael Mejia
d6e203b3dc
[subtitles] fixed multiple subtitles language separated by comma after merge
...
As mentioned in the pull request, I forgot to include this changes.
aa6a10c44a
11 years ago
Jaime Marquínez Ferrándiz
e3ea479087
[youtube] Fix some issues with the detection of playlist/channel urls (reported in #1374 )
...
They were being caught by YoutubeUserIE, now it only extracts a url if the rest of extractors aren't suitable.
Now the url tests check that the urls can only be extracted with an specific extractor.
11 years ago
Jaime Marquínez Ferrándiz
faab1d3836
[youtube] Fix detection of feeds urls ( fixes #1294 )
...
Urls like https://www.youtube.com/feed/watch_later were being as users (before the last changes to YoutubeUserIE, as videos)
11 years ago
Jaime Marquínez Ferrándiz
f4b052321b
[youtube] Urls like youtube.com/NASA are now interpreted as users ( fixes #1069 )
...
Video urls like http://youtube.com/BaW_jenozKc are not valid, but http://youtu.be/BaW_jenozKc is correct.
11 years ago
Jaime Marquínez Ferrándiz
b7052e5087
Also print the field that fails if it is a md5 checksum
11 years ago
Jaime Marquínez Ferrándiz
aa6a10c44a
Allow to specify multiple subtitles languages separated by commas ( closes #518 )
11 years ago
Jaime Marquínez Ferrándiz
9e9c164052
Merge pull request #937 from jaimeMF/subtitles_rework
...
Subtitles rework
11 years ago
Ismael Mejia
18b4e04f1c
Merge branch 'master' into subtitles_rework
11 years ago
Philipp Hagemeister
d741e55a42
[youtube] Support watch_popup URLs ( Fixes #1275 )
11 years ago
Ismael Mejia
d80a064eff
[subtitles] Added tests to check correct behavior when no subtitles are
...
available
11 years ago
Ismael Mejia
447591e1ae
[test] Cleaned subtitles tests
11 years ago
Ismael Mejia
33eb0ce4c4
[subtitles] removed only-sub option (--skip-download achieves the same
...
functionality)
11 years ago
Philipp Hagemeister
e2f48f9643
Remove youtube sig tests
...
The signature algo changes too often for the static test to make sense.
11 years ago
Ismael Mejia
953e32b2c1
[dailymotion] Added support for subtitles + new InfoExtractor for
...
generic subtitle download.
The idea is that all subtitle downloaders must descend from SubtitlesIE
and implement only three basic methods to achieve the complete subtitle
download functionality. This will allow to reduce the code in YoutubeIE
once it is rewritten.
11 years ago
Jaime Marquínez Ferrándiz
04bca64bde
[youtube]: new algo for length 83 ( fixes #1164 )
11 years ago
Jaime Marquínez Ferrándiz
75952c6e3d
YoutubeIE: new algo for length 86 ( fixes #1156 )
...
Now is using the same length as the flash player used for age protected videos, but the algorithm is different, so now for age protected videos it first tries to use the old algo.
11 years ago
Jaime Marquínez Ferrándiz
caeefc29eb
[vimeo] add an extractor for channels
11 years ago
Jaime Marquínez Ferrándiz
a3c736def2
[dailymotion] Add an extractor for Dailymotion playlists
11 years ago
Jaime Marquínez Ferrándiz
5c468ca8a8
YoutubeIE: add algo for length 79 ( fixes #1126 )
11 years ago
Jaime Marquínez Ferrándiz
aedd6bb97d
YoutubeIE: new algo for length 81 ( fixes #1127 )
11 years ago
patrickslin
239e3e0cca
YoutubeIE: new algo for length 87 ( fixes #1105 )
...
Squashed commit from the pull requests #1107 , #1109 and #1110 .
11 years ago
Jaime Marquínez Ferrándiz
5d51a883c2
Use a dictionary for storing the subtitles
...
The errors while getting the subtitles are reported as warnings, if no subtitles are found return and empty dict.
11 years ago
Jaime Marquínez Ferrándiz
a4358cbabd
YoutubeIE: new algo for length 85 ( closes #1080 ), thanks to @patrickslin
11 years ago
Jaime Marquínez Ferrándiz
3e0b3a1428
Remove the test to signature of lengths 43,43
...
It's already covered by the test for length 87
11 years ago
Jaime Marquínez Ferrándiz
444b116597
YoutubeIE: add algo for length 90 ( closes #1064 )
...
Order the cases from higher to lower length.
11 years ago
Philipp Hagemeister
51fb64bab1
Mark test_youtube_sig as non-executable ( #1066 )
11 years ago
Philipp Hagemeister
2a5201638d
[youtube] Add sig test for 92 (Thanks to @patrickslin)
11 years ago
Jaime Marquínez Ferrándiz
606d7e67fd
YoutubeIE: add algo for length 81 ( closes #1026 )
11 years ago
Jaime Marquínez Ferrándiz
85347e1cb6
YoutubeIE: a new algo for length 83
11 years ago
Philipp Hagemeister
59ae56fad5
Add helper function find_path_attr
11 years ago
Jaime Marquínez Ferrándiz
c93898dae9
YoutubeIE: new algo for length 83 ( closes #1017 and closes #1016 )
12 years ago
Philipp Hagemeister
897f36d179
[youtube:subscriptions] Use colon for differentiation of shortcuts
12 years ago
Jaime Marquínez Ferrándiz
75dff0eef7
[youtube]: add YoutubeShowIE ( closes #14 )
...
It just extracts the playlists urls for each season
12 years ago
Jaime Marquínez Ferrándiz
bc2884afc1
Print which IE is being skipped in test_download
12 years ago
Jaime Marquínez Ferrándiz
023fa8c440
Add function add_default_info_extractors to YoutubeDL
...
It adds to the list the ies returned by ge_extractors
12 years ago
Philipp Hagemeister
a924876fed
Make sure that IEs only accept their own URLs
12 years ago
Philipp Hagemeister
fc2c063e1e
Move testcase generator to helper
12 years ago
Philipp Hagemeister
6f5ac90cf3
Move tests to the IE definitions
12 years ago
Philipp Hagemeister
0c56a3f773
[googleplus] move tests
12 years ago
Philipp Hagemeister
9d069c4778
[infoq] move tests
12 years ago
Philipp Hagemeister
67f51b3d8c
[youku] move tests
12 years ago
Philipp Hagemeister
5c5de1c79a
[eighttracks] move test
12 years ago
Philipp Hagemeister
0821771466
[steam] move test
12 years ago
Philipp Hagemeister
83f6f68e79
[metacafe] move tests
12 years ago
Philipp Hagemeister
0c6c096c20
[soundcloud] Move tests
12 years ago
Philipp Hagemeister
41beccbab0
Use str every time
12 years ago
Philipp Hagemeister
2eb88d953f
Allow _TESTS attribute for IEs with multiple tests
...
This also improves the numbering of duplicate tests
12 years ago
Philipp Hagemeister
6b47c7f24e
Allow moving tests into IE files
...
Allow adding download tests right in the IE file.
This will cut down on merge conflicts and make it more likely that new IE authors will add tests right away.
12 years ago
Philipp Hagemeister
ed4a915e08
Add tests and improve for HotNewHipHop
12 years ago
Filippo Valsorda
23300d7149
a new day, a new s algo - fix #946
12 years ago
Philipp Hagemeister
6b37f0be55
Add a clean-room implementation for youtube signatures
12 years ago
Philipp Hagemeister
5746f9da99
Add test for youtube signature algorithm
12 years ago
Philipp Hagemeister
112da0a0ce
Simplify FakeYDL
12 years ago
Philipp Hagemeister
ed92bc9f6e
[wimp] minor readability improvements ( #940 )
12 years ago
Jaime Marquínez Ferrándiz
aa0c87391c
Add CSpanIE ( closes #312 )
12 years ago
M.Yasoob Khalid
8bcc355972
removed trailing ',' and corrected the title in test
12 years ago
M.Yasoob Khalid
6b4642fae3
added test for wimp.com
12 years ago
Ismael Mejia
65cceef8f4
Added support for additional vtt subtitle format (WebVTT) in youtube-dl.
12 years ago
Jaime Marquínez Ferrándiz
b004821fa9
Add the option "--write-auto-sub" to download automatic subtitles from Youtube
...
Now automatic subtitles are only downloaded if the option is given.
(closes #903 )
12 years ago
M.Yasoob Khalid
f4daa18152
added test for tudou.com
12 years ago
Filippo Valsorda
f7ab6cbe16
add tests for use_cipher_signature videos ( #897 ) and the ability to test multiple videos per IE
12 years ago
Jaime Marquínez Ferrándiz
70d1924f8b
Add VevoIE
12 years ago
Jaime Marquínez Ferrándiz
8bf8b5a577
Use the new class in the tests
12 years ago
Jaime Marquínez Ferrándiz
8222d8de88
Split FileDownloader in two classes: FileDownloader and YoutubeDL
...
YoutubeDL is the class that coordinates everything
FileDownloader gets a filename and an info dict and downloads the video.
12 years ago
Philipp Hagemeister
825e0984e2
[break] adapt to new paths
12 years ago
Philipp Hagemeister
d1cade5ade
Correct module name
12 years ago
Philipp Hagemeister
0824c28c8b
Remove mentions of old InfoExtractors module
12 years ago
Philipp Hagemeister
b8a360837a
Fix Statigram test
12 years ago
Philipp Hagemeister
51ce3a75c9
Improve error reporting for downloads
12 years ago
M.Yasoob Khalid
9b5fffb149
added an IE and test for break.com
12 years ago
Philipp Hagemeister
828dba2983
Improvge error reporting
12 years ago
Philipp Hagemeister
6b3f5a329b
Improve Statigr.am IE
12 years ago
M.Yasoob Khalid
4fdd4e6f6f
added test for Statigr
12 years ago
Jaime Marquínez Ferrándiz
f4c8bbcfc2
TEDIE: download the best quality video and use the new _search_regex functions
...
Also extracts the description.
12 years ago
Jaime Marquínez Ferrándiz
377fdf5dde
Update the TumblrIE: the video is no longer available
12 years ago
Jaime Marquínez Ferrándiz
213b715893
Merge pull request #887 from anisse/master
...
Fetch all entries that are in a youtube playlist
Also add a test.
12 years ago
Filippo Valsorda
8bc7c3d858
Merge branch 'search_regex' - PR #872 - closes #847
12 years ago
Jaime Marquínez Ferrándiz
36ed7177f0
Fix HypemIE test: the song name has been changed
12 years ago
Jaime Marquínez Ferrándiz
32aa88bcae
Add GametrailersIE
12 years ago
Jaime Marquínez Ferrándiz
31513ea6b9
Update test_issue_673 in Youtube Lists
...
Some videos have been removed.
Delete the title check, it's not the purpose of that test.
12 years ago
Jaime Marquínez Ferrándiz
9abc6c8b31
Update YahooIE test
...
The old test video is no longer available.
12 years ago
Filippo Valsorda
ee55fcbe12
switch long info_dict fields checking to md5
12 years ago
Filippo Valsorda
78d3442b12
test: extend the reach of info_dict checking
...
* print the info_dict in a format suitable to easy adding to tests.json during tests if un-tested fields are detected
* make it possible to put the crc32 in tests.json if the field is too long
* complete the "info_dict" fields in existing tests
* fixed the bugs catched doing this
12 years ago
Filippo Valsorda
979a9dd4c4
_html_search_regex with clean_html superpowers
12 years ago
M.Yasoob Khalid
ecb3e676a5
Added Vbox7 Infoextractor
12 years ago
Filippo Valsorda
be95cac157
raise exceptions on warnings during tests - and solve a couple of them
12 years ago
Filippo Valsorda
476203d025
print WARNINGs during test + minor fix to NBAIE
12 years ago
M.Yasoob Khalid
157b864a01
added HypemIE
...
rebased, closes PR #871
12 years ago
Filippo Valsorda
951b9dfd94
Merge pull request #866 from yasoob/master
...
Added support for XHamster - closes #841
12 years ago
M.Yasoob Ullah Khalid
c978a96c02
Added test for XHamster.com
12 years ago
Clément DAVID
57bde0d9c7
Fix the test_all_urls (Import issue)
12 years ago
Clément DAVID
50b4d25980
Merge within test_all_urls
12 years ago
Clément DAVID
4a76d1dbe5
Add tests for justin.tv and twitch.tv
12 years ago
Jaime Marquínez Ferrándiz
dc1c355b72
YoutubeIE: fallback to automatic captions when subtitles aren't found ( closes #843 )
...
Also modify test_youtube_subtitles to support running the tests in any order.
12 years ago
Jaime Marquínez Ferrándiz
45014296be
Add TeamcocoIE ( closes #212 )
12 years ago
Anna Bernardi
afef36c950
add support for Flickr videos - closes #261
12 years ago
Jaime Marquínez Ferrándiz
17bd1b2f41
VineIE: extract more information and minor style changes
12 years ago
Anna Bernardi
5b0d3cc0cd
Add support for Vine - closes #845
12 years ago
Filippo Valsorda
d4f76f1674
Add support for Howcast.com - closes #835
12 years ago
Jaime Marquínez Ferrándiz
340fa21198
UstreamIE: get thumbnail and uploader name
12 years ago
Jaime Marquínez Ferrándiz
59f4fd4dc6
YahooIE: remove old code and accept screen.yahoo.com videos ( #300 )
...
Videos require rtmpdump
12 years ago
Philipp Hagemeister
86fd453ea8
Merge remote-tracking branch 'origin/master'
12 years ago
Philipp Hagemeister
c83411b9ee
Skip bandcamp tests for now - free limit has been exceeded
12 years ago
Jaime Marquínez Ferrándiz
057c9938a1
Import FileDownloader in test_youtube_subtitles
...
Fix last commit
12 years ago
Jaime Marquínez Ferrándiz
9259966132
test_youtube_subtitles: FakeDownloader inherits form FileDownloader
12 years ago
julien
7f5bd09baf
Add support to www.ina.fr
12 years ago
Jaime Marquínez Ferrándiz
d96680f58d
PhotobucketIE: accept new format of urls and add a test
12 years ago
Philipp Hagemeister
09dd418f53
Experimentally whitelist Escapist test
12 years ago
Philipp Hagemeister
c34407d16c
Simplify RedTube
12 years ago
M.Yasoob Ullah Khalid
815dd2ffa8
Redtube test now works
...
I just did a little makeover by changing redtube tests. Now they are passed.
12 years ago
M.Yasoob Ullah Khalid
b86174e7a3
added test for redtube.com
...
I just added the test for redtube.com
12 years ago
Jaime Marquínez Ferrándiz
46bfb42258
InfoExtractors: use _download_webpage in more IEs
...
IEs without tests are intact.
12 years ago
Jaime Marquínez Ferrándiz
104ccdb8b4
TumblrIE: fix title matching
12 years ago
Jaime Marquínez Ferrándiz
aed523ecc1
Add BandcampIE ( closes #568 )
12 years ago
Jaime Marquínez Ferrándiz
34c29ba1d7
Add test for SoundcloudSet
12 years ago
Philipp Hagemeister
8749b71273
Fix FakeDownloaders
12 years ago
Jaime Marquínez Ferrándiz
ba7c775a04
Remove a commented line I forgot.
...
[ci skip]
12 years ago
Philipp Hagemeister
9665577802
Adapt tests to changes in youtube's "Most Popular" channel
12 years ago
Jaime Marquínez Ferrándiz
37254abc36
Allow to use relative dates in the format (now|today)[+-][0-9](day|week|month|year)(s)? ( Closes #137 )
...
Also fix DateRange not accepting ranges of one day.
12 years ago
Jaime Marquínez Ferrándiz
bf50b0383e
Fix some IEs that didn't return the uploade_date in the YYYYMMDD format
...
Create a function unified_strdate in utils.py to fix these problems
12 years ago
Jaime Marquínez Ferrándiz
bd55852517
Allow to select videos to download by their upload dates (related #137 )
...
Only absolute dates.
12 years ago
Jaime Marquínez Ferrándiz
aba8df23ed
YoutubePlaylistIE: don't crash with empty lists (related #808 )
...
The playlist_title wasn't initialized.
12 years ago
Jaime Marquínez Ferrándiz
c15e024141
TumblrIE
...
I haven't found many videos to test, so it may not work for all.
12 years ago
Jaime Marquínez Ferrándiz
c72938240e
Get the title of Youtube playlists
12 years ago
Jaime Marquínez Ferrándiz
9341212642
Create a function in InfoExtractors that returns the InfoExtractor class with the given name
12 years ago
Jaime Marquínez Ferrándiz
49da66e459
The test video for subtitles has added a new language
12 years ago