c010af6f19
[escapist] Make regexes more robust ( Closes #5028 )
10 years ago
35b7982303
[appletrailers] Add test ( #5027 )
10 years ago
f311cfa231
[appletrailers] Extend _VALID_URL ( Closes #5027 )
10 years ago
98c70d6fc7
[YoutubeDL] only add normal subtitles to the 'requested_subtitles' field if 'writesubtitles' is True
10 years ago
03091e372f
[ted] Always extract the subtitles
...
The required info is already in the webpage
10 years ago
4d17184817
[YoutubeDL] don't set the 'requested_subtitles' without writesubtitles or writeautomaticsub
10 years ago
e086e0eb6c
release 2015.02.21
10 years ago
314368c822
[teamcoco] Fix extraction
...
Also, use a single style of quotes
10 years ago
c5181ab410
[gdcvault] Fix rtmp streams ( Closes #5024 )
10 years ago
ea5152cae1
[zapiks] Extend _VALID_URL ( #5014 )
10 years ago
255fca5eea
[generic] Add support for Zapiks embeds ( #5014 )
10 years ago
4aeccadf4e
[zapiks] Add extractor ( #5014 )
10 years ago
93540ee10e
[rtve] Fix the video url
...
Changing mvod to mvod1 fixes the url, we don't need to add the query.
10 years ago
8fb3ac3649
PEP8: W503
10 years ago
77b2986b5b
[extractor/common] Recognize Indian censorship ( #5021 )
10 years ago
62b013df0d
[vimeo] Encode password before hash calculation
10 years ago
fad6768bd1
[vimeo] Fix password protected videos ( Closes #5001 )
10 years ago
1e9a9e167d
release 2015.02.20
10 years ago
3da0db62e6
[escapist] Fix extraction ( fixes #5017 )
10 years ago
e14ced7918
Merge branch 'master' of github.com:rg3/youtube-dl
10 years ago
a461a11989
[ted] Improve external video handling and add test
10 years ago
1bd838608f
prefer 'code' to 'uri' if present
10 years ago
365577f567
[chirbit] add profile extractor.
10 years ago
50efb383f0
[tv4] Add new extractor ( Closes #4839 ) ( Closes #2103 )
10 years ago
5da6bd0083
[chirbit] Add new extractor.
10 years ago
5e9a033e6e
[imgur] Allow alternative values
...
Every now and then, imgur.com goes crazy and gives us a generic title and description (otherwise it looks all fine though).
Simply update the test case to allow for that craziness.
10 years ago
fb7cb6823e
Remove the SubtitlesInfoExtractor class
...
No longer needed
10 years ago
dd0a58f5f0
[blinkx] Fix extraction
10 years ago
a21420389e
release 2015.02.19.3
10 years ago
6140baf4e1
[nationalgeographic] Add extractor ( closes #4960 )
10 years ago
8fc642eb5b
[pornhub] Fix uploader regex
10 years ago
e66e1a0046
[pornhub] Add support for playlists ( Closes #4995 )
10 years ago
d5c69f1da4
[5min] Cover joystiq.com URLs ( Closes #4962 )
10 years ago
f13b1e7d7f
[bbccouk] Convert to new subtitles system
...
I haven't found any video available outside the UK, so I haven't added tests.
I have updated how the srt file is build, because (at least for www.bbc.co.uk/programmes/p02j9b69) the subtitles is inside 'span' elements.
10 years ago
5c8a3f862a
[nbc] Use a test video that works outside the US
10 years ago
8807f1277f
[theplatform] Convert to new subtitles system
10 years ago
a3b9157f49
[cbssports] Add extractor ( closes #4996 )
10 years ago
b88ba05356
[imgur] Simplify
10 years ago
b74d505577
Merge remote-tracking branch 'jbboehr/imgur-gifv-improvements'
10 years ago
9e2d7dca87
[imgur] improve error check for non-video URLs
10 years ago
d236b37ac9
[imgur] improve regex #4998
10 years ago
e880c66bd8
[theonion] Modernize
10 years ago
1a13940c8d
[imgur] support regular URL
10 years ago
3d54788495
[webofstories] Fix extraction
10 years ago
71d53ace2f
[sockshare] Do not require thumbnail anymore
...
Thumbnail is not present on the website anymore.
10 years ago
f37e3f99f0
[generic] Correct test case
...
Video has been reuploaded / edited
10 years ago
bd03ffc16e
[netzkino] Skip download in test case
...
Works fine from Germany, but fails from everywhere else
10 years ago
1ac1af9b47
release 2015.02.19.2
10 years ago
3bf5705316
[imgur] Add new extractor
10 years ago
1c2528c8a3
[cbs] Modernize
10 years ago
7bd15b1a03
release 2015.02.19.1
10 years ago
6b961a85fd
[patreon] Add support for embedlies ( fixes #4969 )
10 years ago
7707004043
[patreon] Modernize
10 years ago
a025d3c5a5
release 2015.02.19
10 years ago
c460bdd56b
[sandia] Add new extractor ( #4974 )
10 years ago
b81a359eb6
[YoutubeDL] Use render_table for format listing
10 years ago
d61aefb24c
Merge remote-tracking branch 'origin/master'
10 years ago
d305dd73a3
[utils] Fix js_to_json
...
Previously, the runtime could be atrocious for longer inputs.
10 years ago
93a16ba238
[vimeo] Raise the ExtractorError with expected=True when no video password is given
10 years ago
4f7cea6c53
[viki] Convert to new subtitles system
10 years ago
afbdd3acc3
[rai] Convert to new subtitles system
10 years ago
85d5866177
[yahoo] Remove md5sum from test case
...
The md5 sum has changed repeatedly, and we check whether it looks like a video anyways nowadays.
10 years ago
9789d7535d
[xtube] Fix test case
10 years ago
d8443cd3f7
[wsj] Correct test case
10 years ago
d47c26e168
[brightcove] Correct keys in playlists
10 years ago
01561da142
[nrk] Convert to new subtitles system
10 years ago
0af25f784b
[mtv] Convert to new subtitles system
10 years ago
b9b42f2ea0
[npo] Convert to new subtitles system
10 years ago
311c393838
[lynda] Convert to new subtitles system
10 years ago
18c1c42405
[drtv] Convert to new subtitles system
10 years ago
37dd5d4629
[mit] Don't set the subtitles field
...
YouTube already provides them in more formats
10 years ago
81975f4693
release 2015.02.18.1
10 years ago
3eff81fbf7
[jsinterp] Disable comment support
...
We need a proper lexer to be able to understand YouTube's code, which contains /* inside of strings.
For now it's sufficient to just disable comment support altogether.
Fixes #4976 , fixes #4979 , fixes #4980 , fixes #4981 , fixes #4982 .
Closes #4977 .
10 years ago
785521bf4f
[youtube] Remove useless if
10 years ago
6d1a55a521
[youtube] Show entire player URL when -v is given
10 years ago
9cad27008b
release 2015.02.18
10 years ago
11e611a7fa
Extend various playlist tests
10 years ago
72c1f8de06
[bandcamp:album] Fix extractor results and associated test
10 years ago
6e99868e4c
[buzzfeed] Fix playlist test case
10 years ago
4d278fde64
[ign] Amend playlist test
10 years ago
1def5f359e
[livestream] Correct playlist ID and add a test for it
10 years ago
15ec669374
[vk] Amend playlist test
10 years ago
a3fa5da496
[vimeo] Amend playlist tests
10 years ago
30965ac66a
[vimeo] Prevent infinite loops if video password verification fails
...
We're seeing this in the tests¹ right now, which do not terminate.
¹ https://travis-ci.org/jaimeMF/youtube-dl/jobs/51135858
10 years ago
09ab40b7d1
Merge branch 'progress-as-hook2'
10 years ago
edab9dbf4d
[YoutubeDL] use the 'render_table' function for listing the subtitles
10 years ago
9868ea4936
[extractor/common] Simplify subtitles handling methods
...
Initially I was going to use a single method for handling both subtitles and automatic captions, that's why I used the 'list_subtitles' and the 'subtitles' variables.
10 years ago
85920dd01d
[bliptv] Convert to new subtitles system
10 years ago
fa15607773
PEP8 fixes
10 years ago
a91a2c1a83
[downloader] Remove various unneeded assignments and imports
10 years ago
16e7711e22
[downloader/http] Remove gruesome import
10 years ago
5cda4eda72
[YoutubeDL] Use a progress hook for progress reporting
...
Instead of every downloader calling two helper functions, let our progress report be an ordinary progress hook like everyone else's.
Closes #4875 .
10 years ago
98f000409f
[radio.de] Fix extraction
10 years ago
bd7fe0cf66
[walla] Convert to new subtitles system
10 years ago
48246541da
[ceskatelevize] Convert to new subtitles system
10 years ago
4a8d4a53b1
[videolecturesnet] Fix rtmp stream glitches ( Closes #4968 )
10 years ago
4cd95bcbc3
[twitch:stream] Prefer the 'source' format ( fixes #4972 )
10 years ago
be24c8697f
release 2015.02.17.2
10 years ago
0d93378887
[videolecturesnet] Check http format URLs ( Closes #4968 )
10 years ago
4069766c52
[extractor/common] Test URLs with GET
10 years ago
7010577720
release 2015.02.17.1
10 years ago
8ac27a68e6
[hls] Switch to available as a property
10 years ago
46312e0b46
release 2015.02.17
10 years ago
f9216ed6ad
Merge remote-tracking branch 'origin/master'
10 years ago
65bf37ef83
[ffmpeg] Remove trivial helper method
10 years ago
f740fae2a4
[ffmpeg] Make available a property
10 years ago
fbc503d696
[downloader/hls] Fix detection of ffmpeg/avconv (reported in #4966 )
10 years ago
662435f728
[YoutubeDL] Use a Request object for getting the cookies ( fixes #4970 )
...
So that we don't have to implement all the methods used by the cookiejar.
10 years ago
163d966707
[downloader/external] curl: Add the '--location' flag
...
curl doesn't follow redirections by default
10 years ago
85729c51af
[downloader] Add --hls-prefer-native to use the native HLS downloader ( #4966 )
10 years ago
360e1ca5cc
[youtube] Convert to new subtitles system
...
The automatic captions are stored in the 'automactic_captions' field, which is used if no normal subtitles are found for an specific language.
10 years ago
a1f2a06b34
[dailymotion] Convert to new subtitles system
10 years ago
c84dd8a90d
[YoutubeDL] store the subtitles to download in the 'requested_subtitles' field
...
We need to keep the orginal subtitles information, so that the '--load-info' option can be used to list or select the subtitles again.
We'll also be able to have a separate field for storing the automatic captions info.
10 years ago
65469a7f8b
[vimeo] Convert to new subtitles system
...
Removed some tests, the behaviour should be checked in a test for the YoutubeDL class
10 years ago
6b597516c1
[atresplayer] Convert to new subtitles system
10 years ago
b5857f62e2
[crunchyroll] Convert to new subtitles system
10 years ago
a504ced097
Improve subtitles support
...
For each language the extractor builds a list with the available formats sorted (like for video formats), then YoutubeDL selects one of them using the '--sub-format' option which now allows giving the format preferences (for example 'ass/srt/best').
For each format the 'url' field can be set so that we only download the contents if needed, or if the contents needs to be processed (like in crunchyroll) the 'data' field can be used.
The reasons for this change are:
* We weren't checking that the format given with '--sub-format' was available, checking it in each extractor would be repetitive.
* It allows to easily support giving a format preference.
* The subtitles were automatically downloaded in the extractor, but I think that if you use for example the '--dump-json' option you want to finish as fast as possible.
Currently only the ted extractor has been updated, but the old system still works.
10 years ago
1db5fbcfe3
release 2015.02.16.1
10 years ago
59b8ab5834
[rtlnl|generic] Add support for rtl.nl embeds ( Fixes #4959 )
10 years ago
a568180441
release 2015.02.16
10 years ago
85e80f71cd
[yam] Allow faults in optional fields ( #4943 )
10 years ago
bfa6bdcd8b
Merge remote-tracking branch 'yan12125/IE_Yam'
10 years ago
03cd72b007
[extractor/common] Move up filesize
...
filesize and tbr should correlate, so it doesn't make sense to treat them differently.
10 years ago
5bfd430f81
Merge remote-tracking branch 'origin/master'
10 years ago
73fac4e911
[ffmpeg] Add --ffmpeg-location
10 years ago
f813928e4b
[bbccouk] Fix fallback to legacy playlist
10 years ago
b9c7a97318
[history] Add extractor ( Closes #4934 )
10 years ago
9fb2f1cd6d
[theplatform] Add URL sign capability
10 years ago
6ca7732d5e
[extractor/common] Fix link to external documentation
10 years ago
b0ab0fac49
Remove unused imports
10 years ago
a294bce82f
[streamcz] Fix extraction ( Closes #4940 )
10 years ago
76d1466b08
[drtuber] Add one more title regex
10 years ago
1888d3f7b3
Merge pull request #4951 from peugeot/beeg
...
[beeg] fix test
10 years ago
c2787701cc
Merge pull request #4950 from peugeot/drtuber
...
[drtuber] fix extraction
10 years ago
52e1d0ccc4
[beeg] fix test
10 years ago
10e3c4c221
[drtuber] fix extraction
10 years ago
68f2d273bf
[sunporno] Keep old video regex just in case
10 years ago
ae1580d790
[sunporno] fix extraction
10 years ago
a4f3d779db
[nbcnews] Simplify
10 years ago
d9aa2b784d
Support NBC Nightly News broadcasts
10 years ago
cffcbc02de
[postprocessor/ffmpeg] Don't let ffmpeg read from stdin ( fixes #4945 )
...
If you run 'while read aurl ; do youtube-dl --extract-audio "${aurl}"; done < path_to_batch_file' (batch_file contains one url per line) each call to youtube-dl consumed some characters and 'read' would assing to 'aurl' a non valid url, something like 'tube.com/watch?v=<id>'.
10 years ago
9347fddbfc
[1tv] Cover arbitraty URLs
10 years ago
037e9437e4
[camdemy] Fix _VALID_URL
10 years ago
ae6423d704
[bambuser] Fix 'uploader_id' extraction ( fixes #4944 )
10 years ago
7105440cec
[Yam] Add new extractor
10 years ago
171ca612af
[npo:radio] Move to extractor to common npo place and add extractor for fragments
10 years ago
c3d64fc1b3
[nporadio] Edit to confirm to flake8 standards
10 years ago
7c24ce225d
[NPORadio] Added extractor for live radio
10 years ago
08b38d5401
[camdemy] Simplify and make more robust ( #4938 )
...
Do not throw errors if view count or upload date extraction fails.
Dispose of re.MULTILINE, which had absolutely no effect without any ^ or $ in sight.
Follow PEP8 naming conventions.
10 years ago
024c53694d
Merge remote-tracking branch 'yan12125/IE_camdemy'
10 years ago
7e6011101f
[camdemy] Python2 compatibility
10 years ago
c40feaba77
[camdemy] Add support for folders
10 years ago
5277f09dfc
release 2015.02.11
10 years ago
2d30521ab9
[youtube] Extract average rating ( closes #2362 )
10 years ago
f36f92f4da
[aes] style: Put __all__ variable at the end of the file
10 years ago
124f3bc67d
[dotsub] Fix extraction and modernize
10 years ago
8367d3f3cb
[camdemy] Detection of external sources
10 years ago
c56d7d899d
[dctptv] Skip rtmp download
10 years ago
ea5db8469e
[canalplus] Add support for itele.fr URLs ( Closes #4931 )
10 years ago
3811c567e7
[teamcoco] Fix video id extraction
10 years ago
8708d76425
[camdemy] Add new extractor
...
Single file download done, while folder extaction in plan
10 years ago
054fe3cc40
[ntvru] Adapt to new direct delivery and modernize ( Closes #4918 )
10 years ago
af0d11f244
release 2015.02.10.5
10 years ago
9650885be9
[escapist] Filter video differently ( Fixes #4919 )
10 years ago
596ac6e31f
[escapist] Modernize
10 years ago
612ee37365
release 2015.02.10.4
10 years ago
442c37b7a9
[YoutubeDL] Do not perform filter matching on partial results ( Fixes #4921 )
10 years ago
04bbe41330
release 2015.02.10.3
10 years ago
8f84f57183
[ccc] Add new extractor ( Fixes #4890 )
10 years ago
c0e1a415fd
[firstpost] Modernize
10 years ago
bf8f082a90
[vimeo:album] Add support for album passwords ( Fixes #4917 )
10 years ago
2f543a2142
[options] Add alias --dump-header for --print-traffic
10 years ago
7e5db8c930
[options] Add --no-color
10 years ago
f7a211dcc8
[pornhd] Fix extraction ( fixes #4915 )
10 years ago
845734773d
release 2015.02.10.2
10 years ago
347de4931c
[YoutubeDL] Add generic video filtering ( Fixes #4916 )
...
This functionality is intended to eventually encompass the current format filtering.
10 years ago
8829650513
release 2015.02.10.1
10 years ago
c73fae1e2e
[commonmistakes] Detect BOMs at the beginning of URLs
...
Reported at https://bugzilla.redhat.com/show_bug.cgi?id=1093517 .
10 years ago
834bf069d2
[bandcamp] Correct variable name
10 years ago
c06a9fa34f
Use snake_case instead of camelCase
10 years ago
753fad4adc
[commonmistakes] Correct logic error
10 years ago
34814eb66e
release 2015.02.10
10 years ago
3a5bcd0326
[extractor/common] Wrap extractor errors ( Fixes #1194 )
...
For now, we just wrap some common errors. More may follow. We do not want to catch actual programming errors in the extractors, such as 1 // 0.
10 years ago
99c2398bc6
[bandcamp] Use our API to get more stable error messages ( #1194 )
10 years ago
28f1272870
[svtplay] Correct test case
10 years ago
f18e3a2fc0
release 2015.02.09.3
10 years ago
c4c5dc27cb
Merge branch 'master' of github.com:rg3/youtube-dl
10 years ago
2caf182f37
[trilulilu] Add support for videos without category in the URL ( Closes #4067 )
...
Also, update the testcase, detect private/country restricted videos and modernize a bit.
10 years ago
43f244b6d5
[YoutubeDL] Do not show worst in --list-formats output
...
Nobody wants to know what the worst possible format is. And if they do, they can still provide -f worst.
10 years ago
1309b396d0
[svtplay] Add new extractor ( Fixes #4914 )
10 years ago
ba61796458
[youtube] Don't override format info from the dash manifest ( fixes #4911 )
10 years ago
3255fe7141
release 2015.02.09.2
10 years ago
e98b8e79ea
[generic] Improve SBS detection ( Fixes #4899 )
10 years ago
196121c51b
release 2015.02.09.1
10 years ago
5269028951
[rtlnow] Add test for @mmue's extension ( #4908 )
10 years ago
f7bc056b5a
Merge remote-tracking branch 'mmue/fix-rtlnow'
10 years ago
a0f7198544
[generic] Add support for jwPlayer YouTube videos
...
This makes nationalarchives.gov.uk work (Fixes #4907 , fixes #4876 )
10 years ago
dd8930684e
release 2015.02.09
10 years ago
bdb186f3b0
fix rtlnow for newer series like "Der Bachelor" season 5
10 years ago
64f9baa084
[options] Mention asr as possible filter
10 years ago
b29231c040
release 2015.02.08
10 years ago
6128bf07a9
[options] Update help on string comparisons
10 years ago
2ec19e9558
[YoutubeDL] Allow filtering by audio sampling rate
10 years ago
9ddb6925bf
[YoutubeDL] Allow filtering by string properties ( #4906 )
10 years ago
41c23b0da5
[gamekings] Support videos from news pages
10 years ago
d87ec897e9
[gamekings] Improve extraction
10 years ago
3bd4bffb1c
Merge branch 'gamekings' of https://github.com/robin007bond/youtube-dl into robin007bond-gamekings
10 years ago
c36b09a502
[Gamekings] Use thumbnail in return statement
10 years ago
641eb10d34
Use _family_friendly_search for determining age_limit
10 years ago
955c5505e7
[Gamekings] Use xpath
...
XPath is used for extracting the video url and the thumbnail
10 years ago
69319969de
[extractor/common] Add new helper method _family_friendly_search
10 years ago
a14292e848
[soulanime] Remove extractor ( #4554 )
...
Was supposed to be deleted by 67c2bcd
10 years ago
5d678df64a
[Gamekings] Download playlist
...
Todo: URL and Thumbnail should be extracted with XPath
10 years ago
8ca8cbe2bd
[Gamekings] Check string for vimeo, fix test
...
The test now doesn't fail anymore. It just checks the string for having
"vimeo" in it, instead of using the method for URL-checking, since it's
returns an error.
The tests don't fail, and the extractor works fine now.
10 years ago
ba322d8209
[Gamekings] Added test and replaced video_url
...
Quick and dirty fix for the Gamekings extractor. It gives an error about
the video_url, but it downloads it now instead of giving a 404 error on
newer Gamekings videos
10 years ago
2f38289b79
[Gamekings] Fix order of replacement string
...
Oops.
10 years ago
f23a3ca699
[Gamekings] Fixed typo in URL replacement
10 years ago
77d2b106cc
[Gamekings] Fix 404 when large isn't available
...
When trying to download some GameKings videos, not all worked. This was
because not all videos had a "/large"-URL available. The extractor
checks now if the /large URL is available, if it isn't, it tries to get
the normal URL.
10 years ago
c0e46412e9
[aparat] Fix extraction ( Closes #4897 )
10 years ago
b3a286d69d
[YoutubeDL] _calc_cookies: add get_header method to _PseudoRequest ( #4861 )
10 years ago
467d3c9a0c
[ffmpeg] --extrac-audio: Use the same options for avconv and ffmpeg
...
They have been available in ffmpeg since version 0.9, and we require 1.0 or higher.
10 years ago
ad5747bad1
[rtp] Construct regular HTTP download URLs ( #4882 )
10 years ago
d6eb66ed3c
[aftenposten] Add extractor ( Closes #4863 )
10 years ago
7f2a9f1b49
[tvigle] Add support for cloud URLs ( Closes #4887 )
10 years ago
1e1896f2de
[extractor/common] Correct sort order.
...
We should look at height and width before ext_preference.
10 years ago
c831973366
release 2015.02.06
10 years ago
1a2548d9e9
[rtp] Pass --realtime to rtmpdump ( Fixes #4882 )
...
A workaround for video jumping back in time.
10 years ago
3900eec27c
[extractor/common] Fix 2.0 manifest extraction ( Closes #4830 )
10 years ago
9c91a8fa70
[tweakers] Switch extraction to xspf playlist, extract all formats and meta ( #4881 )
10 years ago
41469f335e
Merge branch 'tweakers' of https://github.com/robin007bond/youtube-dl into robin007bond-tweakers
10 years ago
67ce4f8820
Use match_id method instead of splitted URL
10 years ago
bc63d56cca
Remove unnecessary TODO-comments
10 years ago
c893d70805
Remove player-url in tweakers.py
...
Player-url only needed for rmftp, not for regular URLs
10 years ago
3ee6e02564
Edit Tweakers extractor
...
Fixed code conventions (mainly adding two or more spaces before making
an inline comment)
10 years ago
e3aaace400
[tweakers] Add new extractor
10 years ago
300753a069
[YoutubeDL] Fix video+audio format field ( Closes #4880 )
10 years ago
f13b88c616
[rts] Fix f4m and m3u8 extraction ( Closes #4873 )
10 years ago
60ca389c64
[extractor/common] Prefix f4m/m3u8 entries with identifier
10 years ago
9e91449c8d
[npo] Fix subtitles ( Closes #3638 )
10 years ago
25e5ebf382
Add NPO.nl subtitles
...
Implements #3638
10 years ago
7dfc356625
release 2015.02.04
10 years ago
58ba6c0160
[mixcloud] Fix extraction ( Closes #4862 )
10 years ago
f076b63821
[generic/ooyala] Add support for Ooyala embeds on SBN network websites ( Fixes #4859 )
10 years ago
cd7342755f
release 2015.02.03.1
10 years ago
9bb8e0a3f9
[wsj] Add new extractor ( Fixes #4854 )
10 years ago
1a6373ef39
[sort_formats] Prefer bitrate over video size
...
720p @ 1000KB/s looks way better than 1080p @ 500KB/s
10 years ago
f6c24009be
[YoutubeDL] Calculate thumbnail IDs automatically
10 years ago
d862042301
[aftonbladet] Modernize
10 years ago
23d9ded655
[franceculture] Rewrite for new HTML scheme ( Fixes #4853 )
10 years ago
4c1a017e69
release 2015.02.03
10 years ago
Sergey M․