77b2986b5b
[extractor/common] Recognize Indian censorship ( #5021 )
10 years ago
62b013df0d
[vimeo] Encode password before hash calculation
10 years ago
fad6768bd1
[vimeo] Fix password protected videos ( Closes #5001 )
10 years ago
3da0db62e6
[escapist] Fix extraction ( fixes #5017 )
10 years ago
e14ced7918
Merge branch 'master' of github.com:rg3/youtube-dl
10 years ago
a461a11989
[ted] Improve external video handling and add test
10 years ago
1bd838608f
prefer 'code' to 'uri' if present
10 years ago
365577f567
[chirbit] add profile extractor.
10 years ago
50efb383f0
[tv4] Add new extractor ( Closes #4839 ) ( Closes #2103 )
10 years ago
5da6bd0083
[chirbit] Add new extractor.
10 years ago
5e9a033e6e
[imgur] Allow alternative values
...
Every now and then, imgur.com goes crazy and gives us a generic title and description (otherwise it looks all fine though).
Simply update the test case to allow for that craziness.
10 years ago
fb7cb6823e
Remove the SubtitlesInfoExtractor class
...
No longer needed
10 years ago
dd0a58f5f0
[blinkx] Fix extraction
10 years ago
6140baf4e1
[nationalgeographic] Add extractor ( closes #4960 )
10 years ago
8fc642eb5b
[pornhub] Fix uploader regex
10 years ago
e66e1a0046
[pornhub] Add support for playlists ( Closes #4995 )
10 years ago
d5c69f1da4
[5min] Cover joystiq.com URLs ( Closes #4962 )
10 years ago
f13b1e7d7f
[bbccouk] Convert to new subtitles system
...
I haven't found any video available outside the UK, so I haven't added tests.
I have updated how the srt file is build, because (at least for www.bbc.co.uk/programmes/p02j9b69) the subtitles is inside 'span' elements.
10 years ago
5c8a3f862a
[nbc] Use a test video that works outside the US
10 years ago
8807f1277f
[theplatform] Convert to new subtitles system
10 years ago
a3b9157f49
[cbssports] Add extractor ( closes #4996 )
10 years ago
b88ba05356
[imgur] Simplify
10 years ago
b74d505577
Merge remote-tracking branch 'jbboehr/imgur-gifv-improvements'
10 years ago
9e2d7dca87
[imgur] improve error check for non-video URLs
10 years ago
d236b37ac9
[imgur] improve regex #4998
10 years ago
e880c66bd8
[theonion] Modernize
10 years ago
1a13940c8d
[imgur] support regular URL
10 years ago
3d54788495
[webofstories] Fix extraction
10 years ago
71d53ace2f
[sockshare] Do not require thumbnail anymore
...
Thumbnail is not present on the website anymore.
10 years ago
f37e3f99f0
[generic] Correct test case
...
Video has been reuploaded / edited
10 years ago
bd03ffc16e
[netzkino] Skip download in test case
...
Works fine from Germany, but fails from everywhere else
10 years ago
3bf5705316
[imgur] Add new extractor
10 years ago
1c2528c8a3
[cbs] Modernize
10 years ago
6b961a85fd
[patreon] Add support for embedlies ( fixes #4969 )
10 years ago
7707004043
[patreon] Modernize
10 years ago
c460bdd56b
[sandia] Add new extractor ( #4974 )
10 years ago
93a16ba238
[vimeo] Raise the ExtractorError with expected=True when no video password is given
10 years ago
4f7cea6c53
[viki] Convert to new subtitles system
10 years ago
afbdd3acc3
[rai] Convert to new subtitles system
10 years ago
85d5866177
[yahoo] Remove md5sum from test case
...
The md5 sum has changed repeatedly, and we check whether it looks like a video anyways nowadays.
10 years ago
9789d7535d
[xtube] Fix test case
10 years ago
d8443cd3f7
[wsj] Correct test case
10 years ago
d47c26e168
[brightcove] Correct keys in playlists
10 years ago
01561da142
[nrk] Convert to new subtitles system
10 years ago
0af25f784b
[mtv] Convert to new subtitles system
10 years ago
b9b42f2ea0
[npo] Convert to new subtitles system
10 years ago
311c393838
[lynda] Convert to new subtitles system
10 years ago
18c1c42405
[drtv] Convert to new subtitles system
10 years ago
37dd5d4629
[mit] Don't set the subtitles field
...
YouTube already provides them in more formats
10 years ago
785521bf4f
[youtube] Remove useless if
10 years ago
6d1a55a521
[youtube] Show entire player URL when -v is given
10 years ago
11e611a7fa
Extend various playlist tests
10 years ago
72c1f8de06
[bandcamp:album] Fix extractor results and associated test
10 years ago
6e99868e4c
[buzzfeed] Fix playlist test case
10 years ago
4d278fde64
[ign] Amend playlist test
10 years ago
1def5f359e
[livestream] Correct playlist ID and add a test for it
10 years ago
15ec669374
[vk] Amend playlist test
10 years ago
a3fa5da496
[vimeo] Amend playlist tests
10 years ago
30965ac66a
[vimeo] Prevent infinite loops if video password verification fails
...
We're seeing this in the tests¹ right now, which do not terminate.
¹ https://travis-ci.org/jaimeMF/youtube-dl/jobs/51135858
10 years ago
9868ea4936
[extractor/common] Simplify subtitles handling methods
...
Initially I was going to use a single method for handling both subtitles and automatic captions, that's why I used the 'list_subtitles' and the 'subtitles' variables.
10 years ago
85920dd01d
[bliptv] Convert to new subtitles system
10 years ago
fa15607773
PEP8 fixes
10 years ago
98f000409f
[radio.de] Fix extraction
10 years ago
bd7fe0cf66
[walla] Convert to new subtitles system
10 years ago
48246541da
[ceskatelevize] Convert to new subtitles system
10 years ago
4a8d4a53b1
[videolecturesnet] Fix rtmp stream glitches ( Closes #4968 )
10 years ago
4cd95bcbc3
[twitch:stream] Prefer the 'source' format ( fixes #4972 )
10 years ago
0d93378887
[videolecturesnet] Check http format URLs ( Closes #4968 )
10 years ago
4069766c52
[extractor/common] Test URLs with GET
10 years ago
360e1ca5cc
[youtube] Convert to new subtitles system
...
The automatic captions are stored in the 'automactic_captions' field, which is used if no normal subtitles are found for an specific language.
10 years ago
a1f2a06b34
[dailymotion] Convert to new subtitles system
10 years ago
c84dd8a90d
[YoutubeDL] store the subtitles to download in the 'requested_subtitles' field
...
We need to keep the orginal subtitles information, so that the '--load-info' option can be used to list or select the subtitles again.
We'll also be able to have a separate field for storing the automatic captions info.
10 years ago
65469a7f8b
[vimeo] Convert to new subtitles system
...
Removed some tests, the behaviour should be checked in a test for the YoutubeDL class
10 years ago
6b597516c1
[atresplayer] Convert to new subtitles system
10 years ago
b5857f62e2
[crunchyroll] Convert to new subtitles system
10 years ago
a504ced097
Improve subtitles support
...
For each language the extractor builds a list with the available formats sorted (like for video formats), then YoutubeDL selects one of them using the '--sub-format' option which now allows giving the format preferences (for example 'ass/srt/best').
For each format the 'url' field can be set so that we only download the contents if needed, or if the contents needs to be processed (like in crunchyroll) the 'data' field can be used.
The reasons for this change are:
* We weren't checking that the format given with '--sub-format' was available, checking it in each extractor would be repetitive.
* It allows to easily support giving a format preference.
* The subtitles were automatically downloaded in the extractor, but I think that if you use for example the '--dump-json' option you want to finish as fast as possible.
Currently only the ted extractor has been updated, but the old system still works.
10 years ago
59b8ab5834
[rtlnl|generic] Add support for rtl.nl embeds ( Fixes #4959 )
10 years ago
85e80f71cd
[yam] Allow faults in optional fields ( #4943 )
10 years ago
bfa6bdcd8b
Merge remote-tracking branch 'yan12125/IE_Yam'
10 years ago
03cd72b007
[extractor/common] Move up filesize
...
filesize and tbr should correlate, so it doesn't make sense to treat them differently.
10 years ago
f813928e4b
[bbccouk] Fix fallback to legacy playlist
10 years ago
b9c7a97318
[history] Add extractor ( Closes #4934 )
10 years ago
9fb2f1cd6d
[theplatform] Add URL sign capability
10 years ago
6ca7732d5e
[extractor/common] Fix link to external documentation
10 years ago
b0ab0fac49
Remove unused imports
10 years ago
a294bce82f
[streamcz] Fix extraction ( Closes #4940 )
10 years ago
76d1466b08
[drtuber] Add one more title regex
10 years ago
1888d3f7b3
Merge pull request #4951 from peugeot/beeg
...
[beeg] fix test
10 years ago
c2787701cc
Merge pull request #4950 from peugeot/drtuber
...
[drtuber] fix extraction
10 years ago
52e1d0ccc4
[beeg] fix test
10 years ago
10e3c4c221
[drtuber] fix extraction
10 years ago
68f2d273bf
[sunporno] Keep old video regex just in case
10 years ago
ae1580d790
[sunporno] fix extraction
10 years ago
a4f3d779db
[nbcnews] Simplify
10 years ago
d9aa2b784d
Support NBC Nightly News broadcasts
10 years ago
9347fddbfc
[1tv] Cover arbitraty URLs
10 years ago
037e9437e4
[camdemy] Fix _VALID_URL
10 years ago
ae6423d704
[bambuser] Fix 'uploader_id' extraction ( fixes #4944 )
10 years ago
7105440cec
[Yam] Add new extractor
10 years ago
171ca612af
[npo:radio] Move to extractor to common npo place and add extractor for fragments
10 years ago
c3d64fc1b3
[nporadio] Edit to confirm to flake8 standards
10 years ago
7c24ce225d
[NPORadio] Added extractor for live radio
10 years ago
08b38d5401
[camdemy] Simplify and make more robust ( #4938 )
...
Do not throw errors if view count or upload date extraction fails.
Dispose of re.MULTILINE, which had absolutely no effect without any ^ or $ in sight.
Follow PEP8 naming conventions.
10 years ago
024c53694d
Merge remote-tracking branch 'yan12125/IE_camdemy'
10 years ago
7e6011101f
[camdemy] Python2 compatibility
10 years ago
c40feaba77
[camdemy] Add support for folders
10 years ago
2d30521ab9
[youtube] Extract average rating ( closes #2362 )
10 years ago
124f3bc67d
[dotsub] Fix extraction and modernize
10 years ago
8367d3f3cb
[camdemy] Detection of external sources
10 years ago
c56d7d899d
[dctptv] Skip rtmp download
10 years ago
ea5db8469e
[canalplus] Add support for itele.fr URLs ( Closes #4931 )
10 years ago
3811c567e7
[teamcoco] Fix video id extraction
10 years ago
8708d76425
[camdemy] Add new extractor
...
Single file download done, while folder extaction in plan
10 years ago
054fe3cc40
[ntvru] Adapt to new direct delivery and modernize ( Closes #4918 )
10 years ago
9650885be9
[escapist] Filter video differently ( Fixes #4919 )
10 years ago
596ac6e31f
[escapist] Modernize
10 years ago
8f84f57183
[ccc] Add new extractor ( Fixes #4890 )
10 years ago
c0e1a415fd
[firstpost] Modernize
10 years ago
bf8f082a90
[vimeo:album] Add support for album passwords ( Fixes #4917 )
10 years ago
7e5db8c930
[options] Add --no-color
10 years ago
f7a211dcc8
[pornhd] Fix extraction ( fixes #4915 )
10 years ago
c73fae1e2e
[commonmistakes] Detect BOMs at the beginning of URLs
...
Reported at https://bugzilla.redhat.com/show_bug.cgi?id=1093517 .
10 years ago
834bf069d2
[bandcamp] Correct variable name
10 years ago
753fad4adc
[commonmistakes] Correct logic error
10 years ago
3a5bcd0326
[extractor/common] Wrap extractor errors ( Fixes #1194 )
...
For now, we just wrap some common errors. More may follow. We do not want to catch actual programming errors in the extractors, such as 1 // 0.
10 years ago
99c2398bc6
[bandcamp] Use our API to get more stable error messages ( #1194 )
10 years ago
28f1272870
[svtplay] Correct test case
10 years ago
c4c5dc27cb
Merge branch 'master' of github.com:rg3/youtube-dl
10 years ago
2caf182f37
[trilulilu] Add support for videos without category in the URL ( Closes #4067 )
...
Also, update the testcase, detect private/country restricted videos and modernize a bit.
10 years ago
1309b396d0
[svtplay] Add new extractor ( Fixes #4914 )
10 years ago
ba61796458
[youtube] Don't override format info from the dash manifest ( fixes #4911 )
10 years ago
e98b8e79ea
[generic] Improve SBS detection ( Fixes #4899 )
10 years ago
5269028951
[rtlnow] Add test for @mmue's extension ( #4908 )
10 years ago
f7bc056b5a
Merge remote-tracking branch 'mmue/fix-rtlnow'
10 years ago
a0f7198544
[generic] Add support for jwPlayer YouTube videos
...
This makes nationalarchives.gov.uk work (Fixes #4907 , fixes #4876 )
10 years ago
bdb186f3b0
fix rtlnow for newer series like "Der Bachelor" season 5
10 years ago
41c23b0da5
[gamekings] Support videos from news pages
10 years ago
d87ec897e9
[gamekings] Improve extraction
10 years ago
3bd4bffb1c
Merge branch 'gamekings' of https://github.com/robin007bond/youtube-dl into robin007bond-gamekings
10 years ago
c36b09a502
[Gamekings] Use thumbnail in return statement
10 years ago
641eb10d34
Use _family_friendly_search for determining age_limit
10 years ago
955c5505e7
[Gamekings] Use xpath
...
XPath is used for extracting the video url and the thumbnail
10 years ago
69319969de
[extractor/common] Add new helper method _family_friendly_search
10 years ago
a14292e848
[soulanime] Remove extractor ( #4554 )
...
Was supposed to be deleted by 67c2bcd
10 years ago
5d678df64a
[Gamekings] Download playlist
...
Todo: URL and Thumbnail should be extracted with XPath
10 years ago
8ca8cbe2bd
[Gamekings] Check string for vimeo, fix test
...
The test now doesn't fail anymore. It just checks the string for having
"vimeo" in it, instead of using the method for URL-checking, since it's
returns an error.
The tests don't fail, and the extractor works fine now.
10 years ago
ba322d8209
[Gamekings] Added test and replaced video_url
...
Quick and dirty fix for the Gamekings extractor. It gives an error about
the video_url, but it downloads it now instead of giving a 404 error on
newer Gamekings videos
10 years ago
2f38289b79
[Gamekings] Fix order of replacement string
...
Oops.
10 years ago
f23a3ca699
[Gamekings] Fixed typo in URL replacement
10 years ago
77d2b106cc
[Gamekings] Fix 404 when large isn't available
...
When trying to download some GameKings videos, not all worked. This was
because not all videos had a "/large"-URL available. The extractor
checks now if the /large URL is available, if it isn't, it tries to get
the normal URL.
10 years ago
c0e46412e9
[aparat] Fix extraction ( Closes #4897 )
10 years ago
ad5747bad1
[rtp] Construct regular HTTP download URLs ( #4882 )
10 years ago
d6eb66ed3c
[aftenposten] Add extractor ( Closes #4863 )
10 years ago
7f2a9f1b49
[tvigle] Add support for cloud URLs ( Closes #4887 )
10 years ago
1e1896f2de
[extractor/common] Correct sort order.
...
We should look at height and width before ext_preference.
10 years ago
1a2548d9e9
[rtp] Pass --realtime to rtmpdump ( Fixes #4882 )
...
A workaround for video jumping back in time.
10 years ago
3900eec27c
[extractor/common] Fix 2.0 manifest extraction ( Closes #4830 )
10 years ago
9c91a8fa70
[tweakers] Switch extraction to xspf playlist, extract all formats and meta ( #4881 )
10 years ago
41469f335e
Merge branch 'tweakers' of https://github.com/robin007bond/youtube-dl into robin007bond-tweakers
10 years ago
67ce4f8820
Use match_id method instead of splitted URL
10 years ago
bc63d56cca
Remove unnecessary TODO-comments
10 years ago
c893d70805
Remove player-url in tweakers.py
...
Player-url only needed for rmftp, not for regular URLs
10 years ago
3ee6e02564
Edit Tweakers extractor
...
Fixed code conventions (mainly adding two or more spaces before making
an inline comment)
10 years ago
e3aaace400
[tweakers] Add new extractor
10 years ago
f13b88c616
[rts] Fix f4m and m3u8 extraction ( Closes #4873 )
10 years ago
60ca389c64
[extractor/common] Prefix f4m/m3u8 entries with identifier
10 years ago
9e91449c8d
[npo] Fix subtitles ( Closes #3638 )
10 years ago
25e5ebf382
Add NPO.nl subtitles
...
Implements #3638
10 years ago
58ba6c0160
[mixcloud] Fix extraction ( Closes #4862 )
10 years ago
f076b63821
[generic/ooyala] Add support for Ooyala embeds on SBN network websites ( Fixes #4859 )
10 years ago
9bb8e0a3f9
[wsj] Add new extractor ( Fixes #4854 )
10 years ago
1a6373ef39
[sort_formats] Prefer bitrate over video size
...
720p @ 1000KB/s looks way better than 1080p @ 500KB/s
10 years ago
d862042301
[aftonbladet] Modernize
10 years ago
23d9ded655
[franceculture] Rewrite for new HTML scheme ( Fixes #4853 )
10 years ago
c1147c05e1
[brightcove] Fix up more generically invalid XML ( Fixes #4849 )
10 years ago
a465808592
Merge branch 'master' of github.com:rg3/youtube-dl
10 years ago
5c4862bad4
[normalboots] Remove unused import
10 years ago
995029a142
[nerdist] Add new extractor ( Fixes #4851 )
10 years ago
a57b562cff
[nfl] Add support for articles pages ( fixes #4848 )
10 years ago
531572578e
[normalboots] Modernize
10 years ago
7d3d06a16c
[vevo] Restore SMIL support ( #3656 )
10 years ago
f920ce295e
[ntvru] Remove unused import
10 years ago
7a7bd19c45
[n-tv.de] Use native m3u8 as best format
10 years ago
8f4b58d70e
[ntvde] Add new extractor ( Fixes #4850 )
10 years ago
3fd45e03bf
[ntvru] Rename from NTV to clarify the difference between n-tv.de and ntv.ru
10 years ago
78271e3319
[drtv] Extract material id ( Closes #4814 )
10 years ago
92bf0bcdf8
[historicfilms] Add extractor ( Closes #4825 )
10 years ago
c6df692466
[rutv] Extract all m3u8 formats
10 years ago
acf757f42e
[youtube] Complete test definition
10 years ago
dd8982f19c
[wdr] Complete test definition
10 years ago
654bd52f58
[teletask] Fix test definition
10 years ago
a9551e9020
[soundcloud:set] Fix test definition
10 years ago
c172440ac5
[ringtv] Modernize test definition
10 years ago
e332772531
[servingsys] Modernize
10 years ago
437cac8cc1
[sina] Modernize and simplify
10 years ago
9f281cacd2
[keezmovies] Fix extraction and modernize test
10 years ago
748a0fab8a
Remove unused imports
10 years ago
c1f06d6307
[macgamestore] Modernize
10 years ago
c4e817ce4a
[france2.fr:generation-quoi] Modernize
10 years ago
9a3e5e6955
[kankan] Modernize
10 years ago
228d30ed06
[la7] Modernize
10 years ago
057c0609fc
[toutv] Modernize test definition
10 years ago
17d2712d9c
[teamcoco] Modernize and fix extraction
10 years ago
fc09240e24
[vimeo] Modernize test definition
10 years ago
146303136f
[nerdcubed] Modernize test definition
10 years ago
96aded8d3d
[rottentomatoes] Modernize test definition
10 years ago
2886be15aa
[defense] Modernize
10 years ago
ca0f500ecf
[mtv] Modernize and clean up test
10 years ago
29aef5a33c
[ard] Remove deleted video test case
10 years ago
9158b2b301
[mpora] Modernize
10 years ago
8c72beb25e
[globo] Properly extract m3u8 formats ( #4346 #4832 )
10 years ago
1ee94db2d0
[globo] Fix error on some globo videos
10 years ago
e41b1f7385
Fix flake8 errors
10 years ago
cd596028d6
[rtve] Recognize mobile urls ( fixes #4823 )
10 years ago
cc57bd33a8
[rtve] Fix extraction
...
Skip live stream test, we can't use the f4m manifest yet
10 years ago
91755ee384
[comedycentral:shows] Generate better IDs and add a test for that
10 years ago
0692ef86ef
[bbccouk] Improve _VALID_URL
10 years ago
439d9be27d
[mixcloud] Remove unused import
10 years ago
b80505a409
[mixcloud] Fix extraction ( Closes #4784 )
10 years ago
e4c17d7274
[nhl:news] Add extractor ( Closes #4805 )
10 years ago
2c58674e0e
[nhl] Improve _VALID_URL ( #4805 )
10 years ago
ef1269fb07
[drtv] Improve _VALID_URL ( #4814 )
10 years ago
e525d9a3df
[mtv] Extract subtitles ( Closes #4811 )
10 years ago
20b4492c71
[spike] Improve _VALID_URL
10 years ago
dee3f73787
[spike] Modernize
10 years ago
01c46659c4
[washingtonpost] Catch more UUIDs
10 years ago
b04b885271
[extractor/common] Document all protocol values
10 years ago
70fca8d694
[youtube] Remove unused import
10 years ago
a52c633536
[cinchcast] Wrap overly long lines ( #4820 )
10 years ago
749f2ca044
Smotri info extractor: removed unreachable code and updated old md5 for test video
10 years ago
5468ff4d91
Remove duplicate dictionary keys
10 years ago
1d2daaea63
Simplify list creation
10 years ago
52585fd6dc
The opening curly brace `{` is a regex reserved [control character]( http://stackoverflow.com/a/400316/1106367 ), so it needs to be escaped.
10 years ago
6449cd807e
[youtube] Fall back to embed webpage when content is blocked on main ( Fixes #4717 )
10 years ago
c1708b89c0
[youtube:truncated_url] Add hl= forms ( #4799 )
10 years ago
83fddfd493
[dctp] PEP8
10 years ago
6ebb0dca9f
[dctp] Improve output ( #4796 )
10 years ago
cf8d6ec865
Merge remote-tracking branch 'bastik/dev-dctp'
10 years ago
3198291f26
[ctsnews] Remove unused import
10 years ago
02c1d5e285
Merge remote-tracking branch 'yan12125/IE_NextMedia'
10 years ago
ec4161a57d
[ctsnews] Remove news count check ( #4802 )
...
That's the number of articles (or at least some constant value); view count is the number of views of the video!
Also add a better description so that we can distinguish the two downloads.
10 years ago
03d2d6d51b
Merge remote-tracking branch 'yan12125/IE_CtsNews'
10 years ago
4fe8495a23
[viddler] PEP8
10 years ago
7bb3ceb4c7
[dctp] prefix real_time parameter with rtmp_
10 years ago
75a4fc5b72
[dctp] fix test
10 years ago
87673cd438
[dctp] follow id conventions
10 years ago
f345fe9db7
[dctp] fix python 2.6 compatibility
10 years ago
e683a48d0e
[ctsnews] Detect youtube embedde videos
10 years ago
219337990b
[xuite] Fix _VALID_URL
10 years ago
376a770cc4
Merge pull request #4809 from bastik/fix-sr
...
fix srmediathek description
10 years ago
Philipp Hagemeister