7d740e7dc7
[23video] Relax _VALID_URL ( #26870 )
4 years ago
4eda10499e
[utils] Don't attempt to coerce JS strings to numbers in js_to_json ( #26851 )
...
The current logic in `js_to_json` tries to rewrite octal/hex numbers to
decimal. However, when the logic actually happens the `"` or `'` have
already been trimmed off. This causes what were originally strings, that
happen to look like octal/hex numbers, to get rewritten to decimal and
returned as a number rather than a string.
In practive something like:
```js
{
"0x40": "foo",
"040": "bar",
}
```
would get rewritten as:
```json
{
64: "foo",
32: "bar
}
```
This is problematic since this isn't valid JSON as you cannot have
non-string keys.
4 years ago
605535776a
[ustream] Add support for video.ibm.com ( #26894 )
4 years ago
1050e0d09f
[iqiyi] Fix typo ( #26884 )
4 years ago
d65d89183f
[expressen] Add support for di.se ( closes #26670 )
4 years ago
0c92f1e96b
[iprima] Improve video id extraction ( #26507 ) ( closes #26494 )
4 years ago
c5764b3f89
[downloader/http] Properly handle missing message in SSLError ( closes #26646 )
4 years ago
0837992a22
[downloader/http] Fix access to not yet opened stream in retry
4 years ago
b55715934b
release 2020.09.20
4 years ago
1ca5f821c8
[redtube] Extend _VALID_URL ( #26506 )
4 years ago
defc820b70
[twitch] Switch streams to GraphQL and refactor ( closes #26535 )
4 years ago
82ef02e936
[telequebec] Fix issues ( closes #26368 )
4 years ago
b856b3997c
[telequebec] Add support for brightcove videos ( closes #25833 )
4 years ago
cd85a1bb8b
[pornhub] Extract metadata from JSON-LD ( closes #26614 )
4 years ago
ce5b904050
[extractor/common] Relax interaction count extraction in _json_ld
4 years ago
ad06b99dd4
[extractor/common] Extract author as uploader for VideoObject in _json_ld
4 years ago
540b9f5164
[pornhub] Fix view count extraction ( #26621 ) (refs #26614 )
4 years ago
6e65a2a67e
[downloader/hls] Fix incorrect end byte in Range HTTP header for media segments with EXT-X-BYTERANGE ( #24512 ) ( closes #14748 )
...
The end of the byte range is the first byte that is NOT part of the to
be downloaded range. So don't include it into the requested HTTP
download range, as this additional byte leads to a broken TS packet and
subsequently to e.g. visible video corruption.
Fixes #14748 .
4 years ago
f8c7bed133
[extractor/common] Handle ssl.CertificateError in _request_webpage ( closes #26601 )
...
ssl.CertificateError is raised on some python versions <= 3.7.x
4 years ago
cdc55e666f
[downloader/http] Improve timeout detection when reading block of data (refs #10935 )
4 years ago
86b7c00adc
[downloader/http] Retry download when urlopen times out ( #26603 ) (refs #10935 )
4 years ago
e8c5d40bc8
release 2020.09.14
4 years ago
bff857a8af
[postprocessor/embedthumbnail] Fix issues ( closes #25717 )
...
* Fix WebP with wrong extension processing
* Fix embedding of thumbnails with % character in path
4 years ago
a31a022efd
[postprocessor/embedthumbnail] Add support for non jpeg/png thumbnails ( closes #25687 )
4 years ago
45f6362464
[rtlnl] Extend _VALID_URL for new embed URL schema
4 years ago
97f34a48d7
[rtlnl] Extend _VALID_URL ( #26549 ) ( closes #25821 )
4 years ago
ea74e00b3a
[youtube] Fix empty description extraction ( #26575 ) ( closes #26006 )
4 years ago
06cd4cdb25
[srgssr] Extend _VALID_URL ( closes #26555 , closes #26556 , closes #26578 )
4 years ago
da2069fb22
[googledrive] Use redirect URLs for source format ( closes #18877 , closes #23919 , closes #24689 , closes #26565 )
4 years ago
95c9810015
[svtplay] Fix id extraction ( closes #26576 )
4 years ago
b03eebdb6a
[redbulltv] improve support for rebull.com TV localized URLS( #22063 )
4 years ago
1f7675451c
[redbulltv] Add support for new redbull.com TV URLs( closes #22037 )( closes #22063 )
4 years ago
aa27253556
[soundcloud] Reduce pagination limit to fix 502 Bad Gateway errors when listing a user's tracks. ( #26557 )
...
Per the documentation here https://developers.soundcloud.com/blog/offset-pagination-deprecated the maximum limit is 200, so let's respect that (even if a higher value sometimes works).
Co-authored-by: tfvlrue <tfvlrue>
4 years ago
d51e23d9fc
release 2020.09.06
4 years ago
50e9fcc1fd
[nrktv:episode] Improve video id extraction ( closes #25594 , closes #26369 , closes #26409 )
4 years ago
16ee69c1b7
[youtube] Fix age gate content detection ( #26100 ) ( closes #26152 , closes #26311 , closes #26384 )
4 years ago
67171ed7e9
[youtube:user] Extend _VALID_URL ( closes #26443 )
4 years ago
1d9bf655e6
[utils] Recognize wav mimetype ( closes #26463 )
4 years ago
62ae19ff76
[xhamster] Improve initials regex ( #26526 ) ( closes #26353 )
4 years ago
5ed05f26ad
[svtplay] Fix svt id extraction ( closes #26425 , closes #26428 , closes #26438 )
4 years ago
841b683804
[twitch] Rework extractors ( closes #12297 , closes #20414 , closes #20604 , closes #21811 , closes #21812 , closes #22979 , closes #24263 , closes #25010 , closes #25553 , closes #25606 )
...
* Switch to GraphQL.
+ Add support for collections.
+ Add support for clips and collections playlists.
4 years ago
f5863a3ea0
[biqle] improve video_ext extraction
4 years ago
10709fc7c6
[xhamster] Extend _VALID_URL ( closes #25927 )
4 years ago
a7e348556a
[xhamster] Fix extraction ( closes #26157 ) ( #26254 )
4 years ago
6cb30ea5ed
[xhamster] Extend _VALID_URL ( closes #25789 ) ( #25804 )
4 years ago
a4ed50bb84
release 2020.07.28
4 years ago
e450f6cb63
[youtube] Fix sigfunc name extraction ( closes #26134 , closes #26135 , closes #26136 , closes #26137 )
4 years ago
a115e07594
[youtube] Improve description extraction ( closes #25937 ) ( #25980 )
4 years ago
718393c632
[wistia] Restrict embed regex ( closes #25969 )
4 years ago
07af16b92e
[youtube] Prevent excess HTTP 301 ( #25786 )
4 years ago
e942cfd1a7
[youtube:playlists] Extend _VALID_URL ( closes #25810 )
4 years ago
9a7e5cb88a
[bellmedia] add support for cp24.com clip URLs( closes #25764 )
4 years ago
2391941f28
[brightcove] Improve embed detection ( closes #25674 )
4 years ago
9ff6165a81
release 2020.06.16.1
4 years ago
ee0b726cd7
[youtube] Force old layout ( closes #25682 , closes #25683 , closes #25680 , closes #25686 )
4 years ago
dbeafce5d5
[youtube] Fix categories and improve tags extraction
4 years ago
ed604ce7bc
release 2020.06.16
4 years ago
a6211d237b
[youtube] Fix uploader id and uploader URL extraction
4 years ago
7b16239a49
[youtube] Improve view count extraction
4 years ago
37357d21a9
[youtube] Fix upload date extraction
4 years ago
b477fc1314
[youtube] Fix thumbnails extraction and remove uploader id extraction warning ( closes #25676 )
4 years ago
d84b21b427
[youtube] Fix playlist and feed extraction ( closes #25675 )
4 years ago
48bd042ce7
[facebook] Support single-video ID links
...
I stumbled upon this at https://www.facebook.com/bwfbadminton/posts/10157127020046316 . No idea how prevalent it is yet.
4 years ago
84213ea8d4
[youtube] Extract chapters from JSON ( closes #24819 )
5 years ago
562de77f41
[kaltura] Add support for multiple embeds on a webpage ( closes #25523 )
5 years ago
e1723c4bac
release 2020.06.06
5 years ago
a5b6102ea8
[tele5] Bypass geo restriction
5 years ago
b77888228d
[jwplatform] Add support for bypass geo restriction
5 years ago
0b1eaec3bc
[tele5] Prefer jwplatform over nexx ( closes #25533 )
5 years ago
b37e47a3f9
[twitch:stream] Expect 400 and 410 HTTP errors from API
5 years ago
ce3735df02
[twitch:stream] Fix extraction ( closes #25528 )
5 years ago
a0455d0ffd
[twitch] Pass v5 accept header and fix thumbnails extraction ( closes #25531 )
5 years ago
c8b232cc48
[brightcove] Sort imports
5 years ago
b4eb0bc7bd
[brightcove] Fix subtitles extraction ( closes #25540 )
5 years ago
d5147b65ac
[malltv] Add support for sk.mall.tv ( #25445 )
5 years ago
7b0b53ea69
[twitter:broadcast] Add untitled periscope broadcast test
5 years ago
7016e24ebe
[periscope] Fix untitled broadcasts ( #25482 )
5 years ago
bef4688c72
[jwplatform] Improve embeds extraction ( closes #25467 )
5 years ago
228c1d685b
release 2020.05.29
5 years ago
fe515e5c75
[ard:beta] Extend _VALID_URL ( closes #25405 )
5 years ago
1db5ab6b34
[youtube] Add support for more invidious instances ( #25417 )
5 years ago
2791e80b60
[postprocessor/ffmpeg] Embed series metadata with --add-metadata
5 years ago
8f841fafcd
[giantbomb] Extend _VALID_URL ( #25222 )
5 years ago
a54c5f83c0
[ard] Improve _VALID_URL ( closes #25134 ) ( #25198 )
5 years ago
cd13343ad8
[redtube] Improve formats extraction and extract m3u8 formats ( closes #25311 , closes #25321 )
5 years ago
9cd5f54e31
[utils] Fix file permissions in write_json_file ( closes #12471 ) ( #25122 )
5 years ago
9a269547f2
[indavideo] Switch to HTTPS for API request ( #25191 )
5 years ago
bf097a5077
[redtube] Improve title extraction ( #25208 )
5 years ago
52c50a10af
[vimeo] improve format extraction and sorting( closes #25285 )
5 years ago
b334732709
[soundcloud] reduce API playlist page limit( closes #25274 )
5 years ago
384bf91f88
[youtube] Add support for yewtu.be ( #25226 )
5 years ago
adc13b0748
[mailru] Fix extraction ( closes #24530 ) ( #25239 )
5 years ago
327593257c
[bbccouk] PEP8
5 years ago
9d8f3a12a6
[spike] fix Bellator mgid extraction( closes #25195 )
5 years ago
b002bc433a
release 2020.05.08
5 years ago
fa3db38333
[youtube] Improve signature cipher extraction ( closes #25188 )
5 years ago
30fa5c6087
[iprima] Improve extraction ( closes #25138 )
5 years ago
6c907eb33f
[downloader/http] Request last data block of exact remaining size
...
Always request last data block of exact size remaining to download if possible not the current block size.
5 years ago
f7b42518dc
[downloader/http] Finish downloading once received data length matches expected
...
Always do this if possible, i.e. if Content-Length or expected length is known, not only in test.
This will save unnecessary last extra loop trying to read 0 bytes.
5 years ago
ce7db64bf1
[uol] fix extraction( closes #22007 )
5 years ago
Hannu Hartikainen