Commit Graph

15764 Commits (ab9001dab50db90f6470fcaf2189bcd2cfc0c370)

Author SHA1 Message Date
Remita Amine 5e95e18ce9 [nrk] improve format extraction and geo-restriction detection (closes #24221) 4 years ago
Sergey M․ e91df0c550
[pornhub] Handle HTTP errors gracefully (closes #26414) 4 years ago
Sergey M․ c5636e9bca
[nrktv] Relax _VALID_URL (closes #27299, closes #26185) 4 years ago
Remita Amine 2e47264235 [zdf] extract webm formats(closes #26659) 4 years ago
Matthew Rayermann beab2f88c9
[nhk] Add audio clip test to NHK extractor (#27269) 4 years ago
Remita Amine 0025447369 [gamespot] Extract DASH and HTTP formats 4 years ago
Remita Amine da4304609d [extractor/commons] improve Akamai HTTP formats extraction 4 years ago
Remita Amine ea89680aea [tver] correct episode_number key 4 years ago
Remita Amine 664dd8ba85 [extractor/common] improve Akamai HTTP format extraction
- Allow m3u8 manifest without an additional audio format
- Fix extraction for qualities starting with a number
Solution provided by @nixxo based on: https://stackoverflow.com/a/5984688
4 years ago
Remita Amine 64554c12e1 [tver] Add new extractor (closes #26662)(closes #27284) 4 years ago
opusforlife2 4ded9c0f00
[pornhub] Add support for pornhub.org (#27276)
Most ISPs block the other two TLDs through deep packet inspection
4 years ago
Remita Amine c0820dd52a [extractors] Add QubIE import 4 years ago
Sergey M․ 2bb70750a9
release 2020.12.02 4 years ago
Remita Amine 37d979ad33 [tva] Add support for qub.ca (closes #27235) 4 years ago
Remita Amine 95ac4de229 [toggle] Detect DRM protected videos (closes #16479)(closes #20805) 4 years ago
Remita Amine d3e142b3fa [toggle] Add support for new MeWatch URLs (closes #27256) 4 years ago
Sergey M․ 132aece1ed
[youtube:tab] Extract channels only from channels tab (closes #27266) 4 years ago
Sergey M․ 3e4e338133
[cspan] Extract info from jwplayer data (closes #3672, closes #3734, closes #10638, closes #13030, closes #18806, closes #23148, closes #24461, closes #26171, closes #26800, closes #27263) 4 years ago
Roman Beránek be19ae11fd
[cspan] Pass Referer header with format's video URL (#26032) (closes #25729) 4 years ago
Sergey M․ 59d63d8d4a
[youtube] Improve age-gated videos extraction (closes #27259) 4 years ago
Remita Amine cfeba5d17f [mediaset] add support for movie URLs(closes #27240) 4 years ago
Sergey M․ 6da0e5e7a2
[yandexmusic] Refactor and add support for artist's tracks and albums (closes #11887, closes #22284) 4 years ago
Sergey M․ d6ce649f15
[yandexmusic:track] Fix extraction (closes #26449, closes #26669, closes #26747, closes #26748, closes #26762) 4 years ago
Sergey M․ b449b73dcc
release 2020.11.29 4 years ago
Michael Munch 4318170779
[drtv] Extend _VALID_URL (#27243) 4 years ago
Sergey M․ fb626c0586
[tiktok] Fix extraction (closes #20809, closes #22838, closes #22850, closes #25987, closes #26281, closes #26411, closes #26639, closes #26776, closes #27237) 4 years ago
bopol 717d1d2d5a
[ina] Add support for mobile URLs (#27229) 4 years ago
Sergey M․ 9585b376db
[YoutubeDL] Write static debug to stderr and respect quiet for dynamic debug (closes #14579, closes #22593)
TODO: logging and verbosity needs major refactoring (refs #10894)
4 years ago
JChris246 f04cfe24e0
[pornhub] Fix like and dislike count extraction (closes #27227) (#27234) 4 years ago
Sergey M․ 20c50c6556
[youtube] Improve yt initial player response extraction (closes #27216) 4 years ago
Remita Amine f9f9699f2f [videa] improve extraction 4 years ago
Adrian Heine né Lang a3cf22e590
[videa] Adapt to updates (#26301)
closes #25973, closes #25650.
4 years ago
Remita Amine 99de2f38d3 [spreaker] fix SpreakerShowIE test URL 4 years ago
Sergey M․ 9fe50837c3
release 2020.11.26 4 years ago
Sergey M․ 686e898fde
[spreaker] Add extractor (closes #13480, closes #13877) 4 years ago
Remita Amine 3a78198a96 [vlive] improve extraction for geo-restricted videos 4 years ago
Remita Amine 836c810716 [vlive] Add support for post URLs(closes #27122)(closes #27123) 4 years ago
Remita Amine 97c5be383c [viki] fix video API request(closes #27184) 4 years ago
Remita Amine a7ea88537a [bbc] fix BBC Three clip extraction 4 years ago
Remita Amine 6c35de4c6b [bbc] fix BBC News videos extraction 4 years ago
Remita Amine 579d43951d [medaltv] improve extraction 4 years ago
Joshua Lochner e24ebeafd1
[medaltv] Add new extractor (#27149) 4 years ago
Remita Amine 01c92973dd [youtube] imporve music metadata and license extraction(closes #26013) 4 years ago
Sergey M․ f4415faa46
[downloader/fragment] Set final file's mtime according to last fragment's Last-Modified header (closes #11718, closes #18384, closes #27138) 4 years ago
Sergey M․ a86ce9d7a1
[nrk] Fix extraction 4 years ago
Sergey M․ 37258c644f
[cda] Fix extraction (closes #17803, closes #24458, closes #24518, closes #26381) 4 years ago
Sergey M․ d0512ac4c5
release 2020.11.24 4 years ago
Sergey M․ 191286265d
[youtube:tab] Fix feeds extraction (closes #25695, closes #26452) 4 years ago
Sergey M․ 3234272818
[youtube:tab] PEP 8 4 years ago
Sergey M․ 9d2c90354f
[youtube:favorites] Restore extractor 4 years ago
Sergey M․ 316b10855a
[youtube:tab] Fix some weird typo (closes #27157) 4 years ago
Remita Amine 484fe78737 [pinterest] Add support for large collections(more than 25 pins) 4 years ago
Remita Amine 2cd43a00d1 [franceinter] flake8 4 years ago
renalid dd0f524c69
[franceinter] add thumbnail url (#27153)
Co-authored-by: remitamine <remitamine@gmail.com>
4 years ago
Remita Amine c84f9475b8 [box] Add new extractor(#5949) 4 years ago
Jia Rong Yee 15f2734791
[nytimes] Add new cooking.nytimes.com extractor (#27143)
* [nytimes] support cooking.nytimes.com, resolves #27112

Co-authored-by: remitamine <remitamine@gmail.com>
4 years ago
Remita Amine cb6e24f946 [lbry] relax _VALID_URL regex(closes #27144) 4 years ago
Remita Amine 9d531aa291 [rumble] add support for embed pages(#10785) 4 years ago
Remita Amine e9cbb98a0f [skyit] add support for multiple Sky Italia websites(closes #26629) 4 years ago
Remita Amine 193422e12a [extractor/common] add generic support for akamai http format extraction 4 years ago
Sergey M․ c4cabf040e
[pinterest] Add extractor (closes #25747) 4 years ago
Sergey M․ f23eceebbf
release 2020.11.21.1 4 years ago
Sergey M․ 5d8cb4367d
release 2020.11.21 4 years ago
Sergey M․ 82abc13aed
[youtube:tab] Comment out test 4 years ago
Sergey M․ 1e72660c9b
[svtplay] Fix test title 4 years ago
Sergey M․ 049f224248
[svtplay] Add support for svt.se/barnkanalen (closes #24817) 4 years ago
Mattias Wadman 0ada1b90b8
[svt] Extract timestamp and thumbnail in more cases (#27130)
Add timestamp, set to "valid from" which i think could been seen as publish time.
Add thumbnail in more cases, seems to was only done in the embedded data case for some reason.
Switch svtplay test url to an existing video and also one with no expire date.
Also add an additional thumbnail url test regex.
4 years ago
Josh Soref 71ddc222ad
Fix typos (#27084)
* spelling: authorization

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: brightcove

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: creation

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: exceeded

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: exception

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: extension

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: extracting

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: extraction

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: frontline

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: improve

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: length

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: listsubtitles

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: multimedia

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: obfuscated

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: partitioning

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: playlist

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: playlists

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: restriction

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: services

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: split

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: srmediathek

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: support

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: thumbnail

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: verification

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>

* spelling: whitespaces

Signed-off-by: Josh Soref <jsoref@users.noreply.github.com>
4 years ago
Daniel Peukert 21292c0649
[youtube] Fix error reason extraction (#27081) 4 years ago
Sergey M․ 46a265a2da
[youtube] Fix like and dislike count extraction (closes #25977) 4 years ago
Sergey M․ e2096776b9
[youtube:tab] Add support for current video and fix lives extraction (closes #27126) 4 years ago
Remita Amine a1c88c4819 [infoq] fix format extraction(closes #25984) 4 years ago
renalid 51ca93d751
[francetv] Update to fix thumbnail URL issue (#27120)
Fix the thumbnail URL. The issue was here for many years, never fixed. It's done ! :-)

Example : https://www.france.tv/france-2/de-gaulle-l-eclat-et-le-secret/de-gaulle-l-eclat-et-le-secret-saison-1/2035247-solitude.html

failed thumbnail url generated : http://pluzz.francetv.fr/staticftv/ref_emissions/2020-11-02/EMI_1104da66f533cc7dc5d0d07a181a18c2e2fe1d81_20201014122553940.jpg

right thumbnail url fixed : https://sivideo.webservices.francetelevisions.fr/staticftv/ref_emissions/2020-11-02/EMI_1104da66f533cc7dc5d0d07a181a18c2e2fe1d81_20201014122553940.jpg
4 years ago
Sergey M․ a7e0531999
[downloader/http] Fix crash during urlopen caused by missing reason of URLError 4 years ago
Sergey M․ ab0eda99e1
[YoutubeDL] Fix --ignore-errors for playlists with generator-based entries of url_transparent (closes #27064) 4 years ago
Sergey M․ ec99f47108
[youtube:tab] Replace some test URLs with RIAA-friendly ones 4 years ago
Sergey M․ b31b5f4434
[youtube] Improve yt initial data extraction (closes #27093) 4 years ago
Remita Amine 86f2fa1590 [discoverynetworks] add support new TLC/DMAX URLs(closes #27100) 4 years ago
Remita Amine 7bc7fbce23 [rai] fix protocol relative relinker URLs(closes #22766) 4 years ago
Remita Amine a78e530c14 [rai] fix unavailable video format detection 4 years ago
Remita Amine af7bb684c0 [rai] improve extraction 4 years ago
Leonardo Taccari dd9e0f58f3
[rai] Fix extraction for recent raiplay.it updates (#27077)
- Remove first test of RaiPlayIE: it is no longer available
- Make RaiPlayIE extension-agnostic (passing possible `.json' URLs is now
  supported too)
- Adjust RaiPlayLiveIE to recent raiplay.it updates.  Passing it as
  `url_transparent' is no longer supported (there is no longer an accessible
  ContentItem)
- Adjust RaiPlayPlaylistIE to recent raiplay.it updates and instruct it about
  ContentSet-s.
- Update a RaiIE test and remove two tests that are no longer availables

Thanks to @remitamine for the review!
4 years ago
Remita Amine 59e583f7e8 [viki] improve format extraction 4 years ago
beefchop daa25d4142
[viki] fix stream extraction from mpd (#27092)
Co-authored-by: beefchop <beefchop@users.noreply.github.com>
4 years ago
Remita Amine 25a35cb38a [googledrive] fix format extraction(closes #26979) 4 years ago
Remita Amine 2cf8003638 [amara] improve extraction 4 years ago
Joost Verdoorn cf1a8668e8
[Amara] Add new extractor (#20618)
* [Amara] Add new extractor
4 years ago
Remita Amine 2dbb45ae82 [vimeo:album] fix extraction(closes #27079) 4 years ago
Remita Amine 4fe190df70 [mtv] fix mgid extraction(closes #26841) 4 years ago
Sergey M․ 039e715b30
release 2020.11.19 4 years ago
Sergey M․ b1347a5881
[youporn] Fix upload date extraction and make comment count optional (closes #26986) 4 years ago
Sergey M․ 91e954587f
[arte] Rework extractors
* Reimplement embed and playlist extractors to delegate to the single entrypoint artetv extractor
  Beware reluctant download archive extractor keys breakage.
* Improve embeds detection (closes #27057)
- Remove obsolete code
4 years ago
Sergey M․ 9b505185da
[arte] Extract m3u8 formats (closes #27061) 4 years ago
Remita Amine 444a68e0ec [mgtv] fix format extraction(closes #26415) 4 years ago
Sergey M․ c7178f0f7a
[extractor/common] Output error for invalid URLs in _is_valid_url (refs #21400, refs #24151, refs #25617, refs #25618, refs #25586, refs #26068, refs #27072) 4 years ago
Remita Amine 5c3f7014ef [lbry] add support for odysee.com domain(closes #26806) 4 years ago
Remita Amine d65628ef03 [francetv] improve info extraction 4 years ago
gdzx 8a6c5b0806
[francetv] Add fallback video url extraction (#27047)
Fallback on another API endpoint when no video formats are found.

Closes ytdl-org#22561
4 years ago
Sergey M․ 9360936f26
release 2020.11.18 4 years ago
Sergey M․ 2d7a29081c
[spiegel] Fix extraction (closes #24206, closes #24767)
Code picked from PR #24767 since original repo is not available due to takedown.
4 years ago
Sergey M․ 2864179293
[youtube] Improve extraction
+ Add support for --no-playlist (closes #27009)
* Improve playlist and mix extraction (closes #26390, closes #26509, closes #26534, closes #27011)
+ Extract playlist uploader data
* Update tests
4 years ago
Remita Amine 284f8306df [youtube:tab] fix view_count extraction(closes #27051) 4 years ago
Remita Amine aa613ef7e1 [malltv] fix extraction(closes #27035) 4 years ago
Remita Amine cb2b9a22a5 [bandcamp] extract playlist_description(closes #22684) 4 years ago
Remita Amine 5b867c15a8 [urplay] fix extraction(closes #26828) 4 years ago
Sergey M․ f8c749f12c
[youtube:tab] Fix playlist title extraction (closes #27015) 4 years ago
Sergey M․ 7d509c613b
[youtube] Fix chapters extraction (closes #26005) 4 years ago
Sergey M․ b92e95aa01
release 2020.11.17 4 years ago
Sergey M․ 6699b6ce41
[youtube:tab] Fix extraction with cookies provided (closes #27005) 4 years ago
Remita Amine 91dcde8a38 [lrt] fix extraction with empty tags(closes #20264) 4 years ago
Sergey M․ 11f3471c4b
[ndr:embed:base] Extract subtitles (closes #25447, closes #26106) 4 years ago
Sergey M․ f4093b34f6
[servus] Add support for pm-wissen.com (closes #25869) 4 years ago
Sergey M․ a80b23c373
[servus] Fix extraction (closes #26872, closes #26967, closes #26983, closes #27000) 4 years ago
Sergey M․ 2e7fa18bb9
[xtube] Fix extraction (closes #26996) 4 years ago
Sergey M․ fe07e788bf
[utils] Skip ! prefixed code in js_to_json 4 years ago
Remita Amine 6d3bdcf217 [lrt] fix extraction 4 years ago
Remita Amine ec2a2ab441 [lbry] Add new extractor 4 years ago
Remita Amine 9448a20312 [condenast] fix extraction and extract subtitles 4 years ago
Remita Amine 3f1748b944 [bandcamp] fix extraction 4 years ago
Remita Amine fe13087cd1 [rai] fix RaiPlay extraction 4 years ago
Remita Amine f22fa82d7f [extractors] Remove VLivePlaylistIE import 4 years ago
Remita Amine 059fa9aa81 [vlive] fix extraction 4 years ago
Remita Amine 650aec4a98 [usanetwork] fix extraction 4 years ago
Remita Amine 2ea9c97432 [nbc] fix NBCNews/Today/MSNBC extraction 4 years ago
Remita Amine 1737ea69b9 [cnbc] fix extraction 4 years ago
Sergey M․ 1fb034d029
[youtube] Remove RIAA copyrighted media from tests as per [1]
1. Github dmca and 1201 notice re youtube-dl 9-21-20
4 years ago
Sergey M․ 28f9568a84
release 2020.11.12 4 years ago
Sergey M․ 2de2ca6659
[youtube] Rework extractors
WIP
4 years ago
Sergey M․ 051071203c
release 2020.11.01.1 4 years ago
Sergey M․ 34299510bb
release 2020.11.01 4 years ago
Sergey M․ 6d4733ce7b
[youtube] Fix JS player URL extraction 4 years ago
Sergey M․ 416da574ec
[ytsearch] Fix extraction (closes #26920) 4 years ago
Toan Nguyen 48c5663c5f
[afreecatv] Fix typo (#26970) 4 years ago
Hannu Hartikainen 7d740e7dc7
[23video] Relax _VALID_URL (#26870) 4 years ago
Kevin O'Connor 4eda10499e
[utils] Don't attempt to coerce JS strings to numbers in js_to_json (#26851)
The current logic in `js_to_json` tries to rewrite octal/hex numbers to
decimal. However, when the logic actually happens the `"` or `'` have
already been trimmed off. This causes what were originally strings, that
happen to look like octal/hex numbers, to get rewritten to decimal and
returned as a number rather than a string.

In practive something like:

```js
{
  "0x40": "foo",
  "040": "bar",
}
```

would get rewritten as:

```json
{
  64: "foo",
  32: "bar
}
```

This is problematic since this isn't valid JSON as you cannot have
non-string keys.
4 years ago
Sergio Livi 605535776a
[ustream] Add support for video.ibm.com (#26894) 4 years ago
Felix Yan 1050e0d09f
[iqiyi] Fix typo (#26884) 4 years ago
Sergey M․ d65d89183f
[expressen] Add support for di.se (closes #26670) 4 years ago
Surkal 0c92f1e96b
[iprima] Improve video id extraction (#26507) (closes #26494) 4 years ago
Sergey M․ c5764b3f89
[downloader/http] Properly handle missing message in SSLError (closes #26646) 4 years ago
Sergey M․ 0837992a22
[downloader/http] Fix access to not yet opened stream in retry 4 years ago
Sergey M․ b55715934b
release 2020.09.20 4 years ago
nixxo 1ca5f821c8
[redtube] Extend _VALID_URL (#26506) 4 years ago
Sergey M․ defc820b70
[twitch] Switch streams to GraphQL and refactor (closes #26535) 4 years ago
Sergey M․ 82ef02e936
[telequebec] Fix issues (closes #26368) 4 years ago
Patrick Dessalle b856b3997c
[telequebec] Add support for brightcove videos (closes #25833) 4 years ago
Sergey M․ cd85a1bb8b
[pornhub] Extract metadata from JSON-LD (closes #26614) 4 years ago
Sergey M․ ce5b904050
[extractor/common] Relax interaction count extraction in _json_ld 4 years ago
Sergey M․ ad06b99dd4
[extractor/common] Extract author as uploader for VideoObject in _json_ld 4 years ago
JChris246 540b9f5164
[pornhub] Fix view count extraction (#26621) (refs #26614) 4 years ago
Stefan Pöschel 6e65a2a67e
[downloader/hls] Fix incorrect end byte in Range HTTP header for media segments with EXT-X-BYTERANGE (#24512) (closes #14748)
The end of the byte range is the first byte that is NOT part of the to
be downloaded range. So don't include it into the requested HTTP
download range, as this additional byte leads to a broken TS packet and
subsequently to e.g. visible video corruption.

Fixes #14748.
4 years ago
Sergey M․ f8c7bed133
[extractor/common] Handle ssl.CertificateError in _request_webpage (closes #26601)
ssl.CertificateError is raised on some python versions <= 3.7.x
4 years ago
Sergey M․ cdc55e666f
[downloader/http] Improve timeout detection when reading block of data (refs #10935) 4 years ago
Ori Avtalion 86b7c00adc
[downloader/http] Retry download when urlopen times out (#26603) (refs #10935) 4 years ago
Sergey M․ e8c5d40bc8
release 2020.09.14 4 years ago
Sergey M․ bff857a8af
[postprocessor/embedthumbnail] Fix issues (closes #25717)
* Fix WebP with wrong extension processing
* Fix embedding of thumbnails with % character in path
4 years ago
Alex Merkel a31a022efd
[postprocessor/embedthumbnail] Add support for non jpeg/png thumbnails (closes #25687) 4 years ago
Sergey M․ 45f6362464
[rtlnl] Extend _VALID_URL for new embed URL schema 4 years ago
Derek Land 97f34a48d7
[rtlnl] Extend _VALID_URL (#26549) (closes #25821) 4 years ago
Daniel Peukert ea74e00b3a
[youtube] Fix empty description extraction (#26575) (closes #26006) 4 years ago
Sergey M․ 06cd4cdb25
[srgssr] Extend _VALID_URL (closes #26555, closes #26556, closes #26578) 4 years ago
Sergey M․ da2069fb22
[googledrive] Use redirect URLs for source format (closes #18877, closes #23919, closes #24689, closes #26565) 4 years ago
Sergey M․ 95c9810015
[svtplay] Fix id extraction (closes #26576) 4 years ago
Remita Amine b03eebdb6a [redbulltv] improve support for rebull.com TV localized URLS(#22063) 4 years ago
Remita Amine 1f7675451c [redbulltv] Add support for new redbull.com TV URLs(closes #22037)(closes #22063) 4 years ago
tfvlrue aa27253556
[soundcloud] Reduce pagination limit to fix 502 Bad Gateway errors when listing a user's tracks. (#26557)
Per the documentation here https://developers.soundcloud.com/blog/offset-pagination-deprecated the maximum limit is 200, so let's respect that (even if a higher value sometimes works).

Co-authored-by: tfvlrue <tfvlrue>
4 years ago
Sergey M․ d51e23d9fc
release 2020.09.06 4 years ago
Sergey M․ 50e9fcc1fd
[nrktv:episode] Improve video id extraction (closes #25594, closes #26369, closes #26409) 4 years ago
random-nick 16ee69c1b7
[youtube] Fix age gate content detection (#26100) (closes #26152, closes #26311, closes #26384) 4 years ago
Sergey M․ 67171ed7e9
[youtube:user] Extend _VALID_URL (closes #26443) 4 years ago
Sergey M․ 1d9bf655e6
[utils] Recognize wav mimetype (closes #26463) 4 years ago
TheRealDude2 62ae19ff76
[xhamster] Improve initials regex (#26526) (closes #26353) 4 years ago
Sergey M․ 5ed05f26ad
[svtplay] Fix svt id extraction (closes #26425, closes #26428, closes #26438) 4 years ago
Sergey M․ 841b683804
[twitch] Rework extractors (closes #12297, closes #20414, closes #20604, closes #21811, closes #21812, closes #22979, closes #24263, closes #25010, closes #25553, closes #25606)
* Switch to GraphQL.
+ Add support for collections.
+ Add support for clips and collections playlists.
4 years ago
Remita Amine f5863a3ea0 [biqle] improve video_ext extraction 4 years ago
Sergey M․ 10709fc7c6
[xhamster] Extend _VALID_URL (closes #25927) 4 years ago
TheRealDude2 a7e348556a
[xhamster] Fix extraction (closes #26157) (#26254) 4 years ago
JChris246 6cb30ea5ed
[xhamster] Extend _VALID_URL (closes #25789) (#25804) 4 years ago
Sergey M․ a4ed50bb84
release 2020.07.28 4 years ago
Sergey M․ e450f6cb63
[youtube] Fix sigfunc name extraction (closes #26134, closes #26135, closes #26136, closes #26137) 4 years ago
MRWITEK a115e07594
[youtube] Improve description extraction (closes #25937) (#25980) 4 years ago
Sergey M․ 718393c632
[wistia] Restrict embed regex (closes #25969) 4 years ago
Glenn Slayden 07af16b92e
[youtube] Prevent excess HTTP 301 (#25786) 4 years ago
Sergey M․ e942cfd1a7
[youtube:playlists] Extend _VALID_URL (closes #25810) 4 years ago
Remita Amine 9a7e5cb88a [bellmedia] add support for cp24.com clip URLs(closes #25764) 4 years ago
Sergey M․ 2391941f28
[brightcove] Improve embed detection (closes #25674) 4 years ago
Sergey M․ 9ff6165a81
release 2020.06.16.1 4 years ago
Sergey M․ ee0b726cd7
[youtube] Force old layout (closes #25682, closes #25683, closes #25680, closes #25686) 4 years ago
Sergey M․ dbeafce5d5
[youtube] Fix categories and improve tags extraction 4 years ago
Sergey M․ ed604ce7bc
release 2020.06.16 4 years ago
Sergey M․ a6211d237b
[youtube] Fix uploader id and uploader URL extraction 4 years ago
Sergey M․ 7b16239a49
[youtube] Improve view count extraction 4 years ago
Sergey M․ 37357d21a9
[youtube] Fix upload date extraction 4 years ago
Sergey M․ b477fc1314
[youtube] Fix thumbnails extraction and remove uploader id extraction warning (closes #25676) 4 years ago
Sergey M․ d84b21b427
[youtube] Fix playlist and feed extraction (closes #25675) 4 years ago
Philipp Hagemeister 48bd042ce7 [facebook] Support single-video ID links
I stumbled upon this at https://www.facebook.com/bwfbadminton/posts/10157127020046316 . No idea how prevalent it is yet.
4 years ago
Sergey M․ 84213ea8d4
[youtube] Extract chapters from JSON (closes #24819) 5 years ago
Sergey M․ 562de77f41
[kaltura] Add support for multiple embeds on a webpage (closes #25523) 5 years ago
Sergey M․ e1723c4bac
release 2020.06.06 5 years ago
Sergey M․ a5b6102ea8
[tele5] Bypass geo restriction 5 years ago
Sergey M․ b77888228d
[jwplatform] Add support for bypass geo restriction 5 years ago
Sergey M․ 0b1eaec3bc
[tele5] Prefer jwplatform over nexx (closes #25533) 5 years ago
Sergey M․ b37e47a3f9
[twitch:stream] Expect 400 and 410 HTTP errors from API 5 years ago
Sergey M․ ce3735df02
[twitch:stream] Fix extraction (closes #25528) 5 years ago
Sergey M․ a0455d0ffd
[twitch] Pass v5 accept header and fix thumbnails extraction (closes #25531) 5 years ago
Sergey M․ c8b232cc48
[brightcove] Sort imports 5 years ago
Sergey M․ b4eb0bc7bd
[brightcove] Fix subtitles extraction (closes #25540) 5 years ago
Matej Dujava d5147b65ac
[malltv] Add support for sk.mall.tv (#25445) 5 years ago
Sergey M․ 7b0b53ea69
[twitter:broadcast] Add untitled periscope broadcast test 5 years ago
Sergey M․ 7016e24ebe
[periscope] Fix untitled broadcasts (#25482) 5 years ago
Sergey M․ bef4688c72
[jwplatform] Improve embeds extraction (closes #25467) 5 years ago
Sergey M․ 228c1d685b
release 2020.05.29 5 years ago
Sergey M․ fe515e5c75
[ard:beta] Extend _VALID_URL (closes #25405) 5 years ago
striker.sh 1db5ab6b34
[youtube] Add support for more invidious instances (#25417) 5 years ago
Sergey M․ 2791e80b60
[postprocessor/ffmpeg] Embed series metadata with --add-metadata 5 years ago
JordanWeatherby 8f841fafcd
[giantbomb] Extend _VALID_URL (#25222) 5 years ago
Michael Klein a54c5f83c0
[ard] Improve _VALID_URL (closes #25134) (#25198) 5 years ago
Sergey M․ cd13343ad8
[redtube] Improve formats extraction and extract m3u8 formats (closes #25311, closes #25321) 5 years ago
Rob 9cd5f54e31
[utils] Fix file permissions in write_json_file (closes #12471) (#25122) 5 years ago
tlsssl 9a269547f2
[indavideo] Switch to HTTPS for API request (#25191) 5 years ago
Dave Loyall bf097a5077
[redtube] Improve title extraction (#25208) 5 years ago
Remita Amine 52c50a10af [vimeo] improve format extraction and sorting(closes #25285) 5 years ago
Remita Amine b334732709 [soundcloud] reduce API playlist page limit(closes #25274) 5 years ago
Juan Francisco Cantero Hurtado 384bf91f88
[youtube] Add support for yewtu.be (#25226) 5 years ago
comsomisha adc13b0748
[mailru] Fix extraction (closes #24530) (#25239) 5 years ago
Sergey M․ 327593257c
[bbccouk] PEP8 5 years ago
Remita Amine 9d8f3a12a6 [spike] fix Bellator mgid extraction(closes #25195) 5 years ago
Sergey M․ b002bc433a
release 2020.05.08 5 years ago
Sergey M․ fa3db38333
[youtube] Improve signature cipher extraction (closes #25188) 5 years ago
Sergey M․ 30fa5c6087
[iprima] Improve extraction (closes #25138) 5 years ago
Sergey M․ 6c907eb33f
[downloader/http] Request last data block of exact remaining size
Always request last data block of exact size remaining to download if possible not the current block size.
5 years ago
Sergey M․ f7b42518dc
[downloader/http] Finish downloading once received data length matches expected
Always do this if possible, i.e. if Content-Length or expected length is known, not only in test.
This will save unnecessary last extra loop trying to read 0 bytes.
5 years ago
Remita Amine ce7db64bf1 [uol] fix extraction(closes #22007) 5 years ago
hh0rva1h 1328305851
[orf] Add support for more radio stations (closes #24938) (#24968) 5 years ago
Sergey M․ 6c22cee673
[extractor/common] Use compat_cookiejar_Cookie for _set_cookie (closes #23256, closes #24776)
To always ensure cookie name and value are bytestrings on python 2.
5 years ago
Sergey M․ 6d874fee2a
[compat] Introduce compat_cookiejar_Cookie 5 years ago
Sergey M․ 676723e0da
[dailymotion] Fix typo 5 years ago
Sergey M․ c380cc28c4
[utils] Improve cookie files support
+ Add support for UTF-8 in cookie files
* Skip malformed cookie file entries instead of crashing (invalid entry len, invalid expires at)
5 years ago
Sergey M․ f7f304910d
[puhutv] Remove no longer available HTTP formats (closes #25124) 5 years ago
Sergey M․ 00a41ca4c3
release 2020.05.03 5 years ago
Sergey M․ 6ffc3cf74a
[crunchyroll] Fix and improve extraction (closes #25096, closes #25060) 5 years ago
Sergey M․ 4433bb0245
[extractor/common] Extract multiple JSON-LD entries 5 years ago
Sergey M․ e40c758c2a
[youtube] Improve player id extraction and add tests 5 years ago
Sergey M․ 011e75e641
[youtube] Use redirected video id if any (closes #25063) 5 years ago
Remita Amine 2468a6fa64 [yahoo] fix GYAO Player extraction and relax title URL regex(closes #24178)(closes #24778) 5 years ago
Remita Amine 700265bfcf [tvplay] fix Viafree extraction(closes #15189)(closes #24473)(closes #24789) 5 years ago
Sergey M․ c97f5e934f
[tenplay] Relax _VALID_URL (closes #25001) 5 years ago
Sergey M․ 38db9a405a
[prosiebensat1] Extract series metadata 5 years ago
Philipp Stehle 2cdfe977d7
[prosiebensat1] Improve extraction and remove 7tv.de support (#24948) 5 years ago
willbeaufoy 46d0baf941
[options] Clarify doc on --exec command (closes #19087) (#24883) 5 years ago
Sergey M․ 00eb865b3c
[youtube] Fix DRM videos detection (refs #24736) 5 years ago
Sergey M․ 2f19835726
[thisoldhouse] Improve video id extraction (closes #24549) 5 years ago
AndrewMBL 533f3e3557
[thisoldhouse] Fix video id extraction (closes #24548)
Added support for:
with of without "www."
and either  ".chorus.build" or ".com"

It now validated correctly on older URL's
```
<iframe src="https://thisoldhouse.chorus.build/videos/zype/5e33baec27d2e50001d5f52f
```
and newer ones
```
<iframe src="https://www.thisoldhouse.com/videos/zype/5e2b70e95216cc0001615120
```
5 years ago
Sergey M․ 75294a5ed0
[soundcloud] Improve AAC format extraction (closes #19173, closes #24708) 5 years ago
tom b9e5f87291
[soundcloud] Extract AAC format 5 years ago
Sergey M․ 6b09401b0b
[youtube] Skip broken multifeed videos (closes #24711) 5 years ago
Sergey M․ 5caf88ccb4
[nova:embed] Fix extraction (closes #24700) 5 years ago
Sergey M․ dcc8522fdb
[motherless] Fix extraction (closes #24699) 5 years ago
Felix Stupp c9595ee780
[twitch:clips] Extend _VALID_URL (closes #24290) (#24642) 5 years ago
Sergey M․ 91bd3bd019
[tv4] Fix ISM formats extraction (closes #24667) 5 years ago
Sergey M․ 13b08034b5
[extractor/common] Skip malformed ISM manifest XMLs while extracting ISM formats (#24667) 5 years ago
Sergey M․ 6a6e1a0cd8
[tele5] Fix extraction (closes #24553) 5 years ago
Sergey M․ 4e7b5bba5f
[mofosex] Add support for generic embeds (closes #24633) 5 years ago
Sergey M․ 52c4c51556
[youporn] Add support form generic embeds 5 years ago
Sergey M․ 8fae1a04eb
[spankwire] Add support for generic embeds (refs #24633) 5 years ago
Sergey M․ d44a707fdd
[spankwire] Fix extraction (closes #18924, closes #20648) 5 years ago
Sergey M․ 049c0486bb
release 2020.03.24 5 years ago
Sergey M․ 6e47200b6e
[teachable] Update test 5 years ago
Sergey M․ 38fa761a45
[teachable] Update gns3 domain 5 years ago
Sergey M․ 08a27407c4
[teachable] Update upskillcourses domain
New version does not use teachable platform any longer
5 years ago
Sergey M․ be7dacf9cf
[generic] Look for teachable embeds before wistia 5 years ago
Sergey M․ 4560adc820
[teachable] Extract chapter metadata (closes #24421) 5 years ago
Sergey M․ 63dce3094b
[bilibili] Add support for player.bilibili.com (closes #24402) 5 years ago
Sergey M․ b4eb08bb03
[bilibili] Add support for new URL schema with BV ids (closes #24439, closes #24442) 5 years ago
Remita Amine 2e20cb3636 [limelight] remove disabled API requests(closes #24255) 5 years ago
Remita Amine a6c5859d6b [soundcloud] fix download url extraction(closes #24394) 5 years ago
Sergey M․ c76cdf2382
[cbc:watch] Fix authenticated device token caching (closes #19160) 5 years ago
Devon Meunier 787c360467
[cbc:watch] Add support for authentication 5 years ago
Sergey M․ 73453430c1
[hellporno] Fix extraction (closes #24399) 5 years ago
Sergey M․ 158bc5ac03
[xtube] Fix typo 5 years ago
Sergey M․ 4568a11802
[xtube] Fix formats extraction (closes #24348) 5 years ago
Sergey M․ 4cbce88f8b
[ndr] Fix extraction (closes #24326) 5 years ago
Sergey M․ 541fe3eaff
[nhk] Update m3u8 URL and use native hls (#24329) 5 years ago
Sergey M․ 9bfe088594
[nhk] Remove obsolete rtmp formats (closes #24329) 5 years ago
Sergey M․ fcaf4d7a06
[nhk] Relax _VALID_URL (#24329) 5 years ago
Remita Amine 40b6495d40 Revert "[vimeo] fix showcase password protected video extraction(closes #24224)"
This reverts commit 12ee431676.
5 years ago
Sergey M․ f1a8511f7b
[utils] Add reference to cookie file format 5 years ago
Sergey M․ 042b664933
Revert "[utils] Add support for cookies with spaces used instead of tabs"
According to [1] TABs must be used as separators between fields.
Files produces by some tools with spaces as separators are considered
malformed.

1. https://curl.haxx.se/docs/http-cookies.html

This reverts commit cff99c91d1.
5 years ago
Sergey M․ 68fa15155f
release 2020.03.08 5 years ago
Sergey M․ cff99c91d1
[utils] Add support for cookies with spaces used instead of tabs 5 years ago
Tristan Waddington fa9b8c6628
[pornhub] Add support for pornhubpremium.com (#24288) 5 years ago
Sergey M․ 43ebf77df3
[youtube] Remove outdated code
Additional get_video_info requests don't seem to provide any extra itags any longer
5 years ago
Sergey M․ d332ec725d
[youtube] Improve age-gated videos extraction in 429 error conditions (refs #24283) 5 years ago
Sergey M․ f93abcf1da
[youtube] Improve extraction in 429 error conditions (closes #24283) 5 years ago
Remita Amine 0ec9d4e565 [nhk] update API version(closes #24270) 5 years ago
Sergey M․ 34525a3885
release 2020.03.06 5 years ago
Sergey M․ 5429d6a9cb
[youtube] Fix tests 5 years ago
Sergey M․ dc879c5a37
[youtube] Fix age-gated videos support without login (closes #24248) 5 years ago
Remita Amine 12ee431676 [vimeo] fix showcase password protected video extraction(closes #24224) 5 years ago
Sergey M․ 46cc54ca8f
[pornhub] Improve title extraction (closes #24184) 5 years ago