Commit Graph

11511 Commits (c452790a796730113dd62db0e743b11045606e27)

Author SHA1 Message Date
Remita Amine 2309d6bf92 [sixplay] try to extract non drm protected manifests(closes #20849) 6 years ago
Remita Amine 822b9d9cb0 [youtube] improve Youtube Music Auto-generated description parsing(closes #20742) 6 years ago
quinlander 5caabd3c70 [youtube] Extract additional meta data from video description on youtube music videos
YouTube music videos often have auto-generated video descriptions that can be
utilized to extract additional information about the video. This is desirable
in order to provide the user with as much meta data as possible. This commit
adds extraction methods for the following fields for youtube music videos:
- artist (fallback extraction methods added)
- track (fallback extraction methods added)
- album (new in this commit)
- release_date (new in this commit)
- release_year (new in this commit)

4 tests have been added to test this new functionality:
- YoutubeIE tests 27, 28, 29, and 30

Resolves: #20599
6 years ago
Jakub Wilk aa05a093bb [wrzuta] Remove extractor (closes #20684) (#20801)
Wrzuta.pl was shut down in 2017.
6 years ago
Sergey M․ 60e67c5b2c
[twitch] Prefer source format (closes #20850) 6 years ago
Mao Zedong 88b547492f [twitcasting] Add support for private videos (#20843) 6 years ago
Mao Zedong 00a9a25cf9 [twitcasting] Fix test: video title (#20840) 6 years ago
Remita Amine 97abf05ad3 [reddit] check thumbnail URL(closes #20030) 6 years ago
Remita Amine 58ef5e7881 [yandexmusic] fix track url extraction(closes #20820) 6 years ago
Sergey M․ 56667d622c
[youtube] Fix extraction (closes #20758, closes #20759, closes #20761, closes #20762, closes #20764, closes #20766, closes #20767, closes #20769, closes #20771, closes #20768, closes #20770) 6 years ago
Remita Amine 50d660479d [toutv] fix extraction and extract series info(closes #20757) 6 years ago
Remita Amine 1fa8893734 [vrv] add support for movie listings(closes #19229) 6 years ago
Remita Amine 15be3eb5e5 [youtube] raise ExtractorError when no data available(#20737) 6 years ago
Sergey M․ e09965d550
[soundcloud] Add support for new rendition and improve extraction (closes #20699) 6 years ago
Remita Amine 3fd86cfe13 [ooyala] add support for geo verification proxy 6 years ago
Remita Amine fdc2183650 [nrl] Add new extractor(closes #15991) 6 years ago
Remita Amine 85b6335d55 [vimeo] extract live archive source format(#19144) 6 years ago
Remita Amine c25720ef6a [vimeo] add support live streams and improve info extraction(closes #19144) 6 years ago
Remita Amine c9b19d7a55 [ntvcojp] Add new extractor 6 years ago
Remita Amine 47cfa00516 [nhk] extract rtmpt format 6 years ago
Remita Amine 061d1cd948 [nhk] add support for audio URLs 6 years ago
Remita Amine 5de538787d [udemy] add another course id extraction pattern(closes #20491) 6 years ago
Sergey M․ 9abeefd527
[openload] Add support for oload.services (closes #20691) 6 years ago
ealgase f3914b06a0
[openload] Add support for openloed.co (closes #20691)
While the .co could be captured directly, I anticipate that there will be more TLD's for openloed in the future.
6 years ago
Remita Amine 81d989c21e
[bravotv] fix extraction(closes #19213) 6 years ago
Sergey M․ 7fc3b68ad3
[openload] Randomize User-Agent (closes #20688) 6 years ago
Sergey M c4341ea47e
[openload] Add support for oladblock domains (#20471) 6 years ago
Remita Amine e6c9ae31df [adn] fix subtitle extraction(#12724) 6 years ago
ealgase 6104cc1591
[openload] add test for oladblock.me 6 years ago
ealgase f114e43d38
[openload] add oladblock.me domain 6 years ago
Remita Amine cb6cd76f7b [aol] add support for localized websites 6 years ago
Remita Amine 0b758fea1c [yahoo] add support GYAO episode URLs 6 years ago
Remita Amine 3534b6329a [yahoo] add support for streaming.yahoo.co.jp(closes #5811)(closes #7098) 6 years ago
Remita Amine 174f62992d [yahoo] add support for gyao.yahoo.co.jp 6 years ago
Remita Amine 1038532213 [aenetworks] add encoding declaration 6 years ago
Remita Amine 4f1e02ad60 [aenetworks] fix history topic extraction and extract more formats 6 years ago
Remita Amine 180a9dff1f [cbs] extract smpte and vtt subtitles 6 years ago
Sergey M 972d2dd0bc
[streamango] add support for streamcherry.com (#20592) 6 years ago
JChris246 8721b09751 [yourporn] Add support for sxyprn.com (#20646) 6 years ago
Remita Amine dc27fd8bb8 [mgtv] fix extraction(closes #20650) 6 years ago
Remita Amine c912029480 [linkedin:learning] use urljoin for form action url(closes #20431) 6 years ago
Remita Amine 118f7add3b [gdc] add support for kaltura embeds and update tests(closes #20575) 6 years ago
Remita Amine 4bc12b8f81 [dispeak] improve mp4 bitrate extraction 6 years ago
Remita Amine 5ca3459828 [kaltura] sanitize embed URLs 6 years ago
Remita Amine 9c017253e8 [jwplatfom] do not match manifest URLs(#20596) 6 years ago
Remita Amine 9045d28b5e [aol] restrict url regex and improve format extraction 6 years ago
Sergey M․ 7c2ecbc1cc
[tiktok] Add support for new URL schema (closes #20573) 6 years ago
Remita Amine d562cac9dc [stv:player] Add new extractor(closes #20586) 6 years ago
ealgase 9ed06812ec
[streamango] add support for streamcherry.com 6 years ago
ealgase bf6fb8b9dc
[openload] add tests 6 years ago
Sergey M․ 8410653f24
[ruutu] Add support for audio podcasts (closes #20473, closes #20545) 6 years ago
Sergey M․ f4da808036
[xvideos] Extract all thumbnails (closes #20432) 6 years ago
Sergey M․ 059cd768b9
[vk] Remove unused import 6 years ago
Sergey M․ c701472fc9
[platzi] Add extractor (closes #20562) 6 years ago
Remita Amine 19591facea [dvtv] remove unnecessary comments and spaces 6 years ago
Jan Friesse b9aad6c427 [dvtv] Fix extraction (closes #18514) 6 years ago
Remita Amine 9f182c23ba [vrv] add basic support for individual movie links(#19229) 6 years ago
Remita Amine 4810655cd6 [bfi:player] Add new extractor(#19235) 6 years ago
Remita Amine a7978f8e2a [hbo] fix extraction and extract subtitles(closes #14629)(closes #13709) 6 years ago
Remita Amine 19041a3877 [youtube] extract srv[1-3] subtitle formats(#20566) 6 years ago
Remita Amine afb7496416 [adultswim] fix extraction(closes #18025) 6 years ago
Remita Amine 69e6efac16 [teamcoco] fix extraction and add suport for subdomains(closes #17099)(closes #20339) 6 years ago
Remita Amine 2bbde1d09a [adn] fix subtitle compatibility with ffmpeg 6 years ago
Remita Amine b966740cf7 [adn] fix extraction and add support for positioning styles(closes #20549) 6 years ago
Remita Amine 220828f2d6 [vk] use a more unique video id(closes #17848) 6 years ago
Remita Amine 977a782110 [rtl2] update player_url 6 years ago
Remita Amine a2b6f946f1 [newstube] fix extraction 6 years ago
Remita Amine 4f7db46887 [rtl2] improve _VALID_URL regex 6 years ago
Remita Amine f8987163fb [adobeconnect] Add new extractor(closes #20283) 6 years ago
Remita Amine 313e8b2b18 [gaia] add support for authentication(closes #14605) 6 years ago
Sergey M․ efee62ac7f
[mediasite] Add support for dashed ids and named catalogs (closes #20531) 6 years ago
RexYuan 93bb6b1bae [weibo] Extend _VALID_URL (#20496) 6 years ago
Sergey M․ b43c5f474a
[xhamster] Add support for xhamster.one (closes #20508) 6 years ago
Sergey M․ 4014a48622
[mediasite:catalog] Add extractor (closes #20507) 6 years ago
Remita Amine 99fe330070 [teamtreehouse] Add new extractor(closes #9836) 6 years ago
Remita Amine c4c888697e [ina] add support for audio URLs 6 years ago
Remita Amine b27a71e66c [ina] improve extraction 6 years ago
Remita Amine de74ef83b7 [cwtv] fix episode number extraction(closes #20461) 6 years ago
ealgase cf3d399727
[openload] add support for oladblock.services and oladblock.xyz domains 6 years ago
Sergey M․ 8cb10807ed
[npo] Improve DRM detection 6 years ago
Sergey M․ b8526c78f9
[pornhub] Add support for DASH formats (closes #20403) 6 years ago
Sergey M․ c4580580f5
[svtplay] Update API endpoint (closes #20430) 6 years ago
Sergey M․ 8428fdccf2
[yandexvideo] Add extractor 6 years ago
Sergey M․ 04988b55b5
[openload] Improve embed detection 6 years ago
Sergey M․ 034f5fb5ee
[radiocanada:audiovideo] Fix typo 6 years ago
wolfy1339 a63782b581 [corus] Add support for bigbrothercanada.ca (#20357) 6 years ago
Lukas Anzinger 0146c6cde6 [orf:radio] Extract series (#20012) 6 years ago
Sergey M․ ddff25c5d1
[extractors] Remove superfluous whitespace 6 years ago
Tyler Szabo 81dada0b4b [cbc:watch] Add support for gem.cbc.ca (closes #20251, #20359) 6 years ago
Sergey M․ eba3a2f9ef
[anysex] Remove extractor (closes #19279) 6 years ago
Sergey M․ d493f15c11
[extractor/common] Improve HTML5 entries extraction and add some realworld tests 6 years ago
Austin de Coup-Crank e5cfb779ea [ciscolive] Add support for new URL schema (closes #20320, #20351) 6 years ago
utlasidyo 77d95677b7 [youtube] Add support for invidiou.sh (#20309) 6 years ago
Sergey M․ 79d2077edc
[extractor/common] Fix url meta field for unfragmented DASH formats (closes #20346) 6 years ago
charon2019 6db03a29d1 [anitube] Remove extractor
site no longer exists
6 years ago
Sergey M․ 47f9792620
[ruleporn] Remove extractor (closes #15344, closes #20324)
Covered by generic extractor
6 years ago
Remita Amine 68867668cf [npr] fix extraction(closes #10793)(closes #13440) 6 years ago
Remita Amine e7e3ec828b [biqle] fix extraction(closes #11471)(closes #15313) 6 years ago
Remita Amine e585547284 [viddler] Modernize 6 years ago
Remita Amine 4993132344 [pandatv] fix condition syntax 6 years ago
Remita Amine 8569058f88 [moevideo] fix extraction 6 years ago
Remita Amine 612a159510 [primesharetv] remove extractor 6 years ago
Remita Amine f517c0c0a7 [hypem] Modernize and extract more metadata(closes #15320) 6 years ago
Remita Amine 197cf8b794 [veoh] fix extraction 6 years ago
Remita Amine fddb4a3a8b [escapist] Modernize 6 years ago
Remita Amine 99534feaff [videomega] remove extractor(closes #10108) 6 years ago
Sergey M․ cdc7baffca
[beeg] Add support for beeg.porn (closes #20306) 6 years ago
Sergey M․ 067aa17edf
Start moving to ytdl-org 6 years ago
Remita Amine 2765503713 [vimeo:review] improve config url extraction and extract original format(closes #20305) 6 years ago
Remita Amine 0d08bcdb70 [fox] detect geo restriction and authentication errors(#20208) 6 years ago
Sergey M․ 9d74ea6d36
[francetv:site] Relax video id regex and update test (closes #20268) 6 years ago
Remita Amine 7b6e760870 [toutv] detect invalid login error 6 years ago
Remita Amine 829685b88a [toutv] fix authentication(closes #20261) 6 years ago
0x9fff00 d347b52b63 [urplay] Extract timestamp (#20235) 6 years ago
yonaikerlol 97157c692c [openload] Add support for oload.space 6 years ago
Sergey M․ a551768acf
[facebook] Improve uploader extraction (closes #20250) 6 years ago
Sergey M․ ee0ba927aa
Use compat_etree_Element 6 years ago
Sergey M․ e5ada4f3ad
[extractor/common] Fallback url to base URL for DASH formats 6 years ago
Sergey M․ bb6f112d9d
[npo] Improve ISM extraction 6 years ago
Sergey M․ c17eb5b4b0
[rai] Improve extraction (closes #20253) 6 years ago
Sergey M․ d9eb580a79
[extractor/common] Do not fail on invalid data while parsing F4M manifest in non fatal mode 6 years ago
Remita Amine 5dcd630dca [paramountnetwork] fix mgid extraction(closes #20241) 6 years ago
Sergey M․ c790e93ab5
[extractor/common] Clarify url and manifest_url meta fields 6 years ago
Sergey M․ 39c780fdec
[extractor/common] Return MPD manifest as format's url meta field (#20242)
For symmetry with other segmented media
6 years ago
Remita Amine 0a5baf9c21 [libsyn] improve extraction(closes #20229) 6 years ago
dimqua 8ae113ca9d [youtube] Add more invidious instances
See [Invidious-Instances](https://github.com/omarroth/invidious/wiki/Invidious-Instances) for the reference.
6 years ago
Sergey M․ 7465e0aee2
[spankbang] Fix extraction (closes #20023) 6 years ago
Remita Amine a8f83f0c56 [crunchyroll] fix is_logged check 6 years ago
Remita Amine dca0e0040a Revert "use older login method(closes #11572)"
This reverts commit cc6a960e13.
6 years ago
Remita Amine 398e1e21d6 [espn] extend _VALID_URL regex(closes #20013) 6 years ago
Remita Amine c5b02efe20 [sixplay] handle videos with empty assets(closes #20016) 6 years ago
Remita Amine 06242d44fe [vimeo] add support for Vimeo Pro portfolio protected videos(closes #20070) 6 years ago
Sergey M․ ff60ec8f02
[npo] Fix extraction (#20084) 6 years ago
Sergey M․ 9d9a8676dc
[francetv:site] Extend video id regex (closes #20029, closes #20071) 6 years ago
Sergey M․ db1c3a9d3f
[periscope] Extract width and height (closes #20015) 6 years ago
Sergey M․ 55b8588f0e
[servus] Fix extraction (closes #19297) 6 years ago
Sergey M․ f0228f56fb
[bbccouk] Make subtitles non fatal (#19651) 6 years ago
Sergey M․ caf48f557a
[metacafe] Fix family filter bypass (closes #19287) 6 years ago
Sergey M․ 388cfbd3d8
[tvp:website] Improve support 6 years ago
Sergey M․ d93083789b
[tvp:series] Fix extraction 6 years ago
Sergey M․ 34568dc296
[tvp] Detect unavailable videos 6 years ago
Sergey M․ 3c9647372e
[tvp] Fix description extraction, make thumbnail optional and fix tests 6 years ago
Sergey M․ 659e93fcf5
[linuxacademy] Add extractor (closes #12207) 6 years ago
Sergey M․ c9a0ea6e51
[bilibili] Update keys (closes #19233) 6 years ago
Sergey M․ d7d513891b
[udemy] Extend _VALID_URLs (closes #14330, closes #15883) 6 years ago
Sergey M․ ae65c93a26
[udemy] Update User-Agent and detect captcha (closes #14713, closes #15839, closes #18126) 6 years ago
Sergey M․ ba2e3730d1
[noovo] Fix extraction (closes #19230) 6 years ago
Sergey M․ 2b2da3ba10
[rai] Relax _VALID_URL (closes #19232) 6 years ago
Sergey M․ 794c1b6e02
[vshare] Pass Referer to download request (closes #19205, closes #19221) 6 years ago
yonaikerlol 7bee705d8f [openload] Add support for oload.live 6 years ago
bitraid 6f5c1807f4 [imgur] Use video id as title fallback (closes #18590) 6 years ago
Sergey M․ 985637cbbf
[twitch] Add new source format detection approach (closes #19193) 6 years ago
Sergey M․ 7d8b89163c
[tvplayhome] Fix video id extraction (closes #19190) 6 years ago
Sergey M․ d777f3e81c
[tvplayhome] Fix episode metadata extraction (closes #19190) 6 years ago
Sergey M․ 4c0e0dc9dc
[rutube:embed] Fix extraction and add support private videos (closes #19163) 6 years ago
Sergey M․ f516f44094
[soundcloud] Extract more metadata 6 years ago
Sergey M․ e9dee7f1b2
[trunews] Add extractor (closes #19153) 6 years ago
Remita Amine 91effe22a0 [linkedin:learning] extract chapter_number and chapter_id(closes #19162) 6 years ago
Sergey M․ 4de3cb883c
[malltv] Fix issues and simplify (closes #17856) 6 years ago
Ales Jirasek 22f5f5c6fc
[malltv] Add extractor (closes #18058) 6 years ago
Sergey M․ 49bd993fd9
[spankbang:playlist] Add extractor (closes #19145) 6 years ago
Sergey M․ f06a1cabe8
[spankbang] Extend _VALID_URL 6 years ago
Remita Amine 241c5d7d38 [trutv] fix extraction(closes #17336) 6 years ago
Remita Amine 8fecc7353d [toutv] fix authentication(closes #16398)(closes #18700) 6 years ago
Sergey M․ 5dda1edef9
[pornhub] Improve and simplify (closes #19135) 6 years ago
JChris246 d2d970d07e
[pornhub] Fix tags and categories extraction (closes #13720) 6 years ago
Sergey M․ 48fb963b2f
[pornhd] Fix formats extraction 6 years ago
JChris246 70c3ee1367 [pornhd] Extract like count 6 years ago
Remita Amine 07fbfef1c7 [radiocanada] switch to the new media requests(closes #19115) 6 years ago
Remita Amine eecf788b90 [teachable] add support for courses.workitdaily.com (closes #18871) 6 years ago
Sergey M․ 0efcb5a2fe
[vporn] Remove extractor (closes #16276)
Handled by generic extractor
6 years ago
Sergey M․ 7c5307f4c4
[soundcloud:pagedplaylist] Improve (closes #19086) 6 years ago
Cory Hall 6cc6e0c34d
[soundcloud:pagedplaylist] Add ie and title to entries (#19022)
rel: https://github.com/rg3/youtube-dl/issues/19022
6 years ago
JChris246 b9bc1cff72 [drtuber] Extract duration 6 years ago
Sergey M․ b6423e6ca2
[soundcloud:user] Update tests 6 years ago
Sergey M․ 3ef2da2d21
[soundcloud] Fix paged playlists extraction, add support for albums and update client id 6 years ago
Sergey M․ 49fe4175ae
[drtv] Improve preference (closes #19079) 6 years ago
Sergey M․ 9613e14a92
[openload] Add support for openload.pw and oload.pw (closes #18930) 6 years ago
Batuhan's Unmaintained Account 15e832ff2a [openload] Add support for oload.info 6 years ago
Remita Amine 645c4885cf [crackle] authorize media detail request(closes #16931) 6 years ago
Sergey M․ 5496754ae4
[fox] Remove unused imports 6 years ago
Sergey M․ 9868f1ab18
[yourporn] Improve (closes #19061) 6 years ago
JChris246 41cff90c41
[yourporn] Fix extraction and extract duration (closes #18815, closes #18852)
change cdn to cdn4 for the video_url
6 years ago
Sergey M․ a2d821d711
[drtv] Improve extraction (closes #19039)
+ Add support for EncryptedUri videos
+ Extract more metadata
* Fix subtitles extraction
6 years ago
Remita Amine 6df196f32e [fox] add support for locked videos using cookies(closes #19060) 6 years ago
Remita Amine 41c2c254d3 [fox] fix extraction for free videos(#19060) 6 years ago
Alexander Seiler a81daba231 [zattoo] Add support for tv.salt.ch 6 years ago
Remita Amine 1fcc91663b [vice] fix extraction for locked videos(closes #16248) 6 years ago
Remita Amine 30cd1a5f39 [wakanim] detect DRM protected videos 6 years ago
Sergey M․ 458fd30f56
[extractor/common] Extract season in _json_ld 6 years ago
Sergey M․ 845333acf6
[wakanim] Add extractor (closes #14374) 6 years ago
Remita Amine ae18d58297 [usatoday] fix extraction for videos with custom brightcove partner id(closes #18990) 6 years ago
Sergey M․ 1602a240a7
[drtv] Fix extraction (closes #18989) 6 years ago
Sergey M․ 0eba178fce
[nhk] Extend _VALID_URL (closes #18968) 6 years ago
Remita Amine 118afcf52f [go] fix adobe pass requests for Disney Now(closes #18901) 6 years ago
Sergey M․ 9713d1d1e0
[openload] Add support for oload.club (closes #18969) 6 years ago
Sergey M․ 71a1f61700
[pornhub] Apply scrape detection bypass for all extractors 6 years ago
Sergey M․ 6510a3aa97
[crunchyroll] Extend _VALID_URL (closes #18955) 6 years ago
Sergey M․ 278d061a0c
[pornhub] Bypass scrape detection (closes #5930) 6 years ago
Remita Amine 503b604a31 [vrv] fix oauth signing for python 2(#14307) 6 years ago