archive
/
yt-dlp
mirror of https://github.com/yt-dlp/yt-dlp
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
22,874 Commits
3 Branches
100 Tags
122 MiB
master
release
gh-pages
2021.01.07
2021.01.07-1
2021.01.08
2021.01.09
2021.01.10
2021.01.12
2021.01.14
2021.01.16
2021.01.20
2021.01.24
2021.01.24-1
2021.01.29
2021.02.04
2021.02.09
2021.02.15
2021.02.19
2021.02.24
2021.03.01
2021.03.03
2021.03.03.2
2021.03.07
2021.03.15
2021.03.21
2021.03.24
2021.03.24.1
2021.04.03
2021.04.11
2021.04.22
2021.05.11
2021.05.20
2021.06.01
2021.06.08
2021.06.09
2021.06.23
2021.07.07
2021.07.21
2021.07.24
2021.08.02
2021.08.10
2021.09.01
2021.09.02
2021.09.25
2021.10.09
2021.10.10
2021.10.22
2021.11.10
2021.11.10.1
2021.12.01
2021.12.25
2021.12.27
2022.01.21
2022.02.03
2022.02.04
2022.03.08
2022.03.08.1
2022.04.08
2022.05.18
2022.06.22
2022.06.22.1
2022.06.29
2022.07.18
2022.08.08
2022.08.14
2022.08.18.36
2022.08.19
2022.09.01
2022.10.04
2022.11.11
2023.01.02
2023.01.06
2023.02.17
2023.03.03
2023.03.04
2023.06.21
2023.06.22
2023.07.06
2023.09.24
2023.10.07
2023.10.13
2023.11.14
2023.11.16
2023.12.30
2024.03.10
2024.04.09
2024.05.26
2024.05.27
2024.07.01
2024.07.02
2024.07.07
2024.07.08
2024.07.09
2024.07.16
2024.07.25
2024.08.01
2024.08.06
2024.09.27
2024.10.07
2024.10.22
2024.11.04
2024.11.18
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from 'master'
${ noResults }
Commit Graph

1338 Commits (master)

Author SHA1 Message Date
pukkandan b69fd25c25
[cleanup] Misc cleanup 
Closes #1942 #1976 #2020 #2058 #1984
 3 years ago
pukkandan e0fd95737d
[outtmpl] Add alternate forms `F`, `D` 
and improve `id` detection

F = sanitize as filename (# = restricted)
D = add Decimal suffixes

Closes #2085, 2081
 3 years ago
pukkandan 75ad33572b
[test/download] Split `sanitize_got_info_dict` into a separate function 
so that it can be used by third party scripts
 3 years ago
PilzAdam e978789f0f
[outtmpl] Add operator `&` for replacement text (#2012) 
Authored by: PilzAdam
 3 years ago
Zenon Mousmoulas d5c3254889
[extractor] Support default implicit graph in JSON-LD (#1983) 
Original PR: https://github.com/ytdl-org/youtube-dl/pull/30229

Per W3C JSON-LD v1.1 §4.9 (non-normative ref):

    When a JSON-LD document's top-level structure is a map that contains
    no other keys than @graph and optionally @context (properties that
    are not mapped to an IRI or a keyword are ignored), @graph is
    considered to express the otherwise implicit default graph.

Authored by: zmousm
 3 years ago
std-move fed1309651
[test/download] Ignore field `webpage_url_domain` (#2014) 
Authored by: std-move
 3 years ago
pukkandan ff9f925b63
[test/download] Add more fields 3 years ago
Nil Admirari 8157a09d22
[SponsorBlock] Add Filler and Highlight categories (#1664) 
Authored by: nihil-admirari, pukkandan
 3 years ago
pukkandan 57dbe8077f
[jsinterp] Fix splice to handle float 
Needed for new youtube js player f1ca6900
Closes #1767
 3 years ago
pukkandan 282f570918
[utils] Fix error when copying `LazyList` 3 years ago
pukkandan c5e3f84972
[utils] Allow alignment in `render_table` 
and add tests
 3 years ago
The Hatsune Daishi a04e005521
[AES] Add ECB mode (#1686) 
Needed for #1688
Authored by: nao20010128nao
 3 years ago
pukkandan dd2a987d3f
[tests] Fix tests 3 years ago
pukkandan 9222c38182
[cleanup] Minor cleanup 
Closes #1696, Closes #1673
 3 years ago
pukkandan 4476d2c764
[outtmpl] Add alternate forms for `q` and `j` 3 years ago
pukkandan 582fad70f5
[outtmpl] Do not traverse `None` 
Closes #1585
 3 years ago
pukkandan a331949df3
[test/download] Fallback test to `bv` 3 years ago
pukkandan a1fc7ca074
[jsinterp] Handle default in switch better 3 years ago
pukkandan 404f611f1c
[youtube] Fix throttling by decrypting n-sig (#1437) 3 years ago
Damiano Amatruda 17ec8bcfa9
[microsoftstream] Add extractor (#1201) 
Based on: https://github.com/ytdl-org/youtube-dl/pull/24649
Fixes: https://github.com/ytdl-org/youtube-dl/issues/24440
Authored by: damianoamatruda, nixklai
 3 years ago
pukkandan aa7785f860
[utils] Standardize timestamp formatting code 
Closes #1285
 3 years ago
pukkandan 176f1866cb
Add HDR information to formats 3 years ago
pukkandan 17bddf3e95
Reduce default `--socket-timeout` 3 years ago
pukkandan 18f96d129b
[utils] Allow duration strings in filter 
Closes #1309
 3 years ago
pukkandan b836dc94f2
[outtmpl] Fix bug in expanding environment variables 3 years ago
pukkandan b5ae35ee6d
[cleanup] Misc cleanup 3 years ago
pukkandan 819e05319b
Improved progress reporting (See desc) (#1125) 
* Separate `--console-title` and `--no-progress`
* Add option `--progress` to show progress-bar even in quiet mode
* Fix and refactor `minicurses`
* Use `minicurses` for all progress reporting
* Standardize use of terminal sequences and enable color support for windows 10
* Add option `--progress-template` to customize progress-bar and console-title
* Add postprocessor hooks and progress reporting

Closes: #906, #901, #1085, #1170
 3 years ago
pukkandan e6f21b3d92
[docs,cleanup] Some minor refactoring and improve docs 3 years ago
pukkandan 91dd88b90f
[outtmpl] Alternate form of format type `l` for `\n` delimited list 3 years ago
pukkandan 524e2e4fda
[outtmpl] Format type `U` for unicode normalization 3 years ago
pukkandan ff1c7fc9d3
Allow `0` in `--playlist-items` 3 years ago
pukkandan 1b629e1b4c
[test/cookies] Improve logging 3 years ago
Ákos Sülyi 09906f554d
[aes] Add `aes_gcm_decrypt_and_verify` (#1020) 
Authored by: sulyi, pukkandan
 3 years ago
Nil Admirari c6af2dd8e5
[SponsorBlock] Improve merge algorithm (#999) 
Authored by: nihil-admirari
 3 years ago
pukkandan 7c37ff97d3
Allow alternate fields in outtmpl 
Closes #899, #1004
 3 years ago
pukkandan edf65256aa
[hls,aes] Fallback to native implementation for AES-CBC 
and detect `Cryptodome` in addition to `Crypto`

Closes #935
Related: #938
 3 years ago
pukkandan f5aa5cfbff
Add format type `B` for outtmpl to treat the value as bytes 
This is useful to limit the filename to a certain number of bytes rather than characters
Closes #1003
 3 years ago
coletdjnz a7e999beec
[pbs] Fix subtitle extraction (#813) 
Original PR: https://github.com/ytdl-org/youtube-dl/pull/24430, https://github.com/ytdl-org/youtube-dl/pull/17434
Closes: #836, https://github.com/ytdl-org/youtube-dl/issues/18796, https://github.com/ytdl-org/youtube-dl/issues/17273
Authored-by: coletdjnz, gesa, raphaeldore
 3 years ago
Nil Admirari 7a340e0df3
Native SponsorBlock implementation and related improvements (#360) 
SponsorBlock options:
* The fetched sponsor sections are written to infojson
* `--sponsorblock-remove` removes specified chapters from file
* `--sponsorblock-mark` marks the specified sponsor sections as chapters
* `--sponsorblock-chapter-title` to specify sponsor chapter template
* `--sponsorblock-api` to use a different API

Related improvements:
* Split `--embed-chapters` from `--embed-metadata`
* Add `--remove-chapters` to remove arbitrary chapters
* Add `--force-keyframes-at-cuts` for more accurate cuts when removing and splitting chapters

Deprecates all `--sponskrub` options

Authored by: nihil-admirari, pukkandan
 3 years ago
animelover1984 abafce59a1
[Niconico] Add Search extractors (#672) 
Authored by: animelover1984, pukkandan
 3 years ago
coletdjnz 0bb1bc1b10
[youtube] Remove annotations and deprecate `--write-annotations` (#765) 
Closes #692 
Authored by: coletdjnz
 3 years ago
pukkandan 4dfbf8696b
[utils] Add `parse_qs` 3 years ago
pukkandan 9e598870dd
Fix `playlist_index` not obeying `playlist_start` 
and add tests
Closes #720
 3 years ago
pukkandan 8f18aca871
Let `--match-filter` reject entries early 
Makes redundant: `--match-title`, `--reject-title`, `--min-views`, `--max-views`
 3 years ago
pukkandan ad3dc496bb Misc fixes - See desc 
* Remove unnecessary uses of _list_from_options_callback
* Fix download tests - Bug from 6e84b21559
* Rename ExecAfterDownloadPP to ExecPP and refactor its tests
* Ensure _write_ytdl_file closes file handle on error - Potential fix for #517
 3 years ago
pukkandan e9f4ccd19e
Add option `--replace-in-metadata` 3 years ago
pukkandan b868936cd6 [cleanup] Misc 3 years ago
pukkandan 243c57cfe8 [tests:download] Add batch testing for extractors 
Use `test_YourExtractor_all` to invoke them
 3 years ago
pukkandan 2b8a2973bd Allow entire infodict to be printed using `%()s` 
Makes `--dump-json` redundant
 3 years ago
pukkandan 6e84b21559
Fix bugs related to `sanitize_info` 
Related: 8012d892bd (r54555230)
 3 years ago
pukkandan a047eeb6d2
Add regex to `--match-filter` 
This does not fully deprecate `--match-title`/`--reject-title`
since `--match-filter` is only checked after the extraction is complete,
while `--match-title` can often be checked from the flat playlist.

Fixes: https://github.com/ytdl-org/youtube-dl/issues/9092, https://github.com/ytdl-org/youtube-dl/issues/23035
 3 years ago
Max Teegen 77b87f0519 Add all format filtering operators also to `--match-filter` 
PR: https://github.com/ytdl-org/youtube-dl/pull/27361

Authored by: max-te
 3 years ago
pukkandan 0855702f3f
[test:download] Support testing with `ignore_no_formats_error` 3 years ago
pukkandan e0f2b4b47d
[utils] Fix slicing of reversed `LazyList` 
Closes #589
 3 years ago
pukkandan 7d1eb38af1
Add format types `j`, `l`, `q` for outtmpl 
Closes #345
 3 years ago
pukkandan 901130bbcf Expand and escape environment variables correctly in outtmpl 
Fixes: https://www.reddit.com/r/youtubedl/comments/otfmq3/ytdlp_same_parameters_different_results
 3 years ago
pukkandan 052e135029
[youtube] Simplify `_get_text` early 3 years ago
pukkandan 060ac76257
[test] Use `pytest` instead of `nosetests` (#482) 
`nosetests` is no longer being maintained : https://github.com/nose-devs/nose/issues/1099
and will stop working in py 3.10 as can be seen in #480
 3 years ago
Matt Broadway 982ee69a74
Add option `--cookies-from-browser` to load cookies from a browser (#488) 
* also adds `--no-cookies-from-browser`

Original PR: https://github.com/ytdl-org/youtube-dl/pull/29201
Authored by: mbway
 3 years ago
felix c843e68588
[utils] Improve `js_to_json` comment regex 
Capture the newline character as part of a single-line comment

From #497, Authored by: fstirlitz
 3 years ago
pukkandan b5ac45b197
Fix selectors `all`, `mergeall` and add tests 
Bug from: 981052c9c6
 3 years ago
pukkandan 981052c9c6 Some minor fixes and refactoring (see desc) 
* [utils] Fix issues with reversal
* check_formats should catch `DownloadError`, not `ExtractorError`
* Simplify format selectors with `LazyList` and `yield from`
 3 years ago
pukkandan 9fea350f0d
Fix id sanitization in filenames 
Closes #415
 3 years ago
pukkandan 28419ca2c8
[utils] Improve `LazyList` 
* Add `repr` and `str` that mimics `list`
* Add `reversed`. Unlike `[::-1]`, reversed does not exhaust the iterable and modifies the `LazyList` in-place
* Add tests
 3 years ago
pukkandan 187986a857
Better error handling of syntax errors in `-f` 3 years ago
pukkandan 385a27fad1
Improve offset parsing in outtmpl 4 years ago
pukkandan 5c6542ce69
[test] More rigorous tests for `prepare_filename` 
All tests of `prepare_outtmpl` is now also run on `prepare_filename`
 4 years ago
pukkandan 639f1cea92
Fix `%d` and empty default in outtmpl 
Closes #388
 4 years ago
pukkandan aa75e51f99
[build] Build Windows x86 version with py3.8 
and remove redundant tests
:ci skip

Ao-authored by: pukkandan, shirt-dev
 4 years ago
pukkandan 76a264ac9e
Make outtmpl more robust and catch errors early 4 years ago
pukkandan 87ea7dfc04
Fix filename sanitization 
Bug from 752cda3880
 4 years ago
pukkandan 752cda3880
Fix and refactor `prepare_outtmpl` 
The following tests would have failed previously:
%(id)d %(id)r
%(ext)s-%(ext|def)d
%(width|)d
%(id)r %(height)r
%(formats.0)r
%s
 4 years ago
pukkandan 9d83ad93d0
[cleanup] Mark unused files 4 years ago
felix cc52de4356
[cleanup] Point all shebang to `python3` (#372) 
Authored by: fstirlitz
 4 years ago
pukkandan bc6b9bcd65
[utils] Escape URLs in `sanitized_Request`, not `sanitize_url` 
d2558234cf added escaping of URLs while sanitizing. However, `sanitize_url` may not always receive an actual URL.
Eg: When using `yt-dlp "search query" --default-search ytsearch`, `search query` gets escaped to `search%20query` before being prefixed with `ytsearch:` which is not the intended behavior. So the escaping is moved to `sanitized_Request` instead.
 4 years ago
pukkandan 337e0c62f8
[embedthumbnail] Correctly escape filename 
Closes #352
The approach in [1] is faulty as can be seen in the test cases
1. bff857a8af
 4 years ago
pukkandan c77495e3a4
[cleanup] `_match_entry` 4 years ago
pukkandan 177877c544
[extractor] Always prefer native hls downloader by default 
When the manifest is not downloadable by native downloader, it already is able to detect it and switch to `ffmpeg`. So there doesn't seem to be a reason anymore to use ffmpeg as the preferred downloader
 4 years ago
Hubert Hirtz 5435dcf96e
Handle Basic Auth `user:pass` in URLs 
Fixes https://github.com/ytdl-org/youtube-dl/issues/20258, https://github.com/ytdl-org/youtube-dl/issues/26211
Authored by: hhirtz, pukkandan
 4 years ago
pukkandan af32f40bf5
[test] Fix `test_YoutubeDL.TestYoutubeDL` 
Test `test_ignoreerrors_for_playlist_with_url_transparent_iterable_entries` was broken due to `__original_infodict` being added to the dict
 4 years ago
pukkandan da692b7920
[cleanup] youtube tests 4 years ago
pukkandan 6911e11edd
[test:download] Only extract enough videos for `playlist_mincount` 4 years ago
Felix S 5fbcebed8c [test] Test SSTR manifest parsing 4 years ago
Felix S becdc7f82c [test] Test subtitle extraction from DASH manifests 4 years ago
Felix S 73b9088a1c [test] Test subtitle extraction from HLS manifests 4 years ago
Felix S a0c3b2d5cf [extractor/common] Extract HLS subtitle tracks 
_extract_m3u8_formats is renamed to _extract_m3u8_formats_and_subtitles
and extended to handle subtitle tracks instead of skipping them;
a wrapper with the old name is provided for compatibility.

_parse_m3u8_formats is likewise renamed and extended, but without adding
the compatibility wrapper; the test suite is adjusted to test the enhanced
method instead.
 4 years ago
pukkandan 1bdae7d312
Update to ytdl-commit-7e8b3f9 
[youtube] Remove unused code
7e8b3f9439
 4 years ago
pukkandan a439a3a45c
Improve output template (see desc) 
* Objects can be traversed like `%(field.key1.key2)s`
* A number can be added to the field as `%(field+n)s`
* Deprecates `--autonumber-start`
 4 years ago
pukkandan a3faeb7de4
[MetadataFromField] Improve regex and add tests 4 years ago
pukkandan c32b0aab8a
Improve --sub-langs (see desc) 
* Treat `--sub-langs` entries as regex
* `all` can be used to refer to all the subtitles
* the language code can be prefixed with `-` to exclude it
* Deprecates `--all-subs`
Closes #253
 4 years ago
pukkandan a7191c6f57
Fix some linter and typos 4 years ago
colethedj 9e62f283ff
[utils] Add `datetime_from_str` to parse relative time (#221) 
and `datetime_add_months` to accurately add/subtract months

Authored by: colethedj
 4 years ago
pukkandan 84601bb72b
Ability to set a specific field in the file's metadata 
Eg: `--parse-metadata "description:(?s)(?P<meta_comment>.+)"`
sets the "comment" field using `description`
 4 years ago
pukkandan cd7c66cf01
[youtube] Fix history, trending and mix playlists (#136) 
Co-authored-by: pukkandan <pukkandan.ytdlp@gmail.com>
Co-authored-by: Matthew <colethedj@protonmail.com>
 4 years ago
Pccode66 7a5c1cfe93
Completely change project name to yt-dlp (#85) 
* All modules and binary names are changed
* All documentation references changed
* yt-dlp no longer loads youtube-dlc config files
* All URLs changed to point to organization account

Co-authored-by: Pccode66
Co-authored-by: pukkandan
 4 years ago
shirt-dev 310c2ed2c6
Better support HLS media discontinuity and fully support media initialization (#105) 
* Added options: `--hls-split-discontinuity` and `--no-hls-split-discontinuity`

Authored-by: shirtjs <2660574+shirtjs@users.noreply.github.com>
 4 years ago
pukkandan bc2ca1bb75 Update to ytdl-commit-cf2dbec 
cf2dbec630

Except: [kakao] improve info extraction and detect geo restriction
d8085580f6
 4 years ago
pukkandan cc2db87805 Update to ytdl-2021.02.10 
Except: [archiveorg] Fix and improve extraction (5fc53690cbe6abb11941a3f4846b566a7472753e)
 4 years ago
shirt-dev 3dd264bf42
#64 Implement self updater 
Co-authored-by: shirtjs <2660574+shirtjs@users.noreply.github.com> (shirt-dev)
Co-authored-by: pukkandan <pukkandan@gmail.com>
 4 years ago
pukkandan 545cc85d11 [youtube] Update to ytdl-2021.02.04.1 4 years ago
pukkandan e38df8f9fa Refactor `update-version`, `pyinst.py` and related files 
* Refactor update-version
* Moved pyinst, update-version and icon into devscripts
* pyinst doesn't bump version anymore
* Merge pyinst and pyinst32. Usage: `pyinst.py [32|64]`
* Add mutagen as requirement
* Remove make_win and related files
 4 years ago
pukkandan 5bfa486205 Add option `--parse-metadata` 
* The fields extracted by this can be used in `--output`
* Deprecated `--metadata-from-title`

:ci skip dl
 4 years ago
Remita Amine a820dc722e Update to ytdl-2021.01.24.1 4 years ago
pukkandan 610d8e7692 [tests] Fix test_post_hooks 
:skip ci all
 4 years ago
alxnull 0c3d0f5177 Added `--force-overwrites` option (https://github.com/ytdl-org/youtube-dl/pull/20405) 
Co-authored by alxnull
 4 years ago
pukkandan ebdd9275c3 Enable test_youtube_search_matching 
I forgot to enable this when the search url extractor was reinstated
 4 years ago
Alex Merkel ab8e5e516f Add post_hooks option to YoutubeDL.py (https://github.com/ytdl-org/youtube-dl/pull/27573) 
Authored by: alexmerkel
 4 years ago
pukkandan 00dd0cd573 Update to ytdl-2021.01.08 4 years ago
pukkandan 5d0c537141 Fix/disable tests 
The disabled tests needs to be fixed later
Tests for FormatSort, Multistreams also needs be created
 4 years ago
pukkandan 29f7c58aaf Update to ytdl-2021.01.03 4 years ago
pukkandan 2d30509fc8 Add --force-download-archive by by h-h-h-h 
Authored-by: h-h-h-h
 4 years ago
pukkandan 732044afb2 Add --write-*-link by h-h-h-h 
Authored-by: h-h-h-h
 4 years ago
pukkandan 3d3dddc948 Update youtube extractor to 2020.11.24 4 years ago
pukkandan a0566bbf5c Updated to release 2020.11.21.1 4 years ago
pukkandan 3462ffa892 Implemented all Youtube Feeds (ytfav, ytwatchlater, ytsubs, ythistory, ytrec) and SearchURL 4 years ago
pukkandan 8bdd16b499 Merge 'ytdl-org/youtube-dl/master' release 2020.11.19 
Old Extractors left behind:
	VLivePlaylistIE
	YoutubeSearchURLIE
	YoutubeShowIE
	YoutubeFavouritesIE

If removing old extractors, make corresponding changes in
	docs/supportedsites.md
	youtube_dlc/extractor/extractors.py

Not merged:
	.github/ISSUE_TEMPLATE/1_broken_site.md
	.github/ISSUE_TEMPLATE/2_site_support_request.md
	.github/ISSUE_TEMPLATE/3_site_feature_request.md
	.github/ISSUE_TEMPLATE/4_bug_report.md
	.github/ISSUE_TEMPLATE/5_feature_request.md
	test/test_all_urls.py
	youtube_dlc/version.py
	Changelog
 4 years ago
Unknown dd2d55f10d COMPLAINFREE 4 years ago
Unknown cdb7547e14 add pyinst to test exceptions 4 years ago
Unknown 39e7107d7f Merge branch 'ytdl-org-master' 4 years ago
Tom-Oliver Heidel 9aa79d6460 Merge branch 'master' of https://github.com/zubearc/youtube-dl into zubearc 4 years ago
zubearc 8848f8083b [test/youtube] update subtitle tests 4 years ago
Unknown 8ef153ee6f rot47 capital letters. 4 years ago
Unknown 3867038a06 renaming issues resolved 4 years ago
Unknown cefecac12c [skip travis] renaming 
to avoid using same folder when using pip install for example
 4 years ago
Sergey M․ 84213ea8d4
[youtube] Extract chapters from JSON (closes #24819) 5 years ago
Sergey M․ c380cc28c4
[utils] Improve cookie files support 
+ Add support for UTF-8 in cookie files
* Skip malformed cookie file entries instead of crashing (invalid entry len, invalid expires at)
 5 years ago
Sergey M․ e40c758c2a
[youtube] Improve player id extraction and add tests 5 years ago
Sergey M․ 042b664933
Revert "[utils] Add support for cookies with spaces used instead of tabs" 
According to [1] TABs must be used as separators between fields.
Files produces by some tools with spaces as separators are considered
malformed.

1. https://curl.haxx.se/docs/http-cookies.html

This reverts commit cff99c91d1.
 5 years ago
Sergey M․ cff99c91d1
[utils] Add support for cookies with spaces used instead of tabs 5 years ago
Sergey M․ ea17979d83
[test_subtitles] Remove obsolete test 5 years ago
Sergey M․ 4e9e1e240d
[test_YoutubeDL] Add tests for #10591 (closes #23873) 5 years ago
Sergey M․ e0abaab293
[test_YoutubeDL] Fix get_ids 5 years ago
Sergey M․ 42db58ec73
[utils] Improve str_to_int 5 years ago
Remita Amine 348c6bf1c1 [utils] handle int values passed to str_to_int 5 years ago
Sergey M․ 1ced222120
[utils] Add generic caesar cipher and rot47 5 years ago
InfernalUnderling 9d30c2132a [utils] Handle rd-suffixed day parts in unified_strdate (#23199) 5 years ago
Remita Amine 237513e801 [yahoo] restore support for cbs suffixed URLs 5 years ago
Sergey M․ 824fa51165
[utils] Improve subtitles_filename (closes #22753) 5 years ago
Sergey M․ 28cc2241e4
[utils] Restrict parse_codecs and add theora as known vcodec (#21381) 6 years ago
Sergey M․ 53cd37bac5
[utils] Improve strip_or_none 6 years ago
Sergey M․ 3089bc748c
Fix W504 and disable W503 (closes #20863) 6 years ago
Jakub Wilk fd35d8cdfd [utils] Transliterate "þ" as "th" (#20897) 
Despite visual similarity "þ" is unrelated to "p".
It is normally transliterated as "th":

    $ echo þ-Þ | iconv -t ASCII//TRANSLIT
    th-TH
 6 years ago
Sergey M․ 5e1271c56d
[utils] Improve int_or_none and float_or_none (#20403) 6 years ago
Sergey M․ d493f15c11
[extractor/common] Improve HTML5 entries extraction and add some realworld tests 6 years ago
Sergey M․ 0dc41787af
[utils] Introduce parse_bitrate 6 years ago
Sergey M․ 2e27421c70
[test_InfoExtractor] Add test for #20346 6 years ago
Sergey M․ 067aa17edf
Start moving to ytdl-org 6 years ago
Sergey M․ fca9baf0da
[test] Fix test_compat_etree_Element 6 years ago
Sergey M․ 399f76870d
[compat] Introduce compat_etree_Element 6 years ago
remitamine e7e62441cd [utils] strip #HttpOnly_ prefix from cookies files (#20219) 6 years ago
Ales Jirasek 22f5f5c6fc
[malltv] Add extractor (closes #18058) 6 years ago
Sergey M․ e118a8794f
[YoutubeDL] Fix typo in string negation implementation and add more tests (closes #18961) 6 years ago
Sergey M․ fad4ceb534
[utils] Fix urljoin for paths with non-http(s) schemes 6 years ago
Remita Amine fc746c3fdd [test/test_InfoExtractor] add test for #18923 6 years ago
Sergey M․ 2cc779f497
[YoutubeDL] Add negation support for string comparisons in format selection expressions (closes #18600, closes #18805) 6 years ago
Sergey M․ a16c7c033a
[test/helper] Add support for maxcount and count collection len test checkers 6 years ago
Sergey M․ 6e29458f24
[test/testdata/cookies/session_cookies.txt] Fix empty expires test data 6 years ago
Sergey M․ 9e02c2c704
[YoutubeDLCookieJar] Add test for keeping session cookies 6 years ago
Sergey M․ 6864855eb1
[tests] Fix invalid escape sequences 6 years ago
Xiao Di Guan 95e42d7336 [extractor/common] Ensure response handle is not prematurely closed before it can be read if it matches expected_status (resolves #17195, closes #17846, resolves #17447) 6 years ago
Sergey M․ 25d110be30
[utils] Properly recognize AV1 codec (closes #17506) 6 years ago
Sergey M․ af03000ad5
[utils] Introduce url_or_none 6 years ago
Sergey M․ e9c671d5e8
[utils] Allow JSONP with empty func name (closes #17028) 6 years ago
Enes 85750f8972 [openload] Improve ext extraction 7 years ago
Remita Amine 3bb3ff38a1 [test_utils] add tests for b836118724 7 years ago
Sergey M․ 6cc622327f
[utils] Introduce merge_dicts 7 years ago
Sergey M․ 1cc47c6674
[utils] Fix match_str for boolean meta fields 7 years ago
Dan Salmon 518d5ba519 Fix some tests 7 years ago
Sergey M․ 47a5cb7734
Generalize XML manifest processing code and improve XSPF parsing (closes #15794) 7 years ago
Ricardo Constantino 96b8b9abae
[extractor/generic] Support relative URIs in _parse_xspf 
<location> can have relative URIs, not just absolute.
 7 years ago
Philipp Hagemeister f226880c6d [tennistv] Add support for tennistv.com 7 years ago
Sergey M․ b871d7e954
[utils] Add parse_resolution 7 years ago
Sergey M․ befa4708fd
[utils] Fixup some common URL's typos in sanitize_url (closes #15649) 7 years ago
Sergey M․ 6fcc053947
[test_downloader_http] Use try_rm 7 years ago
Sergey M․ f19eae429a
[test_http] Use 127.0.0.1 instead of localhost 7 years ago
Sergey M․ ba515388b8
Introduce --http-chunk-size 7 years ago
squibbysquibby 655c410063 [test_download] Fix download tests for lazy extractors (closes #13554, closes #13757) 7 years ago
Sergey M․ c707b1d828
[test_utils] Add tests for malformed JSON handling in js_to_json 7 years ago
Mike Fährmann c384d537f8 [util] Improve scientific notation handling in js_to_json (closes #14789) 7 years ago
Sergey M․ 9d6ac71c27
[extractor/common] Fix extraction of DASH formats with the same representation id (closes #15111) 7 years ago
Sergey M․ b555ae9bf1
[utils] Add another date format pattern (#14999) 7 years ago
Sergey M․ 78593e294c
Add references for #14844 7 years ago
Petr Novak 41bf647e89
[extractor/common] Add support for DASH manifests with SegmentLists with bare SegmentURLs 7 years ago
Yen Chi Hsuan f58a506044 [test_InfoExtractor] Fix flake8 7 years ago
Sergey M․ d08dcd2dbd
[test_YoutubeDL] Fix typo (closes #14856) 7 years ago
Sergey M․ 181e381fda
[test_InfoExtractor] Add test for #14660 7 years ago
Sergey M․ 056653bbb1
[utils] Add support for zero years and months in parse_duration 7 years ago
Sergey M․ af0f74288d
[YoutubeDL] Improve _default_format_spec (closes #14461) 7 years ago
Sergey M․ cd6fc19ed7
[YoutubeDL] Ignore duplicates in --playlist-items 
E.g. '--playlist-items 2-4,3-4,3' should result in '[2,3,4]', not '[2,3,4,3,4,3]'
 7 years ago
Sergey M․ 86a15ed64b
[test_YoutubeDL] Add test for #14425 7 years ago
Yen Chi Hsuan 3869028ffb [utils] Use bytes-like objects in dfxp2srt 
This fixes handling of non-UTF8 TTML subtitles

Closes #14191
 7 years ago
Yen Chi Hsuan 95f3f7c20a
[utils] Fix unescapeHTML for misformed string like "&a&quot;" (#13935) 7 years ago
Sergey M․ 4850478543
[extractor/common] Add support for float durations in _parse_mpd_formats (closes #13919) 7 years ago
Sergey M․ 5b232f46dc
[utils] Skip missing params in cli_bool_option (closes #13865) 7 years ago
Sergey M․ 8cda78ef72
[test_YoutubeDL] Add a test for #10083 7 years ago
Yen Chi Hsuan 73095e013f
[options] Typo 7 years ago
Yen Chi Hsuan 905d18a7aa
[options] Correctly hide login info from debug outputs (#13696) 
Iterate over opts instead of PRIVATE_OPTS for both performance and
correctness
 7 years ago
Sergey M․ 0017d9ad6d
[YoutubeDL] Improve default format specification (closes #13704) 7 years ago
Sergey M․ 0396806f67
[YoutubeDL] Do not override id, extractor and extractor_key in url_transparent 
All these meta fields must be borrowed from final extractor that actually performs extraction.
This commit fixes extractor id in download archives for url_transparent downloads. Previously, 'transparent' extractor was erroneously
used for extractor archive id, e.g. 'eggheadlesson 4n8ugwwj5t' instead of 'wistia 4n8ugwwj5t'.
 7 years ago
Sergey M․ 15da37c7dc
[YoutubeDL] Don't expand env variables in meta fields (closes #13637) 7 years ago
Sergey M․ dee2ff1d81
[test_utils] Fix tests under Windows 7 years ago
Yen Chi Hsuan 609ff8ca19 [utils] Support attributes with no values in get_elements_by_attribute() 7 years ago
Sergey M․ b4a3d461e4
[utils] Handle HTMLParseError in extract_attributes (closes #13349) 8 years ago
Sergey M․ 2ae2ffda5e
[utils] Improve unified_timestamp 8 years ago
Sergey M․ 39d4c1be4d
[youtube] Improve chapters extraction (closes #13247) 8 years ago
Yen Chi Hsuan 5552c9eb0f
[utils] Recognize more patterns in strip_jsonp() 
Used in Youku Show pages
 8 years ago
Sergey M․ e4a75d7932
[test_youtube_chapters] PEP 8 8 years ago
Sergey M․ a57a8e9918
[test_youtube_chapters] Add coding cookie 8 years ago
Sergey M․ 9cafc3fd8b
[youtube] Extract chapters 8 years ago
Yen Chi Hsuan 0c26548601
[cda] Implement birthday verification (closes #12789) 8 years ago
Sergey M․ deef31955b
[utils] Improve unified_timestamp 
Seen at http://zaq1.pl/video/xev0e
 8 years ago
Tithen-Firion 9222d94510 [test_utils] Add one more clean_html test 8 years ago
Sergey M․ 30bb6ce1a4
[test_InfoExtractor] Fix test_parse_m3u8_formats 8 years ago
Tithen-Firion 374560f018 [test_download] Fix order when testing file's md5 8 years ago
Sergey M․ ff99fe529e
Don't list master m3u8 playlists in format list (closes #12832) 8 years ago
Sergey M․ 538eee7b6a
Add missing test m3u8 file 8 years ago
Sergey M․ ddd258f922
[test_InfoExtractor] Add m3u8 parsing test for NAME attribute in EXT-X-STREAM-INF tag 8 years ago
Sergey M․ cb2520802d
[extractor/common] Improve m3u8 extraction (closes #12211) 
* Extract m3u8 parsing to separate method
* Improve rendition groups extraction
* Build stream name according stream GROUP-ID
* Ignore reference to AUDIO group without URI when stream has no CODECS
+ Add test coverage for parsing m3u8 from #11507, #11995, #12211 and twitch vod
 8 years ago
Remita Amine 5b995f713b [utils] add support for ttml styles 8 years ago
Sergey M․ 51350db5a3
[test_YoutubeDL] Add test for #11163 8 years ago
Sergey M․ 364a69e8c6
[test_download] Fix testing playlists with single video and add comments 8 years ago
Sergey M․ 60e5016199
[test_download] Remove unused import 8 years ago
Sergey M․ c4d6fc6d65
[test_subtitles] Fix raiplay test 8 years ago
Sergey M․ 80b2fdf9ac
[test_download] Match info dicts against tests before matching info file 8 years ago
John Hawkinson 3bef10a50c [test_download] typo in comment 8 years ago
John Hawkinson a84da06f49 [test_download] Improve diagnostic on wrong 'id' 8 years ago
Sergey M․ 942b44a052
[test_compat] Do not use dash in env variables' names 8 years ago
Sergey M․ a426ef6d78
[test_utils] Do not use dash in env variables' names 8 years ago
Sergey M․ 41c5e60dd5
[test_utils] Fix expand_path tests 8 years ago
Sergey M․ 51098426b8
[utils] Introduce expand_path 8 years ago
John Hawkinson c6c22e984d [test_download] Print additional IEs in summary output 8 years ago
Sergey M․ 7f3590c43b
[test_InfoExtractor] Add some realworld tests for _extract_jwplayer_data 8 years ago
Sergey M․ 4b5de77bdb
[utils] Process bytestrings in urljoin (closes #12369) 8 years ago
Yen Chi Hsuan f48409c7ac [utils] Add pkcs1pad 
Used in daisuki.net (#4738)
 8 years ago
Yen Chi Hsuan c9619f0a17 [aes] Add aes_cbc_encrypt 
Used in daisuki.net (#4738)
 8 years ago
Sergey M․ d0d9ade486 [YoutubeDL] Add support for string formatting operations in output template 8 years ago
Yen Chi Hsuan 8936f68a0b
[travis] Run tests in parallel 
[test_download] Print test names in case of network errors

[test_download] Add comments for nose parameters

[test_download] Modify outtmpl to prevent info JSON filename conflicts

Thanks @jaimeMF for the idea.

[travis] Only download tests should be run in parallel
 8 years ago
Sergey M․ 398dea3210
[test_YoutubeDL] Fix invalid escape sequences 8 years ago
Sergey M․ db13c16ef8
[utils] Add support for quoted string literals in --match-filter (closes #8050, closes #12142, closes #12144) 8 years ago
Thomas Christlieb 2af12ad9d2 Introduce get_elements_by_class and get_elements_by_attribute utility functions 8 years ago
Sergey M․ 4195096ea8
[utils] Improve comments processing in js_to_json (closes #11947) 8 years ago
Michal Čihař b3ee552e4b
[utils] Handle single-line comments in js_to_json 8 years ago
Sergey M․ 15846398ca
[utils] Improve parse_duration 8 years ago
Sergey M․ cb655f34fb
[utils] Add more date formats 8 years ago
Remita Amine 7fe1592073 [common] fix dash codec information for mixed videos and fragment url construction(#11490) 8 years ago
Sergey M․ b0c65c677f
[utils] Improve urljoin 8 years ago
Sergey M․ e34c33614d
[utils] Add convenience urljoin 8 years ago
Yen Chi Hsuan 582be35847
Update coding style after pycodestyle 2.1.0 
In pycodestyle 2.1.0, E305 was introduced, which requires two blank
lines after top level declarations, too.

See https://github.com/PyCQA/pycodestyle/issues/400

See also #10689; thanks @stepshal for first mentioning this issue and
initial patches
 8 years ago
Kacper Michajłow 189935f159 [jsinterp] Fix function calls without arguments. 8 years ago
Sergey M․ 02dc0a36b7
[utils] Introduce base_url 8 years ago
Sergey M․ e5a088dc4b
[utils] Fix --match-filter for int-like strings (closes #11082) 8 years ago
Yen Chi Hsuan 6f20b65e72
[test/test_http] Update tests 
After switching to HTML5 extraction helpers in generic.py, the result
info_dict is always a playlist.
 8 years ago
Sergey M․ c6eed6b8c0
[utils] Lower priority for rare date formats and add tests 8 years ago
Sergey M․ 3e4185c396
[utils] Use native french month names 8 years ago
Sergey M․ f6717dec8a
[utils] Improve month_by_name and add tests 8 years ago
Sergey M․ 6562d34a8c
[utils] Improve mimetype2ext 8 years ago
Yen Chi Hsuan 70852b47ca
[utils] Recognize units with full names in parse_filename 
Reference: https://en.wikipedia.org/wiki/Template:Quantities_of_bytes
 8 years ago
Yen Chi Hsuan e4659b4547
[utils] Correct octal/hexadecimal number detection in js_to_json 8 years ago
Sergey M․ 13585d7682
[utils] Recognize lowercase units in parse_filesize 8 years ago
Yen Chi Hsuan 52aa7e7476
[test_verbose_output] Fix tests under Python 3 8 years ago
Remita Amine 5f2c2b7936 [test_utils] add test for option with not str value 8 years ago
Sergey M․ a8795327ca
[utils] Add support TV Parental Guidelines ratings in parse_age_limit 8 years ago
Yen Chi Hsuan 7dc2a74e0a
[utils] Fix unified_timestamp for formats parsed by parsedate_tz() 8 years ago
Sergey M․ b070564efb
[extractor/common] Support multiple properties in _og_search_property 8 years ago
Philipp Hagemeister ce28252c48 [options] Add test that checks that --password=secret is hidden in verbose output 8 years ago
Yen Chi Hsuan 14a28e705b
[test/test_all_urls] Remove *.cc.com tests 8 years ago
Sergey M․ 317f7ab634
[YoutubeDL] Fix format selection with filters (Closes #10083) 8 years ago
Yen Chi Hsuan 0b68de3cc1 Merge pull request #8876 from remitamine/html5_media 
[extractor/common] add helper method to extract html5 media entries
 8 years ago
Yen Chi Hsuan dfe5fa49ae
[compat] Fix compat_shlex_split for non-ASCII input 
Closes #9871
 8 years ago
Yen Chi Hsuan 84c237fb8a
[utils] Add get_element_by_class 
For #9950
 9 years ago
Remita Amine dfaa86b75e [test_utils] add test for smuggling a smuggled url 9 years ago
Yen Chi Hsuan 40f3666f6b
[test/test_http] Update tests for 38cce791c7 9 years ago
Jaime Marquínez Ferrándiz a9eede3913
[test/compat] compat_shlex_split: test with newlines 9 years ago
Sergey M․ fd7a7498a4
[test_all_urls] PEP 8 and change wording 9 years ago
Matthieu Muffato e3a6747d8f
New test-case: extractor names are supposed to be unique 
@dstftw explained in
https://github.com/rg3/youtube-dl/pull/9918#issuecomment-228625878 that
extractor names are supposed to be unique. @dstftw has fixed the two
offending extractors, and here I add a test to ensure this does not
happen in the future.
 9 years ago
remitamine 4f3c5e0627 [utils] add helper function for parsing codecs 9 years ago
Sergey M․ 88d9f6c0c4
[utils] Add support for name list in _html_search_meta 9 years ago
Yen Chi Hsuan 1143535d76
[utils] Add urshift() 
Used in IqiyiIE and LeIE
 9 years ago
Sergey M․ 46f59e89ea
[utils] Add unified_timestamp 9 years ago
Yen Chi Hsuan 47212f7bcb
[utils] Don't transform numbers not starting with a zero 
Fix test_Viidea and maybe others
 9 years ago
Yen Chi Hsuan 55b2f099c0
[utils] Decode HTML5 entities 
Used in test_Vporn_1. Also related to #9270
 9 years ago
bzc6p b96f007eeb Added sanitization support for Hungarian letters Ő and Ű 9 years ago
Yen Chi Hsuan 54fb199681 [test/test_http] Fix getsockname() on Jython 9 years ago
Yen Chi Hsuan 8c32e5dc32 [test/test_utils] Add test for #9588 9 years ago
Yen Chi Hsuan eb7941e3e6
[compat] Fix for XML with <!DOCTYPE> in Python 2.7 and 3.2 
Such XML documents cause DeprecationWarning if python is run
with `-W error`
 9 years ago
Sergey M․ 46bc9b7d7c
[utils] Allow None in remove_{start,end} 9 years ago
Sergey M․ 364cf465dd
[test_utils] PEP 8 9 years ago
Sergey M․ 89ac4a19e6
[utils] Process non-base 10 integers in js_to_json 9 years ago
felix bd1e484448
[utils] js_to_json: various improvements 
now JS object literals like { /* " */ 0: ",]\xaa<\/p>", } will be correctly converted to JSON.
 9 years ago
Yen Chi Hsuan 98d560f205
[test/test_socks] Skip SOCKS tests 
They occasional trigger errors or blocks
(https://travis-ci.org/rg3/youtube-dl/jobs/130184883)
 9 years ago
Yen Chi Hsuan 778a1ccca7
[utils] Add Œ and œ found in French to ACCENT_CHARS 
Fixes #9463
 9 years ago
Yen Chi Hsuan c2876afafe
[test/test_socks] Use a different port range 
Seems on Travis CI, ports in the original range are often used.
 9 years ago
Yen Chi Hsuan e21f17fc86
[test/test_socks] Test with local SOCKS servers 9 years ago
Yen Chi Hsuan edaa23f822
[compat] Rename struct_(un)pack to compat_struct_(un)pack 9 years ago
Yen Chi Hsuan 72f3289ac4
[test/test_socks] Add tests for SOCKS proxies 9 years ago
Yen Chi Hsuan dab0daeeb0
[utils,compat] Move struct_pack and struct_unpack to compat.py 9 years ago
Sergey M․ fad7bbec3a
[test_compat] Remove unused import 9 years ago
Sergey M․ 20cfdcc910
[test_compat] Avoid None values for compat_setenv 9 years ago
Sergey M․ 1292638754
[test_compat] Use compat_setenv 9 years ago
Sergey M․ fe40f9eef2
[compat] Add compat_setenv 9 years ago