a32a9a7ef5
[extractor/common] Add support multiple getters in try_get
8 years ago
51098426b8
[utils] Introduce expand_path
8 years ago
4b5de77bdb
[utils] Process bytestrings in urljoin ( closes #12369 )
8 years ago
158af5242e
[utils] Carry long doc string
8 years ago
0a5445ddbe
[utils] Add bytes_to_long() and long_to_bytes()
...
Used in daisuki.net (#4738 )
Both are adapted from public domain PyCrypto:
https://github.com/dlitz/pycrypto/blob/master/lib/Crypto/Util/number.py
8 years ago
f48409c7ac
[utils] Add pkcs1pad
...
Used in daisuki.net (#4738 )
8 years ago
4248dad92b
Improve geo bypass mechanism
...
* Rename options to preffixly match with --geo-verification-proxy
* Introduce _GEO_COUNTRIES for extractors
* Implement faking IP right away for sites with known geo restriction
8 years ago
18a0defab0
[utils] Make random_ipv4 return unicode string
8 years ago
773f291dcb
Add experimental geo restriction bypass mechanism
...
Based on faking X-Forwarded-For HTTP header
8 years ago
bf5b9d859a
[utils] Introduce YoutubeDLError base class for all youtube-dl exceptions
8 years ago
db13c16ef8
[utils] Add support for quoted string literals in --match-filter ( closes #8050 , closes #12142 , closes #12144 )
8 years ago
2f49bcd690
utils.py: Workaround TypeError with Python 2.7.13 in Windows
...
Fixes #11540
Tested with Windows Python 2.7.12 and 2.7.13.
8 years ago
2af12ad9d2
Introduce get_elements_by_class and get_elements_by_attribute utility functions
8 years ago
4195096ea8
[utils] Improve comments processing in js_to_json ( closes #11947 )
8 years ago
b3ee552e4b
[utils] Handle single-line comments in js_to_json
8 years ago
15846398ca
[utils] Improve parse_duration
8 years ago
0c1c6f4b9f
[utils] Add another date format seen in NextTV
8 years ago
cb655f34fb
[utils] Add more date formats
8 years ago
ec85ded83c
Fix "invalid escape sequences" error on Python 3.6
8 years ago
b0c65c677f
[utils] Improve urljoin
8 years ago
e34c33614d
[utils] Add convenience urljoin
8 years ago
fb37eb25d9
[utils] Add common user agents map
8 years ago
02dc0a36b7
[utils] Introduce base_url
8 years ago
e5a088dc4b
[utils] Fix --match-filter for int-like strings ( closes #11082 )
8 years ago
b64d04c119
[utils] Clarify for redirecting STDIN in get_exe_version()
8 years ago
00ca755231
[get_exe_version] Do version probes with <&-
...
When doing version probes for ffmpeg, do the
equivalent of calling it as:
ffmpeg -version <&-
Where <&- is shell syntax for closing stdin before calling the
program. This is roughly equivalent to </dev/null without actually
opening /dev/null.
This prevents ffmpeg -version from hanging when run in the background.
Fixes #955 .
The reason is that ffmpeg tries to manipulate stdin to set up terminal
characteristic, and that causes the kernel to suspend the parent
process (youtube-dl).
Note that closing stdin is achieved by calling subprocess.Popen() with
stdin set to subprocess.PIPE and without passing any input to
Popen.communicate(). This is somewhat subtle.
8 years ago
06b3fe2926
[utils] Expose PACKED_CODES_RE
8 years ago
dcdb292fdd
Unify coding cookie
8 years ago
bd26441205
[utils] Fix xattr error handling
8 years ago
53a7e3d287
[utils] Support xattr as well as pyxattr
...
Closes #9054
There are two xattr packages in Python, pyxattr [1] and xattr [2]. They
have different APIs.
In old days pyxattr supports Linux only and xattr supports Linux, Mac,
FreeBSD and Solaris, and pyxattr supports Linux only. Recently pyxattr
adds support for Mac OS X. [3]
An old version of [2] is shipped with Mac OS X. However, some Linux
distributions have pyxattr only, for example PLD-Linux [4] and old Arch
Linux. [5] As a result, supporting both is the way to go.
[1] https://github.com/iustin/pyxattr
[2] https://github.com/xattr/xattr
[3] https://github.com/iustin/pyxattr/pull/9
[4] https://github.com/rg3/youtube-dl/issues/5498
[5] https://git.archlinux.org/svntogit/community.git/commit/?id=427c4c76401e386d865ccddea4fbfdc74df80492
https://git.archlinux.org/svntogit/community.git/commit/?id=59b40da7b69622a6761d364a8b07909e9cccaa56
python-xattr is added on 2016/06/29 while pyxattr is there for more
than 6 years
8 years ago
c6eed6b8c0
[utils] Lower priority for rare date formats and add tests
8 years ago
3aa3953d28
[vk] Fix date and view count extraction.
8 years ago
efa97bdcf1
Move write_xattr to utils.py
...
There are some other places that use xattr functions. It's better to
move it to a common place so that others can use it.
8 years ago
3e4185c396
[utils] Use native french month names
8 years ago
f6717dec8a
[utils] Improve month_by_name and add tests
8 years ago
a942d6cb48
[utils,franceinter] Add french months' names and fix extraction
...
Update of the "FranceInter" radio extractor : webpages HTML structure
had changed, the extractor didn't work. So I updated this extractor to
get the mp3 URL and all details.
8 years ago
c2b2c7e138
[utils] Add quicktime to mimetype2ext
8 years ago
6562d34a8c
[utils] Improve mimetype2ext
8 years ago
073ac1225f
[utils] add ac-3 to the list of audio codecs in parse_codecs
8 years ago
70852b47ca
[utils] Recognize units with full names in parse_filename
...
Reference: https://en.wikipedia.org/wiki/Template:Quantities_of_bytes
8 years ago
e4659b4547
[utils] Correct octal/hexadecimal number detection in js_to_json
8 years ago
13585d7682
[utils] Recognize lowercase units in parse_filesize
8 years ago
98e698f1ff
[external/curl] respect more downloader options and display progress
8 years ago
81c13222c6
[utils] Recognize more formats in unified_timestamp
...
Used in CtsNews
8 years ago
a8795327ca
[utils] Add support TV Parental Guidelines ratings in parse_age_limit
8 years ago
d3f8e038fe
[utils] Add decode_png for openload ( #9706 )
8 years ago
7dc2a74e0a
[utils] Fix unified_timestamp for formats parsed by parsedate_tz()
8 years ago
f164b97123
[utils] Add another f4m mimetype to mimetype2ext
8 years ago
e910fe2fe4
[brightcove] skip ism manifests
8 years ago
0b68de3cc1
Merge pull request #8876 from remitamine/html5_media
...
[extractor/common] add helper method to extract html5 media entries
8 years ago
Sergey M․