f1fd5e8db1
mark feed as having an error if update task fails (and no last error is already stored for this feed)
5 years ago
4ea407f613
when auto disabling feeds based on DAEMON_UNSUCCESSFUL_DAYS_LIMIT only consider feeds with recent attempts to update (to prevent clashes with not recently logged users, etc)
5 years ago
38a7a1da88
hide uninteresting errors in several DOMDocument->loadHTML() invocations
5 years ago
8a02a728c8
add DAEMON_UNSUCCESSFUL_DAYS_LIMIT tunable (defaults to 30 days)
5 years ago
e641547d37
set ttrss_feeds.last_successful_update as needed
5 years ago
15e8ee3471
housekeeping: add task to cleanup orphan feed icons
5 years ago
82bc740363
Logger::log - allow specifying errno
...
bump severity of PDO exception log messages to E_USER_WARNING
5 years ago
23d20847a3
update_rss_feed: fallback to previous method if passthru() is not available
5 years ago
7c8bed0524
accept -1 as a valid exit code for per-feed update processes
5 years ago
335dcd3bf9
don't mention last_updated in non-zero failure error message because that's not what it means
5 years ago
3534b8dfa7
improve logging for per-feed update task failures
5 years ago
74cd60d7cc
update_rss_feed: don't return as if failed on http 304
5 years ago
d4d0e976dc
update-feed: exit with non-zero exit code if update_rss_feed() failed
...
daemon: log if per-feed update task terminated with non-zero exit code
5 years ago
0761533d0a
lock per-feed update processes based on feed ID to reduce possibilty
...
of concurrent updates
5 years ago
528b387563
update individual feed in a separate process to prevent PHP fatal errors
...
(for example, OOM) from stopping the entire batch
this should also slightly increase memory budget for update processes
5 years ago
05744bb474
fix updater never scheduling feeds for update if they never been updated before while having default update interval set
5 years ago
6811d0bde2
use self:: in some places to invoke static methods from the same class
5 years ago
74568df4ff
remove a lot of stuff from global context (functions.php), add a few helper classes instead
5 years ago
3dd4169b5f
clarify some URL validation-related error messages
5 years ago
4785f21316
update_rss_feed: log effective URL after fetching
...
validate_url: treat scheme as case-insensitive
5 years ago
a4525d31b2
replace FALSE with false so that static analyzer shuts up about it
5 years ago
afa0023c51
don't try to update manually disabled feeds even if they haven't been updated before or are marked for a manual update
5 years ago
c352e872e9
core: pass found enclosures to HOOK_ARTICLE_FILTER
...
af_redditimgur: remove enclosures if we found something to embed because it's going to be a low-res thumbnail
6 years ago
6eb94f1e13
better support for image srcset attributes as discussed in https://community.tt-rss.org/t/problem-with-img-srcset/3519
6 years ago
06d2c65193
calculate_article_hash: don't die() on previous, woops
6 years ago
3a142cbf58
calculate_article_hash: ignore some useless or read-only fields (i.e. GUID) when calculating hash
6 years ago
cd1f3cb8cc
* store UID in article hashed GUID separately so it could be migrated cleanly to a different instance
...
* store resulting GUID as a JSON object so it could be extended easier if needed
6 years ago
3a4b9249a9
DiskCache: properly deal with srcset attributes
6 years ago
4a00f96733
remove unneeded var_dump()
6 years ago
6573541873
* add HOOK_ENCLOSURE_IMPORTED
...
* pass feed id to HOOK_FEED_PARSED
6 years ago
ec1b0befc7
add support for video[@src] in media cache
...
it's a valid alternative to a source[@src] child element:
https://developer.mozilla.org/en-US/docs/Web/HTML/Element/video
6 years ago
cdde23b4dc
actually download <video> posters to media cache
...
video[@poster] is already supported in the rewriting logic but never
actually downloaded
6 years ago
f24ece85a6
add validationtextarea control, use it for filter match editor
6 years ago
6080cca9ca
scrap counter cache system; rework counters to sum() booleans instead
6 years ago
e5b7b145e5
cache media: set referrer to source URL when fetching images
6 years ago
304d3a0b88
tag-related fixes
...
1. move tag sanitization to feedparser common item class
2. enforce length limit on tags when parsing
3. support multiple tags passed via one dc:subject and other such elements, parse them as a comma-separated list
4. sort resulting tag list to prevent different order between feed updates
5. remove some duplicate code related to tag validation
6. allow + symbol in tags
6 years ago
8c3efd51ec
reset domain hit quota on feed update start
6 years ago
0d7b10469b
update_rss_feed: add specific logging for HOOK_FETCH_FEED, HOOK_FEED_FETCHED, HOOK_FEED_PARSED handlers
6 years ago
5bb8dad631
is_gzipped: don't try to strpos() over entire buffer
6 years ago
647c7c45eb
allow article filters to modify num_comments
6 years ago
4e05008aac
update_rss_feed: force cast initial timestamp value to integer
6 years ago
b0d67cd3d0
rework previous to pass unformatted timestamp to plugin, and deal with formatting later
...
also, move timestamp-related debugging output after plugin handler
6 years ago
94a12b9674
pass formatted entry timestamp to article filters and allow them to modify it
6 years ago
6914ad1f74
retire MIN_CACHE_FILE_SIZE
7 years ago
84974c60a7
RSSUtils::cache_media, cache_enclosures: use DiskCache
7 years ago
fdb6066bf6
* HOOK_ENCLOSURE_ENTRY: pass article_id to handler
...
* DiskCache: multiple fixes; support isWritable() for cache entries, set content-disposition for send()
* public/cached_url: allow selecting files from sub-caches other than images
* plugins/Cache_Starred_Images: rework to use DiskCache, can be enabled per-user, properly handles article enclosures, etc
7 years ago
19b9b27662
expire_cached_files to DiskCache::expire()
7 years ago
088fcf8131
move more globals to more appropriate places
...
set libxml to always use internal errors
7 years ago
4fa9aee4e7
move several more global functions to more appropriate classes
7 years ago
9423d72f6c
parser: force libxml error messages to valid utf8
7 years ago
Andrew Dolgov