Commit Graph

264 Commits (3e220fd13165eff5d2c3180f2a2c82672a3187a6)

Author SHA1 Message Date
Dmitry Konishchev ffa1bd7b19 Allow slashes in filter regular expressions
User's regular expressions need escaping before passing them to
preg_match()
12 years ago
Andrew Dolgov 90e5f4f1de base if-modified-since on last received article, not feed update timestamp 12 years ago
Andrew Dolgov 23283f11a3 fetch: better checking for 1970- date 12 years ago
Andrew Dolgov aafd55bab6 do not needlessly mark icons as failed 12 years ago
Andrew Dolgov 84ceb6bd2e fix floicon failed message not respecting debugging setting 12 years ago
Andrew Dolgov e2cf81e214 unify houskeeping stuff, increase spawn interval 12 years ago
Andrew Dolgov 654650857f reduce daemon chattiness a bit 12 years ago
Andrew Dolgov 8cabc200d5 increase updstart locking interval to prevent concurrent updates; decrease batch size for the daemon 12 years ago
Andrew Dolgov fce451a4f7 fix updating for pgsql
increase default batch size
remove random check between feedbrowser or update task executing
12 years ago
Andrew Dolgov 81c2066345 updating: do not use cache timestamp if it is unusable for current feed;
sort chronologically instead of random
12 years ago
Andrew Dolgov 6ee0d4b05c do not recalculate avg color repeatedly 12 years ago
Andrew Dolgov 560cbd8c0d attempt to recalculate favicon avg color if it changes 12 years ago
Andrew Dolgov 36490f11a3 add a hack so that if floicon fails on some icon, it won't be processed again 12 years ago
Daniel Andersson 1134497129 Fix doubly applied basepaths to lockfiles. 12 years ago
Andrew Dolgov 68cccafcad remove debug_enabled global 12 years ago
Andrew Dolgov 9ec103525d update_rss_feed: simplify debug reporting 12 years ago
Andrew Dolgov ebec81a6fb subscribe: verify XML before adding to the database; fetch: try to work around entity problems if initial parsing fails 12 years ago
Andrew Dolgov 1367bc3f5e trim received feed data on fetch 12 years ago
Andrew Dolgov 96db9a14d9 do not try to calculate icon avg color if GD is not present 12 years ago
Andrew Dolgov ce2b219c64 entry_author: do not double escape string, author & comments: trim 12 years ago
Andrew Dolgov 1ffe3391f9 make pluginhost a singleton 12 years ago
Andrew Dolgov 52d88392da move db-prefs to OO 12 years ago
Andrew Dolgov 3f6f085769 add better gzdecode support for php native fetch, use curl under open_basedir 12 years ago
Andrew Dolgov d0d86316ee Revert "do automatic gzcdecode on feed data"
This reverts commit aea03558bb.
12 years ago
Andrew Dolgov aea03558bb do automatic gzcdecode on feed data 12 years ago
Andrew Dolgov 48cb253625 get_article_filter: fix missing argument 12 years ago
Andrew Dolgov a42c55f02b fix blank character after opening bracket in function calls 12 years ago
Andrew Dolgov 7440a7fe3c daemon2: use passthrough to daemon-loop 12 years ago
Andrew Dolgov 6322ac79a0 remove $link 12 years ago
Andrew Dolgov 857efe49e6 add schema checking to feed updating and update script 12 years ago
Andrew Dolgov e2261e177b implement old log entry purging in update_daemon_common; add some more error types; tweak error log display 12 years ago
Andrew Dolgov 5e3d5480f7 use hashed guids in a hopefully backwards compatible fashion 12 years ago
Andrew Dolgov bc7a144dd5 properly remove and replace favicon color when favicon gets manually removed/uploaded 12 years ago
Andrew Dolgov 12a6bd28ac remove hsl stuff from classes/feeds, we take care of this when choosing the color 12 years ago
Andrew Dolgov 6ac722d5b1 try to improve color guessing algorithm a bit 12 years ago
Andrew Dolgov 63c323f736 only enable colored favicons in vfeeds; fix RGB triplet packing 12 years ago
Andrew Dolgov 687a4f59c8 store favicon color as #rrggbb; process existing favicons 12 years ago
moontear 2cfbb448fb Added average color calculation of feeds' favicons for banded display. 12 years ago
Andrew Dolgov 044cff2d74 implement basic feed authentication parameter encryption in the database (FEED_CRYPT_KEY) 12 years ago
Andrew Dolgov c5569ff8d3 decode html entities in article title on import 12 years ago
Andrew Dolgov 3306daecf4 implement upload-related support for open_basedir 12 years ago
Andrew Dolgov 5929a0c1e4 updater: prevent duplicate feed ids being scheduled for update 12 years ago
Barak Korren 32b7a340ad Merge branch 'master' into tunable-fetches
Conflicts:
	include/rssfuncs.php
12 years ago
Barak Korren 8401101d50 Moved hard-coded fetch timeout values into config file to allow site-level tuning 12 years ago
Andrew Dolgov 5e736e4592 implement stop action 12 years ago
Andrew Dolgov ee0542ce28 daemon: do not schedule user-disabled feeds (2) 12 years ago
Andrew Dolgov cd7ebb39e4 daemon: do not schedule user-disabled feeds 12 years ago
Andrew Dolgov e81610d9ef daemon: sort by random 12 years ago
Andrew Dolgov 8292d05b7c daemon: show feeds/minute stats 12 years ago
Andrew Dolgov 17e74b21cf update_rss_feed: bailout if cache is considered valid, but older than last_updated 12 years ago
Andrew Dolgov 31623bfa99 if-modified-since: also take last_updated into account 12 years ago
Andrew Dolgov 7a01dc776e support If-Modified-Since 12 years ago
Andrew Dolgov 7b11aa80ab Revert "Avoid updating feed based on user pref DEFAULT_UPDATE_INTERVAL if it is set to -1 (no update)"
This reverts commit bca1cfbb95.
12 years ago
all bca1cfbb95 Avoid updating feed based on user pref DEFAULT_UPDATE_INTERVAL if it is set to -1 (no update) 12 years ago
Andrew Dolgov 0d6943b097 Revert "order feeds selected for update randomly"
This reverts commit 13b33a3fc3.
12 years ago
Andrew Dolgov 13b33a3fc3 order feeds selected for update randomly 12 years ago
Andrew Dolgov 32b05702ff daemon: do not show feed urls twice 12 years ago
Andrew Dolgov 30ac8d1f86 update: exclude feeds with disabled updates 12 years ago
Andrew Dolgov 1c4421fcd7 experimentally rework update daemon to process all feeds with the same url sequentially to minimize network access and better utilize caches 12 years ago
Andrew Dolgov 4f9cbdff1d cache simplepie object instead of xml feed data 12 years ago
Andrew Dolgov d5974daa33 remove feed update interval debugging 12 years ago
Andrew Dolgov f074ffe945 cache downloaded feed data to minimize network access 12 years ago
Joschasa ca5ff2d9fb Remove 2 useless line breaks. One got printed even with --quiet. 12 years ago
Andrew Dolgov be574731fc modify sorting by date_entered: set date_entered per-batch; use updated as a secondary criteria 12 years ago
saperduper 30123fe630 Handle future pubDate
Posts with pubDate in the future always appear at the top, which is ruining the
whole "newest at top" idea. One way to handle this is to use time() instead.
This is what google reader does and seems reasonable.
12 years ago
Andrew Dolgov a3a896a127 let us rejoice on being able to create double negative filters (refs #631) 12 years ago
Andrew Dolgov 227d5e4168 label auto matcher: preg_quote() label 12 years ago
Andrew Dolgov 9811276da7 rssfuncs: do not try to match on empty label 12 years ago
Andrew Dolgov 3972bf5981 db_escape_string: specify link parameter for consistency; sessions: do not force-close db connection in _close() 12 years ago
Andrew Dolgov f0bd8e6531 rework image caching to work without permanent article content rewriting (refs #582) 12 years ago
Andrew Dolgov f935d98e5d properly fix the cache_images issue (refs #578) 12 years ago
Andrew Dolgov 7873d58822 implement proper last_marked/last_published feeds for proper sorting of
published and marked virtual feeds, remove sorting by last_read
workaround
api: add pubsubhubbub ping when article is being set published
bump schema
12 years ago
Andrew Dolgov 1f45c8571f fix escaping of entry content being broken by cache_images() rewriting 12 years ago
Andrew Dolgov 8349a32e75 remove cache_content remnants 12 years ago
Andrew Dolgov cc38c8e549 remove LIBXML_NOEMPTYTAG because of double <br/>s - the #357 issue with
htmlpurifier might not be relevant anymore because of htmLawed switch,
but <br/>s are annoying
12 years ago
Andrew Dolgov 96f98cb091 escape fetch error message before saving in the db (closes #550) 12 years ago
Andrew Dolgov 41acdf4c11 remove purging of inactive feeds in daemon_common (causes duplicates) 12 years ago
Andrew Dolgov f161869541 when purging inactive feeds, set last_updated to NOW() 12 years ago
Andrew Dolgov be17885789 pluginhost: add get_debug()/set_debug() for plugins to detect if debugging is allowed 12 years ago
Andrew Dolgov 70caff4811 done collecting data debug message: remove title 12 years ago
Andrew Dolgov 5321e775f9 remove update on checksum change (updated status has been removed); rtl stuff (unused) 12 years ago
Andrew Dolgov 5d56d100f1 force disable simplepie unnecessarily sanitizing data 12 years ago
Andrew Dolgov 2ea09bdef6 update_daemon_common: purge inactive/not updated feeds 12 years ago
Andrew Dolgov ada103f234 simplepie init: hide errors 12 years ago
Andrew Dolgov 5de51df7f8 rssfuncs: show fetch done debug message in appropriate place 12 years ago
Andrew Dolgov ab457a9c96 rssfuncs: load pluginhost stuff properly 12 years ago
Andrew Dolgov 017401ddce implement HOOK_FEED_FETCHED 12 years ago
Andrew Dolgov e02555c1b8 add af_* plugin workaround for already processed article 12 years ago
Andrew Dolgov b30abdadd2 prevent article filters from modifying article GUID; add separate plugin_data field for this 12 years ago
Andrew Dolgov 750cfcd2fa remove processing of ttrss_feeds.icon_url 12 years ago
Andrew Dolgov 0a3fd79b0e fix image caching not working on plugin-rewritten content; remove content cache stuff 12 years ago
Andrew Dolgov 87d7e8507a split some more functions from functions.php 12 years ago
Andrew Dolgov c5e3995f8c disable content caching if _FEEDS_CONTENT_CACHE is not enabled 12 years ago
Andrew Dolgov 3a4c897382 force separate data in ttrss_entries between users 12 years ago
Andrew Dolgov ba946ba276 use force_feed() 12 years ago
Andrew Dolgov 9e222305f7 allow plugin modification of article guid 12 years ago
Andrew Dolgov 455b1401cd properly load user plugins and data on update 12 years ago
Andrew Dolgov bb566dc263 fix overflow of various 250 char fields in rssfuncs 12 years ago
Andrew Dolgov d2a421e3cb more work on user-selectable plugins; properly process system and user plugins 12 years ago
Andrew Dolgov f16116834e split digest stuff into digest.php 12 years ago
Andrew Dolgov 356a991a7b update_rss_feed: escape error string immediately 12 years ago
Andrew Dolgov 4412b877d0 implement HOOK_FEED_PARSED, add example plugin (refs #424) 12 years ago
Andrew Dolgov fa6fbd3659 do not preg_match() tags from article content 12 years ago
Andrew Dolgov 1b35d30c1f prevent escaping of article link in the database when using simplepie (refs #472) 12 years ago
Andrew Dolgov 19b3992b78 remove magpie, fix article filter plugins 12 years ago
Andrew Dolgov 19c7350770 experimental new plugin system 12 years ago
Andrew Dolgov 83e6e313be support comments on simplepie properly 12 years ago
Andrew Dolgov 35cb2b8f67 Revert "support comments for simplepie"
This reverts commit d020a86c36.
12 years ago
Andrew Dolgov d020a86c36 support comments for simplepie 12 years ago
Andrew Dolgov 2bbd699475 update: feed escaping issue 12 years ago
Andrew Dolgov 2a91b6ff78 add built-in expiring of obsolete lockfiles 12 years ago
Andrew Dolgov d5e9cf28f1 remove uid from ccache guid prefix 12 years ago
Andrew Dolgov 765509c572 create separate guids for cached and authorized content to prevent unnecessary data sharing 12 years ago
Andrew Dolgov 8054439f47 wait a bit before initial content fetching 12 years ago
Andrew Dolgov 130b078109 minor cached content updating tweaks 12 years ago
Andrew Dolgov cc85704f3c implement experimental article on-import data filters 12 years ago
Andrew Dolgov cb93a5dee8 fix inserting cached content on first update 12 years ago
Andrew Dolgov 87764a50cf implement ttrss_feeds.cache_content 12 years ago
Andrew Dolgov d03ae73e93 get_article_filters: strip newlines from content before matching 12 years ago
Andrew Dolgov 72d1d0678e fix title and content filters only working on title (closes #512) 12 years ago
Andrew Dolgov 4021d61ada enable manual filters to work on complete html content 12 years ago
Andrew Dolgov e8291805dd update: only load existing labels of previously imported articles 12 years ago
Andrew Dolgov bb894b2990 fix update stopped by get_article_labels() 12 years ago
Andrew Dolgov 3fc6e71ac8 apply filters and detect labels based on article content without tags 12 years ago
Andrew Dolgov b24504b121 add ability to auto-assign articles to labels (bump schema) 12 years ago
Andrew Dolgov 92c14e9d53 move article filter functions to rssfuncs.php 12 years ago
Andrew Dolgov 24be5e836f remove sanitize_article_content (CDATA handled by htmLawed) 12 years ago
Andrew Dolgov b3682750bb Revert "sanitize article content when importing data from feed"
This reverts commit c7fe1b4e9e.

Conflicts:
	include/functions.php
	include/rssfuncs.php
12 years ago
Andrew Dolgov e1e3f972b6 update_rss_feed: fix broken title/content escaping 12 years ago
Andrew Dolgov c7fe1b4e9e sanitize article content when importing data from feed 12 years ago
Andrew Dolgov c0c2abbaa7 force refetch feed when clicking update/clicking on same feed in the tree 12 years ago
Andrew Dolgov 67bd0b1f26 allow filters to work on child categories 12 years ago
Andrew Dolgov 0f556e3edb lower default DAEMON_SLEEP_INTERVAL 12 years ago
Andrew Dolgov 304aadb907 remove twitter-specific code 12 years ago
Andrew Dolgov 6aff784575 implement multiple rule/action filters 12 years ago
Andrew Dolgov 9aceda3afc remove hook-based plugins 12 years ago
Andrew Dolgov 369dbc19d6 rework class system to use subdirectories
add placeholder plugin/hook system
12 years ago
Andrew Dolgov 2ea9bbfd07 implement proof of concept postgresql pg_trgm N-gram based marking of similar article titles as read automatically 13 years ago
Andrew Dolgov 0e4a7d7a94 remove memcached stuff 13 years ago
Andrew Dolgov f2798eb6e6 properly update favicon_last_checked 13 years ago
Andrew Dolgov d3158e2250 expire files in cache/export 13 years ago
Andrew Dolgov 382268c6c9 rate-limit requests for favicons when not present to conserve traffic (refs #457) 13 years ago
Andrew Dolgov 1bd11fdf95 Revert "get favicon from icon atom feeds & search for icons not only in html head (closes #457)"
This reverts commit 882311d9ad.
13 years ago
Andrew Dolgov eb38af4ee4 fix warning when entry content is used as array unnecessarily 13 years ago
Andrew Dolgov 882311d9ad get favicon from icon atom feeds & search for icons not only in html head (closes #457) 13 years ago
Andrew Dolgov 941e48a402 apply patch from gmargo to differentiate between manual and new feed after-subscription update 13 years ago
Andrew Dolgov 6cb2269c03 disable internal magpie/simplepie cache for manual updates 13 years ago
Andrew Dolgov ecbd7b91fe allow manual updates for feeds with disabled automatic updates 13 years ago
Andrew Dolgov 2ab20c313c expire_cached_files: check for glob() returning false 13 years ago
Andrew Dolgov 7b8ff151ed fix various tags being stuck because of invalid HTML markup being generated (closes #357) 13 years ago