Commit Graph

269 Commits (c203486e040831881fd91db2cc3d8105214fa568)

Author SHA1 Message Date
Roland Angerer f77c72038f deactivated FeedParser re-use as it is not multiuser safe
different users may have different fetch feed and feed fetched hooks
11 years ago
Roland Angerer 95beaa1471 fixed feed caching logic for multiuser scenario
only vanilla feed data may be cached as every user may have different
fetched feed hooks to apply
11 years ago
Andrew Dolgov e95bb179a8 fix for article language breaking sql insert 11 years ago
Andrew Dolgov 5ba1ddd409 rssfuncs: remove unused variables 11 years ago
Andrew Dolgov 537eca4000 rssfuncs: fix typo 11 years ago
Andrew Dolgov f08426e3d3 when checking feeds to update, respect only default update setting stored in default profile 11 years ago
Andrew Dolgov 5a450b8760 add workaround for languagedetect idiotic shit of some kind 11 years ago
Andrew Dolgov d8179cb9d9 pubsubhubbub: use atom rel=self link (when available) when subscribing
to push-enabled feeds
11 years ago
Andrew Dolgov 4ad04ee227 report all libxml errors in updater debug output
force utf8 encoding if devforceupdate is on
parser: try to convert non-unicode feeds with specified encoding to utf8
before trying to remove dangling utf8 characters in case of utf8-related
libxml errors because doing so produces garbage content
11 years ago
Andrew Dolgov 88edaa9344 daemon: cache parser object while processing a batch of feeds withsame url on first success 11 years ago
Andrew Dolgov 5ddd2705ca make language detection optional (closes #779) 11 years ago
Andrew Dolgov 1357a263be include title when detecting article language 11 years ago
Andrew Dolgov 4f71d7431c replace suppress debugging kludge with a more flexible function (fixes
logging with update.php --feeds being stopped after first feed)
11 years ago
Andrew Dolgov a33558a61e pass logfile to child tasks if locking is possible, lock logfile before writing, add kludge to prevent update_rss_feed unneeded debugging go into master logfile 11 years ago
Andrew Dolgov f73e03e000 pass feed information to article filters 11 years ago
Andrew Dolgov 5c54e68388 support media:description for media: enclosures 11 years ago
Andrew Dolgov edba269b6f fix entries not inserted properly when no languages are detected 11 years ago
Andrew Dolgov 00f22824d7 rss: force language to 2 characters; run house keeping hooks properly 11 years ago
Andrew Dolgov 8e47022036 add hook_house_keeping 11 years ago
Andrew Dolgov 2fc4d981d1 remove unused old-style image rewritign 11 years ago
Andrew Dolgov 6b4617970f add text_languagedetect to guess article language for better hyphenation
(bump schema)
11 years ago
Andrew Dolgov 0997c2bd62 Revert "add temporary hack to store original unhashed guid into cached_content for debugging"
This reverts commit 8096e309a5.
11 years ago
Andrew Dolgov 8096e309a5 add temporary hack to store original unhashed guid into cached_content for debugging 11 years ago
Andrew Dolgov c052e25a8b remove unused cached_content 11 years ago
Andrew Dolgov 420940fa90 do not catchup newly subscribed feeds 12 years ago
Andrew Dolgov 6791af0cfd pass feed it to feed_fetched and fetch_feed hooks 12 years ago
Andrew Dolgov ee65bef405 add HOOK_FETCH_FEED 12 years ago
Andrew Dolgov 0ad2013bd2 update_rss_feed: remove unused override_url parameter 12 years ago
Andrew Dolgov 47673e6611 add fetch_url and owner_uid to HOOK_FEED_FETCHED 12 years ago
Andrew Dolgov d1f3fa9791 try to force-convert feed data to utf8 12 years ago
Andrew Dolgov fd687300bf Revert "subscribe_to_feed: use already fetched data when updating initially"
This reverts commit 23923fb29b.
12 years ago
Andrew Dolgov 23923fb29b subscribe_to_feed: use already fetched data when updating initially 12 years ago
Rasmus Lerdorf 6f7798b643 Fixing bugs found by static analysis 12 years ago
Andrew Dolgov f4ae0f053b update: remove debugging block 12 years ago
Andrew Dolgov 566417c4e7 restore updstart threshold 12 years ago
Andrew Dolgov 5d3e5a1bb2 simplify feed cache age handling (reduce caching to sequential updates) 12 years ago
Andrew Dolgov 5de4010487 disable marking for the time being 12 years ago
Andrew Dolgov 5ef8409700 move the precautionary timestamp bumping 12 years ago
Andrew Dolgov 5d0d3887af add _DISABLE_HTTP_304 12 years ago
Andrew Dolgov 15c762beda updater: show owner_uid for checked feeds 12 years ago
Andrew Dolgov 52637d3b30 remove cache valid bailout clause 12 years ago
Andrew Dolgov 865a3ed6a0 change feed cache file extension 12 years ago
Andrew Dolgov d4992d6b48 add support for dc:subject and slash:comments 12 years ago
Andrew Dolgov ee78f81ccd update: better tag-related debugging info 12 years ago
Andrew Dolgov 852d4ac890 support RDF-XML feeds 12 years ago
Andrew Dolgov fd0daa9b55 remove simplepie 12 years ago
Andrew Dolgov 431e27851b actually save feed xml in the cache 12 years ago
Andrew Dolgov 99429e57e4 remove simplepie entity decode hacks 12 years ago
Andrew Dolgov b8f316dc28 change caching to save xml data, remove RDF init section 12 years ago
Andrew Dolgov 04d2f9c831 add basic rss support 12 years ago
Andrew Dolgov cd07592c29 add basic tinyparser/atom 12 years ago
Andrew Dolgov 65c8d5e76d update: set last_updated to now() when process starts 12 years ago
Andrew Dolgov 39ede9862f experimental: decode numerical utf entities on import in entry title 12 years ago
Andrew Dolgov efe46a3b53 Merge pull request #167 from KonishchevDmitry/pr-allow-slash-in-filter-regex
Allow slashes in filter regular expressions
12 years ago
Dmitry Konishchev 7b80b5e160 Match each tag separately against user filter regular expression
Each article's tag should be matched against user filter regular
expression separately. Current matching confuses when you want to match
an exact tag. You suppose to write "^tag$", bug now have to write
"(^|,)tag(,|$)" which is very inconvenient and requires knowledge about
how do you process this matching.
12 years ago
Dmitry Konishchev ffa1bd7b19 Allow slashes in filter regular expressions
User's regular expressions need escaping before passing them to
preg_match()
12 years ago
Andrew Dolgov 90e5f4f1de base if-modified-since on last received article, not feed update timestamp 12 years ago
Andrew Dolgov 23283f11a3 fetch: better checking for 1970- date 12 years ago
Andrew Dolgov aafd55bab6 do not needlessly mark icons as failed 12 years ago
Andrew Dolgov 84ceb6bd2e fix floicon failed message not respecting debugging setting 12 years ago
Andrew Dolgov e2cf81e214 unify houskeeping stuff, increase spawn interval 12 years ago
Andrew Dolgov 654650857f reduce daemon chattiness a bit 12 years ago
Andrew Dolgov 8cabc200d5 increase updstart locking interval to prevent concurrent updates; decrease batch size for the daemon 12 years ago
Andrew Dolgov fce451a4f7 fix updating for pgsql
increase default batch size
remove random check between feedbrowser or update task executing
12 years ago
Andrew Dolgov 81c2066345 updating: do not use cache timestamp if it is unusable for current feed;
sort chronologically instead of random
12 years ago
Andrew Dolgov 6ee0d4b05c do not recalculate avg color repeatedly 12 years ago
Andrew Dolgov 560cbd8c0d attempt to recalculate favicon avg color if it changes 12 years ago
Andrew Dolgov 36490f11a3 add a hack so that if floicon fails on some icon, it won't be processed again 12 years ago
Daniel Andersson 1134497129 Fix doubly applied basepaths to lockfiles. 12 years ago
Andrew Dolgov 68cccafcad remove debug_enabled global 12 years ago
Andrew Dolgov 9ec103525d update_rss_feed: simplify debug reporting 12 years ago
Andrew Dolgov ebec81a6fb subscribe: verify XML before adding to the database; fetch: try to work around entity problems if initial parsing fails 12 years ago
Andrew Dolgov 1367bc3f5e trim received feed data on fetch 12 years ago
Andrew Dolgov 96db9a14d9 do not try to calculate icon avg color if GD is not present 12 years ago
Andrew Dolgov ce2b219c64 entry_author: do not double escape string, author & comments: trim 12 years ago
Andrew Dolgov 1ffe3391f9 make pluginhost a singleton 12 years ago
Andrew Dolgov 52d88392da move db-prefs to OO 12 years ago
Andrew Dolgov 3f6f085769 add better gzdecode support for php native fetch, use curl under open_basedir 12 years ago
Andrew Dolgov d0d86316ee Revert "do automatic gzcdecode on feed data"
This reverts commit aea03558bb.
12 years ago
Andrew Dolgov aea03558bb do automatic gzcdecode on feed data 12 years ago
Andrew Dolgov 48cb253625 get_article_filter: fix missing argument 12 years ago
Andrew Dolgov a42c55f02b fix blank character after opening bracket in function calls 12 years ago
Andrew Dolgov 7440a7fe3c daemon2: use passthrough to daemon-loop 12 years ago
Andrew Dolgov 6322ac79a0 remove $link 12 years ago
Andrew Dolgov 857efe49e6 add schema checking to feed updating and update script 12 years ago
Andrew Dolgov e2261e177b implement old log entry purging in update_daemon_common; add some more error types; tweak error log display 12 years ago
Andrew Dolgov 5e3d5480f7 use hashed guids in a hopefully backwards compatible fashion 12 years ago
Andrew Dolgov bc7a144dd5 properly remove and replace favicon color when favicon gets manually removed/uploaded 12 years ago
Andrew Dolgov 12a6bd28ac remove hsl stuff from classes/feeds, we take care of this when choosing the color 12 years ago
Andrew Dolgov 6ac722d5b1 try to improve color guessing algorithm a bit 12 years ago
Andrew Dolgov 63c323f736 only enable colored favicons in vfeeds; fix RGB triplet packing 12 years ago
Andrew Dolgov 687a4f59c8 store favicon color as #rrggbb; process existing favicons 12 years ago
moontear 2cfbb448fb Added average color calculation of feeds' favicons for banded display. 12 years ago
Andrew Dolgov 044cff2d74 implement basic feed authentication parameter encryption in the database (FEED_CRYPT_KEY) 12 years ago
Andrew Dolgov c5569ff8d3 decode html entities in article title on import 12 years ago
Andrew Dolgov 3306daecf4 implement upload-related support for open_basedir 12 years ago
Andrew Dolgov 5929a0c1e4 updater: prevent duplicate feed ids being scheduled for update 12 years ago
Barak Korren 32b7a340ad Merge branch 'master' into tunable-fetches
Conflicts:
	include/rssfuncs.php
12 years ago
Barak Korren 8401101d50 Moved hard-coded fetch timeout values into config file to allow site-level tuning 12 years ago
Andrew Dolgov 5e736e4592 implement stop action 12 years ago