5ddd2705ca
make language detection optional ( closes #779 )
11 years ago
1357a263be
include title when detecting article language
11 years ago
4f71d7431c
replace suppress debugging kludge with a more flexible function (fixes
...
logging with update.php --feeds being stopped after first feed)
11 years ago
a33558a61e
pass logfile to child tasks if locking is possible, lock logfile before writing, add kludge to prevent update_rss_feed unneeded debugging go into master logfile
11 years ago
f73e03e000
pass feed information to article filters
11 years ago
5c54e68388
support media:description for media: enclosures
11 years ago
edba269b6f
fix entries not inserted properly when no languages are detected
11 years ago
00f22824d7
rss: force language to 2 characters; run house keeping hooks properly
11 years ago
8e47022036
add hook_house_keeping
11 years ago
2fc4d981d1
remove unused old-style image rewritign
11 years ago
6b4617970f
add text_languagedetect to guess article language for better hyphenation
...
(bump schema)
11 years ago
0997c2bd62
Revert "add temporary hack to store original unhashed guid into cached_content for debugging"
...
This reverts commit 8096e309a5
11 years ago
8096e309a5
add temporary hack to store original unhashed guid into cached_content for debugging
11 years ago
c052e25a8b
remove unused cached_content
11 years ago
420940fa90
do not catchup newly subscribed feeds
12 years ago
6791af0cfd
pass feed it to feed_fetched and fetch_feed hooks
12 years ago
ee65bef405
add HOOK_FETCH_FEED
12 years ago
0ad2013bd2
update_rss_feed: remove unused override_url parameter
12 years ago
47673e6611
add fetch_url and owner_uid to HOOK_FEED_FETCHED
12 years ago
d1f3fa9791
try to force-convert feed data to utf8
12 years ago
fd687300bf
Revert "subscribe_to_feed: use already fetched data when updating initially"
...
This reverts commit 23923fb29b
12 years ago
23923fb29b
subscribe_to_feed: use already fetched data when updating initially
12 years ago
6f7798b643
Fixing bugs found by static analysis
12 years ago
f4ae0f053b
update: remove debugging block
12 years ago
566417c4e7
restore updstart threshold
12 years ago
5d3e5a1bb2
simplify feed cache age handling (reduce caching to sequential updates)
12 years ago
5de4010487
disable marking for the time being
12 years ago
5ef8409700
move the precautionary timestamp bumping
12 years ago
5d0d3887af
add _DISABLE_HTTP_304
12 years ago
15c762beda
updater: show owner_uid for checked feeds
12 years ago
52637d3b30
remove cache valid bailout clause
12 years ago
865a3ed6a0
change feed cache file extension
12 years ago
d4992d6b48
add support for dc:subject and slash:comments
12 years ago
ee78f81ccd
update: better tag-related debugging info
12 years ago
852d4ac890
support RDF-XML feeds
12 years ago
fd0daa9b55
remove simplepie
12 years ago
431e27851b
actually save feed xml in the cache
12 years ago
99429e57e4
remove simplepie entity decode hacks
12 years ago
b8f316dc28
change caching to save xml data, remove RDF init section
12 years ago
04d2f9c831
add basic rss support
12 years ago
cd07592c29
add basic tinyparser/atom
12 years ago
65c8d5e76d
update: set last_updated to now() when process starts
12 years ago
39ede9862f
experimental: decode numerical utf entities on import in entry title
12 years ago
efe46a3b53
Merge pull request #167 from KonishchevDmitry/pr-allow-slash-in-filter-regex
...
Allow slashes in filter regular expressions
12 years ago
7b80b5e160
Match each tag separately against user filter regular expression
...
Each article's tag should be matched against user filter regular
expression separately. Current matching confuses when you want to match
an exact tag. You suppose to write "^tag$", bug now have to write
"(^|,)tag(,|$)" which is very inconvenient and requires knowledge about
how do you process this matching.
12 years ago
ffa1bd7b19
Allow slashes in filter regular expressions
...
User's regular expressions need escaping before passing them to
preg_match()
12 years ago
90e5f4f1de
base if-modified-since on last received article, not feed update timestamp
12 years ago
23283f11a3
fetch: better checking for 1970- date
12 years ago
aafd55bab6
do not needlessly mark icons as failed
12 years ago
84ceb6bd2e
fix floicon failed message not respecting debugging setting
12 years ago
e2cf81e214
unify houskeeping stuff, increase spawn interval
12 years ago
654650857f
reduce daemon chattiness a bit
12 years ago
8cabc200d5
increase updstart locking interval to prevent concurrent updates; decrease batch size for the daemon
12 years ago
fce451a4f7
fix updating for pgsql
...
increase default batch size
remove random check between feedbrowser or update task executing
12 years ago
81c2066345
updating: do not use cache timestamp if it is unusable for current feed;
...
sort chronologically instead of random
12 years ago
6ee0d4b05c
do not recalculate avg color repeatedly
12 years ago
560cbd8c0d
attempt to recalculate favicon avg color if it changes
12 years ago
36490f11a3
add a hack so that if floicon fails on some icon, it won't be processed again
12 years ago
1134497129
Fix doubly applied basepaths to lockfiles.
12 years ago
68cccafcad
remove debug_enabled global
12 years ago
9ec103525d
update_rss_feed: simplify debug reporting
12 years ago
ebec81a6fb
subscribe: verify XML before adding to the database; fetch: try to work around entity problems if initial parsing fails
12 years ago
1367bc3f5e
trim received feed data on fetch
12 years ago
96db9a14d9
do not try to calculate icon avg color if GD is not present
12 years ago
ce2b219c64
entry_author: do not double escape string, author & comments: trim
12 years ago
1ffe3391f9
make pluginhost a singleton
12 years ago
52d88392da
move db-prefs to OO
12 years ago
3f6f085769
add better gzdecode support for php native fetch, use curl under open_basedir
12 years ago
d0d86316ee
Revert "do automatic gzcdecode on feed data"
...
This reverts commit aea03558bb
12 years ago
aea03558bb
do automatic gzcdecode on feed data
12 years ago
48cb253625
get_article_filter: fix missing argument
12 years ago
a42c55f02b
fix blank character after opening bracket in function calls
12 years ago
7440a7fe3c
daemon2: use passthrough to daemon-loop
12 years ago
6322ac79a0
remove $link
12 years ago
857efe49e6
add schema checking to feed updating and update script
12 years ago
e2261e177b
implement old log entry purging in update_daemon_common; add some more error types; tweak error log display
12 years ago
5e3d5480f7
use hashed guids in a hopefully backwards compatible fashion
12 years ago
bc7a144dd5
properly remove and replace favicon color when favicon gets manually removed/uploaded
12 years ago
12a6bd28ac
remove hsl stuff from classes/feeds, we take care of this when choosing the color
12 years ago
6ac722d5b1
try to improve color guessing algorithm a bit
12 years ago
63c323f736
only enable colored favicons in vfeeds; fix RGB triplet packing
12 years ago
687a4f59c8
store favicon color as #rrggbb; process existing favicons
12 years ago
2cfbb448fb
Added average color calculation of feeds' favicons for banded display.
12 years ago
044cff2d74
implement basic feed authentication parameter encryption in the database (FEED_CRYPT_KEY)
12 years ago
c5569ff8d3
decode html entities in article title on import
12 years ago
3306daecf4
implement upload-related support for open_basedir
12 years ago
5929a0c1e4
updater: prevent duplicate feed ids being scheduled for update
12 years ago
32b7a340ad
Merge branch 'master' into tunable-fetches
...
Conflicts:
include/rssfuncs.php
12 years ago
8401101d50
Moved hard-coded fetch timeout values into config file to allow site-level tuning
12 years ago
5e736e4592
implement stop action
12 years ago
ee0542ce28
daemon: do not schedule user-disabled feeds (2)
12 years ago
cd7ebb39e4
daemon: do not schedule user-disabled feeds
12 years ago
e81610d9ef
daemon: sort by random
12 years ago
8292d05b7c
daemon: show feeds/minute stats
12 years ago
17e74b21cf
update_rss_feed: bailout if cache is considered valid, but older than last_updated
12 years ago
31623bfa99
if-modified-since: also take last_updated into account
12 years ago
7a01dc776e
support If-Modified-Since
12 years ago
7b11aa80ab
Revert "Avoid updating feed based on user pref DEFAULT_UPDATE_INTERVAL if it is set to -1 (no update)"
...
This reverts commit bca1cfbb95
12 years ago
bca1cfbb95
Avoid updating feed based on user pref DEFAULT_UPDATE_INTERVAL if it is set to -1 (no update)
12 years ago
0d6943b097
Revert "order feeds selected for update randomly"
...
This reverts commit 13b33a3fc3
12 years ago
Andrew Dolgov