Control search engine crawlers via X-Robots-Tag header instead of <meta> and robots.txt (#5098)

This gives one central place to control these settings and really makes the page will not be listed in Google search results.
8 years ago · cce4994b97
parent 462faace73
commit cce4994b97
5 changed files with 4 additions and 4 deletions
--- a/.htaccess
+++ b/.htaccess
@ -50,6 +50,9 @@ Options -Indexes
 </ifModule>

 <IfModule mod_headers.c>
+# Disable page indexing
+Header set X-Robots-Tag "noindex, nofollow"
+
 # replace 'append' with 'merge' for Apache version 2.2.9 and later
 #Header append Cache-Control public env=!NO_CACHE

--- a/1
+++ b/1
@ -39,6 +39,7 @@ CHANGELOG Roundcube Webmail
 - Managesieve: Support 'duplicate' extension [RFC 7352]
 - Managesieve: Unhide advanced rule controls if there are inputs with errors
 - Managesieve: Display warning message when filter form contains errors
+- Control search engine crawlers via X-Robots-Tag header instead of <meta> and robots.txt (#5098)
 - Enigma: Add possibility to configure gpg-agent binary location (enigma_pgp_agent)
 - Enigma: Fix signature verification with some IMAP servers, e.g. Gmail, DBMail (#5371)
 - Enigma: Make recipient key searches case-insensitive (#5434)
--- a/robots.txt
+++ b/robots.txt
@ -1,2 +0,0 @@
-User-agent: *
-Disallow: /
--- a/skins/classic/templates/login.html
+++ b/skins/classic/templates/login.html
@ -2,7 +2,6 @@
 <html xmlns="http://www.w3.org/1999/xhtml">
 <head>
 <title><roundcube:object name="pagetitle" /></title>
-<meta name="Robots" content="noindex,nofollow" />
 <roundcube:include file="/includes/links.html" />
 </head>
 <body>
--- a/skins/larry/templates/login.html
+++ b/skins/larry/templates/login.html
@ -2,7 +2,6 @@
 <html>
 <head>
 <title><roundcube:object name="pagetitle" /></title>
-<meta name="Robots" content="noindex,nofollow" />
 <roundcube:include file="/includes/links.html" />
 </head>
 <body>