myexperiment-hackers
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[myexperiment-hackers] [1889] trunk/config/environment_private.rb.pre: B


From: noreply
Subject: [myexperiment-hackers] [1889] trunk/config/environment_private.rb.pre: Bot ignore list updated.
Date: Mon, 27 Oct 2008 13:07:06 -0400 (EDT)

Revision
1889
Author
alekses6
Date
2008-10-27 13:07:06 -0400 (Mon, 27 Oct 2008)

Log Message

Bot ignore list updated.

Modified Paths

Diff

Modified: trunk/config/environment_private.rb.pre (1888 => 1889)


--- trunk/config/environment_private.rb.pre	2008-10-27 15:20:42 UTC (rev 1888)
+++ trunk/config/environment_private.rb.pre	2008-10-27 17:07:06 UTC (rev 1889)
@@ -81,4 +81,4 @@
 #
 # It is essential to put patterns into the ignore list in a single quotes - this will enable the
 # patterns to be treated as regular expressions, not just strings
-BOT_IGNORE_LIST = ['Googlebot', 'Slurp', 'msnbot', 'crawler', 'bot', 'heritrix']
\ No newline at end of file
+BOT_IGNORE_LIST = ['Googlebot', 'Slurp', 'msnbot', 'crawler', 'bot', 'heritrix', 'spider', 'Nutch']
\ No newline at end of file

reply via email to

[Prev in Thread] Current Thread [Next in Thread]