Re: [Lynx-dev] Host Header Information

[David Woolley]

Thomas Dickey wrote:
> On Tue, 28 Apr 2009, Graham R. Shutt wrote:

> (a short-term fix might be to force lynx to use "L_y_n_x" as the 
> user-agent, until the next cut/paste artist adds that to mod_security)
Are you sure the problem isn't libwww?  I have a feeling that some email 
address seeking web crawlers are based on libwww as well.  People may be 
using the false logic that anything used by spammers is only used by 
them.  (Lynx's crawl mode may also be being used by spammers).

The other reason Lynx might be considered a security risk is that people 
use it to violate terms of use by using for scripted accesses to web 
sites, and, as a crawler, it doesn't honour the robots protocol (or didn't).

--
David Woolley
Emails are not formal business letters, whatever businesses may want.
RFC1855 says there should be an address here, but, in a world of spam,
that is no longer good advice, as archive address hiding may not work.