good idea i think.
crawlers like googlebot usually take care that a site
is not hammered too much in a short period of time
and bad bots like email harvesters don't respect
robots.txt anyways
regards,
Clemens
> So, is there any consensus on the mail archive indexing via Google?
>
> I'm for allowing it.
>
> Rob
-- __________________________________________________________ Sign-up for your own FREE Personalized E-mail at Mail.com http://www.mail.com/?sr=signupReceived on Sat Aug 31 2002 - 09:08:15 MDT
This archive was generated by hypermail pre-2.1.9 : Tue Dec 09 2003 - 16:16:18 MST