# Robots.txt file - mentioned at http://www.neilgunton.com/spambot_trap/ # # Entries in here should prevent subdirectories off the root # (ie: directories that actually contain some content!) # # The /_contact directory is left off here to deliberately let # all bots, malicious or otherwise, harvest addresses listed there. # User-agent: * Disallow: /burners Disallow: /cgi-bin Disallow: /content Disallow: /errors Disallow: /profiles Disallow: /styles Disallow: /thanks