User-agent: * Disallow: /cgi-bin/ Disallow: /forums/ Disallow: /gallery/ Disallow: /guestbook/ Disallow: /manisbook/ Disallow: /photo/ Disallow: /scgi-bin/ Disallow: /401.shtml Disallow: /404.shtml Disallow: /tamaway.html Disallow: /manitowah/cgi-bin/ Disallow: /manitowah/images/ Disallow: /manitowah/backgrounds/ Disallow: /hawksnest/cgi-bin/ Disallow: /hawksnest/backgrounds/ Disallow: /hawksnest/images/ Disallow: /photo/cgi-bin/ Disallow: /photo/files/ Disallow: /photo/images/ Disallow: /photo/construction.html Disallow: /photo/missfield.html Disallow: /photo/photo.css # don't let search engines see the RSS feed, it's just confusing. User-agent: Googlebot User-agent: InfoNaviRobot User-agent: TV33_Mercator User-agent: AVSearch User-agent: Scooter User-agent: Slurp User-agent: SearchengineLicenceSheep User-agent: shadow User-agent: MultiText User-agent: FAST-WebCrawler User-agent: Atomz User-agent: htdig User-agent: spider00.logika.net User-agent: NetMechanic User-agent: Teleport Pro Disallow: /searchtools-rss.xml # updated 2002-03-22 (disallow rtestprob links) # updated 2002-06-25 (disallow info/slides links, info/robots/)