# Next section for all web crawlers LIVE SITE User-agent: * # Disallow: / Disallow: /includes/ Disallow: /rkdom/ Disallow: /rkDom/ Disallow: /cgi-bin/ Disallow: /tarpit/tarpit.htm Disallow: