# www.robotstxt.org/ # http://code.google.com/web/controlcrawlindex/ User-agent: * Disallow: /test/ Disallow: /admin/ Sitemap: http://www.redcowdairies.com.au/sitemap.xml Disallow:/thankyou.php Disallow:/cancel.php Disallow:/delivery_details.php