User-Agent: gsa-crawler
Allow: /content/betcomprivate/test/gsa-crawler-test.html
Disallow: /content/betcomprivate/
Disallow: /etc/designs/
Disallow: /test/


User-agent: * 
Disallow: /etc/designs/
Disallow: /test/
Disallow: /content/betcomprivate/

Sitemap: http://www.bet.com/sitemap.xml