# Robots.txt file to crawl MS. Raves - Wharton Business Project User-agent: * Disallow: /tmp Disallow: /admin Disallow: /cgi-bin Disallow: /upload Disallow: /_vti_bin Sitemap: http://www.msraves.org/sitemap.xml