User-agent: Mediapartners-Google Disallow: User-agent: * Disallow: /errors/ Disallow: /usage/ Disallow: /domains/ Crawl-delay: 600 Request-rate: 1/600 Visit-time: 0300-0700 User-Agent: bingbot Allow: / Disallow: /errors/ Disallow: /usage/