# Only hit the site once every 10 seconds
User-agent: *
Crawl-delay: 10
Request-rate: 1/10