User-agent: *
Disallow: cgi-bin
Crawl-delay:5