# Robots.txt file. # Created: 4/26/2005 BAP User-agent: * Disallow: /postings User-agent: * Crawl-delay: 20