# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file User-agent: Googlebot Disallow: /search/ User-agent: psbot Disallow: /search/ User-agent: twiceler Disallow: /search/ User-agent: CazoodleBot Disallow: /search/ User-agent: msnbot Disallow: /search/ User-agent: MJ12bot Disallow: /search/ User-agent: ia_archiver Disallow: /search/