# Forbid all robots from browsing your site User-agent: * Disallow: / # Disallow googlebot from indexing anything that starts with /directory User-agent: googlebot Disallow: /directory User-agent: googlebot Disallow: /*print= User-agent: * Disallow: User-agent: * Disallow: /directory Disallow: /file.html User-agent: googlebot User-agent: msnbot Disallow: /directory Disallow: /file.html User-agent: googlebot Disallow: User-agent: * Disallow: /