# PARTIAL access (All Spiders) User-agent:* Disallow: /cgi-bin/ User-agent: Mediapartners-Google* Disallow: User-Agent: Googlebot Disallow: User-agent: Slurp Disallow: User-Agent: msnbot Disallow: User-agent: ia_archiver Disallow: