User-agent: * Disallow: /cgi-bin Disallow: /css Disallow: /scripts Disallow: /media Disallow: /pics Disallow: /images Disallow: /_/ Disallow: /admin User-agent: Slurp User-agent: JetBot Disallow: /