# All robots will spider the domain User-agent: * Disallow: # Disallow directories Disallow: /cgi-bin/ Disallow: /images/ Disallow: /tools/ Disallow: /scripts/ # Disallow Pic Search Bot User-agent: psbot Disallow: / # Disallow GeoBot User-agent: GeoBot/1.0 Disallow: /