# All robots will spider the domain User-agent: * Disallow: /book/ Disallow: /books/ Disallow: /cart/ Disallow: /cgi-bin/ Disallow: /picts/ Disallow: /pdf/ Disallow: /flash/ Disallow: /gallery/ Disallow: /incoming/