User-Agent: * Allow: /store/ Allow: / Disallow: /cgi-bin/ Disallow: /download/ Disallow: /downloads/ Disallow: /lookbook/ Disallow: /fileserver/ Disallow: /*.pdf$ Disallow: /downloads/ebooks/*.pdf$