User-agent: * #Standard exclusions Disallow: /cgi-bin/ Disallow: /css/ Disallow: /scripts/ #Non public Disallow: /clients/ Disallow: /newsletters/ Disallow: /transfer/ #Content only Disallow: /identity/ Disallow: /illustration/ Disallow: /pages/ Disallow: /photography/ Disallow: /print/ Disallow: /web/