User-agent: * Disallow: /content/images/ Disallow: /content/pdfs/ Disallow: /content/bigfiles/ Disallow: /cgi-bin/ Disallow: /styles/ Disallow: /test/ Disallow: /admin/