User-agent: * Disallow: /images Disallow: /cgi-bin/ Disallow: /js/ Disallow: /*.gif$ Disallow: /*.jpg$ Disallow: /*.zip$ Disallow: /*.doc$ Disallow: /*.exe$ Disallow: /*.flv$