User-agent: * Disallow: /cgi-bin Disallow: /js Disallow: /Scripts Disallow: /config.txt Disallow: /site Disallow: /test