User-agent: * Disallow: /cgi-bin Disallow: /assets Disallow: /atis Disallow: /images Disallow: /admin Disallow: /atisdata Disallow: /captcha