User-agent: * Disallow: /favicon.ico$ Disallow: /cgi-bin/ Disallow: /data/ Disallow: /*.cgi$ Disallow: /*.sh$ Disallow: /*.txt$ Disallow: /yahoo/ Disallow: /nifty/ Disallow: /ocn/ Disallow: /goo/ Disallow: /msn/