User-agent: * Disallow: /~test/ Disallow: /~test Disallow: /_archive/ Disallow: /_archive Disallow: aspnet_client/ Disallow: aspnet_client Disallow: /__sandbox/ Disallow: /__sandbox Disallow: /_bonsai/ Disallow: /_bonsai Disallow: /_gicode/ Disallow: /_gicode Disallow: /_test/ Disallow: /_test Disallow: /asp/ Disallow: /asp Disallow: /cgi-bin/ Disallow: /cgi-bin Disallow: /clients/ Disallow: /clients Disallow: /data/ Disallow: /data Disallow: /database/ Disallow: /database Disallow: /docs/ Disallow: /docs Disallow: /examples/ Disallow: /examples Disallow: /fentonguide/ Disallow: /fentonguide Disallow: /marketing/ Disallow: /marketing Disallow: /images/ Disallow: /images Disallow: /mm/ Disallow: /mm Disallow: /myaccount/ Disallow: /myaccount Disallow: /partners/ Disallow: /partners Disallow: /pda/ Disallow: /_sgcom4/ Disallow: /_sgcom4 Disallow: /marketing/ Disallow: /marketing Disallow: /test/ Disallow: /test Disallow: /securitycenter/ Disallow: /securitycenter Disallow: /scripts/ Disallow: /scripts Disallow: /template/ Disallow: /template Disallow: /_old_content/ Disallow: /_old_content Disallow: /_preview/ Disallow: /_preview Disallow: /~preview/ Disallow: /~preview # Bots that store copies of crawled sites User-agent: ia_archiver Disallow: / # Prevent Covert Server Analysis User-agent: NetMechanic Disallow: / # Misc Banned Bots User-agent: Openbot Disallow: / User-agent: TurnitinBot Disallow: / User-agent: libwww-perl Disallow: / # Stop shitty image bots User-agent: Googlebot-Image Disallow: /