# All robots will spider the domain User-agent: * Disallow: # Disallow directory /_private/ User-agent: * Disallow: /_private/ # Disallow directory /aspnet_client/ User-agent: * Disallow: /aspnet_client/ # Disallow directory /assets/ User-agent: * Disallow: /assets/ # Disallow directory /CGI-BIN/ User-agent: * Disallow: /CGI-BIN/ # Disallow directory /database/ User-agent: * Disallow: /database/ # Disallow directory /rsipadmin/ User-agent: * Disallow: /rsipadmin/