# directed to all spiders User-agent: * Disallow: /cgi-bin Disallow: admin.html Disallow: /classified Disallow: /crimedog Disallow: /demos Disallow: /images Disallow: /installers Disallow: /spresources Disallow: /toolbox Disallow: ademco.html Disallow: /ultimate Disallow: /new