# PARTIAL access (All Spiders) User-agent: * Disallow: /Archives/ Disallow: /apps/ Disallow: /beta/ Disallow: /pdfb/ Disallow: /scripts/