# PARTIAL access (All Spiders) User-agent: * Disallow: /0.1/ Disallow: /_private/ Disallow: /rorgenerator.php