# disallow crawlers for private/secure folders User-agent: * Disallow: /mycpanel/ Disallow: /members/ Disallow: /admin/ Disallow: /bus/ Disallow: /cache/ Disallow: /cgi-bin/ Disallow: /controllers/ Disallow: /cronjob/ Disallow: /help/ Disallow: /lang/ Disallow: /lib/ Disallow: /models/ Disallow: /tables/ Disallow: /util/