# Dont allow search engines to index specific folder User-agent: * Disallow: /awstats Disallow: /webalizer Disallow: /menu Disallow: /flash Disallow: /cert Disallow: /joe001.htm