# This robots.txt file tells search engines not to go to certain directories and files User-agent: * Disallow: ./text Disallow: ./alert Disallow: ./news Disallow: ./calendar