# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file # # To ban all spiders from the entire site uncomment the next two lines: User-Agent: * Allow: /apps$ Allow: /*/apps$ Allow: /aws$ Allow: /*/aws$ Allow: /cloud$ Allow: /*/cloud$ Allow: /digital$ Allow: /*/digital$ Allow: /nar$ Allow: /*/nar$ Allow: /office365$ Allow: /*/office365$ Disallow: /