Shield doesn't concern itself with robots.txt as this isn't a thing that pertains to security.


Unless you have a good reason to do so, you should probably leave robots.txt allowed.