robots and humans files
added friendly error pages