We should be able to cache the robots.txt file, or does cacheAllTheThings take care of this?