safe to include hashlib again now + missing robots.txt file