Merged "Adding robots.txt, DJ rankings."

Next commit...