Revert "Add robots file"

This reverts commit 8dcf0deb03989c832f4cb258872b50c1bad8a953.