add a robots meta tag, convert tabs to spaces
kill unused/old files