clean up robots.txt
add canonical url