Yes, if you are sure you do not want to use the site anymore, you should remove the bookmark