Correctly look for symlinks and remove them if existing.