Some caulk removers will be simple to clean up after using just plain water and a towel, but other caulk removers are going to require you to have specialized cleaning solvents to remove the remover from the surface. Always read the label carefully before you buy the cleaning agent.