Yes, although it can be difficult. If you're wearing cotton and the caulk stays on the surface, you can usually just peel it off. Otherwise, you'll have to brush it off.