If you don't remove old caulk, the new caulk can't form a watertight seal, leaving the home with a waterlogged surface.