Sponges will typically start to smell sour as bacteria multiples and food residue becomes rancid, so sanitizing your sponge every other day can help eliminate odors. Sponges aren’t meant to last forever, so if you notice lingering odors on your sponge after you sanitize it, replace it with a new one.