Mix one part water and three parts baking soda to form a paste. Apply the paste to your bath mat, and scrub with a soft bristle brush. Rinse with water and allow the mat to air dry.