How to Remove Calcium Buildup. White vinegar, baking soda and even a lemon can be used to get rid of pesky calcium stains. Many homemakers already use vinegar to help clean difficult areas. It's also helpful when addressing hard water stains or calcium buildup.