Vinegar. Since the majority of hard water is calcium, it is highly reactive with acids like vinegar. Place small fixtures that are covered in buildup into a bowl of hot, all-natural vinegar to dissolve the calcium deposit in about an hour.