A soft water system, also known as a water softener, removes minerals like calcium and magnesium from hard water. It works through a process called ion exchange, where these hard minerals are replaced with sodium or potassium ions, resulting in softened water.