Yes, in some circumstances, boiling drinking water can remove its taste. When you boil water, it causes chlorine to evaporate. As a result, your water will no longer have the chemical taste of chlorine.
Note that boiling water only removes chlorine. You can't remove heavy metals, sulfur, or any other poor-tasting contaminant by boiling your water alone.