The material of your machine, particularly for the parts that come into contact with water and coffee, can indeed affect the taste. Many premium coffee machines use stainless steel for these parts due to its ability to resist corrosion and not impart any unwanted flavours into the brew.