Yes, heating up the coffee may alter the taste slightly. It's best to experiment with different heating methods to find what works best for you.