Without rinsing, paper filters can give a papery taste to your coffee. If your coffee blend is particularly light, you may notice this more. Coffee pros do rinse paper filters before using them for making pour-over coffee, so you can if you want. However, I've drank coffee with a paper filter for years without rinsing the filter and it tastes great to me!