Nah. Leave it out if coffee flavor isn’t your thing. Also, you could use decaffeinated or even coffee flavoring to reduce the amount of caffeine.