Absolutely. Your glass, your rules. Kahlúa is a sweet, syrupy, coffee-flavored liqueur that can be enjoyed straight up, on ice. If you plan to sip your Kahlúa unadulterated, chilling the bottle first will cut down on the burn.