Yes, you can heat up rum for use in cozy cocktails. Warm it slowly to capture all the aromatics and to prevent the alcohol from evaporating.