Yes, you can heat rum. It is best to add it to a hot cocktail or drink just before serving so the alcohol doesn't cook off.