If you decide to make a eggnog bundt cake or just prefer a lighter rum glaze on your eggnog cake, you can simply mix the confectioners sugar with eggnog and vanilla extract (and rum, if spiked.)
The butter is the main part of buttercream, so otherwise, it’s pretty easy to whip together a rum glaze. Make sure the cake is completely cooled before glazing.