Yes, alcohol does evaporate out of rum balls over time. While the initial alcohol content is retained, some of it can dissipate gradually during storage, leaving behind the flavor.