As a hot air balloon travels high, the wind here is more. Therefore, a loose-fit hat might fly away during the ride. Go for something more tight-fitting, like a baseball cap.