While walk-ins are possible, it's advisable to make a reservation, especially during peak hours or on weekends, to ensure room availability.