No, you do not have to alight. Just sit comfortably in the car as the custom official processes the passports and vehicle for clearance！