Yes, all infants and kids traveling with their UAE citizen parents will need a visa to enter Malaysia.