Yes, you can take infants to museums in Dubai, as they have clean and convenient mother's rooms to feed and change your baby.