Overheating can be dangerous for babies, as it may lead to heatstroke, dehydration, and other health complications. It's essential to keep your baby comfortable and avoid overheating to protect their overall health and development.