Yes, babies can overheat if too many layers are used. It's crucial to check your baby regularly for signs of overheating.