You can tell if a baby is too hot by observing signs such as sweating, feeling excessively warm to the touch, flushed skin, or if the baby seems irritable and uncomfortable. Use a swaddling blanket that allows air to circulate, like a muslin cotton swaddle. Additionally, ensure that the room temperature is not too high, and the baby is not overdressed.