While it is possible for babies to overheat in baby carriers there are ways in which to ensure that this does not happen. For example, go outdoors in the cooler parts of the day, dress baby and yourself in cool clothing, and keep baby hydrated.