Yes, memory foam can be toxic for babies. In most cases, it contains a slew of harmful chemicals such as formaldehyde, benzene, and naphthalene. The Occupational Safety and Health Administration explains that memory foam also contains isocyanates, which can cause skin irritations.