There are a few potential downsides to using a memory foam mattress. Some people find them too hot to sleep on, while others may feel like they sink too deeply into the mattress. It's important to find a memory foam mattress that suits your individual needs and preferences.