Thinning material is one of the most common signs of a topper needing to be replaced. After sleeping on your topper night after night, memory foam and other fillings naturally start to lose their shape. When odors persist even after washing your topper, this is usually another sign that mold or mildew are growing within the fabric. At this point, it’s time for a replacement, and the old topper should be discarded.