For best results, store them in the refrigerator as they will soften at room temperature. Peanut butter rice krispie treats will keep in the refrigerator for up to one week, but keep in mind that the crisp rice cereal will soften over time.