You can bake to reheat but I find it quicker to reheat sweet potato casserole in the microwave. Once reheated, you can add new marshmallows and put it in the oven (or air fryer) for a few minutes to toast.