Yes, you can reheat a pre-baked and chilled chicken casserole in the oven: cover with foil and bake at 325˚f for about 20 minutes or just until hot, or reheat on the stovetop over low heat just until hot, stirring occasionally.