Yes, you should bake it covered! This will keep the casserole from drying out.