No, you don’t need to cover the chicken while it bakes. Keeping the chicken uncovered will allow the skin to crisp up which adds delicious flavor and texture to this meal.