**Archived Information**

Interim Evaluation of the Regional Educational Laboratories

Individual Evaluation Plan for the

Pacific Resources for Education and Learning (PREL)

**November 13, 2023**

The purpose of this document is to describe the plans to implement the
Interim Evaluation of the Regional Educational Laboratories at the
Pacific Resources for Education and Learning Regional Educational
Laboratory (PREL). This plan contains the most up-to-date information on
the schedule of activities to implement the evaluation at this
Laboratory, the current panel members, and the proposed data sources.
The data sources are based on information obtained from PREL's nominated
signature works, their inventory of products and services, and the other
data items needed to examine overall Laboratory operations.

# Schedule of Activities for PREL Evaluation

  ---------------------------------------------------- ------------------
  **Activity**                                         **Proposed Date**

  Approval of Individual Evaluation Plan by PES        04/12/99

  Receipt of advance materials from PREL               04/26/99

  Distribution of advance materials to panel members   04/28/99

  Training Session #3, including PREL presentation     05/05/99

  On-site panel visit                                  05/17/99 --
                                                       05/21/99

  Individual evaluation reports submitted to DIR       05/21/99

  Synthesis report submitted to DIR by panel chair     05/28/99

  Review of synthesis report by panel members          05/31/99 --
                                                       06/04/99

  Final synthesis report submitted to DIR by panel     06/11/99
  chair                                                

  Synthesis and individual reports sent to PREL and ED 06/15/99

  PREL response to evaluation report submitted to DIR  06/29/99

  DIR submission of PREL Interim Evaluation Reports    07/02/99
  (including individual reports, synthesis report, and 
  Lab response) to ED                                  
  ---------------------------------------------------- ------------------

**B. Current Participants in PREL Evaluation**

The following persons are assigned to serve as members of the PREL
review panel:

> Judy Bodenhausen
>
> John Brickell
>
> Toni Haas
>
> Andrew Hayes (chair)
>
> Haroldie Spriggs

# C. Data Sources to be used in the PREL Evaluation

The Evaluation Framework approved by ED contains associated evaluation
questions and indicators to guide the conduct of the Interim Evaluation
and reporting of results. The specific data sources to be used for the
evaluation of PREL have been developed after receiving input from the
Laboratory, the OERI Program Officer, and PES regarding the nominated
Signature Works and the PREL Inventory of Products and Services.

The remainder of this section identifies the specific data items to be
reviewed or data collection activities included in the PREL evaluation
plan. Most of the publications and other hard-copy materials specified
as data sources are to be provided to the peer reviewers as part of
their advance materials. Peer reviewers with Internet access will also
be able to examine the PREL's web-site before arriving on the site
visit.

The following data sources are grouped by whether they are: (1)
associated with a Signature Work; (2) additional items selected from the
Inventory that are not part of the selected Signature Works; or (3)
materials to be reviewed in conjunction with overall Laboratory
operations. Summary descriptions of the two selected Signature Works, as
described by PREL, are attached to this document.

Signature Work 1: Research and Development Cadre

PREL's Research and Development (R&D) Cadre is a regionwide leadership
team comprised of educators who are selected by each Pacific entity's
Director, Minister, or Superintendent of Education. The R&D Cadre - with
input from the PREL Board of Directors, other Pacific educators, needs
assessments and other sources -- identifies the significant educational
problems facing the Pacific region and plans, designs, and executes
research in these areas of concern. Research is designed to focus
attention on critical variables that affect educational outcomes in
schools throughout the region. The primary purposes are to: (1) build
the regional capacity to analyze, understand, and carry out much-needed
research; and (2) better understand the causes of pervasive educational
problems. This research then leads to the development and implementation
of research-based solutions that are relevant to the particular issues
found in the Pacific region. For this Signature Work, peer reviewers
will examine the R&D Cadre and selected research studies that have been
conducted or are under development.

Specific publications and materials related to this Signature Work have
been selected from the PREL Inventory of Products and Services or were
identified by the Lab as appropriate data sources within the nomination
of the Signature Works. The list of proposed data sources for advance
review of Signature Work 1 includes:

[R&D Cadre]{.underline}

-   Relevant excerpts or page references (e.g., technical proposal,
    quarterly reports, annual updates)

-   Relevant PREL Board minutes

-   Excerpts from annual consumer report

-   Documentation of needs assessment related to Signature Work 1 (e.g.,
    excerpts from Educational Needs Assessment Report for the Pacific
    Region)

-   Entity planning meetings reports

-   Knowledge Gaps and Research Plans (1996)

-   Relevant sections from External Peer Review Panel Report (1997)

-   Relevant sections from Self-Study Report (1997)

-   Relevant sections from evaluation reports (including Formative
    Evaluation of PREL Products, Services, and Workshop/Presentations
    (1999); Annual Formative Evaluation Survey: PREL Materials and
    Workshops/Presentations (1997); Formative Evaluation: Services and
    Materials Survey (1996))

-   R&D Cadre Seminar materials (agenda, minutes, topics, handouts,
    outcomes, evaluations)

-   R&D Cadre Research Plan 1995-2000

-   Documentation of establishment of Research Advisory Council

-   Documentation of QA process on selected Signature Work 1
    materials/activities

-   Dissemination statistics related to Signature Work 1

-   Customer feedback related to Signature Work 1

-   REL performance indicators

    [RAPSTA (Retention and Attrition of Pacific School Teachers and
    Administrators) Study]{.underline}

-   RAPSTA Studies (selected reports/presentation packets)

-   Impact/Dissemination of study results (e.g., CNMI newsclips,
    American Samoa Public Schools Report)

```{=html}
<!-- -->
```
-   Coping with Teacher Stress: A Research Synthesis for Pacific
    Educators

-   At-Risk Teachers (research synthesis)

[PLUS (Pacific Language Use in Schools) Study]{.underline}

-   Plans for the study (research design, communications with Research
    Advisory Council, data matrix, instruments)

-   Language Use at Home and School (research synthesis)

-   Report on the Vernacular Language Project

-   Report on Chamorro, Carolinian, and English Language Education

On-site activities for evaluation of Signature Work 1 may include
interviews with:

-   PREL project staff involved with Signature Work 1

-   R&D Cadre members (selected)

-   Research Advisory Council national scholars (selected)

-   OERI Program Officer

Signature Work 2 --- Language and Literacy Focus

PREL's Board of Directors has established literacy as the overarching
focus of PREL's work. In addition to its provision of increased access
to knowledge and global communication, literacy is seen as the key to
developing human resources in the Pacific region; achieving literacy
means added economic value for individuals and for society. The wide
variation of language environments in the Pacific region (ranging from 5
percent concentration of students who are English language learners to
99 percent) leads to educational policies and practices that call for a
variety of English and vernacular language use. This Signature Work will
explore PREL's response to this regional need through a variety of
approaches including professional development, publications, and
multimedia products

The list of proposed data sources for advance review of Signature Work 2
includes:

-   Excerpts from or page references to relevant sections of PREL
    contractual documents (e.g., technical proposal, quarterly reports,
    annual updates)

-   Selected Board meeting minutes

-   Annual Consumer Report (excerpts)

-   Documentation of research base for Signature Work 2

-   Documentation of needs assessment related to Signature Work 2 (e.g.,
    entity planning meeting notes, excerpts from Educational Needs
    Assessment Report)

-   Selected sections of relevant evaluations (e.g., Self-Study,
    External Peer Review, Formative Evaluation)

-   Documentation of QA process conducted on selected Signature Work 2
    materials or activities

-   Dissemination statistics

```{=html}
<!-- -->
```
-   OBEMLA/OSERS request to present at national conference
    (correspondence)

-   NCBE request to include report in on-line library (correspondence)

```{=html}
<!-- -->
```
-   Relevant contracts related to Signature Work 2 (e.g., Assistance
    with Language Arts Standards and Curriculum Development, subcontract
    to MERC for Pacific Writers Institutes, development of bilingual
    books (RMI))

[Professional Development]{.underline}

-   1997 PEC Pre-conference Institute: Pacific Choices for Language Use
    (selected materials)

-   1998 PEC Pre-conference Institute: First and Second Language
    Literacy (selected materials)

-   Pacific Writer' Institutes (selected materials)

-   OSERS/OBEMLA Forum on Early Intervention (PowerPoint slides)

-   Storytelling Workshops (selected materials)

-   Relevant selections from Language and Cultural Diversity Laboratory
    Networking Program (LNP) framework

[Publications]{.underline}

-   *Pacific Education Updates: Education for Within and Beyond the
    Reef* (newsletter)

-   *Promising Practices in the Pacific Region* (newsletter)

-   *Language Use at Home and School* (research synthesis)

-   *Chamorro Word Book*

-   *Samoan Word Book*

-   A Review of "The First and Second Language in Education" (briefing
    paper)

-   Integrating Title IV and Title VII: Using TRIBES to Teach English as
    a Second Language (briefing paper)

```{=html}
<!-- -->
```
-   Pacific Reading Success Network; Dear Teacher Let Me Tell You Who I
    Am... (brochures)

[Multimedia Products]{.underline}

-   Plans for teleconference on First and Second Language Literacy

-   Reading Aloud to Children audiotape series (selection)

-   PALM CD-ROM (on-site)

-   Language, Literacy, and Education powerpoint presentation

On-site data collection activities in relation to Signature Work 2 may
include interviews with:

-   PREL project staff involved with Signature Work 2

-   PREL Board members (selected)

-   PCIC members (selected)

-   OERI Program Officer

# Additional Items Selected from the Inventory of Products and Services

In addition to the Signature Works data sources, additional materials
will be provided in advance to the peer reviewers. The following
materials have been selected from the PREL Inventory to provide
additional breadth to the evaluation:

-   Pacific Center News (selected issue)

-   Pacific Education Update (selected issue)

-   Ebeye Public School/Al Maron - (hardcopy overview in advance, Coming
    Together video on-site)

-   Leadership Institutes (selected materials)

-   Pacific Educators in Residence (PEIR) Handbook

-   PEC packet (e.g., planning book?, program, evaluation report)

-   CSRD brochure

-   Educator leave policy work of R&D Cadre (relevant passages from
    minutes)

-   Voyages in Mathematics and Science (selected issue)

```{=html}
<!-- -->
```
-   PREL Website

-   E-School Technology in Education Conference Program

# Materials for Overall Laboratory Operations

Other materials will be collected and provided to the peer reviewers so
that they can examine the overall operations of PREL. The following
materials will be provided to the peer reviewers in advance of the site
visit:

-   Original RFP (DIR will copy and provide the "Scope of Work" to
    reviewers)

-   Inventory of products and services from the current contract period
    (to be copied and provided to peer reviewers by DIR).

-   PREL Technical Proposal and response to technical questions

-   Contract modifications

-   Quarterly reports

-   Annual plans and updates

-   Summary of PREL funding, by source

-   Organizational chart

-   Board roster and affiliations

-   Selected Board meeting agenda and minutes

-   Self-Study Report (1997)

-   Educational Needs Assessment Report for the Pacific: 1997

-   External Peer Review Panel Report (1997)

-   QA System - procedures documentation

-   Annual Formative Evaluation Survey (1997)

-   Customer feedback procedures documentation (e.g., customer
    satisfaction survey results

-   List of staff presentations at relevant regional and national
    meetings

-   Annual Consumer Report

-   List of staff publications in external venues

-   Relevant reports by OERI staff

-   Utilization statistics (e.g., web site hits, \# materials
    disseminated)

On-site interviews regarding overall PREL operations will be conducted
and should include:

-   Staff interviews

-   Board interviews or focus groups

-   OERI Program Officer interview