![](media/image1.png){width="6.499305555555556in" height="0.7375in"}

**RE: RFP \# 623-EA-08-021**

**REQUEST FOR PROPOSALS FOR CONSULTANCY- MID-TERM EVALUATION FOR SIRIP
PROGRAM**

The United States Agency for International Development, Somalia
(USAID/EA/LPC/Somalia) hereby invites for proposals for technical
assistance to conduct a mid-term evaluation of the Somalia Interactive
Radio Instruction Program (SIRIP). USAID is seeking proposals from
qualified consulting firms or individuals to provide services described
in this solicitation.

The purpose of the mid-term evaluation is to provide information and
recommendations to USAID on program performance.

The key questions and issues to address in this evaluation will be: The
overall impact of SIRIP to date, performance and progress towards
achieving program results, program accomplishments to date, areas where
program has fallen short of results, working environment for SIRIP,
response to challenges, and, impact in developing capacities.

The evaluation team is expected to identify, develop and utilize a
variety of appropriate quantitative and qualitative methodologies to
conduct the program evaluation. These may include, but are not limited
to, documentation analysis, site-visits, interviews, focus-groups, test
validation, statistical analysis, etc.

Consultants will be expected to have the following qualifications,
expertise and experience:

-   At the minimum, a Masters degree in the area of Education, Education
    psychology, Inclusive/Special needs education, Social work or
    related fields.

-   Solid experience in the area of education research and assessment,
    particularly in relation to monitoring and evaluation.

-   Proven skills in developing data collecting tools and techniques and
    analysis.

-   Work experience in Somalia and knowledge of the Somalia Education
    sector is highly desirable.

-   Experience in working in difficult situations will be and added
    advantage.

Issuance of this request does not constitute an award commitment on the
part of the US Government, nor does it commit the US Government to pay
for costs incurred in the preparation and submission of any proposal.
Further, the US Government reserves the right to reject any or all
proposals received as a result of this solicitation.

+------------------------+--------------+--------------+--------------+
| U.S. Agency for        | Courier      | U.S. Postal  | Tel:         |
| International          | Address:     | Address:     | 254-20-862   |
| Development            |              |              | 2000         |
|                        | USAID/East   | USAID/East   |              |
| USAID/East Africa      | Africa       | Africa       | Fax:         |
|                        |              |              | 254-20-862   |
| P.O. Box 629           | c/o American | Unit 64102   | 2680 / 2682  |
|                        | Embassy      |              |              |
| Village Market 00621   |              | APO AE       | [http://eas  |
|                        | United       | 09831-4102   | tafrica.usai |
| Nairobi, Kenya         | Nations      |              | d.gov](http: |
|                        | Avenue,      |              | //eastafrica |
|                        | Gigiri,      |              | .usaid.gov/) |
|                        |              |              |              |
|                        | Nairobi,     |              |              |
|                        | Kenya        |              |              |
+------------------------+--------------+--------------+--------------+

Interested firms or individuals who meet the above requirements should
present their technical and financial proposals clearly outlining the
detailed methods that will be applied for data collection. Please
include detailed company profiles and CVs of lead consultants.

Proposals submitted via email should be sent to Lauralea Gilpin on email
<lgilpin@usaid.gov> with a copy to Mary Mwadime on email
<mmwadime@usaid.gov> not later than March 10, 2008 4 p.m

Kenyan Time. Mail/Courier applications should be sent to: Mary mwadime,
USAID/EA/RAAO, United Nations Avenue, Gigiri. P.O. BOX 629, Village
Market 00621, Nairobi, Kenya and should be received at the USAID offices
on or before the closing date and time stated above.

Lauralea Gilpin

Regional Agreement Officer

USAID/EA/RAAO

**USAID/Somalia**

**Statement of Work**

**Mid-term Evaluation of the Somalia Interactive Radio Instruction
Program**

**1. Purpose**

The United States Agency for International Development, Somalia
(USAID/Somalia) is seeking technical assistance to conduct a mid-term
evaluation of the Somalia Interactive Radio Instruction Program (SIRIP).
The purpose of the mid-term evaluation is to provide information and
recommendations to USAID on program performance.

**2. Background**

SIRIP is a three year, \$ 6,000,000 program being implemented by the
Education Development Center (EDC). The program grant was awarded in
September 2005, implementation began shortly thereafter, and the program
end date is September 2008.

*2a. Program Hypotheses and Assumptions*

SIRIP was designed to improve access to education for children
throughout Somalia using high quality radio-based instructional
programs. The International Republican Institute (IRI) approach was
considered to be the most effective way of reaching an increasingly
large number of students particularly in geographical areas affected by
on-going civil conflict, including Mogadishu. The program was designed
to support education authorities, and to establish a network of partners
who would expand the use of IRI programs throughout Somalia. A
radio-based approach was also selected as an appropriate technology for
transmitting instructional programs, as radio is the most widely used
means of communication in Somalia.

*2b. Program Interventions*

The key SIRIP interventions are the development, broadcasting and
testing of IRI programs based on the "national" curriculum for children
in grades 1-6. To ensure the effectiveness of IRI programs in the
classroom, the SIRIP provides a variety of teacher training and support
activities. To further compliment the IRI programs, supplemental
teaching and learning materials have been developed and disseminated.

**3. Evaluations Questions**

The key questions and issues for the mid-term program evaluation to
address are:

-   Assess the overall impact of SIRIP to date: To what extent is the
    program having an impact on improving teaching and learning in
    Somalia? Assess and validate how many children and teachers have
    benefited from the program?

-   Assess performance and progress towards achieving program results as
    measured against targets established in the grant agreement, annual
    implementation plans and the performance monitoring plan.

-   Describe and evaluate the program accomplishments to date: What are
    the notable successes? What accounted for the success of these
    programs? Identify particular strategies, activities or programs
    that were effective and describe why they worked.

-   Describe and evaluate the areas where the program has fallen short
    of achieving results. Assess and explain why these results have not
    been achieved.

-   Describe and analyze the working environment within which SIRIP was
    implemented and contextual factors that affected program
    performance. These may include insecurity, political upheaval, and
    local institutional capacity.

-   Describe and assess how SIRIP responded and adapted to the
    challenging and changing work environment in Somalia. Assess the
    implementing partners' contingency plans and whether or not these
    plans were activated and effective.

-   Compile and provide a brief description of the program outcomes and
    products (radio programs by grade and subject, teaching and learning
    materials, training materials, pre and post tests, etc.). To the
    extent possible assess the quality of these products. Examine how
    these products are being used to support education in Somalia.

-   Describe and assess what impact the program has had in developing
    human and institutional capacities in Somalia?

-   Assess the broadcasting aspects of the program. Examine the quality
    of the radio broadcasts in targeted areas and whether the radio
    frequencies used are adequate for effective classroom instruction
    and teacher training.

-   Assess the quality and impact of the teacher/facilitator activities.
    As a result of the program interventions, do teachers have the
    skills and capacities to utilize IRI effectively in the classroom?

-   Assess how effective the program has been in establishing a network
    of partner institutions for SIRIP scale-up. Identify what steps can
    be taken for SIRIP to strengthen the partner network and accelerate
    and scale-up implementation to an increasing number of learners.

-   Assess the quality and performance of EDC in managing implementation
    of the program. Assess EDC and its implementing partners' technical
    and management capacities and performance. Assess the effectiveness
    of the organizational and management structure of EDC and it's
    implementing partners to achieve program results. Identify what, if
    anything, can be done to strengthen program management.

-   Assess EDC's communications and relations with USAID/Somalia and the
    Somali education authorities. Assess EDC's compliance with the grant
    agreement terms and conditions.

-   Describe and assess what measures have been taken to ensure
    sustainability for the program.

-   Assess the underlying program hypotheses, principles and
    assumptions. Were they accurate, were they followed, and did they
    change over time? Are the program hypotheses still valid and
    relevant for the program?

1.  What are the perceptions of SIRIP among key stakeholders including,
    Education authorities, other development agencies, NGOs, network
    partners, teachers, parents, and students.

**4. Recommendations**

Based on the evaluation findings provide recommendations on the
following:

-   What steps can be taken to improve SIRIP? This may include, among
    other things, recommendations on the programming quality, content,
    delivery, teacher training, monitoring and evaluation, and the
    partner network.

-   What are the conditions and requirements for SIRIP to scale-up
    implementation?

-   What steps can be taken to expand the partner network?

-   How can SIRIP be utilized to reach the large number of primary age
    students that do not have access to formal schools?

**5. Evaluation Methodology**

The evaluation team should identify, develop and utilize a variety of
appropriate quantitative and qualitative methodologies to conduct the
program evaluation. These may include, but are not limited to,
documentation analysis, site-visits, interviews, focus-groups, test
validation, statistical analysis, etc.

*5a. Information Resources*

It is expected that the team will review all relevant program
documentation. During the orientation briefing, USAID will provide the
team will copies of relevant program documents including the grant
agreement, quarterly reports and the performance monitoring plan. The
consultants may also request additional information from Education
Development Center and other relevant implementing partners.

*5b. Key Informants*

It is expected that the evaluation team will meet with and interview key
project staff, partners and beneficiaries of the SIRIP. This would
include key EDC staff members; scriptwriters, radio producers, radio
station staff, teachers, listeners, parents, key Ministry of Education
personnel, current and potential network partners, other development
agencies and NGOs, and USAID staff.

**6. Evaluation Team Composition and Level of Effort**

USAID anticipates that the evaluation team will consist of at least
two-persons with expertise in monitoring and evaluation. At least one
team member should have technical expertise in radio production and
broadcasting. It is estimated that the evaluation will take place over a
four-week period beginning in March 2008.

**7. Schedule and Logistics**

It is anticipated that the evaluation will take place in Nairobi, Kenya
and throughout Somalia. Travel within Somalia should be carefully
planned and coordinated with appropriate consideration for security. In
the event that travel to South Central and/or Puntland is not possible,
the consultants should utilize appropriate alternative evaluation
methods. The consultants will be required to organize all the logistics
required to carry out the evaluation including transportation and
communication. Upon award, the consultant will be required to have a
post-award meeting with USAID officials. A six-day work week is
recommended and authorized.

**8. Deliverables: Report and Dissemination of the Evaluation Findings**

-   A detailed work plan shall be submitted to USAID/Somalia in Nairobi
    for approval within one week of the award.

-   An interim progress report shall be provided to USAID/Somalia in
    Nairobi not later than week two of the assignment.

-   A comprehensive draft report, containing the evaluation finding and
    recommendations shall be submitted to USAID/Somalia in Nairobi by
    the end of the fourth work week. The draft report shall be submitted
    in hard copy and electronically via email in Microsoft Word format.
    USAID will review the Draft evaluation report and will provide
    written comments within three days after receipt of the draft.

-   In addition to the draft report, the consultant will provide an oral
    briefing to USAID/Somalia in Nairobi on the evaluation findings;

-   A revised final evaluation report that incorporates comments on the
    draft shall be submitted for USAID review and approval by the end of
    the fifth work week. The final report shall be submitted in hard
    copy and electronically via email in Microsoft Word format.

**9. Payment Schedule**

An initial payment of 20% shall be made upon receipt of the workplan. An
additional 20% payment for consultancy service will be made upon receipt
and acceptance of the draft report. The final 60% payment shall be made
upon receipt and acceptance of the Final Report.

**10. Evaluation Criteria**

**Evaluation Team 40**

The principal consultant shall have at least 10 years experience in
planning, designing, managing and evaluating education program programs
in post-conflict countries. At least one of the evaluators shall have
professional experience evaluating education programs funded by an
international development agency. One of the evaluators shall have
professional expertise and in-depth knowledge and experience with
radio-based education programs in developing countries. A minimum
Master's degree in a relevant field is required for the principal
evaluators. Excellent communication skills and professional writing
skills are required.

**Research Design 40**

Prospective consultants shall describe their overall approach to this
scope of work, including how they propose to carry out each phase of the
work. This description should include a work plan that identifies all
staff and logistical requirements for the proposed evaluation design.

**Past Performance 20**

Prior experience and a demonstrated track record of consultants in
design, management and conduct of education program evaluation is
essential. Work experience in Somalia and knowledge of the Somalia
education sector is highly desirable.