U.S. flagAn official website of the United States government
        Here’s how you know
    Goverment symbol**Official websites use .gov**
            A **.gov** website belongs to an official government organization in the United States.
        Lock symbol**Secure .gov websites use HTTPS**
            A lock (
              A locked padlock
                 ) or **https://** means you’ve safely connected to the .gov website. Share sensitive
              information only on official, secure websites.
 Skip to main content JoinDonate
    About
    About
          About
        
About menu block one
  

        
        What We Do
                Our Impact
                Agency FAQs
About menu block two
  

        
        Our Team
                Careers
About menu block three
  

        
        Agency Overview
                            Budget and Performance Plans
                Disability and Accessibility
                Federal Register Notices
                Open Government
                Plain Writing
                Privacy Policy
                Strategic Plan

  

  
Serve
    Serve
          Serve
        
Serve menu block one
  

        
        AmeriCorps
                            AmeriCorps NCCC
                AmeriCorps State and National
                AmeriCorps VISTA
                AmeriCorps Seniors
                            AmeriCorps Seniors Foster Grandparent Program
                AmeriCorps Seniors RSVP
                AmeriCorps Seniors Senior Companion Program
Serve menu block two
  

        
        Volunteer
                            9/11 Day
                MLK Day
Serve menu block three
  

        
        Find Your Fit
                Serve FAQs

  

  
Partner
    Partner
          Partner
        
Partner menu block one
  

        
        How it Works
                            AmeriCorps NCCC
                AmeriCorps Seniors Foster Grandparent
                AmeriCorps Seniors RSVP
                AmeriCorps Seniors Senior Companion
                AmeriCorps State and National
                AmeriCorps VISTA
                Research and Evaluation
                Volunteer Generation Fund
Partner menu block two
  

        
        Partnerships
                Communities and Initiatives
                Funding Opportunities
Partner menu block three
  

        
        Partner FAQs

  

  
Members & Volunteers
    Members & Volunteers
          Members & Volunteers
        
Members & Volunteers menu block one
  

        
        Your Benefits
                Segal AmeriCorps Education Award
                Education Award FAQs
Members & Volunteers menu block two
  

        
        Alumni
                Members in VISTA
Members & Volunteers menu block three
  

        
        Member and Volunteer FAQs
                Safety and Security

  

  
Grantees & Sponsors
    Grantees & Sponsors
          Grantees & Sponsors
        
Grantee & Sponsors menu block one
  

        
        State Service Commissions
                State and National Direct Grantees
                State Subgrantees
                VISTA Sponsors
                Research and Evaluation Grantees
                Volunteer Generation Fund and Days of Service Grantees
Grantee & Sponsors menu block two
  

        
        RSVP Grantees
                Foster Grandparent Program Grantees
                Senior Companion Program Grantees
                Senior Demonstration Program Grantees
                NCCC Project Sponsors
Grantee & Sponsors menu block three
  

        
        Manage Your Grant
                Grantee and Sponsor FAQs

  

  
Newsroom
    Newsroom
          Newsroom
        
Newsroom menu block one
  

        
        News
                Blog
Newsroom menu block two
  

        
        Stories
                Events
Newsroom menu block three
  

        
        In the News
                Communication Resources



  
Contact
    Contact
    JoinDonate
search Breadcrumb

              Keystone Smiles - AmeriCorps Evaluation Report
      Back
                Keystone SMILES AmeriCorps recruits, trains, develops, and engages AmeriCorps members to provide:

academic support with host site school districts and alternative education and mentoring with community organizations,
	community strengthening service to host sites, and
	member and community training.During this program cycle, they provided structured programs to offer academic and social/behavior tutoring support within 60 schools and a wide array of service-learning support services from 12 community-based host sites across 12 counties in western and northwestern Pennsylvania.

**Study Goal:**
The goal of the study is to understand the effects of the targeted academic assistance activities provided by AmeriCorps members in the schools they serve (the impact of the program). The evaluation used a quasi-experimental design (QED) along with periodic interviews with host site supervisors. The QED compared 4th-grade mathematics test scores of schools with and without AmeriCorps members. Treatment and comparison schools were matched by performance quartiles from school-level achievement and demographic data.

**Research Question:**

Do students in schools who receive targeted services from Keystone SMILES AmeriCorps members achieve better mathematics scores on the Pennsylvania System of School Assessment (PSSA) standardized test than students in schools with similar academic and socioeconomic backgrounds who do not receive services?**Findings:**
The evaluation found the following:

Eight of the twelve (67%) treatment schools involved in the evaluation scored better than the comparison schools on at least three of the four measurements: Year to Year Average Growth for Total Number of Students, Year to Year Average Growth for Historically Underperforming Students, Average Growth 2015-2019 for Total Number of Students, and Average Growth 2015-2019 for Historically Underperforming Students.
	Based on the quantitative data, there is evidence that receiving services from Keystone SMILES AmeriCorps results in higher test scores on the 4th-grade PSSA mathematics assessment.
	The themes that emerged from the host site interviews indicate that schools heavily depend on the Keystone SMILES AmeriCorps program to provide a quality educational experience for all students, especially those students needing extra support.For more information, download:

Full Report

      Full report
        Further information
    



      Program/Intervention
                        Keystone SMILES AmeriCorps
  

      Implementing Organization
                        Keystone SMILES Community Learning Center
  

      Intermediary(s)
                        Keystone SMILES Community Learning Center
  

      AmeriCorps Program(s)
            AmeriCorps State and National
  

      Age(s) Studied
            6-12 (Childhood)
  

      Outcome Category
            K-12 success
  

      Study Design(s)
            Quasi-experimental (QED)
  

      Level of Evidence
            Moderate
  

      Researcher/Evaluator
                        Wolfrom Consulting
  

      Published Year
                        2020
  

      Study Site Location (State)
            Pennsylvania Back to main content Sign up to hear about our latest news, events, and opportunities.
  Sign up for our newsletter
    Footer about
  

        
        About
                            What We Do
                Our Impact
                Our Team
                Careers
                Agency OverviewFooter serve
  

        
        Serve
                            AmeriCorps
                AmeriCorps Seniors
                Volunteer
                Find Your FitFooter partner
  

        
        Partner
                            How it Works
                Funding OpportunitiesFooter Members & Volunteers
  

        
        Members & Volunteers
                            Your Benefits
                Segal AmeriCorps Education Award
                Alumni
                Safety and SecurityFooter grantees & sponsors
  

        
        Grantees & Sponsors
                            eGrants
                History Checks
                LitmosFooter newsroom
  

        
        Newsroom
                            News
                Blog
                Stories
                Events
                In the News
                Communication Resources
      Bringing Americans together to serve communities

Follow us
  
  1-800-942-2677
            
    help@americorps.gov
    USA.gov / Office of Inspector General / FOIA and Privacy Act / Federal Register notices / No FEAR Act/ Employee Whistleblower Rights / Contractor and Grantee Whistleblower Rights / Office of Special Counsel / STOCK Act / Fraud Alert

Accessibility / Privacy policy / Site map / Donate / Join

**AmeriCorps.gov**
An official website of AmeriCorps. Produced and published at taxpayer expense. 
 You are leaving AmeriCorps.gov
 The website you’re going to is not part of the AmeriCorps domain and may not be under AmeriCorps’ control. Its privacy and security practices and policies may differ from AmeriCorps’. AmeriCorps is not responsible for the link, nor does it endorse the content of the third-party website. Click on the continue button to proceed to the external website; otherwise click cancel to stay on AmeriCorps.gov.
 Cancel Continue