-------------------------- ------------------------------------------------------------------
  **RA: National Institute   
  on Disability and          
  Rehabilitation             
  Research (OSERS)**         

  **FY 2008 Program          
  Performance Report (System 
  Print Out)**               

  Strategic Goal 1           

  Multiple                   

  RA, Title II, 29 U.S.C.    
  762-764                    

  Document                   
  Year 2008 Appropriation:   
  \$105,741                  

  CFDA                       84.133: National Institute on Disability and Rehabilitation
                             Research
  -------------------------- ------------------------------------------------------------------

  -------------- --------------------------------------------------------
  **Program      **To conduct high-quality research and related
  Goal:**        activities that lead to high-quality products.**

  -------------- --------------------------------------------------------

  -----------------------------------------------------------------------

  -----------------------------------------------------------------------

  ------------------------- --------------------------------------------------------
  ***Objective 1 of 4:***   *Advance knowledge through capacity building: Increase
                            capacity to conduct and use high-quality and relevant
                            disability and rehabilitation research and related
                            activities designed to guide decisionmaking, change
                            practice, and improve the lives of individuals with
                            disabilities.*

  ------------------------- --------------------------------------------------------

  ----------------------- ---------------- ------------------- --------------------------
  **Measure 1.1 of 1:**                                        
  The percentage of                                            
  National Institute on                                        
  Disability and                                               
  Rehabilitation Research                                      
  (NIDRR)-supported                                            
  fellows, post-doctoral                                       
  trainees, and doctoral                                       
  students who publish                                         
  results of                                                   
  NIDRR-sponsored                                              
  research in refereed                                         
  journals.   (Desired                                         
  direction: increase)                                         
    1752                                                       

  **Year**                **Target**       **Actual\           **Status**
                                           (or date            
                                           expected)**         

  2005                    Set a Baseline   Not Collected       Not Collected

  2006                    BL+1%            8.8                 Target Exceeded

  2007                    BL+5%            17                  Target Exceeded

  2008                    BL+5%            (December 2009)     Pending

  2009                    BL+5%            (December 2010)     Pending

  2010                    BL+6%            (December 2011)     Pending

  2013                    BL+10%           Undefined           Pending
  ----------------------- ---------------- ------------------- --------------------------

**Source**. Annual Performance Report (APR).

**Frequency of Data Collection**. Annual

**Data Quality**. For this measure, \"refereed journals\" only included
only those journals that are recognized by Thompson Scientific Institute
for Scientific Information journal selection process.  For more
information on this process, see
http://scientific.thomson.com/free/essays/selectionofmaterial/journalselection/. 
For a master list of journals meeting the refereed journal criteria, see
http://www.thomsonscientific.com/cgi-bin/jrnlst/jloptions.cgi?PC=master

**Target Context**. NIDRR intends to collect two years of baseline data
before establishing numeric targets for this measure.

**Explanation**. In 2007, there were a total of 538 currently supported
NIDRR fellows, post-doc trainees and doctoral students. NIDRR-supported
fellows, post-doctoral trainees, and doctoral students produced 92
publications that appeared in refereed journals. Therefore,
approximately 17 percent of those researcher funded by NIDRR produced
publications that appeared in refereed journals.\
\
This statistic requires some qualification because of the lag time it
takes to have publications appear. Some of the publications produced by
the 2007 students will not appear until 2008 or later. Similarly, some
of the publications counted in 2007 are from 2006 students who are no
longer supported. These facts associated with publishing in refereed
journals only allow for the calculation of a rough estimate using
currently funded students in the denominator. Therefore, using available
data, we derive the following rough estimate.\
\
The following funding mechanisms support researchers who publish and who
were counted in these measure: Rehabilitation Research and Training
Centers (RRTC), Rehabilitation Engineering Research Center (RERC),
Advanced Rehabilitation Research Training Grant (ARRT), Model Systems
(MS), Disability Rehabilitation Research Project, (DRRP) and Field
Initiated Projects (FIP) grants. This data does not include those funded
by the Small Business Innovative Research (SBIR program).

  -----------------------------------------------------------------------

  -----------------------------------------------------------------------

  ------------------------- --------------------------------------------------------
  ***Objective 2 of 4:***   *Advance knowledge through research and related
                            activities: Generate scientific-based knowledge,
                            technologies, and applications to inform policy, change
                            practice, and improve outcomes.*

  ------------------------- --------------------------------------------------------

  ----------------------- ----------------- ------------------- --------------------------
  **Measure 2.1 of 3:**                                         
  The number of                                                 
  accomplishments (new or                                       
  improved tools,                                               
  methods, discoveries,                                         
  standards,                                                    
  interventions,                                                
  programs, or devices)                                         
  developed and/or tested                                       
  with National Institute                                       
  on Disability and                                             
  Rehabilitation Research                                       
  (NIDRR) funding that                                          
  have been judged by                                           
  expert panels to be of                                        
  high quality and to                                           
  advance the field.                                            
    (Desired direction:                                         
  increase)   1899                                              

  **Year**                **Target**        **Actual\           **Status**
                                            (or date            
                                            expected)**         

  2006                    Set a Baseline    Not Collected       Not Collected

  2007                    Set a Baseline    49                  Target Met

  2008                    Maintain a        Not Collected       Not Collected
                          Baseline                              

  2013                    BL+10%            Undefined           Pending
  ----------------------- ----------------- ------------------- --------------------------

**Source**.  Annual Performance Assessment Expert Review-APAER

**Frequency of Data Collection**. Annual

**Data Quality**. 

In 2008, NIDRR reviewed its internal peer review process used for
evaluating the quality and relevance of  grantee products and decided to
move to an external review process.  \
\
Use of an external evaluation is intended to improve the quality of the
review process and to enhanse our knowledge about grantees
accomplishments..

**Explanation**. In 2008-09 NIDRR will pilot an external evaluation of
grantee products. This evaluation will provide a new data source for
this measure. If necessary NIDRR may need to change the lanuage for this
measure.

  ----------------------- ---------------- ------------------ --------------------------
  **Measure 2.2 of 3:**                                       
  The percentage of                                           
  National Institute on                                       
  Disability and                                              
  Rehabilitation Research                                     
  (NIDRR)-funded grant                                        
  applications that                                           
  receive an average peer                                     
  review score of 85 or                                       
  higher.   (Desired                                          
  direction: increase)                                        
    1332                                                      

  **Year**                **Target**       **Actual\          **Status**
                                           (or date           
                                           expected)**        

  2002                                     82                 Measure not in place

  2003                                     96                 Measure not in place

  2004                                     89                 Measure not in place

  2005                    Set a Baseline   99                 Target Met

  2006                    85               99                 Target Exceeded

  2007                    90               96                 Target Exceeded

  2008                    99               (October 2008)     Pending

  2009                    96               (October 2009)     Pending

  2010                    96               (October 2010)     Pending

  2011                    Maintain a       Undefined          Pending
                          Baseline                            
  ----------------------- ---------------- ------------------ --------------------------

**Source**. 

U.S. Department of Education Grants Performance System ((GAPS).

**Frequency of Data Collection**. Annual

**Explanation**. In FY 2006, 99 percent of the eighty new awards
received ratings of 85 or higher.  In 2007, 96 percent of the
seventy-one new awards received ratings of 85 or higher.

  ----------------------- ----------------- ------------------ --------------------------
  **Measure 2.3 of 3:**                                        
  The percentage of new                                        
  National Institute on                                        
  Disability and                                               
  Rehabilitation Research                                      
  grants that assess the                                       
  effectiveness of                                             
  interventions,                                               
  programs, and devices                                        
  using rigorous methods.                                      
    (Desired direction:                                        
  increase)   1334                                             

  **Year**                **Target**        **Actual\          **Status**
                                            (or date           
                                            expected)**        

  2002                                      65                 Measure not in place

  2003                                      59                 Measure not in place

  2004                                      59                 Measure not in place

  2005                    Set a Baseline    49                 Target Met

  2006                    65                Not Collected      Not Collected

  2007                    65                35                 Made Progress From Prior
                                                               Year

  2008                    Maintain a        (August 2008)      Pending
                          Baseline                             

  2009                    35                (August 2009)      Pending

  2010                    35                (August 2010)      Pending
  ----------------------- ----------------- ------------------ --------------------------

**Source**. Grant Manager Pre-funding Survey, reviews and tabulations
completed by NIDRR grants managers.

**Frequency of Data Collection**. Annual

**Data Quality**. NIDRR grant managers review grant applications to
identify the research methodologies used.   Possible methodologies that
may be assigned on the basis of this review include: 1) true
experimental; 2) quasi-experimental; or 3) single subject.  If the grant
manager assigns value 1,2 or 3 as being the methodology proposed by the
study, these data are included in this measure as representative of
grantees that use more rigorous research methodologies.

**Explanation**. In 2007, NIDRR grant managers, found that 35 percent of
new awards used true experimental, quasi-experimental or single subject
designs.

  -----------------------------------------------------------------------

  -----------------------------------------------------------------------

  ------------------------- --------------------------------------------------------
  ***Objective 3 of 4:***   *Advance knowledge through translation and
                            dissemination: Promote the effective use of
                            scientific-based knowledge, technologies, and
                            applications to inform policy, improve practice, and
                            enhance the lives of individuals with disabilities.*

  ------------------------- --------------------------------------------------------

  ----------------------- ----------------- ------------------- -------------------------
  **Measure 3.1 of 2:**                                         
  The number of new or                                          
  improved National                                             
  Institute on Disability                                       
  and Rehabilitation                                            
  Research (NIDRR-funded                                        
  assistive and                                                 
  universally designed                                          
  technologies, products,                                       
  and devices transferred                                       
  to industry for                                               
  potential                                                     
  commercialization.                                            
    (Desired direction:                                         
  increase)   1755                                              

  **Year**                **Target**        **Actual\           **Status**
                                            (or date            
                                            expected)**         

  2007                    Set a Baseline    26                  Target Met

  2008                    27                23                  Did Not Meet Target

  2009                    24                (December 2009)     Pending

  2010                    27                (December 2010)     Pending
  ----------------------- ----------------- ------------------- -------------------------

**Source**. Annual Performance Report (APR).

**Frequency of Data Collection**. Annual

**Data Quality**. NIDRR intends to use FY 2007 data to establish a
baseline.  The FY 2007 APR asked grantees implementing development
projects to identify: "What stage of the development process are you in
during this reporting period? Those selecting choice "(f)
commercialization" are included in this measure. 

**Target Context**. NIDRR intends to collect two years of baseline data
before establishing numeric targets for this measure.

**Explanation**. In 2008, twenty-three grantees reported technology
products and devices that were transfered to industry.  We expect that
this number will remain relatively small because of the length of time
it takes to develop new technologies.\
\
Development projects funded by NIDRR through three funding mechanisms
are included in this measure.  These include Small Business Innovative
Research Phase II (SBIRs), Rehabilitation Engineering and Research
Centers (RERCs), and Field Initiated Programs (FIPs). 

  ----------------------- ---------------- ------------------- ---------------------------
  **Measure 3.2 of 2:**                                        
  The average number of                                        
  publications per award                                       
  based on National                                            
  Institute on Disability                                      
  and Rehabilitation                                           
  Research (NIDRR)-funded                                      
  research and                                                 
  development activities                                       
  in refereed journals.                                        
    (Desired direction:                                        
  increase)   1333                                             

  **Year**                **Target**       **Actual\           **Status**
                                           (or date            
                                           expected)**         

  2002                                     2.91                Measure not in place

  2003                    8                3.38                Made Progress From Prior
                                                               Year

  2004                    5                2.71                Did Not Meet Target

  2005                    5                3.81                Made Progress From Prior
                                                               Year

  2006                    2                2.71                Target Exceeded

  2007                    1                1.79                Target Exceeded

  2008                    3                (August 2009)       Pending

  2009                    2                (August 2010)       Pending

  2010                    2                (August 2011)       Pending
  ----------------------- ---------------- ------------------- ---------------------------

**Source**. Annual Performance Report (APR).

**Frequency of Data Collection**. Annual

**Data Quality**. Refereed journals included only those recognized by
Thompson Scientific Institute for Scientific Information journal
selection process.

**Explanation**. In 2007-08, two hundred NIDRR grantees published 1.79
publication per grant in referreed journals.  This rate was down
slightly because fewer grants were funded in 2008.\
\
These data are reported for fiscal year 2007 and 2008

  -----------------------------------------------------------------------

  -----------------------------------------------------------------------

  ------------------------- --------------------------------------------------------
  ***Objective 4 of 4:***   *Enhance efficiency of NIDRR grant award process.*

  ------------------------- --------------------------------------------------------

  ----------------------- ---------------- ------------------ ---------------------------
  **Measure 4.1 of 2:**                                       
  The percentage of                                           
  National Institute on                                       
  Disability and                                              
  Rehabilitation Research                                     
  (NIDRR) competitions                                        
  announced by October 1.                                     
    (Desired direction:                                       
  increase)   1339                                            

  **Year**                **Target**       **Actual\          **Status**
                                           (or date           
                                           expected)**        

  2003                                     21                 Measure not in place

  2004                                     23                 Measure not in place

  2005                                     8                  Measure not in place

  2006                    25               11                 Made Progress From Prior
                                                              Year

  2007                    50               69                 Target Exceeded

  2008                    90               (October 2008)     Pending

  2009                    70               (October 2009)     Pending

  2010                    75               (October 2010)     Pending
  ----------------------- ---------------- ------------------ ---------------------------

**Source**. Grants Administration and Payment System (GAPS).

**Frequency of Data Collection**. Annual

**Explanation**. In 2007, sixth-nine (69) percent of new competitions
were announced by October 1. This is updated data from GAPS.

  ----------------------- ---------------- ------------------ ---------------------------
  **Measure 4.2 of 2:**                                       
  The percentage of                                           
  National Institute on                                       
  Disability and                                              
  Rehabilitation Research                                     
  (NIDRR) grant awards                                        
  issued within six                                           
  months of the                                               
  competition closing                                         
  date.   (Desired                                            
  direction: increase)                                        
    1340                                                      

  **Year**                **Target**       **Actual\          **Status**
                                           (or date           
                                           expected)**        

  2003                                     70                 Measure not in place

  2004                                     83                 Measure not in place

  2005                                     57                 Measure not in place

  2006                    90               87                 Made Progress From Prior
                                                              Year

  2007                    90               100                Target Exceeded

  2008                    90               (October 2008)     Pending

  2009                    80               (October 2009)     Pending

  2010                    85               (October 2010)     Pending
  ----------------------- ---------------- ------------------ ---------------------------

**Source**. Grant Administration and Payment System (GAPS).

**Frequency of Data Collection**. Annual

**Explanation**. In 2007, one hundred percent of the NIDRR grant awards
were issued within six months of the competition closing date.