------------------- ------------------------------------------------------------------
  **RA: National      
  Institute on        
  Disability and      
  Rehabilitation      
  Research**          

  **FY 2008 Program   
  Performance Plan**  

  Strategic Goal 1    

  Multiple            

  RA, Title II, 29    
  U.S.C. 762-764      

  CFDA                84.133: National Institute on Disability and Rehabilitation
                      Research
  ------------------- ------------------------------------------------------------------

  -------------- --------------------------------------------------------
  **Program      **To conduct high-quality research and related
  Goal:**        activities that lead to high-quality products.**

  -------------- --------------------------------------------------------

  -----------------------------------------------------------------------

  -----------------------------------------------------------------------

  ------------------------- --------------------------------------------------------
  ***Objective 1 of 4:***   *Advance knowledge through capacity building: Increase
                            capacity to conduct and use high-quality and relevant
                            disability and rehabilitation research and related
                            activities designed to guide decisionmaking, change
                            practice, and improve the lives of individuals with
                            disabilities.*

  ------------------------- --------------------------------------------------------

  ----------------------- ---------------- ------------------- --------------------------
  **Measure 1.1 of 2:**                                        
  The percentage of                                            
  National Institute on                                        
  Disability and                                               
  Rehabilitation Research                                      
  (NIDRR) grantees that                                        
  are conducting at least                                      
  one multi-site,                                              
  collaborative                                                
  controlled trial.                                            
    (Desired direction:                                        
  increase)   1751                                             

  **Year**                **Target**       **Actual\           **Status**
                                           (or date            
                                           expected)**         

  2006                    Set a Baseline   5                   Target Met

  2007                    BL+2PP           Not Collected       Not Collected

  2008                    Maintain a       (December 2008)     Pending
                          Baseline                             

  2009                    BL+1PP           (December 2009)     Pending

  2013                    BL+2PP           Undefined           Pending
  ----------------------- ---------------- ------------------- --------------------------

**Source**. Annual Performance Report (APR)

**Frequency of Data Collection**. Other

**Data Quality**. NIDRR intends to use data from the FY 2006 Annual
Performance Report (APR) to establish a baseline for this measure. 
NIDRR staff are working to improve the operational definitions for this
survey question.  Data from FY 2007 are not usable because they came
from a revised survey question that proved unworkable.

**Target Context**. NIDRR intends to collect two years of baseline data
before establishing numeric targets for this measure.

**Explanation**. In 2006, 5 percent of 265 NIDRR Model Systems grantees
conducted at least one multi-site collaborative controlled trial.  This
measure only includes NIDRR research grantees funded under NIDRR's Model
Systems mechanism (e.g. Traumatic Brain Injury (TBI), Spinal Cord Injury
(SCI), or Burn Model Systems (MS)) only.  The data are limited to this
funding mechanism because, at the current time, only this mechanism is
conducting multi-site collaborative controlled trials.

  ----------------------- ---------------- ------------------- --------------------------
  **Measure 1.2 of 2:**                                        
  The percentage of                                            
  National Institute on                                        
  Disability and                                               
  Rehabilitation Research                                      
  (NIDRR)-supported                                            
  fellows, post-doctoral                                       
  trainees, and doctoral                                       
  students who publish                                         
  results of                                                   
  NIDRR-sponsored                                              
  research in refereed                                         
  journals.   (Desired                                         
  direction: increase)                                         
    1752                                                       

  **Year**                **Target**       **Actual\           **Status**
                                           (or date            
                                           expected)**         

  2005                    Set a Baseline   Not Collected       Not Collected

  2006                    BL+1%            8.8                 Target Exceeded

  2007                    BL+5%            (December 2008)     Pending

  2008                    BL+5%            (December 2009)     Pending

  2009                    BL+5             (December 2010)     Pending

  2013                    BL+10%           Undefined           Pending
  ----------------------- ---------------- ------------------- --------------------------

**Source**. Annual Performance Report (APR).

**Frequency of Data Collection**. Annual

**Data Quality**. For this measure, \"refereed journals\" only included
only those journals that are recognized by Thompson Scientific Institute
for Scientific Information journal selection process.  For more
information on this process, see
http://scientific.thomson.com/free/essays/selectionofmaterial/journalselection/. 
For a master list of journals meeting the refereed journal criteria, see
http://www.thomsonscientific.com/cgi-bin/jrnlst/jloptions.cgi?PC=master

**Target Context**. NIDRR intends to collect two years of baseline data
before establishing numeric targets for this measure.

**Explanation**. In 2006, there were a total of 498 currently supported
NIDRR fellows, post-doc trainees and doctoral students. NIDRR-supported
fellows, post-doctoral trainees, and doctoral students produced 44
publications that appeared in refereed journals. Therefore,
approximately 8.8 percent of those researcher funded by NIDRR produced
publications that appeared in refereed journals.\
\
This statistic requires some qualification because of the lag time it
takes to have publications appear. Some of the publications produced by
the 2006 students will not appear until 2007. Similarly, some of the
publications counted in 2006 are from 2005 students who are no longer
supported. These facts associated with publishing in refereed journals
only allow for the calculation of a rough estimate using currently
funded students in the denominator. Therefore, using available data, we
derive the following rough estimate.\
\
The following funding mechanisms support researchers who publish and who
were counted in these measure: Rehabilitation Research and Training
Centers (RRTC), Rehabilitation Engineering Research Center (RERC),
Advanced Rehabilitation Research Training Grant (ARRT), Model Systems
(MS), Disability Rehabilitation Research Project, (DRRP) and Field
Initiated Projects (FIP) grants. These data do not include those funded
by Small Business Innovative Research (SBIR).

  -----------------------------------------------------------------------

  -----------------------------------------------------------------------

  ------------------------- --------------------------------------------------------
  ***Objective 2 of 4:***   *Advance knowledge through research and related
                            activities: Generate scientific-based knowledge,
                            technologies, and applications to inform policy, change
                            practice, and improve outcomes.*

  ------------------------- --------------------------------------------------------

  ----------------------- ----------------- ------------------- -------------------------
  **Measure 2.1 of 3:**                                         
  The number of                                                 
  accomplishments (new or                                       
  improved tools,                                               
  methods, discoveries,                                         
  standards,                                                    
  interventions,                                                
  programs, or devices)                                         
  developed and/or tested                                       
  with National Institute                                       
  on Disability and                                             
  Rehabilitation Research                                       
  (NIDRR) funding that                                          
  have been judged by                                           
  expert panels to be of                                        
  high quality and to                                           
  advance the field.                                            
    (Desired direction:                                         
  increase)   1899                                              

  **Year**                **Target**        **Actual\           **Status**
                                            (or date            
                                            expected)**         

  2006                    Set a Baseline    Not Collected       Not Collected

  2007                    Set a Baseline    49                  Target Met

  2008                    Maintain a        (December 2008)     Pending
                          Baseline                              

  2009                    Maintain a        (December 2009)     Pending
                          Baseline                              

  2013                    BL+10%            Undefined           Pending
  ----------------------- ----------------- ------------------- -------------------------

**Source**. Annual Performance Assessment Expert Review (APAER) phase I
ratings.

**Frequency of Data Collection**. Annual

**Data Quality**. NIDRR has improved the reliability of the FY 2007
APAER data by having accomplishments reviewed by 12 reviewers. \
\
In FY 2005 and 2006, accomplishments were rated by only one reviewer,
reducing data reliable and comparability.

**Target Context**. NIDRR intends to complete current efforts to revise
the APAER peer review mechanism before establishing numeric targets for
this measure.

**Explanation**. In 2007, 49 of 84 (or 58 percent) rated accomplishments
were judged by expert panel members to be both of high quality and to
make a substantial contribution to the field.  NIDRR employs an annual
expert panel review to rate NIDRR accomplishments.  Reviewers who are
experts in disabilities research are asked to rate the accomplishments
reported by grantees in NIDRR's Annual Performance Report.  NIDRR is
currently working to improve the APAER peer review mechanism, and
proposed changes to this data collection tool may result in outyear data
that are not comparable.

  ----------------------- ---------------- ------------------ --------------------------
  **Measure 2.2 of 3:**                                       
  The percentage of                                           
  National Institute on                                       
  Disability and                                              
  Rehabilitation Research                                     
  (NIDRR)-funded grant                                        
  applications that                                           
  receive an average peer                                     
  review score of 85 or                                       
  higher.   (Desired                                          
  direction: increase)                                        
    1332                                                      

  **Year**                **Target**       **Actual\          **Status**
                                           (or date           
                                           expected)**        

  2002                                     82                 Measure not in place

  2003                                     96                 Measure not in place

  2004                                     89                 Measure not in place

  2005                    Set a Baseline   99                 Target Met

  2006                    85               99                 Target Exceeded

  2007                    90               96                 Target Exceeded

  2008                    99               (August 2008)      Pending

  2009                    Maintain a       (August 2009)      Pending
                          Baseline                            
  ----------------------- ---------------- ------------------ --------------------------

**Source**. Grant Manager Pre-funding Survey, reviews and tabulations
completed by NIDRR grants managers for all potentially fundable
applications.

**Frequency of Data Collection**. Annual

**Explanation**. In FY 2006, 99 percent of the eighty new awards
received ratings of 85 or higher.  In 2007, 96 percent of the
seventy-one new awards received ratings of 85 or higher.

  ----------------------- ----------------- ------------------ --------------------------
  **Measure 2.3 of 3:**                                        
  The percentage of new                                        
  National Institute on                                        
  Disability and                                               
  Rehabilitation Research                                      
  grants that assess the                                       
  effectiveness of                                             
  interventions,                                               
  programs, and devices                                        
  using rigorous methods.                                      
    (Desired direction:                                        
  increase)   1334                                             

  **Year**                **Target**        **Actual\          **Status**
                                            (or date           
                                            expected)**        

  2002                                      65                 Measure not in place

  2003                                      59                 Measure not in place

  2004                                      59                 Measure not in place

  2005                    Set a Baseline    49                 Target Met

  2006                    65                Not Collected      Not Collected

  2007                    65                35                 Made Progress From Prior
                                                               Year

  2008                    Maintain a        (August 2008)      Pending
                          Baseline                             

  2009                    BL+2.5PP          (August 2009)      Pending
  ----------------------- ----------------- ------------------ --------------------------

**Source**. Grant Manager Pre-funding Survey, reviews and tabulations
completed by NIDRR grants managers.

**Frequency of Data Collection**. Annual

**Data Quality**. NIDRR grant managers review grant applications to
identify the research methodologies used.   Possible methodologies that
may be assigned on the basis of this review include: 1) true
experimental; 2) quasi-experimental; or 3) single subject.  If the grant
manager assigns value 1,2 or 3 as being the methodology proposed by the
study, these data are included in this measure as representative of
grantees that use more rigorous research methodologies.

**Explanation**. In 2007, NIDRR grant managers, found that 35 percent of
new awards used true experimental, quasi-experimental or single subject
designs.

  -----------------------------------------------------------------------

  -----------------------------------------------------------------------

  ------------------------- --------------------------------------------------------
  ***Objective 3 of 4:***   *Advance knowledge through translation and
                            dissemination: Promote the effective use of
                            scientific-based knowledge, technologies, and
                            applications to inform policy, improve practice, and
                            enhance the lives of individuals with disabilities.*

  ------------------------- --------------------------------------------------------

  ----------------------- ----------------- ------------------- -------------------------
  **Measure 3.1 of 2:**                                         
  The number of new or                                          
  improved National                                             
  Institute on Disability                                       
  and Rehabilitation                                            
  Research (NIDRR-funded                                        
  assistive and                                                 
  universally designed                                          
  technologies, products,                                       
  and devices transferred                                       
  to industry for                                               
  potential                                                     
  commercialization.                                            
    (Desired direction:                                         
  increase)   1755                                              

  **Year**                **Target**        **Actual\           **Status**
                                            (or date            
                                            expected)**         

  2007                    Set a Baseline    26                  Target Met

  2008                    BL+1              (December 2008)     Pending

  2009                    BL+2              (December 2009)     Pending
  ----------------------- ----------------- ------------------- -------------------------

**Source**. Annual Performance Report (APR).

**Frequency of Data Collection**. Annual

**Data Quality**. NIDRR intends to use FY 2007 data to establish a
baseline.  The FY 2007 APR asked grantees implementing development
projects to identify: "What stage of the development process are you in
during this reporting period? Those selecting choice "(f)
commercialization" are included in this measure. 

**Target Context**. NIDRR intends to collect two years of baseline data
before establishing numeric targets for this measure.

**Explanation**. Development projects funded by NIDRR through three
funding streams are included in this measure.  These include Small
Business Innovative Research Phase II (SBIRs), Rehabilitation
Engineering and Research Centers (RERCs), and Field Initiated Programs
(FIPs).

  ----------------------- ---------------- ------------------ --------------------------
  **Measure 3.2 of 2:**                                       
  The average number of                                       
  publications per award                                      
  based on National                                           
  Institute on Disability                                     
  and Rehabilitation                                          
  Research (NIDRR)-funded                                     
  research and                                                
  development activities                                      
  in refereed journals.                                       
    (Desired direction:                                       
  increase)   1333                                            

  **Year**                **Target**       **Actual\          **Status**
                                           (or date           
                                           expected)**        

  2002                                     2.91               Measure not in place

  2003                    8                3.38               Made Progress From Prior
                                                              Year

  2004                    5                2.71               Did Not Meet Target

  2005                    5                3.81               Made Progress From Prior
                                                              Year

  2006                    2                2.71               Target Exceeded

  2007                    BL+1             (August 2008)      Pending

  2008                    BL+3PP           (August 2009)      Pending

  2009                    BL+5PP           (August 2010)      Pending
  ----------------------- ---------------- ------------------ --------------------------

**Source**. Annual Performance Report (APR).

**Frequency of Data Collection**. Annual

**Data Quality**. Refereed journals included only those recognized by
Thompson Scientific Institute for Scientific Information journal
selection process.

**Explanation**. 

  -----------------------------------------------------------------------

  -----------------------------------------------------------------------

  ------------------------- --------------------------------------------------------
  ***Objective 4 of 4:***   *Enhance efficiency of NIDRR grant award process.*

  ------------------------- --------------------------------------------------------

  ----------------------- ---------------- ------------------ ---------------------------
  **Measure 4.1 of 2:**                                       
  The percentage of                                           
  National Institute on                                       
  Disability and                                              
  Rehabilitation Research                                     
  (NIDRR) competitions                                        
  announced by October 1.                                     
    (Desired direction:                                       
  increase)   1339                                            

  **Year**                **Target**       **Actual\          **Status**
                                           (or date           
                                           expected)**        

  2003                                     21                 Measure not in place

  2004                                     23                 Measure not in place

  2005                                     8                  Measure not in place

  2006                    25               11                 Made Progress From Prior
                                                              Year

  2007                    50               69                 Target Exceeded

  2008                    90               (October 2008)     Pending

  2009                    90               (October 2009)     Pending
  ----------------------- ---------------- ------------------ ---------------------------

**Source**. Grants Administration and Payment System (GAPS).

**Frequency of Data Collection**. Annual

**Explanation**. In 2007, sixth-nine (69) percent of new competitions
were announced by October 1. This is updated data from GAPS.

  ----------------------- ---------------- ------------------ ---------------------------
  **Measure 4.2 of 2:**                                       
  The percentage of                                           
  National Institute on                                       
  Disability and                                              
  Rehabilitation Research                                     
  (NIDRR) grant awards                                        
  issued within six                                           
  months of the                                               
  competition closing                                         
  date.   (Desired                                            
  direction: increase)                                        
    1340                                                      

  **Year**                **Target**       **Actual\          **Status**
                                           (or date           
                                           expected)**        

  2003                                     70                 Measure not in place

  2004                                     83                 Measure not in place

  2005                                     57                 Measure not in place

  2006                    90               87                 Made Progress From Prior
                                                              Year

  2007                    90               100                Target Exceeded

  2008                    90               (October 2008)     Pending

  2009                    90               (October 2009)     Pending
  ----------------------- ---------------- ------------------ ---------------------------

**Source**. Grant Administration and Payment System (GAPS).

**Frequency of Data Collection**. Annual

**Explanation**. In 2007, one hundred percent of the NIDRR grant awards
were issued within six months of the competition closing date.