U.S. Department of Education: Promoting Educational Excellence for all Americans

A r c h i v e d  I n f o r m a t i o n

National Institute on Disability and Rehabilitation Research (NIDRR)

Goal 8: To conduct high-quality research that leads to high quality research products.
Objective 1 of 4: To support the conduct and dissemination of high-quality research that contributes to improvement in the quality of life of persons with disabilities.
Indicator 8.1.1 of 2: Scientific excellence: Grantee research quality is good or excellent, as reflected in research design and its usefulness to customers.
Targets and Performance Data Assessment of Progress Sources and Data Quality
Percentage of grantees sampled who had good or excellent ratings
Year Actual Performance Performance Targets
1997
37
 
1998
55
 
1999
53
60
2000
 
65
2001
76
70
Status: Target exceeded. 17 Traumatic Brain Injury 3.93 (OS) 3.99 (GRCP) 82% of all centers in this category received a good or excellent rating above (3.75) 5 Burn Model Systems 3.52 (OS) 3.70 (GRCP) 60% of all centers in this category received a good or excellent rating above (3.75) 7 Research Rehabilitation Training Centers 3.64 (OS) 3.69 (GRCP) 72% of all centers in this category received a good or excellent rating above (3.75).

Explanation: This year's data are based on 29 summative reviews. This is the largest summative review ever conducted by NIDRR in a single year. The average scores presented are based on the Overall Score (OS) on all domains of the CoE, and the Global rating for the Center Program CoE (GRCP) These scores are shown above for each of the summatives reviewed.  
Additional Source Information: NIDRR Program Review; Center of Excellence Scale.

Frequency: Annually.
Collection Period: 2002.
Data Available: October 2002.
Validated By: On-Site Monitoring By ED.

Limitations: The Summative and Formative review process is a very labor intensive and costly process. We are experimenting with electronic formats to streamline the process and facilitate implementation of recommendations.

 
Indicator 8.1.2 of 2: Increased publication and citation: Publication of research findings, with the appropriate citation, will increase in refereed journals.
Targets and Performance Data Assessment of Progress Sources and Data Quality
Average number of publications per grantee (55 grantees total)
Year Actual Performance Performance Targets
1997
7.10
 
2000
 
10
2001
20
15
Status: Target exceeded. Average number of Publications per grantee is: ARRT: 21 MS: 18.9 DRRP: 23 RERC: 15.3 RRTC: 22.2.

Explanation: Our standard for this measure has improved significantly as it is now based on peer reviewed publications only. Also the data are being collected by type of program, allowing for type of program comparisons. This indicator information comes from grantees data on Outcomes and Publications in NIDRRs web-based Performance Reporting System. 61% of all NIDRR centers (111 centers) reported having their work published in peer reviewed or referred journals.  
Additional Source Information: NIDRR Reporting System; Annual Performance Management Report; Outcomes and Publications sections of the following grantee types Performance Reports: ARRT, DRRP, FIP, MS, RERC, and RRTC.

Frequency: Annually.
Collection Period: 2002.
Data Available: October 2002.
Validated By: On-Site Monitoring By ED.
Verified by Dept. of Ed. attestation process and ED Standards for Evaluation Program Performance Data.

Limitations: The newly developed web-based Performance Reporting System has only been available to grantees since June 2001. Grantees self-report the information on their peer reviewed publications. NIDRRs DU and DBTAC programs do not report on this data.

 

Objective 2 of 4: DISSEMINATE AND PROMOTE USE OF INFORMATION ON RESEARCH FINDINGS, IN ACCESSIBLE FORMATS, TO IMPROVE REHABILITATION SERVICES AND OUTCOMES.
Indicator 8.2.1 of 1: Information and TA usefulness: Recipients will find the products, information, and technical assistance that they receive from grantees useful.
Targets and Performance Data Assessment of Progress Sources and Data Quality
Percentage of recipients responding "yes," "no," and "N/A" to the question on being served adequately
Year Actual Performance Performance Targets
 
Yes No N/A
Yes No N/A
1998
80 15 5
     
2000
95 2
83.50    
2001
85 3 2
86    
2002
  2 5
88.50    
Status: Positive movement toward target.

Explanation: Current information on this indicator is based on Disability and Business Technical Assistance Centers (DBTACs) reporting system ADA Impact Management System (AIMS, data for Year '01) and the National Center for the Dissemination Disability Research Customer Satisfaction Survey ( Recent quarterly data only). The AIMS and the NCDDR use a Likert Scale.  
Additional Source Information: AIMS and NCDOR Surveys; Customer Satisfaction Survey.

Frequency: Semi-Annually.
Validated By: On-Site Monitoring By ED.

Limitations: Sample size is limited.

 

Objective 3 of 4: EXPAND SYSTEM CAPACITY FOR CONDUCT OF HIGH-QUALITY REHABILITATION RESEARCH AND SERVICES BY ENSURING AVAILABILITY OF QUALIFIED RESEARCHERS AND PRACTITIONERS, INCLUDING PERSONS WITH DISABILITIES AND OTHER UNDERSERVED GROUPS.
Indicator 8.3.1 of 2: Contributions of trainees and fellows: Contributions by NIDRR trainees and fellows that apply to study rehabilitation will increase.
Targets and Performance Data Assessment of Progress Sources and Data Quality
Out of 18 individuals surveyed:
Year Actual Performance Performance Targets
 
Published Presentations
Published Presentations
1998
6.70 18.20
   
2001
19.70 16.30
22 14
Status: Target not met.

Explanation: Our Capacity Building data reported in this period come from the ARRT (ARRT). Fellows Program and from the RERC and RRTC Performance Report Sections on Educational Programs. Other NIDRR programs are not required to report these data. Of the 86 centers in the above NIDRR program catergories who reported on fellows and educational programs, 47 (55%) had data on publications and presentations. Centers reported 90 fellows as follows: ARRT 8; RRTC 40, and RERC 42.  
Additional Source Information: AART, RERC, RRTC, NIDRR Web Repository System; Annual Performance Management Report.

Frequency: Annually.
Collection Period: 2002.
Data Available: October 2002.
Validated By: On-Site Monitoring By ED.
Verified by Dept of Ed. attestation process and ED Standards for Evaluation Program Performance Data.

Limitations: The sample size is too small. The newly developed web-based Performance Reporting System has only been available to grantees since June 2001. As more centers start using the NIDRR Performance Report System we will be able to draw more information on this indicator.

 
Indicator 8.3.2 of 2: Researchers with disabilities and from underserved groups: Participation of researchers working in the field who have disabilities or are from underserved groups will increase.
Targets and Performance Data Assessment of Progress Sources and Data Quality
Percentage of people with disabilities and members of minority populations who are paid employees.
Year Actual Performance Performance Targets
 
Disabled Minority
Disabled Minority
2002
13 16
   
Status: Unable to judge.

Explanation: The information collected is based on the grantees reports on Staffing by staffing position and category. Some persons worked less than full time on the grant. The data refer only to paid grantee staff. The total number of centers reporting during this period was 114 (58%) out of 194 centers who entered their staffing information using the new web system.  
Additional Source Information: NIDRR Web Reporting System; Annual Performance Report; NIDRR Performance Reporting System sections on Staffing from the following programs only D&U, DRRP, FIP, MS, RERC, RRTC.

Frequency: Annually.
Validated By: NCES/Federal Statistical Agencies.

Limitations: Disability and minority data reported on the Staffing section of the NIDRR web-based Performance Reporting System are based on voluntary disclosure information.

 

Objective 4 of 4: ENSURE PRODUCTIVITY AND MANAGEMENT EFFECTIVENESS.
Indicator 8.4.1 of 1: Usefulness of NIDRR products: The percentage of customers reporting that NIDRR products and information are useful will increase.
Targets and Performance Data Assessment of Progress Sources and Data Quality
- No Targets And Performance Data -
Status: Unable to judge.

Explanation: Data gathering activities have not started. In order to focus on measurement of quality research for this indicator we will rewrite this indicator to reflect our efforts toward using the Knowledge Dissemination Utilization Model of Excellence that is undergoing development.  
Additional Source Information: Other.

Frequency: Annually.
Collection Period: 2002.
Data Available: October 2002.
Validated By: On-Site Monitoring By ED.

Limitations: Planning for creating a web based placeholder for customer input on NIDRR will be initiated. The NIDRR web site, NCDDR and NARIC sites will also be used for collecting customer satisfaction information.

 

Return to table of contents