Safe, Disciplined and Drug-Free Schools Programs 2001
Safe, Disciplined, and Drug-Free Schools Expert Panel
The following criteria and indicators were used to evaluate the Safe, Disciplined, and Drug-Free Schools programs submitted to the Expert Panel in 1999.
Evidence of Efficacy
Criterion 1 The program reports relevant evidence of efficacy/effectiveness based on a methodologically sound evaluation.
Condition a. The program evaluation indicates a measurable difference in outcomes that is based on statistical significance testing or a credible indicator of magnitude of effect. Relevant outcomes are factors related to making schools safe, disciplined, and drug-free: a reduction in substance use, violence, and other conduct problems and positive changes in scientifically established risk and protective factors for these problems.
Condition b. The program evaluation used a design and analysis that adequately controls for threats to internal validity, including attrition.
NOTE: Some evaluation designs do not meet the criteria for Exemplary or Promising status. Such designs include the following: 1) pre-post designs without comparison groups; 2) one-time, post-test only, comparison studies without randomization or other efforts to control threats to internal validity; and 3) case studies without comparisons.
Condition c. The program evaluation used reliable and valid outcome measures.
NOTE: Some evaluation measures do not meet the criteria for Exemplary or Promising status. Such measures of program effects include the following: 1) judgments based on clinical experience; and 2) authoritative evidence such as reports by expert committees and testimonials.
Condition d. The program evaluation used analyses appropriate to the data.
Quality of Program
Criterion 2 (Goals) The program's goals with respect to changing behavior and/or risk and protective factors are clear and appropriate for the intended population and setting.
Condition a. The program's goals are explicit and clearly stated.
Condition b. The program's goals are appropriate to the intended population and setting.
Criterion 3 (Rationale) The rationale underlying the program is clearly stated, and the program's content and processes are aligned with its goals.
Condition a. The rationale (e.g., logic model, theory) underlying the program is clearly stated and includes appropriate documentation (e.g., literature reviews and previous research).
Condition b. The program's content and processes are aligned with its goals.
Criterion 4 (Content Appropriateness) The program's content takes into consideration the characteristics of the intended population and setting (e.g., developmental stage, motivational status, language, disabilities, culture) and the needs implied by these characteristics.
NOTE: Content appropriateness will be determined on the basis of the application narrative and the program materials submitted.
Criterion 5 (Implementation Methods) The program implementation process effectively engages the intended population.
Condition a. The program provides a relevant rationale to participants for its implementation.
Condition b. The program actively engages the intended population.
Condition c. The program attends to participants' prior knowledge, attitudes, and commonly held conceptions.
Condition d. The program implementation methods promote participants' collaboration, discourse, and reflection.
Condition e. The methods foster the use and application of skills.
Condition f. The program promotes multiple approaches to learning.
Criterion 6 The application describes how the program is integrated into schools' educational missions.
Usefulness to Others
Criterion 7 (Replicability) The program provides necessary information and guidance for replication in other appropriate settings.
Condition a. The program clearly outlines the essential conditions required to replicate it with fidelity in other settings (e.g., strategies, resources, implementation plans, and materials).
Condition b. The program includes guidelines and materials for training and supporting those who are to replicate it.