This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via Google Scholar Google Scholar Articles by Basch, C. E. Articles by Kolbe, L. J. Search for Related Content PubMed Articles by Basch, C. E. Articles by Kolbe, L. J. Social Bookmarking                   What's this?

Avoiding Type III Errors in Health Education Program Evaluations: A Case Study

Department of Health Education, Teachers College, Columbia University, New York, New York 10027

Elena M. Sliepcevich, DPE

Department of Health Education and School of Medicine, Southern Illinois University, Carbondale, Illinois

Robert S. Gold, PhD, DrPH

School Health Initiative, Office of Disease Prevention and Health Promotion, Department of Health and Human Services. Washington, DC

David F. Duncan, DrPH

Department of Health Education, Southern Illinois University, Carbondale, Illinois

Lloyd J. Kolbe, PhD

Center for Health Promotion Research and Development, University of Texas Health Sciences Center, Houston. Texas

Monitoring the implementation of a program being evaluated can improve the interpretability of data collected and help evaluators to avoid committing a Type III error: evaluating a program that has not been adquately implemented. This article describes an evaluation that analyzed the implementation of a school health education curriculum, assessed cognitive learning outcomes attributable to the curriculum, and examined the relationship between classroom implementation and changes in students' knowledge. Five fifth-grade classes (n = 101) participated in the curriculum, and five classes (n = 84) served as a comparison group. Data collection procedures involved a pretest and posttest of all students' health-related knowledge, daily monitoring of classroom implementation by the five teachers participating, and questionnaires completed by principals and teachers. Analysis methods included descriptive statistics, parametric and non- parametric tests of significance, and qualitative assessment procedures. Results indicated that the curriculum had a positive effect on learning in students; curriculum implementation varied considerably among the five classes participating; teaching/learning activities that were most and least likely to be implemented could be identified and described; both teachers and principals perceived the program favorably: some health instruction was occurring in the comparison classes, so it was not appropriate to consider them as pure controls; and no statistically significant relationship between curriculum implementation and cognitive outcomes was observed. This study provides evidence of the need for and value of measuring implementation of programs being evaluated. Implications for developing implementation measures and the role of formative evaluation in health education practice are considered.

CiteULike    Connotea    Del.icio.us    Digg    Reddit    Technorati    What's this?