CREME (Center for Results, Effects, Measurement, and Evaluation) invites you to a talk by visiting professor Gary T. Henry:
Should we measure implementation?
An example of an approach to measuring implementation fidelity and quality
October 12 from 3:30 p.m to 5:15 p.m.
in room 4.2.26 “frokoststuen”, CSS, Øster Farimagsgade 5, Kbh K.
Gary T. Henry, presenter: Patricia and Rodes Hart Chair, Professor of Public Policy and Education, Department of Leadership, Policy, and Organization, Peabody College, Vanderbilt University. Visiting Professor, Copenhagen University, Department of Political Science and Center for Results, Effects, Measurement, and Evaluation (CREME), Denmark.
The rationale for measuring implementation is compelling – without knowing if a program is implemented with fidelity, lower than anticipated outcomes may be attributed to a flawed program design rather than failure to implement the program. Fidelity of implementation is defined as providing the services as set out by the program developers, usually in the program’s theory of action, including the expected amount and type of services. In addition, without knowing if the comparison (control) sites receive similar services, the evaluators cannot determine if the service delivered in the sites where the program is implemented and the comparison sites are as different as anticipated. But measuring implementation consumes significant evaluation resources and must carefully conform to the program theory of action and ensure that the program providers are responsible for carrying out the actions that are being measured.
In a recent large-scale evaluation of school reform in the U.S., the evaluation team developed and carried out an approach for measuring implementation fidelity for a complex reform. The evaluators also provided information on fidelity to the program staff at three points, six months, one year and eighteen months after the reform began. Professor Henry will share the principles for measuring implementation fidelity and quality, the measurement techniques carried out, the findings, and the influence of the findings on subsequent actions of the program staff. The participants are encouraged to discuss their views and insights about measuring implementation in evaluations.
After the meeting, CREME offers a soft drink or a glass of wine. Therefore, please sign up by contacting Nathalie Olsen at firstname.lastname@example.org.