From Plan to Product: A Case Study of Evaluation Implementation Fidelity in a large-scale NIH Evaluation

Understanding the intersection of evaluation theory, practice, and policy and conducting meta-evaluations are essential for the field of evaluation. This study presents findings from a case study: a metaevaluation of the 10-year evaluation of a large-scale NIH initiative. Through interviews and focus groups, the metaevaluation examines the plan for the evaluation, its implementation, and the alignment between the plan and practice. This approach to meta-evaluation demonstrates how evaluation plans adapt throughout their implementation to fit the evolving program needs and adjust their outputs and outcomes accordingly. This adaptation is primarily due to the complex dynamics of a large evaluation center. These dynamics most notably stem from differences in understanding of research and evaluation, academic training, and institutional contexts. Finally, this session discusses how understanding the lessons from this specific metaevaluation can both improve future evaluations and deepen our understanding of the evaluation theory-practice-policy nexus.