183: Evidencing Causal Pathways: Understanding how, why, and under what conditions virtual and hybrid models accelerate learning outcomes using a theory-based approach

Theory-based evaluation approaches are gaining traction as important methods for answering causal questions around how, why and under what conditions interventions, programs, and practices (collectively “strategies”) have contributed to change. These methodologies are particularly valuable when evaluating systems change initiatives where cause-effect relationships are unpredictable and when change can only be understood retrospectively. This session will present the application of a theory-based approach to explore causal pathways within virtual and hybrid K-12 learning models as part of a larger two-year research project. We will first describe how we generated causal pathways in a participatory manner with school leaders from four virtual and hybrid school systems. We will then present the iterative approach to data collection and analysis used to test and refine these causal pathways using a realist evaluation. It is hoped by sharing these lessons other evaluators may adopt similar approaches to their systems change evaluation efforts.

Dana Harrison; Beth Holland; Drew Koleros; Rae Lymer; Debbie Reed; Megan Shoji