Evaluation Influence During Program Design and Funding: An Ecosystem / Environment Perspective

Lately I have been thinking about the Evaluators’ Eternal Problem, namely, how to influence decisions that are baked in during the funding and planning stages of programming. Woe unto us, we evaluators have precious little influence over what happens when those decisions get made. In this post I present an ecosystem/environment approach for addressing our EEP.

The Logic in Logic Models Part 2:

This is the second of two blog posts on the logic in logic models. (More will come in the future.)I discuss three levels of model specificity. The first is the siloed model that is specific only at a high level of abstraction (e.g., outputs --> outcomes). This model form lists, but does not specify relationships among elements within each high-level category. The second form is the “box and arrow” layout that is so common in evaluation. The third adds to the “box and arrow” form with additional information on relationships, e.g., designations of how strong or likely relationships are likely to be.

The Logic in Logic Models Part 1: Extending Models in the Directions of Less, and More Specificity

I’m working on a series about the logic that can/should be contained in logic models. This is the first in the series . It’s message is that the range of knowledge that can be reflected in a model can be extended in two ways. One is toward less specificity and detail. One is toward more specificity by designating connections in AND/OR terms. Either tactic can be appropriate, depending on the circumstances.

Two Complexity Constructs to Reorient the Logic of Planning and Evaluation

Recently I was asked to prepare a brief presentation for people in the prediction business – planners and evaluators whose work was preoccupied with some form of the question: If I do this, what will happen? The audience brought a traditional if > then logic to the way they answered this question. They knew that … Continue reading Two Complexity Constructs to Reorient the Logic of Planning and Evaluation

Project Schedules, Program Models and Complexity: Linking Across Three Domains

PDF version: Schedules_logic_models_complexity_Morell_2_18_22 In 2018 I published an article making the case for using project schedules (in the form of PERT and Gantt charts) as logic models (Morell, 2018).[2] I offered two reasons for doing so. Using a project schedule as a logic model can reveal unique insight. Because planners and managers pay more attention … Continue reading Project Schedules, Program Models and Complexity: Linking Across Three Domains

How Much Diverse Intellectual Input Should Be Included When Planning an Evaluation? (Revised)

How Much Diverse Intellectual Input Should Be Included When Planning an Evaluation? I addressed this question some time ago in my book on unintended consequences. It’s time to revisit the question. What is the Optimal Amount of Diverse Opinion? My interest in this question stems from an article I recently read in Foreign Affairs about … Continue reading How Much Diverse Intellectual Input Should Be Included When Planning an Evaluation? (Revised)

A Complexity-based Plan for Evaluating Transformation

Jonathan A. Morelljamorell@jamorell.com This is the abstract of a paper I have in draft form. I'm looking for critique on any or all parts of it. If you are interested please send me email and I'll send you a copy. Thanks in advance to all. Abstract This article presents a case for more rigorous application … Continue reading A Complexity-based Plan for Evaluating Transformation

What Does the Graphic Header say About Evaluation?

The graphic superimposes a chessboard on a random walk. It symbolizes a core challenge in evaluation. The Chessboard Program outcomes are predictable in the commonsense definition of predictability.“If I provide service X, outcome A will occur.” That statement is a model: X-->A, and it is the foundation of almost every evaluation model I have seen. … Continue reading What Does the Graphic Header say About Evaluation?