jamorell Practical Ways to use Complexity to do Evaluation, What do research and theory in complexity and systems tell us about evaluation practice and evaluation theory?, Workshop – Complex Behavior in Models, Methodology, and Metrics

Workshop: Drawing from Complexity Science to do Evaluation.

Slides for my AES Workshop: Application of Complexity Science to Evaluation are here. Topics I’ll cover are: Stability and instability in complex systems Talking to stakeholders about complex behavior Thinking in terms of the behavior of complex systems Pattern, predictability and how change happens as general themes. Methodologies we need to evaluate with respect to … Continue reading Workshop: Drawing from Complexity Science to do Evaluation.

jamorell Complex Systems, Programs, and Evaluation, Practical Ways to use Complexity to do Evaluation, Workshop – Complex Behavior in Models, Methodology, and Metrics

Complexity in Evaluation: My Latest Thinking on What Matters

Over the years I have written, lectured, and done workshops about how (and when) Evaluation should draw from Complexity Science. Over that time my beliefs have evolved with respect to what aspects of Complexity Science matter, and how evaluation methodologies can be applied to understand program activity and the consequences of program action. This post … Continue reading Complexity in Evaluation: My Latest Thinking on What Matters

jamorell Complex Systems, Programs, and Evaluation, Practical Ways to use Complexity to do Evaluation

Installment One of an Occasional Series: Applied Complexity – Tools for Understanding Programs and their Consequences

The primary objective of this series is to provide evaluators with the capability to apply constructs from Complexity Science to evaluation practice. This objective is bookended with two others. The first is to give evaluators a broad conceptual understanding of Complexity. The other is to provide an appreciation of how Complexity can influence how we conceptualize pattern, predictability, and the reasons for change. Our intention is to accomplish the primary goal within each case that is presented. The "bookended" goals will be achieved over time, as readers see the relevance of complexity in multiple cases.

jamorell Practical Ways to use Complexity to do Evaluation

Questions That Could Benefit from an Understanding of Complexity

In preparation for a workshop on complexity that I am giving at EES 2022, I am preparing a list of questions whose answers could benefit from an understanding of complex behavior. Below is the list. If anyone has additions, let me know. Why is diverse intellectual input desirable?What theories of change underlie statistical thinking?When does … Continue reading Questions That Could Benefit from an Understanding of Complexity

jamorell Practical Ways to use Complexity to do Evaluation

Complexity-Informed Evaluation – An Exploration in Understanding Pattern, Predictability, and How Change Happens.

Description I am presenting a professional development workshop at the upcoming meeting of the European Evaluation Association. The workshop description appears below. The content of this workshop will be a succession of lectures, group discussions, and breakout exercises to provide participants with the understanding needed to recognize how complex behavior might play a role in … Continue reading Complexity-Informed Evaluation – An Exploration in Understanding Pattern, Predictability, and How Change Happens.

jamorell Complex Systems, Programs, and Evaluation, Logic Models and Program Theory, Practical Ways to use Complexity to do Evaluation, Program Theory and Program Logic

Two Complexity Constructs to Reorient the Logic of Planning and Evaluation

Recently I was asked to prepare a brief presentation for people in the prediction business – planners and evaluators whose work was preoccupied with some form of the question: If I do this, what will happen? The audience brought a traditional if > then logic to the way they answered this question. They knew that … Continue reading Two Complexity Constructs to Reorient the Logic of Planning and Evaluation

jamorell Complex Systems, Programs, and Evaluation, Practical Ways to use Complexity to do Evaluation, Program Theory and Program Logic, Uncategorized

A Complexity-based Plan for Evaluating Transformation

Jonathan A. Morelljamorell@jamorell.com This is the abstract of a paper I have in draft form. I'm looking for critique on any or all parts of it. If you are interested please send me email and I'll send you a copy. Thanks in advance to all. Abstract This article presents a case for more rigorous application … Continue reading A Complexity-based Plan for Evaluating Transformation

jamorell Complex Systems, Programs, and Evaluation, Practical Ways to use Complexity to do Evaluation, Uncategorized

Why do Evaluators Need to Understand Complexity?

This is the title of a blog post I wrote for the International Evaluation Academy. The blog opens with: Evaluators need to know more about complexity because the programs they evaluate often exhibit complex behaviors. Without understanding complexity, evaluators cannot construct models, develop methodologies, and interpret data in ways that accurately describe what programs are … Continue reading Why do Evaluators Need to Understand Complexity?

jamorell Complex Systems, Programs, and Evaluation, Practical Ways to use Complexity to do Evaluation

A Complex System View of Technology Acquisition Choice

I am involved in a project that involves helping people make a single choice among multiple technologies. They must commit to one, so there is no waffling. This is one more of many such exercises that I have been involved in over the course of my career, and I have never been fully satisfied with any of them. On an intuitive level, everyone knows they cannot make the best choice, but everyone thinks that they should be able to. I finally figured out why they cannot. I don’t mean that people are not smart enough. I mean that it is impossible. The behavior of complex systems makes it impossible.