Slides for my AES Workshop: Application of Complexity Science to Evaluation are here. Topics I’ll cover are: Stability and instability in complex systems Talking to stakeholders about complex behavior Thinking in terms of the behavior of complex systems Pattern, predictability and how change happens as general themes. Methodologies we need to evaluate with respect to … Continue reading Workshop: Drawing from Complexity Science to do Evaluation.
Blog
Why does Evaluation need Complexity Science?
Why does Evaluation need Complexity Science? With implications for predictability, unpredictability, and methodology.
Six principles for applying complexity to the evaluation of transformation
Motivated by a survey I was asked to complete, I spent some time distilling my thoughts about how complexity can be applied to the evaluation of transformation. It came down to six principles. I have written a lot on this topic, so if anyone wants the gory details, just ask. Evaluators deal with complexity in … Continue reading Six principles for applying complexity to the evaluation of transformation
Complexity in Evaluation: My Latest Thinking on What Matters
Over the years I have written, lectured, and done workshops about how (and when) Evaluation should draw from Complexity Science. Over that time my beliefs have evolved with respect to what aspects of Complexity Science matter, and how evaluation methodologies can be applied to understand program activity and the consequences of program action. This post … Continue reading Complexity in Evaluation: My Latest Thinking on What Matters
Installment One of an Occasional Series: Applied Complexity – Tools for Understanding Programs and their Consequences
The primary objective of this series is to provide evaluators with the capability to apply constructs from Complexity Science to evaluation practice. This objective is bookended with two others. The first is to give evaluators a broad conceptual understanding of Complexity. The other is to provide an appreciation of how Complexity can influence how we conceptualize pattern, predictability, and the reasons for change. Our intention is to accomplish the primary goal within each case that is presented. The "bookended" goals will be achieved over time, as readers see the relevance of complexity in multiple cases.
Questions That Could Benefit from an Understanding of Complexity
In preparation for a workshop on complexity that I am giving at EES 2022, I am preparing a list of questions whose answers could benefit from an understanding of complex behavior. Below is the list. If anyone has additions, let me know. Why is diverse intellectual input desirable?What theories of change underlie statistical thinking?When does … Continue reading Questions That Could Benefit from an Understanding of Complexity
Complexity-Informed Evaluation – An Exploration in Understanding Pattern, Predictability, and How Change Happens.
Description I am presenting a professional development workshop at the upcoming meeting of the European Evaluation Association. The workshop description appears below. The content of this workshop will be a succession of lectures, group discussions, and breakout exercises to provide participants with the understanding needed to recognize how complex behavior might play a role in … Continue reading Complexity-Informed Evaluation – An Exploration in Understanding Pattern, Predictability, and How Change Happens.
Good Reasons Not to Use Data: The Problem of Tactics Outside of Culture
I’m arguing for a culture of data use that resonates with what we know about information use and decision making.
What Does Complexity Have to Say About the Learning Organization?
This is the text of a post I recently contributed to Evaltalk, the listserv of the American Evaluation Association. Organizational Learning as Adaptation I see organizational learning in terms of potential for adaptation in a changing environment. Environments can change rapidly or slowly, which makes for two different kinds of adaptive capacity. (I’m a big … Continue reading What Does Complexity Have to Say About the Learning Organization?
Two Complexity Constructs to Reorient the Logic of Planning and Evaluation
Recently I was asked to prepare a brief presentation for people in the prediction business – planners and evaluators whose work was preoccupied with some form of the question: If I do this, what will happen? The audience brought a traditional if > then logic to the way they answered this question. They knew that … Continue reading Two Complexity Constructs to Reorient the Logic of Planning and Evaluation
Evaluation Uncertainty 