My last blog post dealt with why evaluators should focus on complex behavior as opposed to complex systems. Bob Williams made a comment about how the post made a lot of sense, but that it conveyed the impression that evaluators do not have to worry about complexity theory. Evaluators do need to be concerned with … Continue reading What complexity theory do evaluators need to know?
Applying Complexity to Make Practical Decisions About Evaluation
Lately I have been speaking to as many audiences as I can about the need to focus on complex behavior rather than on complex systems. The reason is that there is no practical way to apply the notion of a “complex system” to practical decisions about program models, metrics, or methodology. But it is possible … Continue reading Applying Complexity to Make Practical Decisions About Evaluation
A Plan for Making Complexity Useful in Evaluation
Recently a friend of mine asked about my understanding of what role complexity can play in Evaluation, and how I would further that role. Below is an edited version of what I sent her. My goal for the role of complexity in Evaluation Complexity as discussed in evaluation circles contains a great deal of information … Continue reading A Plan for Making Complexity Useful in Evaluation
Case Study Example: Drawing on Complexity to do Hands-on Evaluation
In 2016 I developed a case for a workshop I did at the Canadian Evaluation Society on the use of complexity in evaluation. I was doing some archeology and unearthed it. It offers pretty rich opportunity to think about complex behavior in evaluation, so I decided to share it. Construction of the Case This is … Continue reading Case Study Example: Drawing on Complexity to do Hands-on Evaluation
Part 1 of a 3 Part Series on how to Make AEA, and Evaluation, Relevant in the Future: What is Diversity?
Common Introduction to all Three Parts I have been thinking about what will happen to AEA, and to evaluation, in the future. I can conjure scenarios where AEA and evaluation thrive, and I can imagine scenarios where they whither. What I cannot envision is a future in which AEA and evaluation, as we know them … Continue reading Part 1 of a 3 Part Series on how to Make AEA, and Evaluation, Relevant in the Future: What is Diversity?
Part 2 of a 3 Part Series on how to Make AEA, and Evaluation, Relevant in the Future: AEA as an Evolving Organism
Common Introduction to all Three Parts I have been thinking about what will happen to AEA, and to evaluation, in the future. I can conjure scenarios where AEA and evaluation thrive, and I can imagine scenarios where they whither. What I cannot envision is a future in which AEA and evaluation, as we know them … Continue reading Part 2 of a 3 Part Series on how to Make AEA, and Evaluation, Relevant in the Future: AEA as an Evolving Organism
Part 3 of a 3 Part Series on how to Make AEA, and Evaluation, Relevant in the Future: Evolution, Diversity and Change from the Middle
Common Introduction to all Three Parts I have been thinking about what will happen to AEA, and to evaluation, in the future. I can conjure scenarios where AEA and evaluation thrive, and I can imagine scenarios where they whither. What I cannot envision is a future in which AEA and evaluation, as we know them … Continue reading Part 3 of a 3 Part Series on how to Make AEA, and Evaluation, Relevant in the Future: Evolution, Diversity and Change from the Middle
Evaluation use by people opposed to the program
Recently I posted a message to Evaltalk about a story in the NY Times that dealt with the Administration’s plan to cut funding for teenage pregnancy prevention programs: Programs That Fight Teenage Pregnancy Are at Risk of Being Cut. (Evaltalk is an American Evaluation Association’s listserv.) That message led to an interesting back and forth, … Continue reading Evaluation use by people opposed to the program
Are Policy Makers, Program Designers and Managers Doing a Good Job if they Rely Too Much on Evaluation?
We like to complain about evaluation use. People in my business (me included) like to lament the lack of attention that people pay to evaluation. If only we did a better job if identifying stakeholders. If only we could do a better job of engaging them. If only we understood their needs better. If only … Continue reading Are Policy Makers, Program Designers and Managers Doing a Good Job if they Rely Too Much on Evaluation?
Some Musings on Evaluation Use in the Current Political Context
This blog is my effort to consolidate and organize some back and forth I have been having about evaluation use. It was spurred by a piece on NPR about the Administration’s position on an after school program. (Trump's Budget Proposal Threatens Funding For Major After-School Program.) In large measure the piece dealt with whether the … Continue reading Some Musings on Evaluation Use in the Current Political Context
Evaluation Uncertainty 