Evaluation: What’s the Use?

Michael Quinn Patton’s publication, Utilization-Focused Evaluation, catalyzed a discussion on evaluation use that has continued for over 30 years. The first step in operationalizing this discussion is to glean the priorities of the client and evaluands in the design process. Fully understanding and eliciting their priorities can be done in a creative, respectful, and fun way that is rewarding for all involved- and that’s exactly what we set out to do for the John D. and Catherine T. MacArthur Foundation.

EnCompass LLC was commissioned by the MacArthur Foundation to collect baseline data for a portfolio of seven grants focused on improving maternal health accountability in Nigeria. To establish the foundation for a useful evaluation, the EnCompass evaluation team spent 2 days in Abuja with 14 grantees and 2 Foundation staff. We facilitated a process for participants to construct a portfolio theory of change, develop evaluation questions, create sampling criteria, and advise on methodology. The meeting was a tremendous success.

From the moment participants entered the conference hall, the room was full of color. Tables were scattered around the room covered with multi-colored, scented markers, pipe cleaners, and various colored index cards and sticky notes. Within the first few minutes participants realized that this was not going to be a typical meeting.

EnCompass used brainwritingappreciative visioning, and small group activities to ensure all voices were heard and all participants were engaged from start to finish. There was no “front of the room,” and EnCompass facilitated rather than led discussions; we spent most of our time “in the back,” listening. This fun, relaxing, comfortable, and equitable atmosphere empowered participants to take leadership of the evaluation design process.

As a result, the EnCompass team came away with all the critical information required to design a useful evaluation, and participants left excited and prepared for the evaluation. We knew we had done our job well, when, at the end of the meeting, one participant said:

“I used to feel frustrated with evaluation. The last time we went through an evaluation we felt that the evaluator really didn’t understand our program or our goals.  But I have loved providing input during this meeting! I see evaluation differently now!

Learn more about the project, and our participatory evaluation process, here

Jonathan Jones

Director, MEL

Jonathan Jones is EnCompass' Director of MEL. He has led many complex evaluations and has twelve years of direct fieldwork experience in over 20 developing countries. He is a thematic expert in monitoring and evaluation of democracy assistance programs, but has led M&E efforts in several sectors. He has also designed and delivered training on different M&E topics for international development funders and partners around the world. Dr. Jones has significant experience in participatory approaches to evaluation and is adept at ensuring that the evaluation process is useful for key audiences. He believes deeply in the foundational role that evaluation plays in ensuring the right evidence is on hand to inform strategic decisions. Dr. Jones taught graduate level courses on M&E at the George Washington University and Georgetown, and holds a PhD in Political Science from the University of Florida.

Leave a Reply

Skip to content