Capturing Evaluation Capacity: Findings from a Mapping of Evaluation Capacity Instruments

Steffen Bohni Nielsen, Sebastian Lemire, Isabelle Bourgeois, Leslie A. Fierro

Research output: Contribution to journalJournal articleResearchpeer-review

Abstract

This article surveys the literature on organizational evaluation capacity (EC) instruments. Over the past 25 years, articles have been published in four waves covering the development of organizational evaluation capacity models, surveys of the evaluation capacity and practice landscape, the development of EC instruments, and their replication and adaptation. Altogether, the authors identified 20 studies applying 16 EC instruments. Several studies applied variants of the same instrument. We found instruments of three types: checklists, rubrics, and questionnaires. The instruments vary in terms of type, purpose, scoring, dimensions, number of items, and validation processes. In general, the validation studies demonstrated acceptable face, content, construct validity, and internal consistency. Only two studies tested for predictive validity. No studies covered concurrent validity and test–retest, or inter-rater reliability.
Original languageEnglish
JournalCanadian Journal of Program Evaluation
Volume38
Issue number3
Pages (from-to)433-460
ISSN0834-1516
DOIs
Publication statusPublished - Apr 2024

Cite this