Steven Goldberg is probably best known for the controversial “Billions of Drops in Millions of Buckets: Why Philanthropy Doesn’t Advance Social Progress.” In this post he looks at the ways in which success and failure are measured in his field. Healthcare audiences will note many familiar themes. What should we measure? How should we measure it? How much weight should we give the results? And perhaps most importantly: what other questions should we be asking? — John Irvine
Conventional wisdom holds that randomized control trials (RCT) are the “gold standard” of evaluation. In fact, RCTs only make sense under very strict conditions that can rarely be met in the real world. Most of the time, RCTs produce inconclusive results and simply aren’t worth the time and money. As the social sector assumes greater responsibility for improving the lives of many more people, it should focus less on pseudo-scientific “proof” that programs work and focus more on making good programs better.
Now that the Social Innovation Fund (SIF) appears to have survived the “transparency” commotion, the eleven chosen intermediary grantmakers have less than six months to select their portfolios of nonprofit grantees.
As a commendable exercise in “evidence-based” grantmaking, SIF requires the intermediaries to incorporate evaluation into every step of their awards, from the initial competitive solicitations all the way through final payments and renewals. Applicants will be required to explain how their success should be measured and demonstrate their capacity to do so, and awards will be contingent upon the establishment of meaningful performance metrics, the timely collection and reporting of reliable data, and the faithful implementation of sound evaluation protocols.








