Measuring outcomes for children, families and communities
The emphasis for social service organisations is to demonstrate progress they're making toward achieving outcomes for their clients. Rather than measuring the number of people receiving a service, for example, people want to know what the results of a project or service are. In other words, how are we doing?
Shifting from measuring outputs to measuring outcomes can also help organisations - and communities - create a picture of what success will look like, and how much progress they've made towards this.
Having quality information about the results being achieved by your organisation can help you to:
- plan with confidence: deliver the right services, in the right place at the right time
- improve the way you deliver services
- document your impact and report to funders, members and other interested people
- look at trends over time.
A number of outcomes-based methods can be used by organisations to plan and then evaluate the outcomes achieved by their services. These include outcome logic models, most significant change, Results Based Accountability (RBA) and others.
By 2010 the Ministry of Social Development will have all its contract expectations with providers expressed in terms of outcomes. Contracts will clearly state the outcomes that providers have agreed to work toward with their clients. The contracts will also include the performance measures that providers agree will be used to assess how their activities contribute to these client outcomes.
What is Results Based Accountability (RBA)?
RBA is the model favoured by the Ministry of Social Development. A key attraction is that it's easy to use. It provides a clear, common language for assessing outcomes, indicators and performance measures. It also encourages people to think about who they can work with and how, together, they can work differently to achieve shared outcomes.
Another benefit: RBA gets participants from talk to action quickly, and helps them make a real difference in peoples' lives.
RBA entails actually starting at the end (the desired outcome) and working back to identify how to achieve that outcome.
This particular RBA model was developed by Mark Friedman, an American public policy expert who provides training and consultation on results accountability in countries around the world. His ideas are free to public and not-for-profit agencies via his websites. (See getting started LINK)
It's a flexible approach that works with small organisations taking a few hours to prepare, to whole of communities over weeks and months.
Organisations can use the RBA approach to consider how to improve services, programmes or even a whole provider. In funding relations the information collected is used to demonstrate accountability for funds received.
Getting started with RBA
Fiscal Policy Studies Institute
Home of Results Based Accountability. Lists workshops offered, resources, articles and links.
Results Based Accountability Implementation Guide
Practical resources and tools to run your own RBA process.
Trying Hard is Not Good Enough: How to Produce Measurable Improvements for Customers and Communities, by Mark Friedman (2005). Print only.
The book's Results Accountability framework can be used to improve the quality of life in communities, cities, counties, states and nations, including everything from the well-being of children to the creation of a sustainable environment. It can help government and private sector agencies improve the performance of their programs and make them more customer-friendly and effective.
Results accountability 101 DVD
Three hour DVD with a full presentation of the Results Based Accountability framework.
Mark Friedman interviews
Coach Judy Nelson (6 July 2008) on blogtalkradio.com
Autumn 2008, Neighbourhood Centres and Results Based Accountability: a conversation with Mark Friedman
In LOCAL newsletter, NSW Local Community Services Association
RBA in action
Here are examples and case studies of organisations using RBA:
Other resources on measuring outcomes
A selection of resources about outcomes and how to measure them.
Easy outcomes
New Zealander Dr Paul Duignan has created a standardised way of developing an evaluation and outcomes framework for any program, organisation or sector. The easy outcomes analysis has been broken into 10 easy-to-follow steps. Free software is also available to assist with planning for and measuring progress towards outcomes.
Most significant change
A way of monitoring and evaluating services and programmes. Stories that capture the significant changes with a service are collected. Then the most significant of these stories is chosen and discussed by panels of designated stakeholders or staff.
Proving and improving: a quality and impact toolkit for social enterprise, by New Economics Foundation (UK)
A toolkit for social enterprise and other mission-driven organisations that shows how to prove and improve quality and impact.
Your project and its outcomes, by Sally Cupitt with Jean Ellis for Charities Evaluation Services (UK), 2007 (PDF 217KB)
A 20-page booklet explaining: what outcomes are; how to identify outcomes; how to assess what outcomes your project is achieving; how to use the information you gather.
Collecting data and other research links
Community research how-to guide, CommunityNet Aotearoa
Christchurch-based community consultant Garth Nowland-Foreman has compiled resources, email lists, websites and other guides to help you do your own research.
Evaluation and research resources, Managing Well catalogue
A short list of print resources on research.
