Share

Charities are best placed to assess their own effectiveness

Charities are best placed to assess their own effectiveness
Blogs

Charities are best placed to assess their own effectiveness2

Governance | 7 Jan 2016

It is the charities themselves who can best assess how effective they are, not the government or anyone else, says Genevieve Maitland Hudson

The journalist Harriet Sergeant recently wrote a piece for the Spectator on the ‘5 questions’ that would tell us whether charities are doing a good job. It will have made frustrating reading for many.

Here are three reasons why the article doesn’t provide an effective model for assessing the effectiveness of charities:

  1. Three of the ‘questions’ are already common practice across social programmes
  2. One won’t work
  3. The last fails to grasp the ways in which social programmes are fundamentally different to customer services

The first question “who uses the charity and in what numbers?” is the basis of all programme monitoring. The problem does not lie with asking this question, it lies in answering it.

I have written about this before. The problem with so much monitoring data lies in the use of aggregate figures that encourage exaggeration. There are better measures, such as caseload averages, that would steer us away from misleading cumulative numbers of the kind used by Kids Company.

The third question in the article, “how effective is the charity over the long term?” is interpreted as an outcomes question. Outcomes go some way to answering questions about long term effectiveness, but they aren’t sufficient on their own. I have written about this before too, once again in relation to Kids Company. Outcomes measurement is also rife with difficulties in practice, and has too often been used by commissioners to ensure compliance rather than improve service delivery.

The fourth question “is the charity actually required?” is presented as a question about duplication of effort. It is already common practice across social programme commissioning to ask whether there is duplication and whether organisations could work in partnership to better support their beneficiary groups. There may be a need for more of this mapping, or for it to be done differently or better, but to suggest it doesn’t exist already is simply incorrect.

These are the three questions that are already common practice. So much for them.

The second question in the article points towards the need to collect first hand feedback from service users. Feedback is crucial, certainly, and should directly influence the continual improvement of services within social programmes. There is still too little of it, although it is an area of growth and development particularly within the Feedback Labs collective.

It should not, however, be based on the casual interview of two service users as the article suggests. It should be a systematic, embedded and transparent part of ordinary service delivery. The casual interview of two detractors is no more useful than the casual interview of two promoters at providing reliable evidence of effectiveness.

The last question in the article is the hardest to follow. It suggests that charities should be “person-centred” but does not clearly define what this means in practice. There is a fundamental point to be made here about how social programmes build relationships with their service users.

Once again, I’ve touched on this elsewhere. I disagree with Harriet Sergeant when she suggests that the solution lies in “government” understanding the “problem” in advance of commissioning an “imaginative solution”.

Complex social problems don’t work like this. No problem can be simply understood and there is rarely if ever one appropriate “solution”, however imaginative. Nor can relationships between service users and the programmes they access be reduced to customer satisfaction ratings, not least because so much behaviour change is uncomfortable, difficult and takes time.

Most frustratingly for those of us who work with social programmes, is the suggestion that questions about effectiveness should come from without. They should not. They are best asked, and answered, from within social programmes where systematic and open monitoring and evaluation can improve services and better meet the needs of those we want to support.

Genevieve Maitland Hudson is a director of impact measurement consultancy OSCA

Bryn Price
Director
Safer Kent
2 Feb 2016

Genevieve Maitland Hudson makes a number of vital points in highlighting the issues involved. However I would like to add a further question: Is the need for the charity still there? At some stage Help for Hero's may no longer be needed, if we can stop going to war so often, and many Private schools may have difficulty still claiming the that their need is still there. Unfortunately we all think we are still needed as we are still delivering services, but how often have we actually checked to see if they are still needed. I know we have recently closed down a whole programme of events, as they are now being delivered by commercial organisations as part of their CSR.

Jeremy Payne
8 Jan 2016

An unhelpful headline which suggests your point is basically 'Trust me I'm a charity' which it isn't - it's a critique of the Spectator article. Just as well otherwise the response would have needed to be wake up and smell the regulatory environment and the media scrutiny.

Comments

[Cancel] | Reply to:

Close »

Community Standards

The civilsociety.co.uk community and comments board is intended as a platform for informed and civilised debate.

We hope to encourage a broad range of views, however, there are standards that we expect commentators to uphold. We reserve the right to delete or amend any comments that do not adhere to these standards.

We welcome:

  • Robust but respectful debate
  • Strongly held opinions
  • Intelligent relevant discussion
  • The sharing of relevant experiences
  • New participants

We will not publish:

  • Rude, threatening, offensive, obscene or abusive language, or links to such material
  • Links to commercial organisations or spam postings. The comments board is not an advertising platform
  • The posting of contact details for yourself or others
  • Comments intended for malicious purpose or mindless abuse
  • Comments purporting to be from another person or organisation under false pretences
  • Gratuitous criticism, commentary or self-promotion
  • Any material which breaches copyright or privacy laws, or could be considered libellous
  • The use of the comments board for the pursuit or extension of personal disputes

Be aware:

  • Views expressed on the comments board are left at users’ discretion and are in no way views held or supported by Civil Society Media
  • Comments left by others may not be accurate, do not rely on them as fact
  • You may be misunderstood - sarcasm and humour can easily be taken out of context, try to be clear

Please:

  • Enjoy the opportunity to express your opinion and respect the right of others to express theirs
  • Confine your remarks to issues rather than personalities

Together we can keep our community a polite, respectful and intelligent platform for discussion.

Open door policy: the importance of approachability for a charity chief executive

25 Jul 2016

Helen Simmons says that a good leader needs to be in touch with what’s really happening in the organisation.

Economic forecasts downgraded following EU referendum

20 Jul 2016

Cazenove's Kate Rogers predicts the economic outlook of a post-referendum Britain.

Team talk and a CRM upgrade

19 Jul 2016

A CRM upgrade is not just about tech – you need to consider the effect on people, says Ivan Wainewright....

Join the discussion

Twitter
 
Training

Attending our one day courses is a highly effective way of ensuring new and existing trustees fully understand their role, responsibilities and liabilities.

>> Find out more <<