Share

Let's be realistic about measuring impact

Let's be realistic about measuring impact
Blogs

Let's be realistic about measuring impact

Governance | Andrew Chaggar | 10 Oct 2012

How do you measure impact when there's so little consensus over how to do it or what the results should be? Andrew Chaggar offers his take on measuring sustainability.

I’ve just returned from a week in Port-au-Prince where I was evaluating how our projects have continued to impact Haitian lives since our volunteers departed in December. The trip was critical because, like all charities, evaluating our success and demonstrating our impact is critical to keeping existing supporters engaged and encouraging others to get involved.  

We’ve always tracked statistics about our programmes, like the number of students in school thanks to our classroom construction for example, but these day-to-day project outputs do not by themselves demonstrate our overall success in Haiti. Success is also determined by whether or not we’ve achieved the main goal that all our individual projects and programmes work towards – supporting sustainable disaster recovery. Evaluating sustainability can be challenging because although the concept of sustainability may be clear, it is actually a very difficult thing to define and measure.

Find your own definition

Our own charitable objects describe sustainable development as “development which meets the needs of the present without compromising the ability of future generations to meet their own needs”.  While a good start, this definition is still vague and lacks information on the many types of need encompassed, or on how to ascertain whether these are being met in a sustainable manner.

Even when these questions are considered it is not easy to achieve consensus on the answers. For example, in 2008 the UN and Organisation for Economic Cooperation and Development (OECD) issued a report on measuring sustainable development. While this report found common ground between contributors it also noted discord. For example, among 25 European countries the number of indicators used to measure sustainability varied from 12 to 187.

As a result an easier way to evaluate sustainability is via a conceptual framework. For example sustainability is sometimes also described in relation to the triple-bottom-line of 'profit, planet and people'. This approach breaks down sustainability into three key areas - economics, the environment and society - which must all be accounted for if true sustainability is to be achieved.

For example, our classroom construction programme provided earthquake-hit schools with the means to re-open and enroll students. With little government support schools in Haiti often fund themselves through charging tuition fees.  We supported schools which were financially viable but also accessible by their local communities. By building classrooms, we allowed these schools to admit students, which in turn boosted their income. During my recent visit I found that three of these schools were reinvesting that money on further building improvements which will allow them to accept even more students. Our classrooms have helped these schools achieve a level of sustainable economic recovery.

However, our building work involved the use of concrete which is environmentally costly and reduces the overall sustainability achieved. However, while overall sustainability would be the preferred outcome, it would be a mistake to undervalue success in an individual area.

One step at a time

In an environment as challenging as Haiti, in can be unrealistic to address all issues simultaneously. In fact it would have been hard to get started at all if we had only considered projects which tackled all three areas of sustainability at once.  

When writing this blog I came across a slightly different definition of sustainability that I thought was useful given this context. This describes sustainable development as “an ability to meet the needs of the present while contributing to future needs”.  I prefer this definition as to me it acknowledges that you often can’t achieve sustainability immediately. It needs to be built one layer at a time.

For example, our on-going English programme began with volunteers supporting existing community-based English lessons. We spent a lot of 2011 training Haitian teachers so that the school could continue teaching to a recognised curriculum after we left.

Today, while the school is still heavily dependent on us for funding and exam support, the day-to-day teaching and management is performed by Haitians. So, in terms of social sustainability we’re very happy with the current results.

Further, English is a key vocational skill in Haiti, and as more and more students gain qualifications and jobs we should seeing them earn a sustainable income. This will help the local economy and several of the students have already broached the idea of setting up an alumni association which could help financially support the school itself in the future.

All this will be an ongoing process but sustainability can only be ultimately measured over generations anyway.  Expecting to achieve or demonstrate overall sustainability after only a nine-month period would be unrealistic. What we do want to see however is step-by-step progress towards more sustainable outcomes. After all, the strongest foundations are always built layer upon layer.

 

Comments

[Cancel] | Reply to:

Close »

Community Standards

The civilsociety.co.uk community and comments board is intended as a platform for informed and civilised debate.

We hope to encourage a broad range of views, however, there are standards that we expect commentators to uphold. We reserve the right to delete or amend any comments that do not adhere to these standards.

We welcome:

  • Robust but respectful debate
  • Strongly held opinions
  • Intelligent relevant discussion
  • The sharing of relevant experiences
  • New participants

We will not publish:

  • Rude, threatening, offensive, obscene or abusive language, or links to such material
  • Links to commercial organisations or spam postings. The comments board is not an advertising platform
  • The posting of contact details for yourself or others
  • Comments intended for malicious purpose or mindless abuse
  • Comments purporting to be from another person or organisation under false pretences
  • Gratuitous criticism, commentary or self-promotion
  • Any material which breaches copyright or privacy laws, or could be considered libellous
  • The use of the comments board for the pursuit or extension of personal disputes

Be aware:

  • Views expressed on the comments board are left at users’ discretion and are in no way views held or supported by Civil Society Media
  • Comments left by others may not be accurate, do not rely on them as fact
  • You may be misunderstood - sarcasm and humour can easily be taken out of context, try to be clear

Please:

  • Enjoy the opportunity to express your opinion and respect the right of others to express theirs
  • Confine your remarks to issues rather than personalities

Together we can keep our community a polite, respectful and intelligent platform for discussion.

Andrew Chaggar

Andy Chaggar is executive director of International Disaster Volunteers (IDV) which he co-founded in 2008. In 2004, he was seriously injured and bereaved in the South East Asian tsunami, after which he became a disaster response volunteer, and founded IDV.

Follow Andy on Twitter @IDVExec

Tesse Akpeki (55) Martin Farrell (46) Robert Ashton (41) Tania Mason (23) Andrew Chaggar (23) David Ainsworth (16) David Philpott (14) Making Good: The Future of the Voluntary Sector (13) Ian Allsop (12) Vibeka Mair (11)
Niki May Young (11) Celina Ribeiro (10) Gordon Hunter (9) Kirsty Weakley (9) Leon Ward (9) David Davison (8) Dorothy Dalton (8) John Tate (8) Neal Green (5) Jeremy Swain (5) Rowena Lewis (5) Daniel Phelan (4) Andrew Hind CB (3) Suzi Leather (3) Stephen Lloyd (3) Pauline Broomhead (3) Rosie Chapman (3) Ingrid Marson (3) Alexander Swallow (3) Belinda Pratten (3) Sir Stuart Etherington (2) Adrian Beney (2) Joe Saxton (2) Jesper Christensen (2) Paul Gibson (2) Andrew Scadding (2) Anne Moynihan (2) Kevin Carey (2) Garreth Spillane (2) June O'Sullivan (2) Dan Corry (2) Paul Emery (2) Simon Steeden (2) Alice Sharman (2) Lesley-Anne Alexander CBE (1) Victoria Cook (1) Claris D'cruz (1) Peter Gotham (1) Sir Thomas Hughes-Hallett (1) Justin Davis Smith (1) Kate Sayer (1) Alison McKenna (1) Anne-Marie Piper (1) Jo Swinhoe (1) Karl Wilding (1) Richard Williams (1) Mike Hudson (1) Sir Christopher Kelly (1) Martin Brookes (1) Simon Hebditch (1) Lindsay Driscoll (1) Jo Coleman (1) Cedric Frederick (1) Jonathan Lewis (1) Dame Mary Marsh (1) Rosamund McCarthy (1) Jill Pitkeathley (1) Nick Brooks (1) Linda Laurance (1) Suzie Who (1) James Thompson (1) Stephen Hammersley (1) John May (1) Julian Blake (1) Malcolm Hurlston (1) Andy Gregg (1) Anne Owers (1) Beth Yorath (1) Paul Amadi (1) Caroline Beaumont (1) Judith Davey (1) Douglas Rouse (1) Jackie Turpin (1) Jonathan Last (1) Tom Flood (1) Dan Sutch (1) Jonathan Crown (1) Ruchir Shah (1) Katy Wing (1) George Ames (1) Jenny North (1) Sir David Varney (1) Liam Barrington-Bush (1) Mairéad O'Reilly (1) Tobin Aldrich (1) Michael O'Toole (1) Lisa Clavering (1) Ian Joseph (1) Jonathan Bruck (1) Rachel Short (1) Dr Debra Beck (1) Andy Rich (1) Ian Leggett (1) Leigh Daynes (1) Tim Willis (1) Richard Caulfield (1) Emma Callagher (1)
Less +++ More +++

Defending the right

7 Nov 2014

Ian Allsop calls for a charity to be set up to campaign on behalf of oppressed right-wing politicians.

Fiery rocket or damp squib?

4 Nov 2014

As bonfire night approaches, John Tate is cautious about the pace of the new developments setting the...

The social investment arguments are not black and white

3 Nov 2014

Social finance is not wrong for the voluntary sector - but we must learn lessons from history, says Ashley...

Free eNews

Join the discussion

Twitter
 
Training

Attending our one day courses is a highly effective way of ensuring new and existing trustees fully understand their role, responsibilities and liabilities.

>> Find out more <<