Engaging with Evidence series

Session Overview

In this session we explored the latest findings from the second interim report of the Mental Health and Employment Partnership (MHEP) evaluation for the Life Chances Fund (LCF) which looks at the MHEP Social Outcomes Partnerships (SOPs, also known as social impact bonds).The Mental Health and Employment Partnership (MHEP) was established in 2015 to drive expansion of high-quality employment support programmes, based on the Individual Placement and Support (IPS) model. Within the Life Chances Fund, MHEP supports five impact bonds. Alongside one of the authors of the report, Emily Hulse at the Government Outcome Lab, were joined by leading experts in the field. During our session, we explored the lessons and insights from the second Interim Report of MHEP evaluation of the “SOP effect” including 5 key questions:

1. Is there greater accountability in SOP-funded IPS compared to traditional commissioning?
2. Does the MHEP SOP affect service quality?
3. How did the structure of the MHEP SOPs affect service delivery?
4. Through what incentives do SOPs operate?
5. Does MHEP have a legacy? We will explore the sources of complexity and how to mitigate these common pitfalls of social impact bonds. Additionally, the legacy effects will be presented including new IT systems and dependable data routines for providers and a creation of a new baseline expectation and experience in partnership working for commissioners. Anyone interested in the flow of incentives in SOPs and how effective they were (or not) should also attend in this session.

Speakers for this session:

• Emily Hulse is Research Associate at GO Lab (Oxford) and leads the Mental Health and Employment Partnership evaluation, bringing expertise in health economics and impact bonds.
• Madeline Goldie is Government + Enterprise Manager at Social Finance and specializes in system transformation and outcomes-based commissioning, with experience from Harvard Kennedy School and Australian government.
• Russell Jones is Assistant Director for Children and Adults Joint Commissioning at London Borough of Southwark and South East London Integrated Care Board, bringing extensive experience in health, social care and community partnerships.
• Shomsia Ali is an Independent Consultant bringing 20+ years of experience in outcomes-based contracting across public and private sectors, including advisory work for the Global Fund.

The session was moderated by Jessica Reedy, Senior Policy Engagement Officer at GO Lab (Oxford).

Session Overview

In this session we explored the latest findings from the implementation of India's Skill Impact Bond, the world’s largest development impact bond in the skills sector. The Skill Impact Bond is dedicated to skills training and job placement using private sector capital and expertise. Its objective is to benefit 50,000 young Indians over four years, with 60% of the beneficiaries being women, and it focuses on job placement and retention, rather than on just training and certification.

In conversation with a diverse panel of experts, we looked at the impact that the programme has had and asked:

1. How can we leverage the demographic dividend balancing equity, employability, and empowerment?
2. How can we ensure that evidence generated is relevant, useful, and practical for concurrently improving programme performance?
3. How can the lessons learned be mainstreamed to support scale-up and sustainability beyond the life of the results-based financing programme?

We were delighted to bri together on the session perspectives from key project stakeholders with direct experience working on the programme– the evaluator, the performance manager and the outcomes funder. We were joined by: Divya Nambiar and Phalasha Nagpal from OPML who will provide the evaluator perspective, Anushree Parekh from the British Asian Trust who will provide the performance manager perspective, and Vandana Bahri from CIFF who will bring in the outcome funder perspective.

Together we explored what it takes to create actionable, youth-centric evidence that drives programmatic improvements, strategies for scaling and sustaining impact beyond the life of the programme, and practical insights inot how to build effective partnerships for better skills and employment outcomes for youth, especially women and young girls. In doing so, we aim to provide valuable insights for stakeholders (particularly practitioners) interested in outcomes-based funding, youth skills, and livelihoods sectors.

Find more information about the Skill India Bond through the INDIGO Impact Bond Dataset.

Session Overview

In this session, we explored a new case study on Educate Girls' Project Maitri. We examined how the use of outcomes-based contracts enabled scaling impact through community-based organisations and offering insights on supporting locally-led development.

Locally led development recognises the importance of involving the people and communities affected by development and humanitarian challenges in designing and delivering their solutions. Donor commitments to support locally led development have been increasingly strengthened since the 2005 Paris Declaration, gaining particular momentum since USAID’s ‘new vision for global development’ in 2021. However, despite these commitments to increase funding for local NGOs (LNGOs), there exists a significant gap between stated intentions and financial support. Research indicates that, in 2021, only 6% of bilateral funding to NGOs went to NGOs registered in the global South, and less than a quarter of philanthropic funding to non-profits went to domestic NGOs.

This Engaging with Evidence session centred around a new case study of Educate Girls’ Project Maitri developed by Social Finance International. Project Maitri built on 10 years of Educate Girls’ experience of outcomes-based delivery at scale, to deliver impact through community-based organisations in a state in which they had not previously operated.

The webinar unpacked:

• Why Educate Girls took the decision to scale their impact without scaling their footprint
• How they used outcomes-based contracts to drive impact through community-based organisations
• What can be learnt from Project Maitri for other larger NGOs and funders wanting to harness the potential and capacity of community based organisations to drive change

Find more information about the Educate Girls through the INDIGO Impact Bond Dataset and GO Lab's case study.

Session Overview

Social impact bonds, increasingly referred to as social outcomes partnerships, were pioneered in the UK and are now used in over 35 countries, with nearly 300 such projects launched globally to date. Nearly fifteen years since the launch of the world’s first social impact bond at the Peterborough prison in England, this session brought together government, practitioner and evaluator perspectives to take stock of the evolution of the implementation of this partnership model and the emerging evidence.

Increasingly impact bonds are understood less as a financial instrument (as the word ‘bond’ might suggest) but rather a form of cross-sector partnership (a social outcomes partnership) that brings together government, non-profit service providers and socially motivated investors in the pursuit of measurable outcomes. More than a technical specification for outcome measures in a transactional arrangement, we’ve seen a shift away from a punitive, rigid application of key performance indicators towards outcome measurement as a tool for learning and adaptation for more responsive social services.

Can social outcomes partnerships help reform public services and improve efficiency in public spending? Do they offer value for money? What does best practice look like and what has been the legacy of the practice to date?

In the session we:

• Mapped the UK’s social outcomes partnership landscape, drawing on data from the global Impact Bond Dataset curated by the GO Lab team
• Shared insights from the respective evaluations of the two largest outcomes funds in the UK: The Commissioning Better Outcomes & the Life Chances Fund
• Explored what the learning from the journey so far tells us about how to fund and deliver more adaptive, accountable and person-centered public services.

Session Overview

The Reducing Youth Reoffending in South Auckland Social Impact Bond (SIB) was launched in New Zealand in 2017 to provide a new set of services to reduce reoffending amongst young people. It was commissioned by the New Zealand Government and delivery was led by the Genesis Youth Trust. In this session, we explored the findings of the Final Report of the Reduction in Youth Reoffending in South Auckland SIB.

Participants in the session had the opportunity to:

• learn from the research about the results and impact of the New Zealand’s Reduction in Youth Reoffending SIB & their innovative practices
• hear from those directly involved in the SIB about the implementation of the mechanism
• explore with the experts the wider implications of the evaluation findings such as:

1. How this impact bond enabled more innovation in both the design and implementation of the service
2. How this can be scaled and reproduced
3. What are the enabling environment and conditions needed for this innovation to occur

We heard from the those involved in setting up the programme, and evaluating, as well as from the Former New Zealand Prime Minister who was in Government when the fund was initiated.

Session Overview

In this session, we explored the findings of the third wave of the independent evaluation of the FCDO Development Impact Bonds (DIBs) Pilot Programme. We were joined by leading experts from the Foreign Commonwealth Development Office (FCDO), Ecorys, Village Enterprise and Bridges Outcomes Partnership.

Participants in the session had the opportunity to:

• learn more about the evaluation of the FCDO DIBs Pilot Programme and the findings of the evaluation, particularly the effect of the DIB funding mechanism;
• hear from those directly involved in the programmes about their reflections on the impact, legacy, and lessons learned from delivering the programme through a DIB model; and
• explore with development experts and academics the wider implications of the evaluation findings and how the lessons can help inform future design and delivery of outcomes-focused programmes for development more broadly.

In 2017, the Foreign, Commonwealth and Development Office (FCDO) launched the Development Impact Bonds (DIBs) pilot programme. The DIBs pilot programme aimed to build the evidence base on the suitability of DIBs to improve the efficiency and effectiveness of development programmes in several sectors. FCDO allocated GBP 6.3 million for three projects: 1. Humanitarian Impact Bond for Physical Rehabilitation, 2. Village Enterprise (VE) and 3. Quality Education (QEI) DIB. Ecorys was commissioned to evaluate the programme, aiming to generate learning to inform FCDO’s future policy around DIBs. The third and final report summarises and captures final learnings and conclusions from the implementation stage.

The focus of the third wave evaluation was the DIBs funding mechanism. The evaluation was interested in understanding the ‘DIB effect’ – that is, the effect of using a DIB instead of a grant or other PbR mechanism. The figure 1 summarises the DIB effect observed across the three pilot programmes.

Session Overview

This session of Engaging with Evidence looked at an exciting new publication on transformative cross-sector collaboration that the Whitehall and Industry Group and the Blavatnik School of Government have commissioned. The work by Ian Taylor and Nigel Ball, entitled ‘The Collaboration Playbook: A Leaders’ Guide to Cross-Sector Collaboration’, surfaces considerations for effective cross-sector collaboration, presenting tactics that draw on academic literature, thought leadership and case study examples from various contexts.

The challenges facing our societies and economies today are so large and complex that in many cases, cross-sector collaboration is not a choice, but an imperative. Yet collaboration remains elusive for many, often being put into the ‘too hard’ category. The collaboration playbook has been researched and written with ideas on how to seize collaboration opportunities successfully and rise to the challenges, focusing on the intangible aspects of collaboration that often prove to be the most challenging for collaborating partners. The 18 discrete ‘plays’ presented in the playbook will be outlined, alongside the five themes of power, culture, trust, leadership, and learning.

This session was joined by leaders who have been engaged in cross-sector collaboration and experts who have researched and taught on the subject. All speakers in this session were involved in contributing to the Collaboration Playbook project,and each spoke about their experiences.

The speakers will be:

• Paul Morrison - CEO of the Planning Inspectorate
• Mike Adamson - CEO of the British Red Cross
• Anna Keeling - Former Managing Director, Boeing Defence UK
• Nigel Ball - Director of the Social Purpose Lab at UAL and Author of the Collaboration Playbook
• Cathy Butler - Head of Leadership at the Whitehall & Industry Group
• Ian Taylor - Author of the Collaboration Playbook and Research Associate at the Government Outcomes Lab, Blavatnik School of Government

Participants in the session had the opportunity to:

• Learn about the need for a collaboration guide.
• Hear how the collaboration playbook attempts to help leaders with cross-sector collaboration.
• Hear advice and opinions from organisational leaders from the private, public and third sectors who have been at the coalface of cross-sector collaboration.

Session Overview

In this session, we explored the main findings, lessons learned and recommendations from the evaluation of the scaling up of Results Based Financing for Community Health Programme, implemented in Uganda by Living Goods. We were joined by leading experts from Living Goods, Instiglio and USAID.

Since its founding in 2007, Living Goods (LG) has supported nearly 11,000 digitally empowered community health workers (CHWs) to deliver care, improving ability of families to access the treatment and care they need. LG has supported CHWs to go door-to-door in their communities, delivering integrated package of reproductive, maternal, newborn, and child health interventions.

Following the successful implementation of a one-year pilot of RBF programme in 2018, funded by Deerfield Foundation in two districts in Uganda, LG decided to scale the RBF to three additional districts, targeting approximately 1,968 CHWs. The RBF scale-up programme, structured as an Outcomes Fund with USAID Development Innovation Ventures, as the anchor outcome payer, began implementation in October 2020 for a duration of 27 months. The programme aimed to drive improved cost-effectiveness and quality of CHWs targeting underserved and at-risk populations. It also aimed to crowd in increased long-term funding for community health as well as support government's engagement efforts.

The final results showed that the RBF programme led to measurable, scalable, and sustainable improvements in the quality of programmatic data on community health worker performance with Living Goods achieving 93% of expected target on community health workers' productivity. The evaluation also revealed some areas of further research including exploring ways of improving cost-effectiveness of the verification component of an RBF mechanism and investing in further research to identify suitable ways to measure and incentivise quality of service delivery in RBF mechanisms.

Session participants had the opportunity to:

• Learn about the scale-up RBF programme and hear from those directly involved in the programme as to their reflections on the lessons learned and recommendations on using RBF to improve performance in community health worker programmes,
• Engage with leading experts in the field to learn about the wider implications of using RBF to improve service delivery in community health worker programmes, and
• Deepen their understanding of when and how to use RBF as an innovative financing approach.

Session Overview

In this session, we explored the latest findings from the first interim report of the Mental Health and Employment Partnership (MHEP) evaluation for the Life Chances Fund (LCF).

Alongside one of the authors of the report, Emily Hulse, Research Associate at the Government Outcome Lab, and Sarah Baillie, Manager at Social Finance, we were joined by leading experts in the field with our guest speakers, the theories of change and contextual factors (barriers and facilitators) which serve as external influences on the MHEP projects, the distinctive contribution of MHEP and the benefits that the evaluation design choices can bring to the projects. We also reflected on performance data of the key outcome metrics of MHEP projects and the wider applicability of the lessons to employment support for those who face the greatest barriers to labour market inclusion.

The Life Chances Fund is a £70 million outcomes fund to support locally commissioned social impact bonds (SIBs), launched by the Department for Digital, Culture, Media & Sport (DCMS) in 2016. There are 5 Mental Health and Employment Partnership (MHEP) SIBs contracted under the LCF. MHEP was established in 2015 to drive expansion of high-quality employment support programmes, based on the Individual Placement and Support (IPS) model, for people with mental health issues. It is a special purpose vehicle run by Social Finance, backed by investment from Big Issue Invest. The first report adopts a mixed methods approach, drawing on qualitative interview data and aggregate quantitative performance data.The evaluation of the MHEP is being undertaken by the Government Outcomes Lab.

During our session, we explored the lessons and insights from the first Interim Report of MHEP evaluation. There were three main mediating mechanisms which may explain how MHEP provides additional value compared to traditional commissioning:

1) Additional financial and human resources 

MHEP was able to unlock additional funding for projects through the Life Chances Fund. This was understood to bring additional financial and human resources.

2) Additional performance management function

MHEP provided a dedicated performance management function that was seen to drive an additional focus on achieving outcomes, supported by data analysis and intelligence.

3) Collaborative working

MHEP supported a more intentional, collaborative working culture within each local partnership. MHEP represented a “three-way partnership” with a sense of shared purpose, and despite requiring considerable work, this was viewed as hugely beneficial.

Session Overview

Helping families in difficulty before they reach full-blown crisis is good for children's outcomes and good for the public purse. But the system of prevention is not working well enough, and more and more children are going into care.

This is one of the main findings of the MacAlister Care Review. The review recommends an investment of £2billion for "family help", which would combine existing early help provision with statutory "Child in Need" services. Families would build a more consistent relationship with care agencies over time, with a focus on support rather than assessment. Future demand on more intensive forms of care could be drastically reduced. The government's response commits to some of these recommendations, but two questions remain:

1. How should a locally-based wrap-around family help offer, however it was funded, be implemented?
2. Without new central government funding, where else could the money come from? Is there a way to unlock the required upfront investment locally, reducing future demand on care placements?

The session was chaired by Nigel Ball, Executive Director at the GO Lab. To begin the discussion, we heard from the Stronger Families Norfolk Social Impact Bond (SIB), a project commissioned under UK’s Life Chances Fund. The programme, set up in 2019, uses Functional Family Therapy for Child Welfare to improve communication and supportiveness between and young people and their parents. We delved into the uniqueness of the project’s intervention for supporting families to stay together more than 100,000 days so far, and explored the lessons coming out of the project and how these might be applied to children's commissioning elsewhere in the country. The focus on outcomes instead of inputs, the flexibility in delivery, and the relational elements of the partnership are likely to be key areas of focus for the discussion.

Session Overview

In this session, we explored the lessons learnt from the development and implementation of the International Red Cross Committee (ICRC) Humanitarian Impact Bond (HIB). We were joined for this session by experts from the International Committee of the Red Cross, Foreign, Commonwealth & Development Office, the International Institute for Management Development, and the University of Oxford.

Participants to the session had the opportunity to:

• learn more about the implementation of the HIB programme and the results achieved;
• hear from those involved in the programme as to their reflections on the impact, legacy, and lessons learnt from delivering the programme through an innovative funding model (impact bond), and
• explore with development and social finance experts how the experience of the ICRC HIB can help inform practice in the humanitarian sector more broadly.

The ICRC Humanitarian Impact Bond was launched in 2017 to help transform the way vital services for people with disabilities are financed in conflict-hit countries. This was a 5-year programme delivered by the International Committee of the Red Cross to build and operationalise three new physical rehabilitation centres in Nigeria, Democratic Republic of Congo and Mali. The initial funding was provided by social investors, such as Bank Lombard Odier and New Re, and ultimately reimbursed through a payment-by-result agreements by outcome funders, including the governments of Switzerland, Belgium, Italy, the United Kingdom and "La Caixa" Foundation.

Despite multiple setbacks including two political coup d’états and a national strike in Mali and an attack on the electricity supply in Maiduguri, Nigeria, by insurgents, as well as more routine challenges in operationalising the new centres, the HIB implementers have succeeded in opening all three centres. The final results of the programme showed that the centres are nearly 10% more efficient than the benchmark centre in terms of time management, staff members skills, management of stock and resources. These criteria and essential elements such as the quality of care and the satisfaction of the patients were the key factors that helped determine the level of success of the HIB.

Due to technical issues with Zoom we don't yet have a recording of the session, but we are working on getting it

Session overview

In this session we explored the final results of the Quality Education India Development Impact Bond (DIB). This programme was set up in 2018 to support education providers in India to improve learning outcomes for 200,000 primary school children aged 5-11 across Delhi, Gujarat, Maharashtra and Uttar Pradesh. This is the largest education DIB deployed in the world. It brings together a broad coalition of private, not-for-profit, and public sector partners in India. According to the final results report, the programme managed to outperform its outcome targets over the last 4 years. It also contributed to further close the learning gap experienced by some students during the pandemic.

For this discussion we were joined by experts involved in the implementation and evaluation of the Quality Education India programme, as well as a range of leading practitioners from the education finance sector. We will explore with our guest speakers what the lessons coming out of the Quality Education India programme can tell us about how to tackle global challenges in funding education and how to improve education systems effectively.

Some key findings from the Quality Education India report include:

• Increased levels of learning, despite the COVID-19 pandemic: Students in the programme learned 2.5 times more than those in non-participating schools.
• Shifting to an outcomes-based funding approach can be a catalyst for change: Education providers were able to create a step change in learning outcomes achievement compared to their previous grant programmes. Factors which helped drive this success included robust performance management, regular engagement with each education provider and flexibility in funding and approach.
• Funders got better impact because they were paying for outcomes: The actual price per outcome was 46% lesser than the original expected price, suggesting that DIBs can provide better value for money for funders.
• The investor achieved the targeted return: The investor, UBS Optimus Foundation received a return of 8% on its investment, suggesting that impact focussed investors can make a return, whilst assuming the responsibility for implementation and the associated risk in such programmes.

For the thirteenth session of Engaging with Evidence, we explored the latest findings from the evaluation of the UK's Commissioning Better Outcomes (CBO) Fund.

For this discussion we were joined by the authors of the CBO third update report, as well as a range of other experienced practitioners and researchers. During the session we focused on the six core characteristics of the social impact bonds (SIBs) supported through the CBO Fund (as synthesised in the report under the SIB Hexagon framework), and explored how the underlying motivations for developing a SIB project influence these characteristics, and how in turn they influence the delivery and impact of SIB projects.

We explored with our guest speakers practical examples of how these characteristics evolve over the course of designing and implementing a SIB, and looked at the inherent tensions and trade-offs when developing these projects, and the benefits that these characteristics or design choices can bring to the project. We also reflected on what the findings of the report mean for those designing and implementing outcomes-focused programmes in the UK and internationally.

For the twelfth Engaging with Evidence session, we explored the key conditions and competencies that enable successful delivery of outcomes-based partnerships.

In the session, we took stock of existing frameworks for assessing the readiness of government and service providers to engage in outcomes-based partnerships, and shared findings from a recent review conducted by Social Finance UK in partnership with the Government Outcomes Lab. The review builds on existing evidence and practice to develop two coherent and comprehensive frameworks for assessing the readiness of eco-systems and service provider organisations respectively, to engage in outcomes-based partnerships. Providing tools to map the necessary competencies is crucial in identifying and better understanding gaps and in informing a substantive capacity-building agenda for policy-makers, donors and funders to use.

Resources

Frameworks: Engaging in outcomes-based partnerships: Frameworks to support ecosystem and service provider readiness (Social Finance and Government Outcomes Lab)

Introductory guide: Outcomes-based contracting (Government Outcomes Lab)

For the eleventh Engaging with Evidence webinar session, we explored insights from the Village Enterprise Development Impact Bond (DIB), a poverty alleviation project in Uganda and Kenya.

Drawing on a recent report by IDinsight, the session explored the learnings and final results from the project, as well as highlight practitioner experiences. This session sought to understand key stakeholders’ experiences around delivering the project. Our guest panelists reflected on the application of outcomes-based funding to poverty alleviation interventions, project adaptation to COVID-19, and the use of a randomized controlled trial (RCT) for measurement and evaluation.

Resources

Case study: Village Enterprise DIB (Government Outcomes Lab)

Case study: Village Enterprise Development Impact Bond: A case study produced as part of the evaluation of FCDO’s Development Impact Bond Pilot Programme (Ecorys & Foreign, Commonwealth and Development Office)

Introductory guide: Impact bonds (Government Outcomes Lab)

Blog: Surviving the storm of the pandemic – lessons from the Village Enterprise Development Impact Bond (Laura Bonsaver, Government Outcomes Lab)

For the tenth Engaging with Evidence webinar session, we explored the use of outcomes-based funding within education interventions in India.

We invited a group of guest panellists to discuss some of the key takeaways from a recent report by Dalberg, and discuss broader lessons around the cost effectiveness of outcomes-based funding and its impact on accountability. As the Quality Education India Development Impact Bond (QEI DIB), set up in 2018 to support education providers in India, is coming to an end, this report serves to draw broader lessons for outcomes-based financing ecosystem in education in India.

Resources

Report: Summary report: Understanding cost effectiveness of education interventions in India: a key step towards outcomes-based financing (Dalberg, UBS Optimus Foundation, British Asian Trust)

Case study: Quality Education India Development Impact Bond (Government Outcomes Lab)

Guide: Introductory guide: outcomes-based contracting (Government Outcomes Lab)

Blog: Learning outcomes at all costs – is outcomes-based funding in the education sector a smart buy? (Laura Bonsaver, Government Outcomes Lab)

This session drew on recent research from Government Outcomes Lab and the Sorbonne Business School in Paris (IAE) to explore the role of cross-sector partnerships and innovative financing tools in supporting refugees.

We shared learnings from two innovative yet different approaches used in Finland and France within employment and housing.

The KOTO project was launched in Finland as the world’s first social impact bond to support refugees into employment. It illustrates the potential of outcomes contracts to convene government, the social sector, and investors around shared objectives. Meanwhile, the Hemisphere project in France aimed at providing accommodation to refugees and asylum seekers and demonstrates innovation in public private partnerships. The session combined key learnings from both cases with views from practitioners and engaged researchers.

Resources

Introductory guide: Outcomes-based contracting (Government Outcomes Lab)

Find out more: Social Outcomes Contracting (European Investment Advisory Hub's Social Outcomes Contracting Platform)

Find out more: KOTO SIB

Case study: KOTO SIB (European Investment Advisory Hub's Social Outcomes

Contracting Platform)

Case study: Hemisphere project (European Investment Advisory Hub's Social Outcomes

Contracting Platform)

Blog: The global refugee system is broken. Can innovative financing and cross-sector collaborations help fix it? (Tanyah Hameed, Government Outcomes Lab)

This session investigated the use of outcomes contracting as a potential approach to foster cohesive cross-sector collaborations to improve social outcomes.

We drew on Government Outcomes Lab’s recently published interim report on the Kirklees Integrated Support Service and Better Outcomes Partnership, which outlines four hypothesised features of social impact bonds that are expected to improve service delivery.

The Kirklees project aims to support adults who face barriers to living independently and who have historically experienced poor and fragmented provision from lots of different parts of the state and voluntary sector – benefits, housing, mental health, sometimes criminal justice system. This case illustrates the wider potential of outcomes contracts as a structure to support an important coordination or ‘orchestration’ role across a complex set of local provider organisations.

The session combined these emerging research insights with views from practitioners and engaged researchers, focussing on addressing fragmentation in public services and building holistic ecosystems of support.

Resources

Report: The Kirklees Integrated Support Service Social Impact Bond evaluation report (Government Outcomes Lab)

Guide: Introduction to outcomes based contracting (Government Outcomes Lab)

Book summary: Measuring social change summary note (Alnoor Ebrahim, Tufts University)

Video: Measuring social change (Tufts Talks, Tufts University)

Blog: Service fragmentation in social services - how can ecosystem orchestrators and outcomes contracts help? (Tanyah Hameed, Government Outcomes Lab)

After our summer break, the Engaging with Evidence series returned with a deep dive session on lessons learnt from key stakeholders of the Cameroon Kangaroo Mother Care DIB.

The Kangaroo Mother Care (KMC) Development Impact Bond (DIB) was launched in February 2019 to improve neonatal health outcomes in ten public hospitals across five regions in Cameroon through the delivery of quality Kangaroo Mother Care (KMC). Addressing the high rate of under-five mortality in Cameroon, KMC is an intervention for saving and caring for infants by administering continuous skin-to-skin contact, breastfeeding, and early discharge from hospital with follow-up. As the programme came to an end in September 2021, those involved in the delivery of the programme undertook a multi-stakeholder learning exercise to reflect on the DIB’s decision-making and governance structures, data and learning mechanisms, financial structure, management systems, and how to sustain impact after the DIB.

In this session, we explored what the key lessons were for the stakeholders involved in this programme, what results were achieved, what comes next after the DIB, and what this might tell us about the potential to use outcomes-based approaches to introduce and scale social interventions.

Resources

Case study: Cameroon Kangaroo Mother Care Development Impact Bond (Government Outcomes Lab)

Report: Cameroon KMC DIB end of programme report 2018-2021 (Social Finance)

[French version]: Obligation à impact sur le développement pour la MMK au Cameroun 2018-2021 (Social Finance)

Report: Changing Lives, Changing Systems: Building routes to scale (Social Finance)

Blog: Scaling and sustaining the impact of a development impact bond programme – what does it take? (Laura Bonsaver, Government Outcomes Lab)

For the sixth session of our Engaging with Evidence series, we brought together academic and practitioner perspectives to reflect on the role of outcomes-based financing and impact bonds in building resilient services during the Covid-19 pandemic.

Date: 14 June 3:30-5:00pm BST

Covid-19 has exacerbated gaps in financing and delivery of public services. Across the world, there is a need to respond to growing demand pressures but governments’ abilities to do so are constrained by adverse effects on already-stretched public finances and government operations. While outcomes-based financing and impact bonds have recently gained traction as helpful tools, can their strengths be channeled towards post-pandemic recovery?

We invited leading experts to reflect on the resilience of outcomes-based contracting during Covid-19 and their role in post-pandemic recovery. This discussion was built on recent research from the Government Outcomes Lab and the World Bank, discussing the opportunities these tools can bring as well as complications that need to be addressed.

Resources

• World Bank Group, 2021: Outcome-Based Financing for Service Delivery: with key considerations for the recovery from COVID-19
• Manchester Metropolitan University and University of Southern California: Social impact bonds 2.0?: Can impact bonds help to cure "social long Covid"?
• The Brookings Institution: Harnessing private capital and tying funding to results to build back better
• The Brookings Institution: Partnerships for public purpose: The new PPPs for fighting the biggest crises of our time
• The Brookings Institution: What happens in an outcome-based financing model when a major crisis hits?
• The Brookings Institution: Measuring the success of impact bonds
• Blog (Tanyah Hameed, GO Lab, 2021): How can impact bonds help build back better?

For the fifth session of the Engaging with Evidence series, we took stock of the state of play of social outcomes contracts in Europe and discussed with policymakers and other leading experts how and when this instrument can best be used to help address complex social problems.

We were joined by a group of expert policymakers and leading practitioners from around Europe to take stock of the state of play on SOCs in the continent. Together, we reflected on how this model is being adapted in different contexts and sought to understand how these financing mechanisms can be best applied. To recognise some of the practical considerations for successful development and implementation of SOCs, we looked at some of the countries that have been leading the way with SOCs in Europe, and explored the drivers, success factors and constraints underpinning these initiatives.

The session drew on practitioners' insights and data from the Government Outcomes Lab's Impact Bond Dataset to explore how social outcomes contracts (SOCs) are being adopted and adapted across Europe to address a wide range of social problems. 

Resources

• Social outcomes contracting in Europe: An introductory guide to social outcomes contracting in European Union Member States (European Investment Bank; GO Lab; European Commission, 2021)
• Social outcomes contracting to support social investment: European examples (European Investment Bank, 2020)
• Introductory guide to impact bonds (GO Lab's online technical guidance)
• Blog (Tanyah Hameed, GO Lab, 2021): Experimenting with social outcomes contracts - what has Europe learned?

For the fourth session of our Engagement with Evidence series, we hosted an online session on the global landscape of outcomes funds. The session drew on recent research conducted by the Government Outcomes Lab and practitioners' insights into the design and implementation of outcomes funds. 

We brought together academic and practitioner perspectives to take stock of the global landscape of outcomes funds and explore the various approaches to these funds in different contexts and geographies. The discussion was anchored in recent empirical research conducted by the Government Outcomes Lab (GO Lab) that investigates the rationales for developing outcomes funds in the UK and internationally, and offers an analytical framework for characterising outcomes funds. 

Speakers included senior researchers from the GO Lab at the University of Oxford, alongside experts from the UK Government, the Education Outcomes Fund, Social Finance and Instiglio.  

Resources:

• Introductory guide (Government Outcomes Lab): Outcomes funds
• Blog (Tanyah Hameed, GO Lab, 2021): How are outcomes funds evolving over time?

For the third session of our Engagement with Evidence series, we hosted an online session on new evidence and insights from the world's first development impact bond for maternal health, the Utkrisht Impact Bond.

The session provided implementation insights from the main stakeholders involved in the Utkrisht development impact bond, the world's first maternal and newborn health impact bond. We drew on Mathematica's recent midline report which outlines findings and insights from this experiment in innovative finance for maternal health. 

We were joined by a leading panel of speakers from across the globe. They brought expertise on social innovation, global health, health financing and international development, as well as their own practical experience working on impact bonds. 

Resources:

• Full midline report (Mathematica, 2020): Maternal Health Care Quality and Outcomes Under the Utkrisht Impact Bond: Midline Findings and Insights
• Case study: The Utkrisht Impact Bond

For the second session of our Engagement with Evidence series, we hosted an online session on new evidence and insights from four Development Impact Bonds (DIBs) across Africa and Asia.

We drew on a recent Ecorys report which captures lessons from the delivery phase of FCDO’s DIBs pilot programme. Through this, we explored key ingredients in DIBs to increase efficiency and effectiveness, the conditions for DIBs to be an appropriate commissioning tool, and the costs and benefits of using them. 

We were joined by a leading panel of speakers from across the globe. They brought expertise on impact investment, humanitarian aid and international development, as well as their own practical experience in impact bond management. 

Resources:

• Summary report on delivery stage (Ecorys & FCDO, 2021): Findings from the second research wave of the Independent Evaluation of the FCDO Development Impact Bonds Pilot Programme 
  
• Full report on delivery stage (Ecorys & FCDO, 2021): Findings from the second research wave of the independent Evaluation of the FCDO Development Impact Bonds Pilot Programme
• Infographics from second research wave (Ecorys & FCDO, 2021): Lessons learnt from the SIB effect, The DIB black box unpacked & DIBs and Covid.
• Report on design stage (Ecorys, 2019): Independent Evaluation of the UK Department for International Development’s DIBs Pilot Programme – Full Report
• Blog (Tanyah Hameed, GO Lab, 2021): When are development impact bonds a good idea?

To launch GO Lab’s Engaging with Evidence series, we hosted an online session on new evidence and insights from the implementation of social impact bonds (SIBs) in Latin America.

To launch GO Lab’s Engaging with Evidence series, we hosted an online session in partnership with Ecorys and the Innovation Lab of the Inter-American Development Bank Group (IDB Lab), focussing on new evidence and insights from the process of developing social impact bonds (SIBs) in Latin America. The session drew on a recent Ecorys report which captures lessons from the experience of introducing SIBs in five Latin American countries: Colombia, Argentina, Chile, Mexico and Brazil. We explored key factors for developing the SIB ecosystem, discussed how these can be applied elsewhere, and invited participants to share their experiences from different contexts.

We were joined by a leading panel of speakers from across the globe. They brought expertise on impact investment, social innovation and development finance as well as their own practical experience in launching and leading social impact bonds in the region.

Resources:

• Full report (Ecorys & IDB Lab, 2020): Social Impact Bonds in Latin America: IDB Lab's Pioneering Work in the Region: Lessons Learnt
• Blog (Tanyah Hameed, GO Lab, 2021): How is Latin America developing impact bonds?