Evaluations 2017

Finland Market Entry Project Retrospect

by: Timothy McCann [October 2017]

This document describes the project Lessons identified at the end of the market entry planning phase for MSF in Finland. It summarises the successes and challenges encountered during the project, lists the learning themes arising from these successes and challenges, and includes a set of lessons derived from an analysis of these learning points. The Annex contains a proposed (brief) framework with criteria and pre-requisites for a successful Market Entry Plan in MSF based on this experience. NOTE: This is not an evaluation and therefore there is no ambition for independent judgement.

REPORT


Humanitarian health assistance course evaluation: MSF Sweden initiative to prepare first missioners

by: Eva P. Rocillo Aréchaga [October 2017]

In 2013, MSF Sweden contracted a third-party service provider to set up a medical course known as Humanitarian Health Assistance (HHA). HHA is targeted at doctors and nurses recently recruited by MSF. Its objective is to prepare them for their first mission with MSF. The course, accredited with 15 ETCs, is organized by the Swedish Red Cross University College with Karolinska Institutet. This evaluation aims at fostering a better understanding of course outputs and outcomes, in order to support informed decisions to move forward.

REPORT


Evaluation of MSF Intersectional Comms Pool

by: Kristen Bègue [October 2017]

In May 2015, MSF launched an  intersectional pool management system for international field communication profiles and positions. The main rationale triggering the initiative was the difficulty to recruit and retain competent communication professionals for field positions, as well as the willingness to invest in field capacity and serve operations better.  This evaluation aims at capitalizing on lessons learned during the pilot phase as well as providing adequate information and recommendations to support decision-making regarding the way forward.

REPORT


Evaluation de la gestion hospitalière

by: Annie Désilets and Ines Hake [October 2017]

Au cours des dernières années, MSF-OCG a élaboré une politique opérationnelle avec l'ambition d'augmenter et d'améliorer la quantité et la qualité des structures de soins secondaires (ou soins hospitaliers). Cette situation a incité MSF à examiner de plus près les défis, les enseignements et les réalisations en matière de gestion hospitalière afin d'élaborer des stratégies gagnantes pour le démarrage, l'opération et la fermeture de projets pour patients hospitalisés, dans tous les types de contextes.

REPORT(only available in French)


Assessment of MSF International Remuneration System (IRP2) 

by: Annie Désilets and Shana O’Brien [September 2017]

The review of the IRP2 system was conducted from February to September 2017 with the goal to measure the relevance, effectiveness, appropriateness, and connectedness of the system. The evaluation also had the mandate to formulate recommendations for adjustments to the IRP2 system where appropriate.

REPORT


MSF OCB Hurricane Matthew Emergency Response 2017: Reconstruction Materials Distribution

by: Malik Allaouna and Simon Deprez [September 2017]

OCB has undertaken to learn from its emergency intervention to support the victims of Hurricane Matthew, during which it experienced difficulties providing shelter and reconstruction relief. The aim is to evaluate the distribution of reconstruction materials in remote and hard to reach areas covering the entire duration and geographical area; Grand’Anse and Sud Department from 6 October 2016 to 20 February 2017.

REPORT


“THANK GOD, THEY CAME TO LISTEN TO US”: AN INTERMEDIATE EVALUATION OF THE MENTAL HEALTH PSYCHOSOCIAL STRATEGY OF BUENAVENTURA PROJECT, COLOMBIA

by: Helena Manrique [August 2017]

OCBA commenced a new mental health intervention in the city of Buenaventura in February 2015 with the aim to support victims of violence. The project was set up to demonstrate an innovative approach with two principle elements: a) a focus on a mass media campaign as the main means of communication, and b) a provision of therapeutic sessions on the phone. This mid-term evaluation was commissioned to assess appropriateness, effectiveness and efficiency of this intervention after the first 14 months for future adjustments in the project but also for a transfer of lessons to other similar situations, if relevant.

REPORT


MSF OCB Field Opportunity Envelope Review

by: Hélène Juillard and Clément Charlot [August 2017]

In November 2015, MSF-OCB launched a pilot initiative, the Field Opportunity Envelope (FOE), with the objective to give autonomy to field staffs to rapidly and without validation meet the needs of the communities in their intervention area. Each project could request either 100,000 or 200,000 euros, provided that their initiative met a set of criteria. This light review aims to take stock of how it has been received and used by operations and make recommendations for its future development.

REPORT


Evaluation of MSF-OCB Torture Rehabilitation Projects

by: Currun Singh and Eva P. Rocillo Aréchaga [July 2017]

It has been five years since MSF-OCB´s first concrete actions on torture and three years since the launch of the torture rehabilitations projects. Sufficient time has now elapsed to evaluate MSF´s trio of clinics and to make recommendations for their improvement, as well as to identify cross-cutting lessons applicable to future efforts in similar contexts. This is especially important as the clinics represent the first experiences for MSF in the specialized rehabilitation of victims.

REPORT


MSF OCB Bureaucratisation Review

by: Hélène Juillard, Marion Péchayre, and Lauren Weiss [June 2017]

In 2015 MSF-OCB launched a review to assess the perception, by the field teams, of an increased organisational “bureaucratic” burden. The review spanned three phases, from problem identification, to an in depth field study, to a final phase of webinars to improve the coverage and overall accuracy of the findings. The review process culminated in 2 missions agreeing to pilot a new monitoring and reporting system based on the principles coming out of the review, starting asap

REPORT


Review of IRFFG implementation in Haiti, 2016

by: Yves Sonnay [June 2017]

In May 2016, concerns were raised at OCB HQ about the potential underestimation of the general IRFFG implementation costs. The OCB mission in Haiti had to retroactively disburse an unbudgeted 1.33M€ of severance pay to their staff, more than a year after the IRFFG implementation in the country. The OCB HR director requested this review of the implementation process in Haiti in order to document the lessons learned, to mitigate future negative operational consequences of implementation, and to improve capacity for future implementation in other contexts, and of other international/inter-sectional HR tools. OCA and OCP, the two other OCs presents in Haiti agreed to participate in this review.

REPORT(ENG) / REPORT(FRE)


Hospital Management Review

by: Annie Désilets and Ines Hake [March 2017]

In the last few years, MSF OCG has developed an Operational Policy with the ambition to increase and improve the quantity and quality of secondary health care structures (or inpatient care). This recognition has prompted the organization to take a closer look at the challenges, lessons and accomplishments in terms of hospital management to develop strategies that will enable the organization to successfully set up, govern, implement and exit inpatient projects in all types of contexts. The Hospital Management Review was extremely well received throughout the various layers of interviews; from the directors at the headquarters to the hospital managers of the MoH working with MSF in projects. OCG, while providing a higher standard of care for patients, must also contribute at a higher level to the management of the hospitals in which they intervene. There are some exemplary projects where the organization has attempted to introduce new ways of working and approaches that, in the long term, can yield some very positive results. The trial of a new hospital set-up in Haiti and the “integrative” approach at the Bol hospital in Chad are cases in point.

REPORT


RETROSPECT: OCB Tete Burns Victims Response, Mozambique (2016)

by: Stockholm Evaluation Unit [March 2017]

After a very intense and difficult one week response to support the MoH Hospital with specialised burn trauma capacity, the cell and mission brought in Stockholm Evaluation Unit to facilitate an internal Retrospect process to help the team identify key lessons and to bring closure to the project team. Note, the Retrospect does not aim to make independent judgement or analysis, only to facilitate bringing out the lessons and to help synthesize these into actionable outcomes.

REPORT


MSF IN AFGHANISTAN Evaluation of the single representation setup

by: Dan Sermand and Cedric Martin [Februray 2017]

Since MSF’s return to Afghanistan in 2009, its operations on the ground have been monitored with a spyglass, unlike any other mission in this kind of environment. Consequently, OCs have been pushed to innovate but also remain critical vis-a-vis their respective strategies and the overall modus operandi of the Afghan mission. This evaluation of the single representation set up aims to analyse and learn from the current state of affairs of the Afghan mission in view of possible ways forward. More specifically, it analyses the capacity and the possibility for the mission to do more within the framework of single representation and the current set up of support departments both at OC and Field levels

REPORT


Innovation Strategy 2IM

by: Peter Giesen, Lydia tanner and Guy White [Februray 2017]

MSF OCG’s Initiative for Medical Innovation (2IM) has successfully introduced the beginnings of a change in organisational culture through a number of innovation projects. Every department has now adopted the notion of innovation and risk taking and a mindset of challenging the status quo. We have found evidence that the 2IM Initiative has, with a degree of success, started to address an identified latent risk aversion in OCG. Any form of organisational change must be expected to lead to tensions within the status quo, and to some extend this was even intended and deemed necessary. However, a lack of clarity on terminology, roles, responsibilities, functionalities and business processes incorporated risks which were not always well understood or managed, particularly during the design stage of the 2IM Initiative and in some cases exacerbated during implementation.

REPORT


MSF OCB Stop Stock Out Project , South Africa (2016)

by: Andrew McKenzie and Timothy McCann [January 2017]

SSP was formed in the aftermath of a high profile depot crisis in South Africa in 2012/3, with six organisations, already dealing with drug stock outs joining forces to tackle the issue. The different organisations brought different skills to the table. Largely focused on anti-retrovirals (ARVs) and TB medication, from the beginning the SSP has tasked itself to hold government accountable, to perform a watchdog role and to present the patient view on stock outs. This evaluation shows the impact of the SSP since inception and identifies best ways to capitalise on the early success of the project. 

REPORT

By: Association Intern