Differentiated Monitoring
and Evaluation

At the first CQUIN meeting, member countries identified differentiated monitoring and evaluation (M&E) as an urgent, cross-cutting challenge. Differentiated service delivery (DSD) creates potential challenges for routine M&E, as the information needed to track implementation of differentiated ART (DART) models is often not captured by routine M&E systems. In addition, as many DART services are delivered outside of health facilities, HIV programs must implement appropriate tools and strategies to ensure swift and accurate flow of data from the community to health facilities and beyond. As CQUIN countries launch and diversify DART services and take them to scale, M&E systems must evolve and adapt.  

In response, CQUIN is:

  • Supporting member countries to use the CQUIN dashboard as a self-assessment tool 
  • Creating a portfolio of frameworks and resources
  • Facilitating a multi-country community of practice focused on ongoing experience-sharing and resource co-creation
  • Providing targeted technical assistance to member countries
  • Supporting ad hoc data collection and DSD performance reviews

In 2020, CQUIN will also provide technical assistance to countries with electronic medical records to enhance DSD-specific data queries and data visualization.

Frameworks and Tools

M&E Framework for Monitoring of Differentiated ART Services
(English PDF  French PDF)

Developed by the CQUIN M&E community of practice, this framework prioritizes M&E measures to track the scale-up, coverage, and performance of DART services. It is intended to serve as an adaptable tool for ministries of health and program implementers leading DART scale-up and/or supervision.

DSD Performance Review Toolkit

In response to the need for a standardized approach to obtaining DSD data and conducting performance reviews in the absence of routine reporting on DSD indicators, the CQUIN M&E community of practice is developing a toolkit that provides step-by-step guidance on planning for the review, conducting data collection and analysis, holding a dissemination meeting, and developing action plans. The adaptable toolkit, which is based on lessons learned and best practices from performance reviews conducted by CQUIN network countries in 2019, will be available for download in early 2020.

Meaningful Community Engagement Framework

Developed by the CQUIN Community Engagement community of practice, this framework was designed to move toward a definition of meaningful community engagement in policy, implementation, and evaluation at national, program, and community levels. In 2020, the community of practice will develop and pilot a companion assessment tool.

CQUIN Dashboards

The CQUIN Dashboard is a structured self-assessment tool that systematically describes the progress of national initiatives to scale up DSD using a capability maturity model approach. The tool can be used by policymakers to identify implementation gaps and facilitate decision-making.

CQUIN supports baseline and annual DSD dashboard assessments in each of its network countries to track progress and identify areas of common challenges. Country teams present their progress to the CQUIN community each year, most recently in country posters at the third annual CQUIN meeting in November 2019. This process has shown that most countries have made substantive progress toward developing supportive DSD policies, scale-up plans, guidelines, and training materials. Many countries have also improved the coordination of DSD services and have developed standard operating protocols, job aides, and M&E tools.

Sub-National Dashboard

Based on feedback from CQUIN member countries, a sub-national version of the dashboard was designed to provide ministries of health with information on provincial and/or district progress in DSD scale-up. The tool, which has been piloted in several countries, is easily adaptable to meet local needs.

Community of Practice

In 2017, CQUIN launched a community of practice focused on experience-sharing and co-creation of resources for differentiated M&E. The community of practice includes 26 participants from six countries—Côte d’Ivoire, Eswatini, Mozambique, Uganda, Zambia, and Zimbabwe. Read more about the differentiated M&E community of practice here.

DSD Performance Reviews

Because many national M&E systems are not yet set up to routinely collect DSD data, CQUIN supports performance reviews that enable countries to answer priority questions about DSD scale-up. Performance reviews use primary data collection and a sampling approach to obtain a snapshot of the performance of national DSD programs, with the goal of informing programmatic decision-making.

In 2019, ministries of health in Zimbabwe, Uganda, and Côte d’Ivoire conducted regional DSD performance reviews with support and technical assistance from CQUIN. Each country presented results and lessons learned from the review—as well as their country-specific action plans—at CQUIN’s annual meeting in November 2019. The CQUIN differentiated M&E community of practice is now developing a toolkit that will support countries to implement DSD performance reviews independently.

Articles

Patient- and Program-level M&E of DSD for HIV: A Pragmatic and Parsimonious Approach is Needed (2018)

In this viewpoint article featured in AIDS, ICAP Epidemiologist William Reidy, PhD, MPH and CQUIN colleagues highlight common gaps in M&E systems with respect to DART services. The authors also outline elements of an integrated, streamlined approach that provides information to guide patient and program management, while minimizing the burden of data collection and aggregation.

A Pragmatic Approach to Monitor and Evaluate Implementation and Impact of Differentiated ART Delivery for Global and National Stakeholders (2018)

In this article published in the Journal of the International AIDS Society, CQUIN stakeholders define a pragmatic approach to the M&E of the scale-up of differentiated ART delivery for global and national stakeholders.

Presentations


Implementing Differentiated Service Delivery: Differentiated M&E: A presentation by ICAP Epidemiologist William Reidy PhD, MPH from the 2017 IAS conference.

CQUIN 2019: Where are we now? A presentation by Miriam Rabkin, MD, MPH, ICAP Director for Health Systems Strategies

Assessing Client and Healthcare Worker Satisfaction to Inform Implementation and Scale Up of Differentiated Service Delivery for People Living with HIV Preliminary Findings: A presentation by Hervé Kambale, MD, MPhil, DSD Technical Advisor, Ministry of Health of Eswatini

More CQUIN Network Focus Areas

Senegal

Senegal

Senegal joined the CQUIN learning network in 2020.

Ghana

Ghana

Ghana joined the CQUIN learning network in 2020.

Pre-meeting Interviews

Pre-meeting Interviews

The Importance of AHD Find out from leading experts across the globe why we must continue to pay...

Newsletter Signup