At the first CQUIN meeting, member countries identified differentiated monitoring and evaluation (M&E) as an urgent, cross-cutting challenge. Differentiated service delivery (DSD) creates potential challenges for routine M&E, as the information needed to track implementation of differentiated ART (DART) models is often not captured by routine M&E systems. In addition, as many DART services are delivered outside of health facilities, HIV programs must implement appropriate tools and strategies to ensure swift and accurate flow of data from the community to health facilities and beyond. As CQUIN countries launch and diversify DART services and take them to scale, M&E systems must evolve and adapt.
In response, CQUIN is:
- Supporting member countries to use the CQUIN dashboard as a self-assessment tool
- Creating a portfolio of frameworks and resources
- Facilitating a multi-country community of practice focused on ongoing experience-sharing and resource co-creation
- Providing targeted technical assistance to member countries
- Supporting ad hoc data collection and DSD performance reviews
In 2020, CQUIN provided technical assistance to countries with electronic medical records to enhance DSD-specific data queries and data visualization.
- Frameworks and Tools
- CQUIN Dashboards
- Community of Practice
- DSD Performance Reviews
Frameworks and Tools
Developed by the CQUIN M&E community of practice, this framework prioritizes M&E measures to track the scale-up, coverage, and performance of DART services. It is intended to serve as an adaptable tool for ministries of health and program implementers leading DART scale-up and/or supervision.
In response to the need for a standardized approach to obtaining DSD data and conducting performance reviews in the absence of routine reporting on DSD indicators, the CQUIN M&E community of practice has developed a toolkit that provides step-by-step guidance on planning for the review, conducting data collection and analysis, holding a dissemination meeting, and developing action plans. The adaptable toolkit is based on lessons learned and best practices from performance reviews conducted by CQUIN network countries in 2019.
Meaningful Community Engagement Framework
Developed by the CQUIN Community Engagement community of practice, this framework was designed to move toward a definition of meaningful community engagement in policy, implementation, and evaluation at national, program, and community levels. In 2021, the community of practice will develop and pilot a companion assessment tool.
The CQUIN Dashboard is a structured self-assessment tool that systematically describes the progress of national initiatives to scale up DSD using a capability maturity model approach. The tool can be used by policymakers to identify implementation gaps and facilitate decision-making.
CQUIN supports baseline and annual DSD dashboard assessments in each of its network countries to track progress and identify areas of common challenges. Country teams present their progress to the CQUIN community each year, most recently in country posters at the third annual CQUIN meeting in November 2019. This process has shown that most countries have made substantive progress toward developing supportive DSD policies, scale-up plans, guidelines, and training materials. Many countries have also improved the coordination of DSD services and have developed standard operating protocols, job aides, and M&E tools.
Based on feedback from CQUIN member countries, a sub-national version of the dashboard was designed to provide ministries of health with information on provincial and/or district progress in DSD scale-up. The tool, which has been piloted in several countries, is easily adaptable to meet local needs.
Community of Practice
DSD Performance Reviews
Because many national M&E systems are not yet set up to routinely collect DSD data, CQUIN supports performance reviews that enable countries to answer priority questions about DSD scale-up. Performance reviews use primary data collection and a sampling approach to obtain a snapshot of the performance of national DSD programs, with the goal of informing programmatic decision-making.
In 2019, ministries of health in Zimbabwe, Uganda, and Côte d’Ivoire conducted regional DSD performance reviews with support and technical assistance from CQUIN. Each country presented results and lessons learned from the review—as well as their country-specific action plans—at CQUIN’s annual meeting in November 2019. The CQUIN differentiated M&E community of practice is now developing a toolkit that will support countries to implement DSD performance reviews independently.
In this viewpoint article featured in AIDS, ICAP Epidemiologist William Reidy, PhD, MPH and CQUIN colleagues highlight common gaps in M&E systems with respect to DART services. The authors also outline elements of an integrated, streamlined approach that provides information to guide patient and program management, while minimizing the burden of data collection and aggregation.
In this article published in the Journal of the International AIDS Society, CQUIN stakeholders define a pragmatic approach to the M&E of the scale-up of differentiated ART delivery for global and national stakeholders.
Implementing Differentiated Service Delivery: Differentiated M&E: A presentation by ICAP epidemiologist William Reidy PhD, MPH from the 2017 IAS conference.
CQUIN 2020: Where Are We Now? A presentation by Miriam Rabkin, MD, MPH, ICAP director for Health Systems Strategies
An introduction to the CQUIN DSD Performance Review Toolkit, A presentation by Andrea Schaaf, MPH, ICAP strategic information specialist.
Assessing Client and Healthcare Worker Satisfaction to Inform Implementation and Scale-Up of Differentiated Service Delivery for People Living with HIV Preliminary Findings: A presentation by Hervé Kambale, MD, MPhil, DSD technical advisor, Ministry of Health of Eswatini