Wilbroad Mutale1,2*, Namwinga Chintu1 , Cheryl Amoroso3, Koku Awoonor-Williams4, James Phillips5, Colin Baynes5,6, Cathy Michel7, Angela Taylor1, Kenneth Sherr8
1. Centre for Infectious Disease Research in Zambia, Zambia.
2. School of Medicine, University of Zambia, Zambia.
3. Partners In Health/Inshuti Mu Buzima, Rwanda.
4. Upper East Regional Health Directorate, Ministry of Health, Ghana.
5. Heilbrunn Department of Population and Family Health, Mailman School of Public Health, Columbia University, NY, USA.
6. Ifakara Health Institute , Mikocheni, Dar-es-Salaam, Tanzania.
7. Health Alliance International, Direcçao Provincial de Saúde, Beira, Sofala, Mozambique.
8. Department of Global Health, University of Washington, Seattle, USA.
Download PDF
Correspondence: Wilbroad Mutale (wmutale@yahoo.com)
Citation style for this article: Mutale W, Chintu N, Amoroso C et al.Improving health information systems for decision making across five sub-Saharan African countries: Implementation strategies from the African Health Initiative. Health Press Zambia Bull. 2018;2(12); pp 4-16. This work has been adapted from the original article “[ Improving health information systems for decision making across five sub-Saharan African countries: Implementation strategies from the African Health Initiative]” by [Wilbroad Mutale, Namwinga Chintu, Cheryl Amoriso, Koku Awoonor-Williams, James Phillips, Colin Baynes, Cathy Michel, Angela Taylor, Kenneth Sherr and with input from the Population Health Implementation and Training – Africa Health Initiative Data Collaborative]. BMC Public Health Services 2013, 13(Suppl 2):S9 (https://doi.org/10.1186/1472-6963-13-S2-S9; https://bmchealthservres.biomedcentral.com/articles/10.1186/1472-6963-13-S2-S9). The original article is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Weak health information systems (HIS) are a critical challenge to reaching the health-related Millennium Development Goals because health systems performance cannot be adequately assessed or monitored where HIS data are incomplete, inaccurate, or untimely. The Population Health Implementation and Training (PHIT) Partnerships were established in five sub-Saharan African countries (Ghana, Mozambique, Rwanda, Tanzania, and Zambia) to catalyze advances in strengthening district health systems. Interventions were tailored to the setting in which activities were planned.
Comparisons across strategies:
All five PHIT Partnerships share a common feature in their goal of enhancing HIS and linking data with improved decision-making, specific strategies varied. Mozambique, Ghana, and Tanzania all focus on improving the quality and use of the existing Ministry of Health HIS, while the Zambia and Rwanda partnerships have introduced new information and communication technology systems or tools. All partnerships have adopted a flexible, iterative approach in designing and refining the development of new tools and approaches for HIS enhancement (such as routine data quality audits and automated troubleshooting), as well as improving decision making through timely feedback on health system performance (such as through summary data dashboards or routine data review meetings). The most striking differences between partnership approaches can be found in the level of emphasis of data collection (patient versus health facility), and consequently the level of decision making enhancement (community, facility, district, or provincial leadership).
Discussion:
Design differences across PHIT Partnerships reflect differing theories of change, particularly regarding what information is needed, who will use the information to affect change, and how this change is expected to manifest. The iterative process of data use to monitor and assess the health system has been heavily communication dependent, with challenges due to poor feedback loops. Implementation to date has highlighted the importance of engaging frontline staff and managers in improving data collection and its use for informing system improvement. Through rigorous process and impact evaluation, the experience of the PHIT teams hope to contribute to the evidence base in the areas of HIS strengthening, linking HIS with decision making, and its impact on measures of health system outputs and impact.
Background:
Health Information Systems (HIS) are one of the six essential and interrelated building blocks of a health system. A well-functioning HIS should produce reliable and timely information on health determinants, health status and health system performance, and be capable of analyzing this information to guide activities across all other health system building blocks [1]. Thus, an HIS enables decision-makers at all levels of the health system to identify progress, problems, and needs; make evidence-based decisions on health policies and programs; and optimally allocate scarce resources [2-4] – all of which are key elements in the success of large-scale efforts to achieve health improvements [5]. Weak HIS are a critical challenge to reaching the healthrelated Millennium Development Goals [6,7]. Evaluations of routine health facility data have identified consistent problems in HIS completeness, accuracy and timeliness in low- and middle-income country (LMIC) health settings [8,9], which limit HIS use for routine primary health care (PHC) planning, monitoring, and evaluation [10-12]. Other factors associated with poor quality data in resource constrained settings include duplicate, parallel reporting channels and insufficient capacity to analyze and use data for decision making [13]. Improving HIS functioning is a priority given its central role in the delivery of equitable and high quality health services, though approaches to improving HIS vary. Simple data quality assessments that engage frontline health workers and data managers have been used to verify, standardize, and improve routine HIS data [14-16]. Other approaches have focused on technological interventions such as information communication technologies (ICT) designed to reduce errors through reducing data bulkiness and automating data collection, validation, and analysis [4,17,18]. To ensure that HIS contribute to improved health services, it is essential that policy makers and health system managers utilize available information for ongoing monitoring of plans and programs, as well as for resource allocation purposes. Information management is a basis for the production of knowledge and its translation for health system decision making [19-21]. Further evidence is needed on effective strategies for linking data system improvements with decision making, including its impact on the delivery of health services and population health. The Doris Duke Charitable Foundation launched the African Health Initiative to catalyze significant advances in health systems strengthening through supporting Population Health and Implementation Training (PHIT) Partnerships in five sub-Saharan African countries (Ghana, Mozambique, Rwanda, Tanzania and Zambia) [29]. All five PHIT Partnerships include approaches to strengthen the HIS building block as a means of improving health service delivery and, ultimately, population level health. Despite the common goal of improving data capture to support timely decision making, each partnership uses project-specific strategies to strengthen HIS and improve decision making and to target different levels of the health system, including health managers, clinicians, and the community. The full description of each partnership’s methodology is described elsewhere [30-35]. This paper describes, compares, and contrasts the five PHIT Partnership approaches to strengthen HIS and promote the use of data for decision making, focusing on the designs, activities, and the adaptations during the implementation process.
PHIT Partnership approaches to improve HIS and decision making
Table 1 summarizes the range of models to improve HIS across the five PHIT countries, focusing on integration approaches with the MOH’s HIS, strategies for improving data quality, procedures for handling and manipulating data, strategies for linking data to decision making, and sustainability plans.
Ghana
The Ghana PHIT Partnership (the Ghana Essential Health Intervention Project, or GEHIP), has two intervention strategies to strengthen the HIS and link information with improved health system operations. The first is to implement a simplified information capturing system as part of the District Health Information Management System (DHIMS-2) that focuses on essential information for district level planning, thereby reducing the reporting burden in primary care settings (Figure 1). The second is the adoption of a District Health Planning and Reporting Toolkit (DiHPART) for use by district health leadership to identify and allocate resources based on the district level burden of disease profile.
Rationale and contextual appropriateness
Data capture for DHIMS-2
Simplified registers were introduced to standardize data sources, and to ensure consistent supply of registers for community health officers (CHOs). The simplified registers also allow health facilities to rapidly tally figures for monthly summary reports in order to address complex data capture responsibilities that occupied more frontline staff time than clinical service delivery [22]. Prior to the adoption of the simplified registers, maintaining patient encounter registers was complex and cumbersome, involving 27 register books to collect information on patient attendance at outpatient consults, maternity, well-child care, family planning, and home visits. Collating and reporting health information was particularly tedious for CHOs, who record, compile, and report client encounters to sub-district and district levels.
Planning and budgeting with DiHPART
Based on the observation that national decentralization policies lack appropriate training and tools for district leaders to base priorities on need, the DiHPART tool was developed to assist managers with planning. As a means of basing decision-making on known patterns of risk, DiHPART removes the guesswork from budgeting, simplifying the task of strategic leadership for health resource allocation.
Activities and feedback mechanism Data capture for DHIMS-2
The GEHIP team worked with district and sub-district managers and CHOs to review, redesign, and implement the improved versions of the simplified registers over a one-year period. A detailed review was carried out to inventory baseline data collection (data fields collected, registers used), identify redundant information, and assess data collection for appropriateness and relevance for district health managers and CHOs. The physical size of the simplified registers was reduced to make them easier to carry during outreach activities. In the course of this iterative process, the simplified registers were piloted in one district and subsequently adapted to the need of all three GEHIP districts after feedback from CHOs and district health information officers. The data fields collected are regularly reviewed to keep them up to date with those collected by the Ghana Health Service. Procurement, distribution, and content revision functions have been fully integrated into the Upper East Regional Health Information Unit, which facilitates rapid adaptation, adoption, and continued use. In their final format, the simplified registers include five registers for CHOs to gather data on facility consults for outpatient, maternal and child care services, and outreach services in homes and schools. Although the initial goal was to develop a single register, delineation of functions within health facilities required five registers to collect clinical data when staff were deployed to outreach activities. To ensure data quality and its use, monthly and quarterly data validation meetings are held by CHOs, subdistrict, and district teams to review data collected and identify gaps. Subsequently, the data are compiled and submitted to the regional and national levels.
Planning and budgeting with DiHPART
DiHPART’s introduction included an orientation for district health management teams to provide an overview of the disease burden and its implications for current plans and activities, followed by identification of adaptations to align spending priorities with risk patterns. Disease burden models for DiHPART were based on cause of death data from locally derived data provided by the Navrongo Health Research Centre.
Adaptation and learning during implementation
Data capture for DHIMS-2
Qualitative appraisal of reactions to the simplified register system suggests that CHOs welcome the reduced documentation burden and additional time for service and outreach. Essential for the register simplification process has been coordination with national HIS reform (Figure 1), including streamlining data collection and aggregation operations (pathway A) , simplifying and computerizing feedback to all levels (pathway C), and enabling health workers to view data feedback and compare performance with counterparts (pathway D). GEHIP experience has identified additional areas for improvement. Efforts to use cell phone technology for data entry encountered technical problems. In addition, district and regional funds are insufficient to independently cover the recurrent supply cost, including CHO registers. This problem may be resolved when the simplified registers are adopted for nationwide implementation.
Planning and budgeting with DiHPART
The experience with implementing DiHPART has differed from expectations in multiple ways. The lack of flexible funds due to earmarked wages and donor requirements has led to a disconnect between DiHPART plans and actual expenditure, which has impeded implementation of DiHPART guided decision making. However, during its implementation, DiHPART has become an influential resource mobilization tool, providing district managers with evidence to lobby political officials for additional resources.
Mozambique
The Mozambique PHIT strategy focuses on strengthening the MOH’s established HIS through applying innovative approaches to improve HIS quality and foment its use for resource allocation, program monitoring, and service delivery improvements at the facility, district, and provincial levels (Figure 2). The Mozambique project has introduced simplified tools based on routine HIS data to highlight service delivery performance success and problems at the facility and district levels. The project team mentors district and facility health managers to use these tools for identifying, implementing and evaluating efforts to improve health system performance.
Rationale and contextual appropriateness
The PHIT strategy is designed to work within the MOH priorities, specifically to strengthen the quality and use of the existing information system (Módulo Básico). The partnership has adopted and modified nationally developedtraining modules and data assessment approaches in developing an intervention that is contextually appropriate for district managers.
The PHIT strategy endeavors to improve HIS quality from the facility, district, and provincial levels in Sofala province. Strengthening data for decision making focuses on the district level – the key management unit to support and monitor service delivery improvements at the facility level. Under the government of Mozambique’s decentralization program, district managers are increasingly responsible for resource allocation (including financial and non-financial resources, such as human resources), as well as monitoring and evaluating program activities. The PHIT strategy therefore builds district capacity for using data for decision making and supports their linkages with health facilities to lead to health system improvements.
Activities and feedback mechanism
Data quality includes training and supporting district and provincial statistics personnel to continuously monitor the performance of the HIS and the provision of timely feedback to facility and district managers to lead to incremental improvements in HIS quality. Furthermore, an annual data quality assessment (DQA) for primary health care (PHC) services is carried out in all districts in the PHIT intervention province, with feedback provided to district and health facility managers via a summary data quality ranking tool that acknowledges facilities with high data quality and identifies facilities with poor data quality for follow-up by health system managers and PHITsupported personnel [32]. After health facilities with glaring or persistent data quality problems are identified (those in the lowest category of the ranking process), district and provincial health managers provide supportive supervision to facility managers and staff that includes a re-introduction to the HIS and associated tools, clarification of timing and procedures for reporting, and reinforcement of the importance of the HIS. Technical and financial support is also provided to develop and maintain infrastructural capacity to computerize facility summary reports at the district level and send them electronically for monthly collation at the provincial level. Identifying problems and making informed decisions based on up-to-date data from the HIS is promoted at the facility, district, and provincial levels. District and facility managers are trained and mentored to build competencies and routine practices for basic data analysis, including indicator development and secular trend analysis. Simple tools and graphical representations using routinely collected data have been developed, field tested, and implemented for health system managers to use for monitoring primary health care indicators, target interventions, target resources at the district (to improve facility performance), and provincial levels (to improve district performance) [32] and evaluate whether interventions have led to intended service delivery improvements.
Adaptation and learning during implementation
During the six-month planning grant, the Mozambique PHIT Partnership piloted and refined a province-specific DQA methodology, which are now in use [14]. Annual assessment results are disseminated to health facility, district, and provincial managers using a simplified ranking system that was developed based on suggestions from a provincial data quality feedback session. Tools to summarize and regularly compare key PHC indicators across facilities and districts have evolved in design and content over the first three years of implementation to include fewer indicators and focus on secular trend analysis and graphic comparisons among peer facilities and districts. Efforts to promote use of data for decision making have also evolved to go beyond training health managers in data systems, indicator development, and analysis approaches. Periodic district-level review and planning meetings bring together peer facility staff with district and provincial leadership to promote active data review combined with planning and monitoring of plan implementation with key stakeholders.
Rwanda
In Rwanda, the Ministry of Health (MOH) and Partners In Health (PIH) have co-developed an electronic medical record (EMR) system (OpenMRS)[23] and are implementing an enhanced version as part of the PHIT Partnership (Figure 3). In the three PIH-supported districts of Rwanda the EMR holds patient records for 33 health centers, including a catchment area of approximately 800,000 people. The EMR system includes comprehensive medical records for all patients with HIV, tuberculosis, heart failure, epilepsy, hypertension, asthma, chronic obstructive pulmonary disease, diabetes, and cancer. In addition, a medical record system has been developed and is being implemented for acute outpatient consults, including registration, presentation, diagnosis, laboratory tests, and treatment. The EMR supports patient care by providing clinicians with summaries of patient visits and laboratory test results; through reports of at-risk patients (including those with missed visits, low CD4 counts, unsuppressed viral load, and high HBA1c) [24] and through administrative reports to support clinic management, resource allocation, and quality improvement (QI).
Rationale and contextual appropriateness
Though hospitals have paper patient charts recording prior admissions and emergency room visits, the primary care facilities in the project area do not have a standardized comprehensive outpatient paper-based record. As a result, acute and chronic medical history is not always immediately available to clinicians during patient consultation, and information does not always flow optimally between the levels of care. The EMR system allows for synthesis and access to patient history from chronic and acute outpatient encounters at both levels of care. In addition to the nationally required HIS reports, key EMR outputs include customized reports for QI, administration, and infectious disease monitoring. At present, patient registration data have been used to identify geographic areas with low access to acute outpatient services, while chronic care reports guide care for patients with chronic conditions (including HIV, TB, diabetes, hypertension, heart disease, asthma/ COPD and cancer). The MOH has commenced implementation of a nationwide comprehensive electronic medical record system, based partly on the partnership’s work. Core work for this included agreement on standard terminology for national use, including symptoms and diagnoses linked to international standards and development of a tested and refined user interface. This collaboration ensures that parallel systems are not created, with one national information system that integrates across EMR components and feeds into national HIS reporting requirements.
Activities and feedback mechanism
Tools that are being introduced include an electronic patient registration system and an acute patient visit record. Each of these have reports as part of the feedback loop that aggregate data at the facility and district levels (for reporting and administrative purposes), as well as the individual patient level for QI and patient tracking purposes. Training is conducted for data officers and coordinators on a quarterly basis, just prior to the quarterly software releases that deliver new content. Clinicians receive both formal and on-the-job training on using the systems and have a point person from the EMR team to support them.
Adaptation and learning during implementation
In order to allow for integration with the national implementation, the health information model was revised after the terminology standards were discussed with the national e-Health Technical Working Group. Additionally, a training schedule based around software releases and accompanied by more formalized training materials has been developed based on identified field needs.
Tanzania
The Connect Project aims to improve community-level availability, accessibility, and quality of primary health care services using community health agents (CHA) in three districts in rural Tanzania [34]. The Connect Project has adapted and adopted existing community-level health information data capture tools and is working with CHAs
to collect and integrate community-level data with the routine HIS at facility and district levels (Figure 4), with
data feedback targeting workers at the community, dispensary, health center, and hospital levels.
Rationale and contextual appropriateness
Although the MOH has developed community-level data collection tools, integrating collected data into the MOH HIS (MTUHA) has been challenging. Facility-based health workers are intended to use the community-level module (MTUHA III) to collect information on a range of community health indicators and report to their corresponding council health management teams (CHMT), who use this information to design an accurate profile of their district and develop Comprehensive Council Health Management Plans. Currently, MTUHA III is not fully or uniformly operative throughout the country owing to a range of systems factors, including workforce shortages that prevent timely and frequent community outreach. The CHA represents an opportunity to pilot and refine approaches to integrate community health information to the MTUHA system.
The Connect project supports integration of community data in the national MTUHA in order to improve the comprehensiveness and quality of health information in general and prompt data interpretation, discussion,
and problem solving in community settings. Integration efforts have focused on working with CHA clinical supervisors, village leaders, and CHMT MTUHA coordinators
to facilitate their administrative ownership over reporting and utilization of service delivery information from CHAs. As health system and community stakeholder support is built, the Connect HIS system will be customized to reflect the data and reporting requirements of the MTUHA HIS.
Activities and feedback mechanism
Connect staff worked with MTUHA supervisors to develop two community registers (one for service delivery outputs, a second for community mobilization and Symptoms and findings Diagnoses (confirmed, suspected, primary secondary) Laboratory /radiology tests ordered and results Treatment (medications, procedures, referral) Prior acute care history Prior chronic care history (HIV, TB, Diabetes, Heart Failure, Hypertension, Asthma/COPD, cancer) National HIS monthly report (acute outpatient section) Clinical reports for patient follow-up Aggregate reports for Quality Improvement and administration (as defined by District Hospital) Data available for use in nationally approved research studies Current and past medications Vital signs Infectious disease and outbreak monitoring Existing data available to support decision-making Acute Clinical visit data input Acute Clinical data output Figure 3 Visual framework for the health information intervention – Rwanda Mutale et al. BMC Health Services Research 2013, 13(Suppl 2):S9 http://www.biomedcentral.com/1472-6963/13/S2/S9 Page 7 of 12 health education activities) that provide simple project indicators aligned with the MTUHA III modules. Additional health information summary forms were developed for CHAs to record aggregate data from their registers and report each month to supervisors from their community, the health system, and the Connect team. CHAs and supervisors from both health facilities and village governments meet regularly to review monthly outputs, identify and troubleshoot problems, and plan jointly with the health system. Connect project coordinators, district MTUHA coordinators, and CHA supervisors hold similar meetings quarterly and transfer CHA health information to district and project managers for planning and program improvement.
Adaptation and learning during implementation
Data feedback to the CHAs was initially delayed due to the evolving nature of the intervention, the large number and geographic dispersion of study clusters, and variation in CHA supervisor leadership qualities and motivation. To overcome these barriers, the Connect team works with CHA supervisors to motivate their involvement and cover transportation costs incurred while making supportive supervision visits to CHA. There are notable challenges in collecting and using community-based health information. Supervision visits to all CHAs following initial deployment revealed minor problems concerning the uniformity and proper use of the registers. Project staff and supervisors compiled findings from these visits and convened CHAs in the respective study areas in a joint review of the registers to clarify register use. Management of community-based health information has also been a challenge. Though registers are appropriate for recording service delivery information and aggregating data, they did not facilitate CHAs data use for improving client-focused care as they did not capture household and client information, nor qualitative aspects of service encounters that would be useful for follow-up service encounters. Therefore, the project introduced booklets that remain in each village household where CHAs can log more detailed notes Figure 4 Visual framework for the health information intervention – Tanzania Mutale et al. BMC Health Services Research 2013, 13(Suppl 2):S9 http://www.biomedcentral.com/1472-6963/13/S2/S9 Page 8 of 12 from each visit, which has come at a high financial and logistical cost. Patient referrals from CHAs has also been a challenge, as post-referral feedback from health facilities to guide CHA follow-up services has been erratic. To facilitate the CHA/health facility communication, CHAs, supervisors, and referral providers have been provided closed-user phone groups to communicate without incurring costs.
Zambia
The Better Health through Mentorship and Assessment (BHOMA) project is using an Electronic Data Capture System (EDCS) and mobile technology to improve the quality of data captured in the target districts. The BHOMA system includes a dedicated low-wattage Linux client terminal (powered by solar panels and a 12-volt battery pack) with touch screen data entry terminals attached to a miniature data processing server, into which patient visit information is entered (Figure 5). The system automatically generates performance reports based on predetermined performance indicators that identify facility-level performance gaps and are used by clinical QI teams to mentor facility staff on improving clinical care quality. The EDCS system also automatically generates and sends follow-up messages via general packet radio service (GPRS) technology to CHWs (via mobile phones) to indicate a need for patient follow-up. Using modems and cellular networks, BHOMA clinics access the internet to securely synchronize records to a central server, housed at CIDRZ headquarters in Lusaka, which, in turn, transmits the data to BHOMA district offices, and the MOH’s District Health Offices.
Rationale and contextual appropriateness
Poor quality data has been a source of concern throughout Zambia and data are frequently not used for evidence-based planning. Furthermore, community-level data are often not collected or used. The expansion of HIV care and treatment in Zambia brought EMR systems to some rural health facilities, which demonstrated their feasibility for capturing patient-level data in real time and their utility in guiding decision making by health system managers. Increases in mobile technology coverage in Zambia has made internet widely available, providing an opportunity to leverage ICT for collection of patient and community level data in real time and to use these data for evidence-based decision making
Activities and feedback mechanism
There are six data entry screens (patient registration, adult, pediatric, sick antenatal care (ANC), normal ANC, and labor and delivery) that follow the flow of information on clinical forms. Data are entered and locally and available in real time. To date, BHOMA has trained 72 clinic supporters to enter data for each patient visit and run reports. The five reports include 1) Clinic report (summarizing the number of patient visits at each facility, including followup visits for patients with danger signs or severe symptoms who missed their appointment); 2) Patient review report (listing patient charts for the QI teams to review Figure 5 Visual framework for the health information intervention – Zambia Mutale et al. BMC Health Services Research 2013, 13(Suppl 2):S9 http://www.biomedcentral.com/1472-6963/13/S2/S9 Page 9 of 12 with clinic staff); 3) Clinic performance reports (summarizing twelve clinical care measures for QI teams and clinic staff to use as a snapshot of clinical care quality); 4) CHW performance report (summarizing follow-up and assessment activity levels for CHWs at the health facility); and 5) HIS reports (to remove duplicate burden of tallying data). Each clinic has a GPRS modem that uses Zambia’s cell phone networks to synchronize de-identified patient records to a central district database every 15 minutes when the system is on. Each district office has a server that aggregates information from all clinics in that district, allowing the QI teams to print patient review and clinic performance reports in preparation for each supportive mentoring visit.
Adaption and learning during implementation
The BHOMA HIS model has been deployed in largely rural, remote, and understaffed facilities and lessons have become clear during implementation. First, reviewing and clarifying data entry fields reduced the data entry workload. Second, computers with low-power requirements that run on solar power with battery back-up systems are important due to the unreliability of power. Third, using a dedicated client that runs only the BHOMA software avoids viruses, facilitates updates, and simplifies replacement. Fourth, it is essential that clinic performance reports are immediately available at the clinic level — rather than cycling first through the district — for health facility managers to identify areas requiring improvements and to check whether the corrective measures are working. Finally, patient-level information (rather than aggregate data) is used for flagging specific patient charts for followup with targeted intervention.
Comparisons across the PHIT strategies
Although the five PHIT Partnerships have designed different approaches to strengthen health systems in their respective countries, they share common features in enhancing HIS and linking data with improved decision making. Recognizing the complexity and context-specific nature of the intervention settings, PHIT Partnerships have adopted a flexible, iterative approach in designing and refining the development of new tools for HIS enhancement and improved decision making. Across the partnerships, the tools and approaches are designed to actively provide health system performance summaries to enable health system personnel to make informed decision on where to focus their efforts and limited resources. A second common feature is the use of feedback systems to improve data quality, though the error detection and correction approach varies across PHIT Partnerships. Error-detection approaches include automated troubleshooting mechanisms, routine review of aggregate reports for outliers and missing data, or periodic DQAs. A final similarity across PHIT Partnership approaches is the recognition of the importance of MOH information systems to ensure that HIS strengthening efforts are aligned with national priorities and to increase the likelihood of sustained project approaches beyond the life of the African Health Initiative. However, approaches across Partnerships vary in terms of pace and degree of alignment, which can be best described as either front-end integration (Mozambique), progressive integration (Rwanda), current harmonization (Ghana), and potential future harmonization or integration (Tanzania and Zambia). Despite these similarities, there are notable differences in the PHIT Partnership approaches to HIS strengthening and improved decision making. One difference is the level of focus for data collection, and by extension, its use. The Rwanda, Tanzania and Zambia PHIT Partnerships begin with intensive collection of patient-level data, while the Ghana and Mozambique Partnerships focus on facility, district and provincial-level aggregate data. In addition, the Ghana, Tanzania and Zambia data systems incorporate data from community service provision to direct outreach services from either formal or community health cadres. All systems, however, have sufficient flexibility to manipulate data according to frequency of aggregation (daily, monthly, quarterly, annual), and level of aggregation (health facility, district or province). A second difference is the type of data collection system, with the Rwanda and Zambia Partnerships implementing new EMR systems, while the Ghana, Mozambique, and Tanzania partnerships focus on paper-based HIS that are computerized at the health facility or district levels.
Discussion
Through the African Health Initiative, the five PHIT Partnerships have designed and are testing novel approaches to enhancing data systems and using HIS results as a driver for decision making and health system performance improvements. Design differences described across the PHIT Partnerships reflect the different theories of change for each project, particularly with regards to what information is needed, who will use the information to affect change, and how this change is expected to manifest. Ghana and Tanzania have simplified paper registries that incorporate data on community service provision, and in Ghana a resource allocation tool pioneered in Tanzania intends to support district managers in decision making. Mozambique focuses on strengthening the existing national HIS, and provides data summaries for health system managers to identify problems, evaluate solutions, and allocate resources. Zambia and Rwanda are implementing ICT approaches to improve Mutale et al. BMC Health Services Research 2013, 13(Suppl 2):S9 http://www.biomedcentral.com/1472-6963/13/S2/S9 Page 10 of 12 data quality, and provide timely information to guide decision making for clinicians and managers. Though implementation of the PHIT interventions is ongoing, there has been significant country-level enthusiasm for building on the HIS innovations of the African Health Initiative, with elements of the programs being adopted nationally in PHIT Partnership countries. The first three years of PHIT implementation has highlighted a number of elements important for strengthening HIS and linked decision making. First, though an important starting point, training alone is insufficient to engage and build capacity for facility and community health workers. Stakeholder meetings, data reviews, and mentored use of data as a basis for decisions have been utilized to engage health workers and managers and demonstrate the value of data, HIS quality, and ownership of tools to summarize data and guide decision making. A second lesson learned is that it is critical for HIS interventions to be developed in the context of the national HIS, which has been feasible across PHIT Partnerships and is crucial to ensuring sustainability of the programs beyond the project lifespan. Finally, in two of the PHIT Partnerships, the increased availability of mobile phone technology has facilitated the introduction of EMR systems in rural, resource constrained environments. These ICT innovations have come at a high initial financial cost to build infrastructure, modify software, and build human resource capacity for their use. Like many complex health system interventions, success of the PHIT HIS and decision-making approaches will hinge on whether frontline health workers and managers value, adopt and own the tools and procedures introduced by the country Partnerships [19,21]. For HIS to have an impact on health system functioning, and ultimately population health, it will be the institutionalization of habits and norms around data that will make the difference, such that prioritizing and using quality data is as much a part of routine practice as stocking a pharmacy or immunizing a child. Though exploring different approaches, all PHIT Partnerships are working towards the goal of standardized and routinely used procedures to improve data quality, its availability, and use. The PHIT Partnerships have both a common evaluation framework and project specific evaluation plan in place to assess their impact on health system functioning and population health [36]. Identifying effective and appropriate strategies for improving data availability, quality and its use, as well as the role of HIS in improving the health service delivery (including the quality and coverage of these services), will contribute to the limited evidence on this health system building block. Taking lessons learned to scale, however, will require substantial investment in general PHC information systems rather than disease specific information systems that can fragment, distort, and weaken country HIS at all levels of the health system [25].Without a well-functioning HIS, it is unlikely that the remaining five building blocks of a health system can reach their full potential in improving population health [26-28].
List of abbreviations used
BHOMA: Better Health through Mentorship and Assessment; CHA: Community health agent; CHMT: Community Health Management Team; CHO: Community health officer; CHW: Community health worker; CIDRZ: Center for Infectious Disease Research in Zambia; DHIMS-2: District Health Information Management System; DiHPART: District Health Planning and Reporting Toolkit; DQA: Data quality assurance; EDCS: Electronic data capture system; EMR: Electronic medical record; GEHIP: Ghana Essential Health Intervention Project; GPRS: General packet radio service; HIS: Health information system; HIV: Human immunodeficiency virus; ICT: Information communication technologies; LMIC: Low and middle income country; MOH: Ministry of Health; MTUHA: MOH health information system in Tanzania; MTUHA III: MOH HIS community-level module in Tanzania; PHC: Primary health care; PHIT: Population Health and Implementation Training; PIH: Partners In Health; QI: Quality Improvement; TB: Tuberculosis.
Competing interests
The authors declare that they have no competing interests.
Acknowledgements
This work was supported by the African Health Initiative of the Doris Duke Charitable Foundation. K Sherr was supported by Grant Number K02TW009207 from the Fogarty International Center; the content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. We would also like to thank the members of the Population Health Implementation and Training – African Health Initiative Data Collaborative for their contributions to this manuscript. Members include: Cheryl Amoroso, Manzi Anatole, John Koku Awoonor-Williams, Helen Ayles, Paulin Basinga, Ayaga A. Bawah, Colin Baynes, Harmony F. Chi, Roma Chilengi, Namwinga Chintu, Angela Chisembele-Taylor, Jeanine Condo, Fatima Cuembelo, Felix Rwabukwisi Cyamatare, Peter Drobac, Karen Finnegan, Sarah Gimbel, Stephen Gloyd, Jessie Hamon, Ahmed Hingora, Lisa Hirschhorn, Marina Kariaganis, Handson Manda, João Luis Manuel, Wendy Mazimba, Mark Micek, Cathy Michel, Megan Murray, Fidele Ngabo, Anthony Ofosu, James Pfeiffer, James F. Phillips, Alusio Pio, Ab Schaap, Kenneth Sherr, Ntazana Sindano, Allison Stone, Jeffrey S. A. Stringer. Declarations This article has been published as part of BMC Health Services Research Volume 13 Supplement 2, 2013: Improving primary health care to achieve population impact: the African Health Initiative. The full contents of the supplement are available online at http://www.biomedcentral.com/ bmchealthservres/supplements/13/S2. Publication of this supplement was supported by the African Health Initiative of the Doris Duke Charitable Foundation.
List of References
1. World Health Organization: Strengthening Health Systems to Improve Health Outcomes: WHO’s Framework for Action. Geneva: World Heatlh
Organization; 2007.
2. World Health Organization: Health Metrics Network Framework and Standards for Country Health Information Systems. Geneva: World Heatlh
Organization; 2008.
3. Bodart C, Sapirie S: Defining essential information needs and indicators. World Health Forum 1998, 19(3):303-309.
4. Simba DO, Mwangu M: Application of ICT in strengthening health information systems in developing countries in the wake of globalisation. Afr Health Sci 2004, 4(3):194-198.
5. Peersman G, Rugg D, Erkkola T, Kiwango E, Yang J: Are the investments in national HIV monitoring and evaluation systems paying off? J Acquir Immune Defic Syndr 2009, 52(Suppl 2):S87-96.
6. Jha P, Mills A, Hanson K, Kumaranayake L, Conteh L, Kurowski C, Nguyen SN, Cruz VO, Ranson K, Vaz LM, et al: Improving the health of the
global poor. Science 2002, 295(5562):2036-2039.
7. Larsson EC, Atkins S, Chopra M, Ekstrom AM: What about health system strengthening and the internal brain drain? Trans R Soc Trop Med Hyg 2009, 103(5):533-534, author reply 534-535.
8. Mate KS, Bennett B, Mphatswe W, Barker P, Rollins N: Challenges for routine health system data management in a large public programme
to prevent mother-to-child HIV transmission in South Africa. PLoS One 2009, 4(5):e5483.
9. Garrib A, Stoops N, McKenzie A, Dlamini L, Govender T, Rohde J, Herbst K: An evaluation of the District Health Information System in rural South Africa. S Afr Med J 2008, 98(7):549-552.
10. Ronveaux O, Rickert D, Hadler S, Groom H, Lloyd J, Bchir A, Birmingham M:
The immunization data quality audit: verifying the quality and consistency of immunization monitoring systems. Bull World Health Organ
2005, 83(7):503-510.
11. Lim SS, Stein DB, Charrow A, Murray CJ: Tracking progress towards universal childhood immunisation and the impact of global initiatives: a
systematic analysis of three-dose diphtheria, tetanus, and pertussi immunisation coverage. Lancet 2008, 372(9655):2031-2046.
12. Gething PW, Noor AM, Gikandi PW, Ogara EAA, Hay SI, Nixon MS, Snow RW, Atkinson PM: Improving imperfect data from health management
information systems in Africa using space–time geostatistics. PLoS Med2006, 3(6).
13. Chilundo B, Sundby J, Aanestad M: Analysing the quality of routine malaria data in Mozambique. Malar J 2004, 3:3.
14. Gimbel S, Micek M, Lambdin B, Lara J, Karagianis M, Cuembelo F, Gloyd SS,Pfeiffer J, Sherr K: An assessment of routine primary care health information system data quality in Sofala Province, Mozambique. Popul
Health Metr 2011, 9:12.
15. Mphatswe W, Mate KS, Bennett B, Ngidi H, Reddy J, Barker PM, Rollins N: Improving public health information: a data quality intervention in KwaZulu-Natal, South Africa. Bull World Health Organ 2012, 90(3):176-182.
16. The Routine Data Quality Assessment (RDQA) Tool: Guidelines for Implementation for HIV, TB and Malaria Programs. [http://www.
theglobalfund.org/en/me/documents/dataquality/].
17. Williams F, Austin Boren SA: The role of the electronic medical record (EMR) in care delivery development in developing countries: a
systematic review. Informatics in Primary Care 2008, 16:139-45.
18. Wager KA, Lee FW, White AW, Ward DM, Ornstein SM: Impact of an electronic medical record system on community-based primary care
practices. J Am Board Fam Med 2000, 13(5).
19. Redsell SA, Buck J: Health-related decision making: the use of information giving models in different care settings. Qual Prim Care 2009,
17(6):377-379.
20. Corrao S, Arcoraci V, Arnone S, Calvo L, Scaglione R, Di Bernardo C, Lagalla R,Caputi AP, Licata G: Evidence-based knowledge management:
an approach to effectively promote good health-care decision-making
in the information era. Intern Emerg Med 2009, 4(2):99-106.
21. Camporesi S: Better, and ‘healthier’ decision making through information technology: conference report from the Health 2.0 conference in San Francisco, September 2011. Ecancermedicalscience 2011, 5:242.
22. Frimpong J, Awoonor-Williams J, Stone A, Helleringer S, Yeji F, Schmitt M,
Phillips J: Strengthening routine health information systems in rural communities: an approach to improving service delivery and an
antecedent for electronic health infromation systems. Second Global Symposium on Health Systems Research: Beijing China 2012.
23. Mamlin BW, Biondich PG, Wolfe BA, Fraser H, Jazayeri D, Allen C, Miranda J, Tierney WM: Cooking up an open source EMR for developing countries: OpenMRS – a recipe for successful collaboration. AMIA Annu Symp Proc
2006, 529-533.
24. Amoroso CL, Akimana B, Wise B, Fraser HS: Using electronic medical records for HIV care in rural Rwanda. Stud Health Technol Inform 2010,
160(Pt 1):337-341.
25. Chan M, Kazatchkine M, Lob-Levyt J, Obaid T, Schweizer J, Sidibe M, Veneman A, Yamada T: Meeting the demand for results and
accountability: a call for action on health data from eight global health
agencies. PLoS Med 2010, 7(1):e1000223.
26. Adam T, Hsu J, de Savigny D, Lavis JN, Rottingen JA, Bennett S: Evaluatinghealth systems strengthening interventions in low-income and middleincome countries: Are we asking the right questions? Health Policy and
Planning 2012, 27(Suppl 4):iv9-iv19. health systems strengthening interventions in low-income and middleincome countries: Are we asking the right questions? Health Policy and
Planning 2012, 27(Suppl 4):iv9-iv19.
27. Adam Taghreed, de Savigny Don: Systems thinking for strengthening health systems in LMICS: need for a paradigm shift. Health Policy Plan
2012, 27(Suppl 4):iv1-iv3.
28. WHO: Systems Thinking for Health Systems Strengthening. 2009.
29. Bassett MT, Gallin EK, Adedokun L, Toner C: From the ground up:strengthening health systems at district level. BMC Health Services
Research 2013, 13(Suppl 2):S2.
30. Awoonor-Williams JK, Bawah A, Nyonator F, Asuru R, Oduro A, Ofosu A,Phillips J: The Ghana Essential Health Interventions Program: a plausibilitytrial of the impact of health systems strengthening on maternal & child
survival. BMC Health Services Research 2013, 13(Suppl 2):S3.
31. Sherr K, Cuembelo F, Michel C, Gimbel S, Micek M, Kariaganis M, Pio A, Manuel JL, Pfeiffer J, Gloyd S: Strengthening integrated primary health
care in Sofala, Mozambique. BMC Health Services Research 2013, 13(Suppl 2):S4.
32. Drobac PC, Basinga P, Condo J, Farmer PE, Finnegan K, Hamon JK, Amoroso C, Hirschhorn LR, Kakoma JB, Lu C, Murangwa Y, Murray M,
Ngabo F, Rich M, Thomson D, Binagwaho A: Comprehensive and integrated district health systems strengthening: the Rwanda Population
Health Implementation and Training (PHIT) Partnership. BMC Health Services Research 2013, 13(Suppl 2):S5.
33. Ramsey K, Hingora A, Kante M, Jackson M, Exavery A, Pemba S, Manzi F, Baynes C, Helleringer S, Phillips JF: The Tanzania Connect Project: a cluster-randomized trial of the child survival impact of adding paid community health workers to an existing facility-focused health system.
BMC Health Services Research 2013, 13(Suppl 2):S6.
34. Stringer JSA, Chisembele-Taylor A, Chibwesha CJ, Chi HF, Ayles H, Manda H, Mazimba W, Schuttner L, Sindano N, Williams FB, Chintu N, Chilengi R: Protocol-driven primary care and community linkages to improve population health in rural Zambia: the Better Health Outcomes through
Mentoring and Assessment (BHOMA) project. BMC Health Services Research 2013, 13(Suppl 2):S7.
35. Bryce J, Requejo JH, Moulton LH, Ram M, Black RE, Population Health Implementation and Training – Africa Health Initiative Data Collaborative: A common evaluation framework for the African Health Initiative. BMC Health Services Research 2013, 13(Suppl 2):S10.
