SlideShare a Scribd company logo
1 of 1
Routine health Information System Performance assessment in Guanajuato, Mexico 2010.
Alicia Sánchez Parbul, MCP,1 Juan Eugenio Hernández Ávila, D en C,1 Lina Sofía Palacio Mejía, D en EP,1 Beatriz Plaza, MPH,2
1Instituto   Nacional de Salud Pública, 2 Measure Evaluation, Population Center, North Carolina University

Background;timely information depend on
reliable and
              Health systems
                              in order to
monitor their performance and to make
informed decisions; every year millions of
dollars are spent in the collection of data
around the world. In Mexico, it has been
estimated that 20% of the time of health
providers is spent filling paper base forms or
electronic systems.         Despite of this
effort, little attention is dedicated to the
quality of data and the use of information
throughout all the organizational levels of the
health system.
We present here the results of a study to
evaluate the performance of the Routine
Health Information System (RHIS) in the State
of Guanajuato, Mexico, as well as the
technical, organizational and behavioral
factors that may be influencing it. Guanajuato
is one of the 31 states that along with the
Federal District constitute Mexico. It is locates
in the center of the country and, according to
the 2010 census it 5’ 486, 372 inhabitants.
The health system is fragmented into a set of                Protection in Health (Seguro Popular)                 decentralized MoH’s counterparts in each of
public and private institutions. The public                  provides services for the population working          the 31 states and Federal District. They are
health sector includes Social Security                       in the informal economy or the unemployed             organized in local health systems called
Institutions which provide services and social               population. This system is managed by the             sanitary jurisdictions. The SHS of the state of
benefits to the population employed in the                   Federal Ministry of Health (MoH) and the              Guanajuato has eight sanitary jurisdiction and
formal economy. The System for Social                        State Health Services (SHS). The SHS are the          operated 521 medical facilities in 2010.

Methods; SystemPerformance of (PRISM)
Information
            The
                 Management
                              Routine
                                                               PRISM Framework

framework was used to assess the
performance of the routine health
information system (RHIS) in the State of
Guanajuato. The PRISM Framework offers an
innovative approach to the design, evaluation
and strengthening of RHIS by measuring its
performance, tracing possible determinants
in           three         domains:          the
technical, organizational and behavioral.
Using this framework it is possible to identify
factors in the causal pathway affecting the
RHIS performance that may be use as a guide
to develop interventions for its strengthening.
 Lot Quality Assurance Sampling (LQAS) was
used to calculate sample size (20 facilities per
Jurisdiction). A set of 157 facilities which
included all hospitalization facilities and
administrative offices and a sample of
outpatient clinics stratified by sanitary
jurisdiction and urban/rural location was
randomly selected. During the month of
January 2010 four teams of trained field
personnel       accompanied     by     principal
researchers visited the health Clinics, hospital
and jurisdictional offices in the state of
Guanajuato. We applied the performance
diagnostic tool for data quality and use of
information, the RHIS overview and
facility/office    checklist,   the     process
assessment tool and the Organizational and
Behavioral Assessment Tool (OBAT). A total
of 288 informants were interviewed after
informed consent. This research was aproved
by INSP Internal Review Board and ethics
committee.

                                                                                                                   some presentation of data in the RHIS. Only
                                                                                                                   around 50% of the facilities visited reported
                                                                                                                   having a RHIS manual but most of them
                                                                                                                   reported to have computers.

                                                                                                                   Overall     self-confidence     scores     were
                                                                                                                   consistently high in all jurisdictions but, in
                                                                                                                   contrast, demonstrable capabilities in the
                                                                                                                   tasks of managing or operating the RHIS were
                                                                                                                   consistently low. The lowest scores were
                                                                                                                   obtained by interviewed personnel were in
                                                                                                                   their ability to define and resolve problems;
                                                                                                                   this was consistent with the low analytic            C   onclusions; Although data quality is good
                                                             R   esults; data accuracy and timeliness
                                                             scores were high in all sanitary
                                                                                                                   capabilities of the personnel involved with
                                                                                                                   RHIS at the facility level as well as the overall
                                                                                                                                                                        and collection and transmission mechanisms
                                                                                                                                                                        are in place to make it opportune available
                                                                                                                   use un information showed by the diagnostic          there is a need to train qualified personnel to
                                                             jurisdictions, completeness had also very high
                                                                                                                   tool. In general personnel involved in the           analyze and disseminate it and to promote
                                                             scores. Coverage was also very high;
                                                                                                                   RHIS in health facilities does not demand            the use of information to base the decision
                                                             timeliness was not measured in three
                                                                                                                   data, which is also consistent with the low          making processes in the Health System. This
                                                             jurisdictions. In the one of the other five only
                                                                                                                   analytic capabilities.                               is not only at the operation level, our results
                                                             in 47% of the facilities /offices the
                                                             information was transmitted in a timely                                                                    show the need for high officials in the State
                                                                                                                   The organizational factors were in general a         Health Services to fully understand the need
                                                             fashion, in the rest of the jurisdictions the
                                                                                                                   little higher but very few agreed that there is      for a sustainable health information service.
                                                             information flowed on time in 100% of the
                                                                                                                   an environment promoting evidence-based              The results of this project and al more general
                                                             visited facilities/offices. Use of information
                                                                                                                   decision making although they mostly agree           evaluation of the Health Information system
                                                             for decision making was poor in the medical
                                                                                                                   with the idea of a problem solving                   in Mexico using the Health Metric Network
                                                             facilities and a little higher on jurisdictional      environment.                                         Framework led to the opening of a master in
                                                             administrative offices but the overall average
                                                             by sanitary jurisdiction was poor. All of the                                                              public health program in the National
                                                                                                                   The Critical management functions of the RHI         Institute of Public Health with emphasis in
                                                             indicators in use of information were                 also received very low scores in general, but
                                                             consistently low         with few exceptions.                                                              health information systems and biostatistics.
                                                                                                                   financing was by far the lowest. Only around         With this program we hope to train the
                                                             Sanitary jurisdiction 3 had the highest scores.       50% of personnel involved in the operation of
                                                             The scores in the processes of the routine                                                                 future public health workforce to promote a
                                                                                                                   the RHIS received training in the three              better use of information but also to set the
                                                             health information system in Guanajuato               previous months. An in general, only 25% on
                                                             were also low but Jurisdiction 1 had a score                                                               necessary policies to generate a real evidence
                                                                                                                   the facilities have a statistician among it staff.
                                                             of 77%, the highest. This jurisdiction is in the                                                           based decision making environment at all
                                                                                                                   In 63 percent of the facilities the RHIS is
                                                             state’s capital the city of León. Most of the                                                              levels of the organization of the publich
                                                                                                                   operated by the physicians or nurses, taking
                                                             facilities in the eight jurisdictions reported to                                                          health system, we hope this will strengthen
                                                                                                                   approximately 25 5 of their weekly time to fill
                                                             have data processing mechanisms and                                                                        the health system and have an impact in the
                                                                                                                   up paper forms, aggregate data and transfer
                                                             showed to interviewers presentations of                                                                    health of the population
                                                                                                                   information

More Related Content

Viewers also liked

Worsening Socio-economic Disparities in ITN Ownership, Access and Use from 20...
Worsening Socio-economic Disparities in ITN Ownership, Access and Use from 20...Worsening Socio-economic Disparities in ITN Ownership, Access and Use from 20...
Worsening Socio-economic Disparities in ITN Ownership, Access and Use from 20...MEASURE Evaluation
 
Botswana’s Integration of Health Data Quality Assurance Into Standard Operati...
Botswana’s Integration of Health Data Quality Assurance Into Standard Operati...Botswana’s Integration of Health Data Quality Assurance Into Standard Operati...
Botswana’s Integration of Health Data Quality Assurance Into Standard Operati...MEASURE Evaluation
 
Building a Center of Reference for M&E of Health Programs: A Partnership Betw...
Building a Center of Reference for M&E of Health Programs: A Partnership Betw...Building a Center of Reference for M&E of Health Programs: A Partnership Betw...
Building a Center of Reference for M&E of Health Programs: A Partnership Betw...MEASURE Evaluation
 
Building a Resilient Health System in Liberia: Health Information System (HIS...
Building a Resilient Health System in Liberia: Health Information System (HIS...Building a Resilient Health System in Liberia: Health Information System (HIS...
Building a Resilient Health System in Liberia: Health Information System (HIS...MEASURE Evaluation
 
Using data to save the lives of mothers and newborns
Using data to save the lives of mothers and newbornsUsing data to save the lives of mothers and newborns
Using data to save the lives of mothers and newbornsMEASURE Evaluation
 
Lessons Learned Collecting Most Significant Change Stories in an Impact Evalu...
Lessons Learned Collecting Most Significant Change Stories in an Impact Evalu...Lessons Learned Collecting Most Significant Change Stories in an Impact Evalu...
Lessons Learned Collecting Most Significant Change Stories in an Impact Evalu...MEASURE Evaluation
 
Reduction in Disparity of Insecticide-Treated Nets Ownership and Use among So...
Reduction in Disparity of Insecticide-Treated Nets Ownership and Use among So...Reduction in Disparity of Insecticide-Treated Nets Ownership and Use among So...
Reduction in Disparity of Insecticide-Treated Nets Ownership and Use among So...MEASURE Evaluation
 
The Impact of the Scale Up of Malaria Control Interventions in Senegal, 2006-...
The Impact of the Scale Up of Malaria Control Interventions in Senegal, 2006-...The Impact of the Scale Up of Malaria Control Interventions in Senegal, 2006-...
The Impact of the Scale Up of Malaria Control Interventions in Senegal, 2006-...MEASURE Evaluation
 
Effect of Age of ITN Owned by Households on Malaria Parasite Infection Among ...
Effect of Age of ITN Owned by Households on Malaria Parasite Infection Among ...Effect of Age of ITN Owned by Households on Malaria Parasite Infection Among ...
Effect of Age of ITN Owned by Households on Malaria Parasite Infection Among ...MEASURE Evaluation
 
Using PRISM Tools to Assess the Scale-Up of Health Management Information Sys...
Using PRISM Tools to Assess the Scale-Up of Health Management Information Sys...Using PRISM Tools to Assess the Scale-Up of Health Management Information Sys...
Using PRISM Tools to Assess the Scale-Up of Health Management Information Sys...MEASURE Evaluation
 
Evaluating HIV Policy Advocacy: The Local Capacity Initiative
Evaluating HIV Policy Advocacy: The Local Capacity Initiative Evaluating HIV Policy Advocacy: The Local Capacity Initiative
Evaluating HIV Policy Advocacy: The Local Capacity Initiative MEASURE Evaluation
 
Botswana Adaptation of the RDQA
Botswana Adaptation of the RDQABotswana Adaptation of the RDQA
Botswana Adaptation of the RDQAMEASURE Evaluation
 
The Most Significant Change Method: Background
The Most Significant Change Method: BackgroundThe Most Significant Change Method: Background
The Most Significant Change Method: BackgroundMEASURE Evaluation
 
Coordination and Integration of HIV and Family Planning Services through Orga...
Coordination and Integration of HIV and Family Planning Services through Orga...Coordination and Integration of HIV and Family Planning Services through Orga...
Coordination and Integration of HIV and Family Planning Services through Orga...MEASURE Evaluation
 
Measuring National M&E System Strengthening in Nigeria: Application of the Mo...
Measuring National M&E System Strengthening in Nigeria: Application of the Mo...Measuring National M&E System Strengthening in Nigeria: Application of the Mo...
Measuring National M&E System Strengthening in Nigeria: Application of the Mo...MEASURE Evaluation
 
Impact Evaluation of Approaches to Strengthen Health Facility Operation and M...
Impact Evaluation of Approaches to Strengthen Health Facility Operation and M...Impact Evaluation of Approaches to Strengthen Health Facility Operation and M...
Impact Evaluation of Approaches to Strengthen Health Facility Operation and M...MEASURE Evaluation
 
Evaluations of Gender-Integrated Reproductive Health Interventions: A Review ...
Evaluations of Gender-Integrated Reproductive Health Interventions: A Review ...Evaluations of Gender-Integrated Reproductive Health Interventions: A Review ...
Evaluations of Gender-Integrated Reproductive Health Interventions: A Review ...MEASURE Evaluation
 

Viewers also liked (17)

Worsening Socio-economic Disparities in ITN Ownership, Access and Use from 20...
Worsening Socio-economic Disparities in ITN Ownership, Access and Use from 20...Worsening Socio-economic Disparities in ITN Ownership, Access and Use from 20...
Worsening Socio-economic Disparities in ITN Ownership, Access and Use from 20...
 
Botswana’s Integration of Health Data Quality Assurance Into Standard Operati...
Botswana’s Integration of Health Data Quality Assurance Into Standard Operati...Botswana’s Integration of Health Data Quality Assurance Into Standard Operati...
Botswana’s Integration of Health Data Quality Assurance Into Standard Operati...
 
Building a Center of Reference for M&E of Health Programs: A Partnership Betw...
Building a Center of Reference for M&E of Health Programs: A Partnership Betw...Building a Center of Reference for M&E of Health Programs: A Partnership Betw...
Building a Center of Reference for M&E of Health Programs: A Partnership Betw...
 
Building a Resilient Health System in Liberia: Health Information System (HIS...
Building a Resilient Health System in Liberia: Health Information System (HIS...Building a Resilient Health System in Liberia: Health Information System (HIS...
Building a Resilient Health System in Liberia: Health Information System (HIS...
 
Using data to save the lives of mothers and newborns
Using data to save the lives of mothers and newbornsUsing data to save the lives of mothers and newborns
Using data to save the lives of mothers and newborns
 
Lessons Learned Collecting Most Significant Change Stories in an Impact Evalu...
Lessons Learned Collecting Most Significant Change Stories in an Impact Evalu...Lessons Learned Collecting Most Significant Change Stories in an Impact Evalu...
Lessons Learned Collecting Most Significant Change Stories in an Impact Evalu...
 
Reduction in Disparity of Insecticide-Treated Nets Ownership and Use among So...
Reduction in Disparity of Insecticide-Treated Nets Ownership and Use among So...Reduction in Disparity of Insecticide-Treated Nets Ownership and Use among So...
Reduction in Disparity of Insecticide-Treated Nets Ownership and Use among So...
 
The Impact of the Scale Up of Malaria Control Interventions in Senegal, 2006-...
The Impact of the Scale Up of Malaria Control Interventions in Senegal, 2006-...The Impact of the Scale Up of Malaria Control Interventions in Senegal, 2006-...
The Impact of the Scale Up of Malaria Control Interventions in Senegal, 2006-...
 
Effect of Age of ITN Owned by Households on Malaria Parasite Infection Among ...
Effect of Age of ITN Owned by Households on Malaria Parasite Infection Among ...Effect of Age of ITN Owned by Households on Malaria Parasite Infection Among ...
Effect of Age of ITN Owned by Households on Malaria Parasite Infection Among ...
 
Using PRISM Tools to Assess the Scale-Up of Health Management Information Sys...
Using PRISM Tools to Assess the Scale-Up of Health Management Information Sys...Using PRISM Tools to Assess the Scale-Up of Health Management Information Sys...
Using PRISM Tools to Assess the Scale-Up of Health Management Information Sys...
 
Evaluating HIV Policy Advocacy: The Local Capacity Initiative
Evaluating HIV Policy Advocacy: The Local Capacity Initiative Evaluating HIV Policy Advocacy: The Local Capacity Initiative
Evaluating HIV Policy Advocacy: The Local Capacity Initiative
 
Botswana Adaptation of the RDQA
Botswana Adaptation of the RDQABotswana Adaptation of the RDQA
Botswana Adaptation of the RDQA
 
The Most Significant Change Method: Background
The Most Significant Change Method: BackgroundThe Most Significant Change Method: Background
The Most Significant Change Method: Background
 
Coordination and Integration of HIV and Family Planning Services through Orga...
Coordination and Integration of HIV and Family Planning Services through Orga...Coordination and Integration of HIV and Family Planning Services through Orga...
Coordination and Integration of HIV and Family Planning Services through Orga...
 
Measuring National M&E System Strengthening in Nigeria: Application of the Mo...
Measuring National M&E System Strengthening in Nigeria: Application of the Mo...Measuring National M&E System Strengthening in Nigeria: Application of the Mo...
Measuring National M&E System Strengthening in Nigeria: Application of the Mo...
 
Impact Evaluation of Approaches to Strengthen Health Facility Operation and M...
Impact Evaluation of Approaches to Strengthen Health Facility Operation and M...Impact Evaluation of Approaches to Strengthen Health Facility Operation and M...
Impact Evaluation of Approaches to Strengthen Health Facility Operation and M...
 
Evaluations of Gender-Integrated Reproductive Health Interventions: A Review ...
Evaluations of Gender-Integrated Reproductive Health Interventions: A Review ...Evaluations of Gender-Integrated Reproductive Health Interventions: A Review ...
Evaluations of Gender-Integrated Reproductive Health Interventions: A Review ...
 

Similar to Routine Health Information System Performance assessment in Guanajuato, Mexico 2010

E-health technologies show promise in developing countries
E-health technologies show promise in developing countriesE-health technologies show promise in developing countries
E-health technologies show promise in developing countriesInSTEDD
 
HRIS_Brief_26_10_12
HRIS_Brief_26_10_12HRIS_Brief_26_10_12
HRIS_Brief_26_10_12Sunil Kumar
 
Journal of Health Information Management
Journal of Health Information ManagementJournal of Health Information Management
Journal of Health Information Managementdigitalhealthconsulting
 
ASSESMENT OF ROUTINE INFORMATION SYSTEM IN HEALTH SYSTEM, HO.pptx
ASSESMENT OF ROUTINE INFORMATION SYSTEM IN HEALTH SYSTEM, HO.pptxASSESMENT OF ROUTINE INFORMATION SYSTEM IN HEALTH SYSTEM, HO.pptx
ASSESMENT OF ROUTINE INFORMATION SYSTEM IN HEALTH SYSTEM, HO.pptxthabitisadru1
 
32 l Nursing2022 l Volume 52, Number 4 www.Nursing2022.com.docx
32 l Nursing2022 l Volume 52, Number 4 www.Nursing2022.com.docx32 l Nursing2022 l Volume 52, Number 4 www.Nursing2022.com.docx
32 l Nursing2022 l Volume 52, Number 4 www.Nursing2022.com.docxstandfordabbot
 
BME 307 - HMIS - Data Management Systems 24112021 Final.pdf
BME 307 - HMIS - Data Management Systems 24112021 Final.pdfBME 307 - HMIS - Data Management Systems 24112021 Final.pdf
BME 307 - HMIS - Data Management Systems 24112021 Final.pdfedwardlowassa1
 
Management of information and evaluation system
Management of information and evaluation systemManagement of information and evaluation system
Management of information and evaluation systemAntareep Sarania
 
Ensuring Data IntegrityIn Health Information Exchange
Ensuring Data IntegrityIn Health Information ExchangeEnsuring Data IntegrityIn Health Information Exchange
Ensuring Data IntegrityIn Health Information ExchangeTanaMaeskm
 
Improving Data for Decision-Making: Leveraging Data Quality Audits in Haryana...
Improving Data for Decision-Making: Leveraging Data Quality Audits in Haryana...Improving Data for Decision-Making: Leveraging Data Quality Audits in Haryana...
Improving Data for Decision-Making: Leveraging Data Quality Audits in Haryana...HFG Project
 
CHW Review_various_10.12.12
CHW Review_various_10.12.12CHW Review_various_10.12.12
CHW Review_various_10.12.12CORE Group
 
49934427 report-on-hr-practices-in-health-industry
49934427 report-on-hr-practices-in-health-industry49934427 report-on-hr-practices-in-health-industry
49934427 report-on-hr-practices-in-health-industryPrashant Chaubey
 
Health Management Information System in Ethiopia: Who Owns the HMIS
Health Management Information System in Ethiopia: Who Owns the HMISHealth Management Information System in Ethiopia: Who Owns the HMIS
Health Management Information System in Ethiopia: Who Owns the HMISMEASURE Evaluation
 
Changing the paradigm in healthcare information technology
Changing the paradigm in healthcare information technology Changing the paradigm in healthcare information technology
Changing the paradigm in healthcare information technology Antony Sapbuddy
 
Improved Data Quality and Use: Dual Goals of HMIS Strengthening
Improved Data Quality and Use: Dual Goals of HMIS StrengtheningImproved Data Quality and Use: Dual Goals of HMIS Strengthening
Improved Data Quality and Use: Dual Goals of HMIS StrengtheningHFG Project
 
Improvement
ImprovementImprovement
Improvementprimary
 

Similar to Routine Health Information System Performance assessment in Guanajuato, Mexico 2010 (19)

E-health technologies show promise in developing countries
E-health technologies show promise in developing countriesE-health technologies show promise in developing countries
E-health technologies show promise in developing countries
 
HRIS_Brief_26_10_12
HRIS_Brief_26_10_12HRIS_Brief_26_10_12
HRIS_Brief_26_10_12
 
Interventions to Improve RHIS Performance
Interventions to Improve RHIS PerformanceInterventions to Improve RHIS Performance
Interventions to Improve RHIS Performance
 
Journal of Health Information Management
Journal of Health Information ManagementJournal of Health Information Management
Journal of Health Information Management
 
ASSESMENT OF ROUTINE INFORMATION SYSTEM IN HEALTH SYSTEM, HO.pptx
ASSESMENT OF ROUTINE INFORMATION SYSTEM IN HEALTH SYSTEM, HO.pptxASSESMENT OF ROUTINE INFORMATION SYSTEM IN HEALTH SYSTEM, HO.pptx
ASSESMENT OF ROUTINE INFORMATION SYSTEM IN HEALTH SYSTEM, HO.pptx
 
32 l Nursing2022 l Volume 52, Number 4 www.Nursing2022.com.docx
32 l Nursing2022 l Volume 52, Number 4 www.Nursing2022.com.docx32 l Nursing2022 l Volume 52, Number 4 www.Nursing2022.com.docx
32 l Nursing2022 l Volume 52, Number 4 www.Nursing2022.com.docx
 
BME 307 - HMIS - Data Management Systems 24112021 Final.pdf
BME 307 - HMIS - Data Management Systems 24112021 Final.pdfBME 307 - HMIS - Data Management Systems 24112021 Final.pdf
BME 307 - HMIS - Data Management Systems 24112021 Final.pdf
 
Management of information and evaluation system
Management of information and evaluation systemManagement of information and evaluation system
Management of information and evaluation system
 
mis.pptx
mis.pptxmis.pptx
mis.pptx
 
Ensuring Data IntegrityIn Health Information Exchange
Ensuring Data IntegrityIn Health Information ExchangeEnsuring Data IntegrityIn Health Information Exchange
Ensuring Data IntegrityIn Health Information Exchange
 
Improving Data for Decision-Making: Leveraging Data Quality Audits in Haryana...
Improving Data for Decision-Making: Leveraging Data Quality Audits in Haryana...Improving Data for Decision-Making: Leveraging Data Quality Audits in Haryana...
Improving Data for Decision-Making: Leveraging Data Quality Audits in Haryana...
 
CHW Review_various_10.12.12
CHW Review_various_10.12.12CHW Review_various_10.12.12
CHW Review_various_10.12.12
 
Hss and its relation to l+m+g
Hss and its relation to l+m+gHss and its relation to l+m+g
Hss and its relation to l+m+g
 
49934427 report-on-hr-practices-in-health-industry
49934427 report-on-hr-practices-in-health-industry49934427 report-on-hr-practices-in-health-industry
49934427 report-on-hr-practices-in-health-industry
 
Health Management Information System in Ethiopia: Who Owns the HMIS
Health Management Information System in Ethiopia: Who Owns the HMISHealth Management Information System in Ethiopia: Who Owns the HMIS
Health Management Information System in Ethiopia: Who Owns the HMIS
 
Changing the paradigm in healthcare information technology
Changing the paradigm in healthcare information technology Changing the paradigm in healthcare information technology
Changing the paradigm in healthcare information technology
 
Improved Data Quality and Use: Dual Goals of HMIS Strengthening
Improved Data Quality and Use: Dual Goals of HMIS StrengtheningImproved Data Quality and Use: Dual Goals of HMIS Strengthening
Improved Data Quality and Use: Dual Goals of HMIS Strengthening
 
Ias 2017
Ias 2017Ias 2017
Ias 2017
 
Improvement
ImprovementImprovement
Improvement
 

More from MEASURE Evaluation

Managing missing values in routinely reported data: One approach from the Dem...
Managing missing values in routinely reported data: One approach from the Dem...Managing missing values in routinely reported data: One approach from the Dem...
Managing missing values in routinely reported data: One approach from the Dem...MEASURE Evaluation
 
Use of Routine Data for Economic Evaluations
Use of Routine Data for Economic EvaluationsUse of Routine Data for Economic Evaluations
Use of Routine Data for Economic EvaluationsMEASURE Evaluation
 
Routine data use in evaluation: practical guidance
Routine data use in evaluation: practical guidanceRoutine data use in evaluation: practical guidance
Routine data use in evaluation: practical guidanceMEASURE Evaluation
 
Tuberculosis/HIV Mobility Study: Objectives and Background
Tuberculosis/HIV Mobility Study: Objectives and BackgroundTuberculosis/HIV Mobility Study: Objectives and Background
Tuberculosis/HIV Mobility Study: Objectives and BackgroundMEASURE Evaluation
 
How to improve the capabilities of health information systems to address emer...
How to improve the capabilities of health information systems to address emer...How to improve the capabilities of health information systems to address emer...
How to improve the capabilities of health information systems to address emer...MEASURE Evaluation
 
LCI Evaluation Uganda Organizational Network Analysis
LCI Evaluation Uganda Organizational Network AnalysisLCI Evaluation Uganda Organizational Network Analysis
LCI Evaluation Uganda Organizational Network AnalysisMEASURE Evaluation
 
Using Organizational Network Analysis to Plan and Evaluate Global Health Prog...
Using Organizational Network Analysis to Plan and Evaluate Global Health Prog...Using Organizational Network Analysis to Plan and Evaluate Global Health Prog...
Using Organizational Network Analysis to Plan and Evaluate Global Health Prog...MEASURE Evaluation
 
Understanding Referral Networks for Adolescent Girls and Young Women
Understanding Referral Networks for Adolescent Girls and Young WomenUnderstanding Referral Networks for Adolescent Girls and Young Women
Understanding Referral Networks for Adolescent Girls and Young WomenMEASURE Evaluation
 
Data for Impact: Lessons Learned in Using the Ripple Effects Mapping Method
Data for Impact: Lessons Learned in Using the Ripple Effects Mapping MethodData for Impact: Lessons Learned in Using the Ripple Effects Mapping Method
Data for Impact: Lessons Learned in Using the Ripple Effects Mapping MethodMEASURE Evaluation
 
Local Capacity Initiative (LCI) Evaluation
Local Capacity Initiative (LCI) EvaluationLocal Capacity Initiative (LCI) Evaluation
Local Capacity Initiative (LCI) EvaluationMEASURE Evaluation
 
Development and Validation of a Reproductive Empowerment Scale
Development and Validation of a Reproductive Empowerment ScaleDevelopment and Validation of a Reproductive Empowerment Scale
Development and Validation of a Reproductive Empowerment ScaleMEASURE Evaluation
 
Sustaining the Impact: MEASURE Evaluation Conversation on Maternal and Child ...
Sustaining the Impact: MEASURE Evaluation Conversation on Maternal and Child ...Sustaining the Impact: MEASURE Evaluation Conversation on Maternal and Child ...
Sustaining the Impact: MEASURE Evaluation Conversation on Maternal and Child ...MEASURE Evaluation
 
Using Most Significant Change in a Mixed-Methods Evaluation in Uganda
Using Most Significant Change in a Mixed-Methods Evaluation in UgandaUsing Most Significant Change in a Mixed-Methods Evaluation in Uganda
Using Most Significant Change in a Mixed-Methods Evaluation in UgandaMEASURE Evaluation
 
Lessons Learned In Using the Most Significant Change Technique in Evaluation
Lessons Learned In Using the Most Significant Change Technique in EvaluationLessons Learned In Using the Most Significant Change Technique in Evaluation
Lessons Learned In Using the Most Significant Change Technique in EvaluationMEASURE Evaluation
 
Malaria Data Quality and Use in Selected Centers of Excellence in Madagascar:...
Malaria Data Quality and Use in Selected Centers of Excellence in Madagascar:...Malaria Data Quality and Use in Selected Centers of Excellence in Madagascar:...
Malaria Data Quality and Use in Selected Centers of Excellence in Madagascar:...MEASURE Evaluation
 
Evaluating National Malaria Programs’ Impact in Moderate- and Low-Transmissio...
Evaluating National Malaria Programs’ Impact in Moderate- and Low-Transmissio...Evaluating National Malaria Programs’ Impact in Moderate- and Low-Transmissio...
Evaluating National Malaria Programs’ Impact in Moderate- and Low-Transmissio...MEASURE Evaluation
 
Improved Performance of the Malaria Surveillance, Monitoring, and Evaluation ...
Improved Performance of the Malaria Surveillance, Monitoring, and Evaluation ...Improved Performance of the Malaria Surveillance, Monitoring, and Evaluation ...
Improved Performance of the Malaria Surveillance, Monitoring, and Evaluation ...MEASURE Evaluation
 
Lessons learned in using process tracing for evaluation
Lessons learned in using process tracing for evaluationLessons learned in using process tracing for evaluation
Lessons learned in using process tracing for evaluationMEASURE Evaluation
 
Use of Qualitative Comparative Analysis in the Assessment of the Actionable D...
Use of Qualitative Comparative Analysis in the Assessment of the Actionable D...Use of Qualitative Comparative Analysis in the Assessment of the Actionable D...
Use of Qualitative Comparative Analysis in the Assessment of the Actionable D...MEASURE Evaluation
 
Sustaining the Impact: MEASURE Evaluation Conversation on Health Informatics
Sustaining the Impact: MEASURE Evaluation Conversation on Health InformaticsSustaining the Impact: MEASURE Evaluation Conversation on Health Informatics
Sustaining the Impact: MEASURE Evaluation Conversation on Health InformaticsMEASURE Evaluation
 

More from MEASURE Evaluation (20)

Managing missing values in routinely reported data: One approach from the Dem...
Managing missing values in routinely reported data: One approach from the Dem...Managing missing values in routinely reported data: One approach from the Dem...
Managing missing values in routinely reported data: One approach from the Dem...
 
Use of Routine Data for Economic Evaluations
Use of Routine Data for Economic EvaluationsUse of Routine Data for Economic Evaluations
Use of Routine Data for Economic Evaluations
 
Routine data use in evaluation: practical guidance
Routine data use in evaluation: practical guidanceRoutine data use in evaluation: practical guidance
Routine data use in evaluation: practical guidance
 
Tuberculosis/HIV Mobility Study: Objectives and Background
Tuberculosis/HIV Mobility Study: Objectives and BackgroundTuberculosis/HIV Mobility Study: Objectives and Background
Tuberculosis/HIV Mobility Study: Objectives and Background
 
How to improve the capabilities of health information systems to address emer...
How to improve the capabilities of health information systems to address emer...How to improve the capabilities of health information systems to address emer...
How to improve the capabilities of health information systems to address emer...
 
LCI Evaluation Uganda Organizational Network Analysis
LCI Evaluation Uganda Organizational Network AnalysisLCI Evaluation Uganda Organizational Network Analysis
LCI Evaluation Uganda Organizational Network Analysis
 
Using Organizational Network Analysis to Plan and Evaluate Global Health Prog...
Using Organizational Network Analysis to Plan and Evaluate Global Health Prog...Using Organizational Network Analysis to Plan and Evaluate Global Health Prog...
Using Organizational Network Analysis to Plan and Evaluate Global Health Prog...
 
Understanding Referral Networks for Adolescent Girls and Young Women
Understanding Referral Networks for Adolescent Girls and Young WomenUnderstanding Referral Networks for Adolescent Girls and Young Women
Understanding Referral Networks for Adolescent Girls and Young Women
 
Data for Impact: Lessons Learned in Using the Ripple Effects Mapping Method
Data for Impact: Lessons Learned in Using the Ripple Effects Mapping MethodData for Impact: Lessons Learned in Using the Ripple Effects Mapping Method
Data for Impact: Lessons Learned in Using the Ripple Effects Mapping Method
 
Local Capacity Initiative (LCI) Evaluation
Local Capacity Initiative (LCI) EvaluationLocal Capacity Initiative (LCI) Evaluation
Local Capacity Initiative (LCI) Evaluation
 
Development and Validation of a Reproductive Empowerment Scale
Development and Validation of a Reproductive Empowerment ScaleDevelopment and Validation of a Reproductive Empowerment Scale
Development and Validation of a Reproductive Empowerment Scale
 
Sustaining the Impact: MEASURE Evaluation Conversation on Maternal and Child ...
Sustaining the Impact: MEASURE Evaluation Conversation on Maternal and Child ...Sustaining the Impact: MEASURE Evaluation Conversation on Maternal and Child ...
Sustaining the Impact: MEASURE Evaluation Conversation on Maternal and Child ...
 
Using Most Significant Change in a Mixed-Methods Evaluation in Uganda
Using Most Significant Change in a Mixed-Methods Evaluation in UgandaUsing Most Significant Change in a Mixed-Methods Evaluation in Uganda
Using Most Significant Change in a Mixed-Methods Evaluation in Uganda
 
Lessons Learned In Using the Most Significant Change Technique in Evaluation
Lessons Learned In Using the Most Significant Change Technique in EvaluationLessons Learned In Using the Most Significant Change Technique in Evaluation
Lessons Learned In Using the Most Significant Change Technique in Evaluation
 
Malaria Data Quality and Use in Selected Centers of Excellence in Madagascar:...
Malaria Data Quality and Use in Selected Centers of Excellence in Madagascar:...Malaria Data Quality and Use in Selected Centers of Excellence in Madagascar:...
Malaria Data Quality and Use in Selected Centers of Excellence in Madagascar:...
 
Evaluating National Malaria Programs’ Impact in Moderate- and Low-Transmissio...
Evaluating National Malaria Programs’ Impact in Moderate- and Low-Transmissio...Evaluating National Malaria Programs’ Impact in Moderate- and Low-Transmissio...
Evaluating National Malaria Programs’ Impact in Moderate- and Low-Transmissio...
 
Improved Performance of the Malaria Surveillance, Monitoring, and Evaluation ...
Improved Performance of the Malaria Surveillance, Monitoring, and Evaluation ...Improved Performance of the Malaria Surveillance, Monitoring, and Evaluation ...
Improved Performance of the Malaria Surveillance, Monitoring, and Evaluation ...
 
Lessons learned in using process tracing for evaluation
Lessons learned in using process tracing for evaluationLessons learned in using process tracing for evaluation
Lessons learned in using process tracing for evaluation
 
Use of Qualitative Comparative Analysis in the Assessment of the Actionable D...
Use of Qualitative Comparative Analysis in the Assessment of the Actionable D...Use of Qualitative Comparative Analysis in the Assessment of the Actionable D...
Use of Qualitative Comparative Analysis in the Assessment of the Actionable D...
 
Sustaining the Impact: MEASURE Evaluation Conversation on Health Informatics
Sustaining the Impact: MEASURE Evaluation Conversation on Health InformaticsSustaining the Impact: MEASURE Evaluation Conversation on Health Informatics
Sustaining the Impact: MEASURE Evaluation Conversation on Health Informatics
 

Routine Health Information System Performance assessment in Guanajuato, Mexico 2010

  • 1. Routine health Information System Performance assessment in Guanajuato, Mexico 2010. Alicia Sánchez Parbul, MCP,1 Juan Eugenio Hernández Ávila, D en C,1 Lina Sofía Palacio Mejía, D en EP,1 Beatriz Plaza, MPH,2 1Instituto Nacional de Salud Pública, 2 Measure Evaluation, Population Center, North Carolina University Background;timely information depend on reliable and Health systems in order to monitor their performance and to make informed decisions; every year millions of dollars are spent in the collection of data around the world. In Mexico, it has been estimated that 20% of the time of health providers is spent filling paper base forms or electronic systems. Despite of this effort, little attention is dedicated to the quality of data and the use of information throughout all the organizational levels of the health system. We present here the results of a study to evaluate the performance of the Routine Health Information System (RHIS) in the State of Guanajuato, Mexico, as well as the technical, organizational and behavioral factors that may be influencing it. Guanajuato is one of the 31 states that along with the Federal District constitute Mexico. It is locates in the center of the country and, according to the 2010 census it 5’ 486, 372 inhabitants. The health system is fragmented into a set of Protection in Health (Seguro Popular) decentralized MoH’s counterparts in each of public and private institutions. The public provides services for the population working the 31 states and Federal District. They are health sector includes Social Security in the informal economy or the unemployed organized in local health systems called Institutions which provide services and social population. This system is managed by the sanitary jurisdictions. The SHS of the state of benefits to the population employed in the Federal Ministry of Health (MoH) and the Guanajuato has eight sanitary jurisdiction and formal economy. The System for Social State Health Services (SHS). The SHS are the operated 521 medical facilities in 2010. Methods; SystemPerformance of (PRISM) Information The Management Routine PRISM Framework framework was used to assess the performance of the routine health information system (RHIS) in the State of Guanajuato. The PRISM Framework offers an innovative approach to the design, evaluation and strengthening of RHIS by measuring its performance, tracing possible determinants in three domains: the technical, organizational and behavioral. Using this framework it is possible to identify factors in the causal pathway affecting the RHIS performance that may be use as a guide to develop interventions for its strengthening. Lot Quality Assurance Sampling (LQAS) was used to calculate sample size (20 facilities per Jurisdiction). A set of 157 facilities which included all hospitalization facilities and administrative offices and a sample of outpatient clinics stratified by sanitary jurisdiction and urban/rural location was randomly selected. During the month of January 2010 four teams of trained field personnel accompanied by principal researchers visited the health Clinics, hospital and jurisdictional offices in the state of Guanajuato. We applied the performance diagnostic tool for data quality and use of information, the RHIS overview and facility/office checklist, the process assessment tool and the Organizational and Behavioral Assessment Tool (OBAT). A total of 288 informants were interviewed after informed consent. This research was aproved by INSP Internal Review Board and ethics committee. some presentation of data in the RHIS. Only around 50% of the facilities visited reported having a RHIS manual but most of them reported to have computers. Overall self-confidence scores were consistently high in all jurisdictions but, in contrast, demonstrable capabilities in the tasks of managing or operating the RHIS were consistently low. The lowest scores were obtained by interviewed personnel were in their ability to define and resolve problems; this was consistent with the low analytic C onclusions; Although data quality is good R esults; data accuracy and timeliness scores were high in all sanitary capabilities of the personnel involved with RHIS at the facility level as well as the overall and collection and transmission mechanisms are in place to make it opportune available use un information showed by the diagnostic there is a need to train qualified personnel to jurisdictions, completeness had also very high tool. In general personnel involved in the analyze and disseminate it and to promote scores. Coverage was also very high; RHIS in health facilities does not demand the use of information to base the decision timeliness was not measured in three data, which is also consistent with the low making processes in the Health System. This jurisdictions. In the one of the other five only analytic capabilities. is not only at the operation level, our results in 47% of the facilities /offices the information was transmitted in a timely show the need for high officials in the State The organizational factors were in general a Health Services to fully understand the need fashion, in the rest of the jurisdictions the little higher but very few agreed that there is for a sustainable health information service. information flowed on time in 100% of the an environment promoting evidence-based The results of this project and al more general visited facilities/offices. Use of information decision making although they mostly agree evaluation of the Health Information system for decision making was poor in the medical with the idea of a problem solving in Mexico using the Health Metric Network facilities and a little higher on jurisdictional environment. Framework led to the opening of a master in administrative offices but the overall average by sanitary jurisdiction was poor. All of the public health program in the National The Critical management functions of the RHI Institute of Public Health with emphasis in indicators in use of information were also received very low scores in general, but consistently low with few exceptions. health information systems and biostatistics. financing was by far the lowest. Only around With this program we hope to train the Sanitary jurisdiction 3 had the highest scores. 50% of personnel involved in the operation of The scores in the processes of the routine future public health workforce to promote a the RHIS received training in the three better use of information but also to set the health information system in Guanajuato previous months. An in general, only 25% on were also low but Jurisdiction 1 had a score necessary policies to generate a real evidence the facilities have a statistician among it staff. of 77%, the highest. This jurisdiction is in the based decision making environment at all In 63 percent of the facilities the RHIS is state’s capital the city of León. Most of the levels of the organization of the publich operated by the physicians or nurses, taking facilities in the eight jurisdictions reported to health system, we hope this will strengthen approximately 25 5 of their weekly time to fill have data processing mechanisms and the health system and have an impact in the up paper forms, aggregate data and transfer showed to interviewers presentations of health of the population information