SlideShare a Scribd company logo
1 of 31
Presentation of Findings Prepared for: The Agency for Healthcare Research and Quality (AHRQ) Training Modules for Systematic Reviews Methods Guide www.ahrq.gov
Systematic Review Process Overview
[object Object],[object Object],Learning Objectives
[object Object],[object Object],[object Object],[object Object],Organizing and Reporting Findings
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Why Not Meta-analysis? AHRQ .  Methods reference guide for effectiveness and comparative effectiveness reviews . Version 1.0. Available at:  http://effectivehealthcare.ahrq.gov/repFiles/2007_10DraftMethodsGuide.pdf.
[object Object],[object Object],Solution
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],PICOTS
[object Object],[object Object],[object Object],[object Object],Combining Studies
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Summary Tables (I)
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Summary Tables (II) PICOTS = population, intervention, comparator, outcomes, timing, and setting
Example: Summary Table of Study Characteristics ,[object Object],[object Object],Hartmann KE, et al. AHRQ Evidence Report/Technology Assessment No. 187. Available at:  http://www.ahrq.gov/downloads/pub/evidence/pdf/ bladder/bladder.pdf.
Example: Summary Table as High-Level Map  Chung M, et al. AHRQ Evidence Report/Technology Assessment No. 183. Available at: http://www.ahrq.gov/downloads/pub/evidence/pdf/vitadcal/vitadcal.pdf.
Example: Summary Table of Study Characteristics Balk EM, et al.  Ann Intern Med  2003;139:670-82. Reprinted with permission from the American College of Physicians.
Visual Presentation of Available Comparisons Ip S, et al. AHRQ Evidence Report/Technology Assessment No. 124.  Available at:  http://www.ahrq.gov/downloads/pub/evidence/pdf/rhinoupdate/rhinoup.pdf.
Example: Summary Table of Prevalence Findings ,[object Object],Hartmann KE, et al. AHRQ Evidence Report/Technology Assessment No. 187. Available at:  http://www.ahrq.gov/ downloads/pub/evidence/ pdf/ bladder/bladder.pdf.
Example: Summary Table for Randomized Controlled Trials ,[object Object],Hartmann KE, et al. AHRQ Evidence Report/Technology Assessment No. 187. Available at:  http://www.ahrq.gov/ downloads/pub/evidence/pdf/bladder/bladder.pdf.
Example:  Summary Table for Cohort Studies Wang C, et al. AHRQ Evidence Report/Technology Assessment No. 94. Available at:  http://www.ahrq.gov/downloads/pub/evidence/pdf/o3cardio/o3cardio.pdf.
Example: Presentation of Harms Data ,[object Object],Hartmann KE, et al. AHRQ Evidence Report/Technology Assessment No. 187. Available at:  http://www.ahrq.gov/ downloads/pub/evidence/ pdf/ bladder/bladder.pdf.
Example: Presentation of Data by Outcome and Age Chung M, et al. AHRQ Evidence Report/Technology Assessment No. 183. Available at: http://www.ahrq.gov/downloads/pub/evidence/pdf/vitadcal/vitadcal.pdf.
Example: Presentation of Patient-Reported Outcomes ,[object Object],Hartmann KE, et al. AHRQ Evidence Report/Technology Assessment No. 187. Available at:  http://www.ahrq.gov/ downloads/pub/evidence/ pdf/ bladder/bladder.pdf.
[object Object],[object Object],[object Object],[object Object],[object Object],Evidence Maps
Example: Evidence Map Terasawa T, et al.  Ann Intern Med  2009;151:556-65. Reprinted with permission from the American College of Physicians.
A Second Approach to an Evidence Map Raman G, et al. AHRQ Technology Assessment No. GEND1206. Available at:  http://www.cms.gov/determinationprocess/downloads/id61TA.pdf. Dt: time (to stable dose) INR: international normalized ratio mean dose: mean maintenance dose
Forest Plot Without Summary Favors Wide-Area Circumferential Ablation Favors Pulmonary Vein Isolation Ip S, et al. AHRQ Comparative Effectiveness Review No. 15. Available at:   http://www.effectivehealthcare.ahrq.gov/ehc/products/51/114/2009_0623RadiofrequencyFinal.pdf.
Summary Matrix Wang C, et al. AHRQ Evidence Report/Technology Assessment No. 94. Available at:  http://www.ahrq.gov/downloads/pub/evidence/pdf/o3cardio/o3cardio.pdf.
[object Object],[object Object],[object Object],[object Object],[object Object],Key Messages
[object Object],[object Object],[object Object],References (I)
[object Object],[object Object],References (II)
[object Object],[object Object],References (III)
[object Object],[object Object],References (IV)
[object Object],[object Object],Authors

More Related Content

What's hot

What's hot (20)

Evaluation research-resty-samosa
Evaluation research-resty-samosaEvaluation research-resty-samosa
Evaluation research-resty-samosa
 
Critical evaluation ppt
Critical evaluation pptCritical evaluation ppt
Critical evaluation ppt
 
Plagiarism
PlagiarismPlagiarism
Plagiarism
 
Qualitative research and its types
Qualitative research and its typesQualitative research and its types
Qualitative research and its types
 
Research ethics
Research ethicsResearch ethics
Research ethics
 
Research Methodology Part I
Research Methodology Part IResearch Methodology Part I
Research Methodology Part I
 
What Is Peer Review?
What Is Peer Review?What Is Peer Review?
What Is Peer Review?
 
Descriptive Statistics
Descriptive StatisticsDescriptive Statistics
Descriptive Statistics
 
Literature Review (Review of Related Literature - Research Methodology)
Literature Review (Review of Related Literature - Research Methodology)Literature Review (Review of Related Literature - Research Methodology)
Literature Review (Review of Related Literature - Research Methodology)
 
Types of literature review
Types of literature reviewTypes of literature review
Types of literature review
 
Qualitative Research
Qualitative ResearchQualitative Research
Qualitative Research
 
Bibliometric study
Bibliometric studyBibliometric study
Bibliometric study
 
How to develop research question
How to develop research questionHow to develop research question
How to develop research question
 
How to Write a Research Paper
How to Write a Research Paper How to Write a Research Paper
How to Write a Research Paper
 
Data collection and analysis
Data collection and analysisData collection and analysis
Data collection and analysis
 
The Research Question
The Research QuestionThe Research Question
The Research Question
 
Quantitative Data Analysis
Quantitative Data AnalysisQuantitative Data Analysis
Quantitative Data Analysis
 
Chapter 1-INTRODUCTION TO RESEARCH
Chapter 1-INTRODUCTION TO RESEARCHChapter 1-INTRODUCTION TO RESEARCH
Chapter 1-INTRODUCTION TO RESEARCH
 
Research report purposes and classifications
Research report purposes and classificationsResearch report purposes and classifications
Research report purposes and classifications
 
Problem statement of research
Problem statement of researchProblem statement of research
Problem statement of research
 

Similar to Presentation of Findings

Nursing Practice Literature Evaluation Table Article Paper.pdf
Nursing Practice Literature Evaluation Table Article Paper.pdfNursing Practice Literature Evaluation Table Article Paper.pdf
Nursing Practice Literature Evaluation Table Article Paper.pdf
bkbk37
 
A gentle introduction to meta-analysis
A gentle introduction to meta-analysisA gentle introduction to meta-analysis
A gentle introduction to meta-analysis
Angelo Tinazzi
 
184 Deutsches Ärzteblatt International⏐⏐Dtsch Arztebl Int 2009.docx
184 Deutsches Ärzteblatt International⏐⏐Dtsch Arztebl Int 2009.docx184 Deutsches Ärzteblatt International⏐⏐Dtsch Arztebl Int 2009.docx
184 Deutsches Ärzteblatt International⏐⏐Dtsch Arztebl Int 2009.docx
hyacinthshackley2629
 

Similar to Presentation of Findings (20)

Data Extraction
Data ExtractionData Extraction
Data Extraction
 
Analytic Frameworks
Analytic FrameworksAnalytic Frameworks
Analytic Frameworks
 
Nursing Practice Literature Evaluation Table Article Paper.pdf
Nursing Practice Literature Evaluation Table Article Paper.pdfNursing Practice Literature Evaluation Table Article Paper.pdf
Nursing Practice Literature Evaluation Table Article Paper.pdf
 
Automated Extraction Of Reported Statistical Analyses Towards A Logical Repr...
Automated Extraction Of Reported Statistical Analyses  Towards A Logical Repr...Automated Extraction Of Reported Statistical Analyses  Towards A Logical Repr...
Automated Extraction Of Reported Statistical Analyses Towards A Logical Repr...
 
A research study Writing a Systematic Review in Clinical Research – Pubrica
A research study Writing a Systematic Review in Clinical Research – PubricaA research study Writing a Systematic Review in Clinical Research – Pubrica
A research study Writing a Systematic Review in Clinical Research – Pubrica
 
A research study writing a systematic review in clinical research – pubrica
A research study writing a systematic review in clinical research – pubricaA research study writing a systematic review in clinical research – pubrica
A research study writing a systematic review in clinical research – pubrica
 
Clinical trail protocol and development
Clinical trail protocol and developmentClinical trail protocol and development
Clinical trail protocol and development
 
A gentle introduction to meta-analysis
A gentle introduction to meta-analysisA gentle introduction to meta-analysis
A gentle introduction to meta-analysis
 
Reporting guidelines – Manuscript Writing in Medical Research – Pubrica
Reporting guidelines – Manuscript Writing in Medical Research – PubricaReporting guidelines – Manuscript Writing in Medical Research – Pubrica
Reporting guidelines – Manuscript Writing in Medical Research – Pubrica
 
A Protocol For Retrospective Translational Science Case Studies Of Health Int...
A Protocol For Retrospective Translational Science Case Studies Of Health Int...A Protocol For Retrospective Translational Science Case Studies Of Health Int...
A Protocol For Retrospective Translational Science Case Studies Of Health Int...
 
Research Methods
Research MethodsResearch Methods
Research Methods
 
184 Deutsches Ärzteblatt International⏐⏐Dtsch Arztebl Int 2009.docx
184 Deutsches Ärzteblatt International⏐⏐Dtsch Arztebl Int 2009.docx184 Deutsches Ärzteblatt International⏐⏐Dtsch Arztebl Int 2009.docx
184 Deutsches Ärzteblatt International⏐⏐Dtsch Arztebl Int 2009.docx
 
Reporting guidelines – manuscript writing in medical research – pubrica
Reporting guidelines – manuscript writing in medical research – pubricaReporting guidelines – manuscript writing in medical research – pubrica
Reporting guidelines – manuscript writing in medical research – pubrica
 
Systematic review of master protocols
Systematic review of master protocolsSystematic review of master protocols
Systematic review of master protocols
 
Planning And Development Of The Iss Ise Webinar Final
Planning And Development Of The Iss Ise Webinar   FinalPlanning And Development Of The Iss Ise Webinar   Final
Planning And Development Of The Iss Ise Webinar Final
 
Ana Marusic - MedicReS World Congress 2011
Ana Marusic - MedicReS World Congress 2011Ana Marusic - MedicReS World Congress 2011
Ana Marusic - MedicReS World Congress 2011
 
Ich efficacy3 by Ramkrisna Bhunjawa
Ich efficacy3 by Ramkrisna Bhunjawa Ich efficacy3 by Ramkrisna Bhunjawa
Ich efficacy3 by Ramkrisna Bhunjawa
 
PUBLISHING
PUBLISHINGPUBLISHING
PUBLISHING
 
Consort 2010 explanation and elaboration (bmj)
Consort 2010 explanation and elaboration (bmj)Consort 2010 explanation and elaboration (bmj)
Consort 2010 explanation and elaboration (bmj)
 
abstracts lecture 9 4 2565.ppt
abstracts lecture 9 4 2565.pptabstracts lecture 9 4 2565.ppt
abstracts lecture 9 4 2565.ppt
 

More from Effective Health Care Program

When to Select Observational Studies as Evidence for Comparative Effectivenes...
When to Select Observational Studies as Evidence for Comparative Effectivenes...When to Select Observational Studies as Evidence for Comparative Effectivenes...
When to Select Observational Studies as Evidence for Comparative Effectivenes...
Effective Health Care Program
 
The AHRQ Training Modules for the Systematic Reviews Methods Guide: An Introd...
The AHRQ Training Modules for the Systematic Reviews Methods Guide: An Introd...The AHRQ Training Modules for the Systematic Reviews Methods Guide: An Introd...
The AHRQ Training Modules for the Systematic Reviews Methods Guide: An Introd...
Effective Health Care Program
 
Management of the Patient with Stable Ischemic Heart Disease and Preserved Le...
Management of the Patient with Stable Ischemic Heart Disease and Preserved Le...Management of the Patient with Stable Ischemic Heart Disease and Preserved Le...
Management of the Patient with Stable Ischemic Heart Disease and Preserved Le...
Effective Health Care Program
 

More from Effective Health Care Program (20)

When to Select Observational Studies Quiz
When to Select Observational Studies QuizWhen to Select Observational Studies Quiz
When to Select Observational Studies Quiz
 
When to Select Observational Studies as Evidence for Comparative Effectivenes...
When to Select Observational Studies as Evidence for Comparative Effectivenes...When to Select Observational Studies as Evidence for Comparative Effectivenes...
When to Select Observational Studies as Evidence for Comparative Effectivenes...
 
Topic Refinement
Topic RefinementTopic Refinement
Topic Refinement
 
Topic Refinement Quiz
Topic Refinement QuizTopic Refinement Quiz
Topic Refinement Quiz
 
The AHRQ Training Modules for the Systematic Reviews Methods Guide: An Introd...
The AHRQ Training Modules for the Systematic Reviews Methods Guide: An Introd...The AHRQ Training Modules for the Systematic Reviews Methods Guide: An Introd...
The AHRQ Training Modules for the Systematic Reviews Methods Guide: An Introd...
 
Study Eligibility Criteria
Study Eligibility CriteriaStudy Eligibility Criteria
Study Eligibility Criteria
 
Study Eligibility Criteria Quiz
Study Eligibility Criteria QuizStudy Eligibility Criteria Quiz
Study Eligibility Criteria Quiz
 
Searching for Relevant Studies
Searching for Relevant StudiesSearching for Relevant Studies
Searching for Relevant Studies
 
Searching for Relevant Studies Quiz
Searching for Relevant Studies QuizSearching for Relevant Studies Quiz
Searching for Relevant Studies Quiz
 
Reporting the Review
Reporting the ReviewReporting the Review
Reporting the Review
 
Reporting the Review Quiz
Reporting the Review QuizReporting the Review Quiz
Reporting the Review Quiz
 
Quantitative Synthesis II
Quantitative Synthesis IIQuantitative Synthesis II
Quantitative Synthesis II
 
Quantitative Synthesis II Quiz
Quantitative Synthesis II QuizQuantitative Synthesis II Quiz
Quantitative Synthesis II Quiz
 
Quantitative Synthesis I
Quantitative Synthesis IQuantitative Synthesis I
Quantitative Synthesis I
 
Quantitative Synthesis I Quiz
Quantitative Synthesis I QuizQuantitative Synthesis I Quiz
Quantitative Synthesis I Quiz
 
Presentation of Findings Quiz
Presentation of Findings QuizPresentation of Findings Quiz
Presentation of Findings Quiz
 
Management of the Patient with Stable Ischemic Heart Disease and Preserved Le...
Management of the Patient with Stable Ischemic Heart Disease and Preserved Le...Management of the Patient with Stable Ischemic Heart Disease and Preserved Le...
Management of the Patient with Stable Ischemic Heart Disease and Preserved Le...
 
Grading Strength of Evidence
Grading Strength of EvidenceGrading Strength of Evidence
Grading Strength of Evidence
 
Grading Strength of Evidence Quiz
Grading Strength of Evidence QuizGrading Strength of Evidence Quiz
Grading Strength of Evidence Quiz
 
Data Extraction Quiz
Data  Extraction QuizData  Extraction Quiz
Data Extraction Quiz
 

Recently uploaded

Call Girls Bhubaneswar Just Call 9907093804 Top Class Call Girl Service Avail...
Call Girls Bhubaneswar Just Call 9907093804 Top Class Call Girl Service Avail...Call Girls Bhubaneswar Just Call 9907093804 Top Class Call Girl Service Avail...
Call Girls Bhubaneswar Just Call 9907093804 Top Class Call Girl Service Avail...
Dipal Arora
 

Recently uploaded (20)

Call Girls in Delhi Triveni Complex Escort Service(🔝))/WhatsApp 97111⇛47426
Call Girls in Delhi Triveni Complex Escort Service(🔝))/WhatsApp 97111⇛47426Call Girls in Delhi Triveni Complex Escort Service(🔝))/WhatsApp 97111⇛47426
Call Girls in Delhi Triveni Complex Escort Service(🔝))/WhatsApp 97111⇛47426
 
Call Girls Visakhapatnam Just Call 9907093804 Top Class Call Girl Service Ava...
Call Girls Visakhapatnam Just Call 9907093804 Top Class Call Girl Service Ava...Call Girls Visakhapatnam Just Call 9907093804 Top Class Call Girl Service Ava...
Call Girls Visakhapatnam Just Call 9907093804 Top Class Call Girl Service Ava...
 
Top Quality Call Girl Service Kalyanpur 6378878445 Available Call Girls Any Time
Top Quality Call Girl Service Kalyanpur 6378878445 Available Call Girls Any TimeTop Quality Call Girl Service Kalyanpur 6378878445 Available Call Girls Any Time
Top Quality Call Girl Service Kalyanpur 6378878445 Available Call Girls Any Time
 
Call Girls Ooty Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Ooty Just Call 8250077686 Top Class Call Girl Service AvailableCall Girls Ooty Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Ooty Just Call 8250077686 Top Class Call Girl Service Available
 
Call Girls Bhubaneswar Just Call 9907093804 Top Class Call Girl Service Avail...
Call Girls Bhubaneswar Just Call 9907093804 Top Class Call Girl Service Avail...Call Girls Bhubaneswar Just Call 9907093804 Top Class Call Girl Service Avail...
Call Girls Bhubaneswar Just Call 9907093804 Top Class Call Girl Service Avail...
 
Call Girls Agra Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Agra Just Call 8250077686 Top Class Call Girl Service AvailableCall Girls Agra Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Agra Just Call 8250077686 Top Class Call Girl Service Available
 
Top Rated Bangalore Call Girls Ramamurthy Nagar ⟟ 9332606886 ⟟ Call Me For G...
Top Rated Bangalore Call Girls Ramamurthy Nagar ⟟  9332606886 ⟟ Call Me For G...Top Rated Bangalore Call Girls Ramamurthy Nagar ⟟  9332606886 ⟟ Call Me For G...
Top Rated Bangalore Call Girls Ramamurthy Nagar ⟟ 9332606886 ⟟ Call Me For G...
 
Call Girls Faridabad Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Faridabad Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Faridabad Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Faridabad Just Call 9907093804 Top Class Call Girl Service Available
 
(👑VVIP ISHAAN ) Russian Call Girls Service Navi Mumbai🖕9920874524🖕Independent...
(👑VVIP ISHAAN ) Russian Call Girls Service Navi Mumbai🖕9920874524🖕Independent...(👑VVIP ISHAAN ) Russian Call Girls Service Navi Mumbai🖕9920874524🖕Independent...
(👑VVIP ISHAAN ) Russian Call Girls Service Navi Mumbai🖕9920874524🖕Independent...
 
Call Girls Service Jaipur {9521753030} ❤️VVIP RIDDHI Call Girl in Jaipur Raja...
Call Girls Service Jaipur {9521753030} ❤️VVIP RIDDHI Call Girl in Jaipur Raja...Call Girls Service Jaipur {9521753030} ❤️VVIP RIDDHI Call Girl in Jaipur Raja...
Call Girls Service Jaipur {9521753030} ❤️VVIP RIDDHI Call Girl in Jaipur Raja...
 
Call Girls Siliguri Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Siliguri Just Call 8250077686 Top Class Call Girl Service AvailableCall Girls Siliguri Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Siliguri Just Call 8250077686 Top Class Call Girl Service Available
 
Call Girls Tirupati Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Tirupati Just Call 8250077686 Top Class Call Girl Service AvailableCall Girls Tirupati Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Tirupati Just Call 8250077686 Top Class Call Girl Service Available
 
Call Girls Gwalior Just Call 8617370543 Top Class Call Girl Service Available
Call Girls Gwalior Just Call 8617370543 Top Class Call Girl Service AvailableCall Girls Gwalior Just Call 8617370543 Top Class Call Girl Service Available
Call Girls Gwalior Just Call 8617370543 Top Class Call Girl Service Available
 
O963O942363 Call Girls In Ahmedabad Escort Service Available 24×7 In Ahmedabad
O963O942363 Call Girls In Ahmedabad Escort Service Available 24×7 In AhmedabadO963O942363 Call Girls In Ahmedabad Escort Service Available 24×7 In Ahmedabad
O963O942363 Call Girls In Ahmedabad Escort Service Available 24×7 In Ahmedabad
 
Call Girls Bangalore Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Bangalore Just Call 8250077686 Top Class Call Girl Service AvailableCall Girls Bangalore Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Bangalore Just Call 8250077686 Top Class Call Girl Service Available
 
Call Girls Coimbatore Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Coimbatore Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Coimbatore Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Coimbatore Just Call 9907093804 Top Class Call Girl Service Available
 
Russian Call Girls Service Jaipur {8445551418} ❤️PALLAVI VIP Jaipur Call Gir...
Russian Call Girls Service  Jaipur {8445551418} ❤️PALLAVI VIP Jaipur Call Gir...Russian Call Girls Service  Jaipur {8445551418} ❤️PALLAVI VIP Jaipur Call Gir...
Russian Call Girls Service Jaipur {8445551418} ❤️PALLAVI VIP Jaipur Call Gir...
 
Night 7k to 12k Chennai City Center Call Girls 👉👉 7427069034⭐⭐ 100% Genuine E...
Night 7k to 12k Chennai City Center Call Girls 👉👉 7427069034⭐⭐ 100% Genuine E...Night 7k to 12k Chennai City Center Call Girls 👉👉 7427069034⭐⭐ 100% Genuine E...
Night 7k to 12k Chennai City Center Call Girls 👉👉 7427069034⭐⭐ 100% Genuine E...
 
The Most Attractive Hyderabad Call Girls Kothapet 𖠋 6297143586 𖠋 Will You Mis...
The Most Attractive Hyderabad Call Girls Kothapet 𖠋 6297143586 𖠋 Will You Mis...The Most Attractive Hyderabad Call Girls Kothapet 𖠋 6297143586 𖠋 Will You Mis...
The Most Attractive Hyderabad Call Girls Kothapet 𖠋 6297143586 𖠋 Will You Mis...
 
Best Rate (Guwahati ) Call Girls Guwahati ⟟ 8617370543 ⟟ High Class Call Girl...
Best Rate (Guwahati ) Call Girls Guwahati ⟟ 8617370543 ⟟ High Class Call Girl...Best Rate (Guwahati ) Call Girls Guwahati ⟟ 8617370543 ⟟ High Class Call Girl...
Best Rate (Guwahati ) Call Girls Guwahati ⟟ 8617370543 ⟟ High Class Call Girl...
 

Presentation of Findings

  • 1. Presentation of Findings Prepared for: The Agency for Healthcare Research and Quality (AHRQ) Training Modules for Systematic Reviews Methods Guide www.ahrq.gov
  • 3.
  • 4.
  • 5.
  • 6.
  • 7.
  • 8.
  • 9.
  • 10.
  • 11.
  • 12. Example: Summary Table as High-Level Map Chung M, et al. AHRQ Evidence Report/Technology Assessment No. 183. Available at: http://www.ahrq.gov/downloads/pub/evidence/pdf/vitadcal/vitadcal.pdf.
  • 13. Example: Summary Table of Study Characteristics Balk EM, et al. Ann Intern Med 2003;139:670-82. Reprinted with permission from the American College of Physicians.
  • 14. Visual Presentation of Available Comparisons Ip S, et al. AHRQ Evidence Report/Technology Assessment No. 124. Available at: http://www.ahrq.gov/downloads/pub/evidence/pdf/rhinoupdate/rhinoup.pdf.
  • 15.
  • 16.
  • 17. Example: Summary Table for Cohort Studies Wang C, et al. AHRQ Evidence Report/Technology Assessment No. 94. Available at: http://www.ahrq.gov/downloads/pub/evidence/pdf/o3cardio/o3cardio.pdf.
  • 18.
  • 19. Example: Presentation of Data by Outcome and Age Chung M, et al. AHRQ Evidence Report/Technology Assessment No. 183. Available at: http://www.ahrq.gov/downloads/pub/evidence/pdf/vitadcal/vitadcal.pdf.
  • 20.
  • 21.
  • 22. Example: Evidence Map Terasawa T, et al. Ann Intern Med 2009;151:556-65. Reprinted with permission from the American College of Physicians.
  • 23. A Second Approach to an Evidence Map Raman G, et al. AHRQ Technology Assessment No. GEND1206. Available at: http://www.cms.gov/determinationprocess/downloads/id61TA.pdf. Dt: time (to stable dose) INR: international normalized ratio mean dose: mean maintenance dose
  • 24. Forest Plot Without Summary Favors Wide-Area Circumferential Ablation Favors Pulmonary Vein Isolation Ip S, et al. AHRQ Comparative Effectiveness Review No. 15. Available at: http://www.effectivehealthcare.ahrq.gov/ehc/products/51/114/2009_0623RadiofrequencyFinal.pdf.
  • 25. Summary Matrix Wang C, et al. AHRQ Evidence Report/Technology Assessment No. 94. Available at: http://www.ahrq.gov/downloads/pub/evidence/pdf/o3cardio/o3cardio.pdf.
  • 26.
  • 27.
  • 28.
  • 29.
  • 30.
  • 31.

Editor's Notes

  1. Presentation of Findings
  2. Systematic Review Process Overview This slide illustrates the steps in the systematic review process. This module focuses on the presentation of findings.
  3. Learning Objectives
  4. Organizing and Reporting Findings Identifying the analytic framework, key questions, and inclusion/exclusion criteria is important for gathering data, but presenting it in an efficient and intuitive manner is equally important, if not more so. Evidence tables are an integral part of the presentation, but they refer only to individual studies. Synthesizing information from multiple studies is crucial for producing useful conclusions. We discuss how and when to synthesize data and the summary tables used to illustrate this synthesized information.
  5. Why Not Meta-analysis? There are many factors that contribute to the decision about whether or not studies can be combined. Reference: Agency for Healthcare Research and Quality. Methods reference guide for effectiveness and comparative effectiveness reviews . Version 1.0. Rockville, MD: Agency for Healthcare Research and Quality, Draft Posted October 2007. Chapter 2, Finding evidence. Available at: http://effectivehealthcare.ahrq.gov/repFiles/2007_10DraftMethodsGuide.pdf.
  6. Solution Synthesizing a body of literature in a nonquantitative way requires the use of well-constructed and intuitive summary tables and highly structured text to support their interpretations. At the simplest level, it is always the case that presenting results in a structured, uniform manner makes it easier for readers to locate and apply findings. The sheer quantity of data and potential heterogeneity in the context of a systematic review raise this work to a higher level of complexity. Establishing a common pattern in presenting data throughout a report is one principle that can improve clarity and flow. The text mirrors and expands on summary tables that visually illustrate findings and commonalities in the evidence by condensing results from different studies into a single table without combining the data statistically. Reviewers in the Evidence-based Practice Centers typically use several types of tables, several examples of which are shown later in this presentation.
  7. PICOTS This slide provides a breakdown of PICOTS and gives examples for using these components to organize results.
  8. Combining Studies
  9. Summary Tables (I) Summary tables cover groups of studies rather than the individual studies represented in evidence tables.
  10. Summary Tables (II) The following slides provide examples of summary tables. Information is put together in tabular form, and the important characteristics and results of studies are readily available. There is no required format for summary tables. The key is to find the best construction to highlight the summary or particular data points.
  11. Example: Summary Table of Study Characteristics Reviews will usually have several different types of summary tables presented and discussed in the text. At least one overview table such as this one should be included, either for the entire body of literature or for each key question. No results of studies are presented here; rather, the intent is to characterize the literature in terms of variables such as study design, geographic location, funding source, and other study characteristics. Reference: Hartmann KE, McPheeters ML, Biller DH, et al. Treatment of Overactive Bladder in Women . Evidence Report/Technology Assessment No. 187 (Prepared by Vanderbilt University Evidence-based Practice Center under Contract No. 290-2007-10065-I). Rockville, MD: Agency for Healthcare Research and Quality, August 2009. AHRQ Publication No. 09-E017. Available at: http://www.ahrq.gov/downloads/pub/evidence/pdf/bladder/bladder.pdf.
  12. Example: Summary Table as High-Level Map This example is of a table that can help the reader navigate large reports, by using an overall summary table to convey high-level information. In a sense, this is a high-level map: what was compared to what, what was measured, and in what types of studies. Reference: Chung M, Balk EM, Brendel M, et al. Vitamin D and Calcium: A Systematic Review of Health Outcomes . Evidence Report/Technology Assessment No. 183. (Prepared by Tufts–New England Medical Center Evidence-based Practice Center under Contract No. HHSA 290-2007-10055-I). Rockville, MD: Agency for Healthcare Research and Quality, August 2009. AHRQ Publication No. 09-E015. Available at: http://www.ahrq.gov/downloads/pub/evidence/pdf/vitadcal/vitadcal.pdf.
  13. Example: Summary Table of Study Characteristics The overall summary table does not provide significant detail but is broad in its scope. For example, in this table, treatment effects are denoted as “+” or “−”. Detailed exposition per study is given in the evidence tables, which are presented in the module on data extraction. Reference: Balk EM, Lau J, Goudas LC, et al. Effects of statins on nonlipid serum markers associated with cardiovascular disease. Ann Intern Med 2003;139:670-82. http://www.ncbi.nlm.nih.gov/pubmed/14568856
  14. Visual Presentation of Available Comparisons It is often useful to visualize the availability of evidence addressing specific questions or comparisons within the comparative effectiveness or systematic review. In some settings, we may be inundated with a large number of studies and myriad comparisons. A matrix, as shown in this slide, could be constructed to depict the various comparisons that have been reported and the number of studies that have reported them. Such an “evidence map” could be used to help appreciate the scope of the evidence and to identify opportunities for meta-analyses. This slide comes from a 2005 evidence report update on acute bacterial rhinosinusitis. Reference : Ip S, Fu L, Balk E, et al. Update on Acute Bacterial Rhinosinusitis . Evidence Report/Technology Assessment No. 124 (Prepared by Tufts – New England Medical Center Evidence-based Practice Center under Contract No. 290-02-0022). Rockville, MD: Agency for Healthcare Research and Quality, June 2005. AHRQ Publication No. 05-E020-2. Available at: http://www.ahrq.gov/downloads/pub/evidence/pdf/rhinoupdate/rhinoup.pdf.
  15. Example: Summary Table of Prevalence Findings In addition to providing an overview, summary tables can be used to subset groups of studies or to highlight specific outcomes. For example, this case summary table was created for a key question about prevalence; therefore, it included only studies with prevalence data. In addition to presenting the prevalence data, columns were selected to reflect those characteristics that are important for assessing the strengths and limitations of studies that attempt to measure prevalence. Reference: Hartmann KE, McPheeters ML, Biller DH, et al. Treatment of Overactive Bladder in Women . Evidence Report/Technology Assessment No. 187 (Prepared by Vanderbilt University Evidence-based Practice Center under Contract No. 290-2007-10065-I). Rockville, MD: Agency for Healthcare Research and Quality, August 2009. AHRQ Publication No. 09-E017. Available at: http://www.ahrq.gov/downloads/pub/evidence/pdf/bladder/ bladder.pdf.
  16. Example: Summary Table for Randomized Controlled Trials Summary tables may be used to highlight results from specific study types. This table presents baseline and outcomes data only for the randomized controlled trials of one drug, oxybutynin, with a focus on one outcome, urge incontinence. Reference: Hartmann KE, McPheeters ML, Biller DH, et al. Treatment of Overactive Bladder in Women . Evidence Report/Technology Assessment No. 187 (Prepared by Vanderbilt University Evidence-based Practice Center under Contract No. 290-2007-10065-I). Rockville, MD: Agency for Healthcare Research and Quality, August 2009. AHRQ Publication No. 09-E017. Available at: http://www.ahrq.gov/downloads/pub/evidence/pdf/bladder/ bladder.pdf.
  17. Example: Summary Table for Cohort Studies Here is a presentation of the cohort studies available in a review of the effects of omega-3 fatty acids on cardiovascular disease. This table also incorporates the quality scores that were applied to the studies and a measure of their applicability in practice. Reference: Wang C, Chung M, Balk E, et al. Effects of Omega-3 Fatty Acids on Cardiovascular Disease. Evidence Report/Technology Assessment No. 94 (Prepared by Tufts–New England Medical Center Evidence-based Practice Center under Contract No. 209-02-0022). Rockville, MD: Agency for Healthcare Research and Quality, March 2004. AHRQ Publication No. 04-E009-2. Available at: http://www.ahrq.gov/downloads/pub/evidence/pdf/o3cardio/o3cardio.pdf.
  18. Example: Presentation of Harms Data Presentation of harms data can be challenging. This example table presents the range of proportions of individuals experiencing a given set of harms and the number of studies that provided data for the range. Reference: Hartmann KE, McPheeters ML, Biller DH, et al. Treatment of Overactive Bladder in Women . Evidence Report/Technology Assessment No. 187 (Prepared by Vanderbilt University Evidence-based Practice Center under Contract No. 290-2007-10065-I). Rockville, MD: Agency for Healthcare Research and Quality, August 2009. AHRQ Publication No. 09-E017. Available at: http://www.ahrq.gov/downloads/pub/evidence/pdf/bladder/bladder.pdf.
  19. Example: Presentation of Data by Outcome and Age This is another way to present the available evidence per outcome and life stage. Shaded areas mean that the specific outcome/life stage combination was not reviewed because it was not meaningful to do so. Reference: Chung M, Balk EM, Brendel M, et al. Vitamin D and Calcium: A Systematic Review of Health Outcomes . Evidence Report/Technology Assessment No. 183. (Prepared by Tufts–New England Medical Center Evidence-based Practice Center under Contract No. HHSA 290-2007-10055-I). Rockville, MD: Agency for Healthcare Research and Quality, August 2009. AHRQ Publication No. 09-E015. Available at: http://www.ahrq.gov/downloads/pub/evidence/pdf/vitadcal/vitadcal.pdf.
  20. Example: Presentation of Patient-Reported Outcomes In some cases, bodies of literature present few common outcomes across studies. This is often the case in fields where there may be many relevant outcomes or multiple ways to assess the outcomes (e.g., multiple quality of life measures). A more text-intensive table, such as this one, can be used to describe outcomes in the literature. Reference: Hartmann KE, McPheeters ML, Biller DH, et al. Treatment of Overactive Bladder in Women . Evidence Report/Technology Assessment No. 187 (Prepared by Vanderbilt University Evidence-based Practice Center under Contract No. 290-2007-10065-I). Rockville, MD: Agency for Healthcare Research and Quality, August 2009. AHRQ Publication No. 09-E017. Available at: http://www.ahrq.gov/downloads/pub/evidence/pdf/bladder/bladder.pdf.
  21. Evidence Maps Evidence maps are another way to present data graphically without synthesizing them quantitatively through statistical approaches to combining data.
  22. Example: Evidence Map This slide presents an evidence map of the available clinical research on charged particle beam radiotherapy for cancer. One can readily appreciate the number of studies conducted — stratified by cancer type, designs, and outcomes — while getting a sense of their relative sample sizes. Rows represent different cancer types. Super columns (separated by thicker vertical lines) stand for research designs (randomized controlled trials [RCTs], nonrandomized comparative studies, and noncomparative studies). Small columns denote outcomes (overall survival, cancer-specific survival, or other outcomes). Markers (empty circles) stand for published studies; their area is proportional to the sample size, and they have been jittered a bit to enhance visibility. The total number in each cell is shown in the lower right corner. See how few RCTs there are; they are relatively small and cover cancer types that are not very common. The same is true for nonrandomized comparative studies. Reference: Terasawa T, Dvorak T, Ip S, et al. Systematic review: charged-particle radiation therapy for cancer. Ann Intern Med 2009;151:556-65. http://www.ncbi.nlm.nih.gov/pubmed/19755348
  23. A Second Approach to an Evidence Map This evidence map makes evident how selective the reporting was in a pharmacogenetics review: Meta-analysis is limited to whatever data are reported in published studies. Often, readers of a systematic review do not realize how selective a view this is. Here there are 21 single nucleotide polymorphisms (SNPs) in VKORC1 (a gene implicated in the metabolism of warfarin) that have been studied for associations with a variety of outcomes in different populations. Rows represent SNPs. Outcome super columns (defined by thicker vertical lines labeled “INR<2,” “INR>3” and so on) represent surrogate outcomes. Within each outcome super column, fine columns represent the 23 distinct ethnic-descent population strata in the included studies. Empty cells indicate that the corresponding SNP (row) has not been studied in the corresponding population (fine column) for the outcome of the super column. Colored cells indicate that the corresponding association has been studied and that it was reported to be statistically nonsignificant (black) or significant (red or blue, depending upon the direction of the association), or that the study did not report the respective significance. In theory, one can perform a meta-analysis when there are many filled cells across a row/SNP in a super column/outcome. Look at the emptiness of the table and how “selected” the meta-analyses that we can conduct in this field are. This slide shows only surrogate outcomes. The corresponding table for the clinical outcomes (e.g. serious bleeding) does not have any filled cells. The “minor allele” is the less frequent of the two alleles in the population. We coined the genetic comparisons by considering as a “variant allele” the allele with the lowest frequency (i.e., the minor allele) in populations of European descent to ensure correct representation of the direction of the genetic effects. The color code of each cell is based on what is reported by each study. Statistical significance status in the primary studies could be based on different analyses (e.g., haplotype-based analyses or adjusted analyses) than the ones we performed in this technology assessment. Reference: Raman G, Trikalinos TA, Zintzaras E, et al. Reviews of Selected Pharmacogenetic Tests for Non-Cancer and Cancer Conditions . Technology Assessment No. GEND1206 (Prepared by Tufts–New England Medical Center Evidence-based Practice Center under Contract No. 290-02-0022). Rockville, MD: Agency for Healthcare Research and Quality, November 2008. Available at: http://www.cms.gov/determinationprocess/downloads/id61TA.pdf.
  24. Forest Plot Without Summary In addition to summary tables and evidence maps, we suggest two other approaches to graphic presentation of data in comparative effectiveness or systematic reviews: the forest plot and the summary matrix. A forest plot is often used in presenting meta-analysis data, but it can also be useful when we are not combining studies statistically. In this example, a decision was made not to conduct a meta-analysis because of too much interstudy clinical heterogeneity. Rather, the results were presented graphically in a forest plot without a summary synthesis. This is an alternative presentation of study-level effects that can be combined with a summary table. This type of summary could tempt readers to draw a mental summary effect, so its purpose should be stated clearly in the corresponding legend. Reference: Ip S, Terasawa T, Balk EM, et al. Comparative Effectiveness of Radiofrequency Catheter Ablation for Atrial Fibrillation . Comparative Effectiveness Review No. 15 (Prepared by Tufts–New England Medical Center Evidence-based Practice Center under Contract No. 290-02-0022). Rockville, MD: Agency for Healthcare Research and Quality, July 2009. AHRQ Pub. No. 09-EHC015-EF. Available at: http://www.effectivehealthcare.ahrq.gov/ehc/products/51/114/2009_0623RadiofrequencyFinal.pdf.
  25. Summary Matrix A summary matrix such as this one shows the relationship between the methodological quality of the studies and their applicability in practice. Usually, the studies with the best methodological quality (a proxy for studies with the least susceptibility to bias) are not the ones that have the best applicability (a proxy for how generalizable the findings are to the key question or population of interest). This is exemplified by a quality-applicability summary matrix. The least-biased studies may not be applicable to the population of interest. Reference: Wang C, Chung M, Balk E, et al. Effects of Omega-3 Fatty Acids on Cardiovascular Disease. Evidence Report/Technology Assessment No. 94 (Prepared by Tufts –New England Medical Center Evidence-based Practice Center under Contract No. 209-02-0022). Rockville, MD: Agency for Healthcare Research and Quality, March 2004. AHRQ Publication No. 04-E009-2. Available at: http://www.ahrq.gov/downloads/pub/evidence/pdf/o3cardio/o3cardio.pdf.
  26. Key Messages
  27. References (I)
  28. References (II)
  29. References (III)
  30. References (IV)
  31. Authors