SlideShare a Scribd company logo
1 of 21
APPLICATION OF ASSESSMENT AND
EVALUATION DATA TO IMPROVE A DYNAMIC
    GRADUATE MEDICAL EDUCATION
             CURRICULUM
      TIFFANY L. SMITH, PATRICK B. BARLOW,
     ROBERT E. HEIDEL, & WILLIAM METHENY
A LAYOUT OF THE PRESENTATION
   Setting the Scene
       – The Task
       – The Complexities
   Explanation of the tools created
   and the process of creating them
      1. Assessment Tool
      2. Precourse Tool
      3. Classroom Activities and
         Homework
      4. An Evaluation Tool
      5. Fine-Tuning
    The Result of Our Efforts
       – How this process informs
         our task
       – A lesson
       – Suggestions
    Questions
SETTING THE
     SCENE

Systems thinking and
complexity concepts
 as frameworks for
   conceptualizing
     interventions
    (Patton, 2010)
THE TASK

 The creation of a blanket syllabus and set of learning
objectives for research design and statistics that can be
             worked into any lecture series.
THE COMPLEXITIES
• Target Audience
  – Time constraint
  – Intrinsic motivation toward research


• Accreditation and Accountability

• Absence of Materials

• Stakeholder Buy-In
THE PROCESS
• What did we start with?

• What is it like to be without a formal set of
  objectives or a syllabus?

• What do we do to change?



                       Where do we go from here?...
FIRST: AN ASSESSMENT TOOL
• Implementation of an initial assessment for
  the purposes of understanding:

  – Student baseline knowledge

  – Student progress at the completion of the series
SECOND: A PRE-COURSE TOOL
• The initiation of a pre-course survey

   – What do our students want to get out of the course?

   – Who are they?

   – What are their interests?

   – Perceptions of the usefulness of the course
THIRD: CLASSROOM ACTIVITIES AND
                HOMEWORK
• New classroom activities related to applying what
  they’ve learned

• New homework assignments to assess their
  ability to apply course content outside of the
  classroom

• A final research proposal project
   – Incorporating the course content into an oral
     presentation
FOURTH: AN EVALUATION TOOL
• Development of a post-course survey to assess:

  – Change in perceptions

  – Change in attitudes

  – Evaluation of instructor contribution

  – Utility of the modules
A Constant Process of Fine-Tuning
THE RESULT OF OUR EFFORTS TO
 UNDERSTAND AND OPERATE IN A DYNAMIC
               SYSTEM

     We implemented all of these sweeping
 curriculum and measurement changes almost
   exactly one year after our first experience
teaching the material, and it was universally the
most successful and rigorous workshop to date.
HOW THIS PROCESS
     INFORMS OUR TASK
• As this academic year’s workshops get
  underway, there will be a constant turning of the
  feedback wheel
• Utilization of data
• Constant adaptation is KEY
• Constant, critical reflection on our own work
  (Stevahn, King, Ghere, & Minnema, 2005)
• Must remember the complex nature of the task
• This was not only an implementation of a
  course. Not just the implementation of a new
  assessment.
• It was also the implementation of evaluation
  into the process of course development and
  modification.
A LESSON
                    

  Learning objectives, like many things,
cannot be looked at like a   logic model,
with rigidity and fixedness, but instead

      like a   process that will
         change over time.
SUGGESTIONS
Promote feedback and utilization of results
Remember the nature of the organization
Collaborate with colleagues
Use reflection for improvement and
            development
Think outside the box
THANK YOU!

QUESTIONS?

More Related Content

What's hot

Action research: Basic Information on Action Research
Action research: Basic Information on Action ResearchAction research: Basic Information on Action Research
Action research: Basic Information on Action ResearchSameer Babu M
 
Surveys and tests, colleen kelly
Surveys and tests, colleen kellySurveys and tests, colleen kelly
Surveys and tests, colleen kellyColleen Kelly
 
Data and assessment powerpoint presentation 2015
Data and assessment powerpoint presentation 2015Data and assessment powerpoint presentation 2015
Data and assessment powerpoint presentation 2015Erica Zigelman
 
Quantitative & Qualitative Assessment
Quantitative & Qualitative AssessmentQuantitative & Qualitative Assessment
Quantitative & Qualitative AssessmentAnshuDembla
 
Tools and Evaluation Techniques to Support Social Awareness in CSCeL: The AV...
 Tools and Evaluation Techniques to Support Social Awareness in CSCeL: The AV... Tools and Evaluation Techniques to Support Social Awareness in CSCeL: The AV...
Tools and Evaluation Techniques to Support Social Awareness in CSCeL: The AV...Niki Lambropoulos PhD
 
Magdy thesis evaluation
Magdy thesis evaluationMagdy thesis evaluation
Magdy thesis evaluationMagdy Aly
 
Research questions and hypotheses_Hang_Vietnam
Research questions and hypotheses_Hang_VietnamResearch questions and hypotheses_Hang_Vietnam
Research questions and hypotheses_Hang_VietnamHangNguyenPhuocDieu
 
Micro teaching on pilot study
Micro teaching on pilot studyMicro teaching on pilot study
Micro teaching on pilot studyShaells Joshi
 
Annette jordan creating an effective test or survey instrument
Annette jordan creating an effective test or survey instrumentAnnette jordan creating an effective test or survey instrument
Annette jordan creating an effective test or survey instrumentaljordan22
 
Learning-oriented assessment in an era of high-stakes and insecure testing
Learning-oriented assessment in an era of high-stakes and insecure testingLearning-oriented assessment in an era of high-stakes and insecure testing
Learning-oriented assessment in an era of high-stakes and insecure testingMark Carver
 
Design Chapter 7 - Testing and Evaluation Techniques
Design Chapter 7 - Testing and Evaluation TechniquesDesign Chapter 7 - Testing and Evaluation Techniques
Design Chapter 7 - Testing and Evaluation Techniquesguest01bdf1
 
Gary Jones ResearchED Research Leads Conference March 2015
Gary Jones ResearchED Research Leads Conference March 2015Gary Jones ResearchED Research Leads Conference March 2015
Gary Jones ResearchED Research Leads Conference March 2015researchED
 
Research leads #rEDCamb March 15th 2015
Research leads #rEDCamb March 15th 2015Research leads #rEDCamb March 15th 2015
Research leads #rEDCamb March 15th 2015Greenford High School
 
Research day 2011
Research day 2011Research day 2011
Research day 2011tanbob
 

What's hot (20)

Teaching CATs - EBM Teachers Network
Teaching CATs - EBM Teachers NetworkTeaching CATs - EBM Teachers Network
Teaching CATs - EBM Teachers Network
 
Action research: Basic Information on Action Research
Action research: Basic Information on Action ResearchAction research: Basic Information on Action Research
Action research: Basic Information on Action Research
 
Surveys and tests, colleen kelly
Surveys and tests, colleen kellySurveys and tests, colleen kelly
Surveys and tests, colleen kelly
 
Data and assessment powerpoint presentation 2015
Data and assessment powerpoint presentation 2015Data and assessment powerpoint presentation 2015
Data and assessment powerpoint presentation 2015
 
Quantitative & Qualitative Assessment
Quantitative & Qualitative AssessmentQuantitative & Qualitative Assessment
Quantitative & Qualitative Assessment
 
Tools and Evaluation Techniques to Support Social Awareness in CSCeL: The AV...
 Tools and Evaluation Techniques to Support Social Awareness in CSCeL: The AV... Tools and Evaluation Techniques to Support Social Awareness in CSCeL: The AV...
Tools and Evaluation Techniques to Support Social Awareness in CSCeL: The AV...
 
Magdy thesis evaluation
Magdy thesis evaluationMagdy thesis evaluation
Magdy thesis evaluation
 
Questionnaire
QuestionnaireQuestionnaire
Questionnaire
 
Research questions and hypotheses_Hang_Vietnam
Research questions and hypotheses_Hang_VietnamResearch questions and hypotheses_Hang_Vietnam
Research questions and hypotheses_Hang_Vietnam
 
ARLG 2019: Myer have we made a difference
ARLG 2019: Myer have we made a differenceARLG 2019: Myer have we made a difference
ARLG 2019: Myer have we made a difference
 
Micro teaching on pilot study
Micro teaching on pilot studyMicro teaching on pilot study
Micro teaching on pilot study
 
Cd3
Cd3Cd3
Cd3
 
Annette jordan creating an effective test or survey instrument
Annette jordan creating an effective test or survey instrumentAnnette jordan creating an effective test or survey instrument
Annette jordan creating an effective test or survey instrument
 
The research problem
The research problemThe research problem
The research problem
 
Learning-oriented assessment in an era of high-stakes and insecure testing
Learning-oriented assessment in an era of high-stakes and insecure testingLearning-oriented assessment in an era of high-stakes and insecure testing
Learning-oriented assessment in an era of high-stakes and insecure testing
 
Design Chapter 7 - Testing and Evaluation Techniques
Design Chapter 7 - Testing and Evaluation TechniquesDesign Chapter 7 - Testing and Evaluation Techniques
Design Chapter 7 - Testing and Evaluation Techniques
 
Gary Jones ResearchED Research Leads Conference March 2015
Gary Jones ResearchED Research Leads Conference March 2015Gary Jones ResearchED Research Leads Conference March 2015
Gary Jones ResearchED Research Leads Conference March 2015
 
Assessment tools
Assessment toolsAssessment tools
Assessment tools
 
Research leads #rEDCamb March 15th 2015
Research leads #rEDCamb March 15th 2015Research leads #rEDCamb March 15th 2015
Research leads #rEDCamb March 15th 2015
 
Research day 2011
Research day 2011Research day 2011
Research day 2011
 

Viewers also liked

The Development of the Biostatistics & Clinical Epideimiolgy Skills (BACES) A...
The Development of the Biostatistics & Clinical Epideimiolgy Skills (BACES) A...The Development of the Biostatistics & Clinical Epideimiolgy Skills (BACES) A...
The Development of the Biostatistics & Clinical Epideimiolgy Skills (BACES) A...Pat Barlow
 
New Benchmark 500 Uploads!
New Benchmark 500 Uploads!New Benchmark 500 Uploads!
New Benchmark 500 Uploads!Pat Barlow
 
Bad Statistics, Bad Reporting, Bad Impact on Patients: The Story of the PACE ...
Bad Statistics, Bad Reporting, Bad Impact on Patients: The Story of the PACE ...Bad Statistics, Bad Reporting, Bad Impact on Patients: The Story of the PACE ...
Bad Statistics, Bad Reporting, Bad Impact on Patients: The Story of the PACE ...Julie Rehmeyer
 
Fundamentals of measurement
Fundamentals of measurementFundamentals of measurement
Fundamentals of measurementPat Barlow
 
Brief Look at Association vs causation
Brief Look at Association vs causationBrief Look at Association vs causation
Brief Look at Association vs causationPat Barlow
 
Comparing research designs fw 2013 handout version
Comparing research designs fw 2013 handout versionComparing research designs fw 2013 handout version
Comparing research designs fw 2013 handout versionPat Barlow
 
Lecture of epidemiology
Lecture of epidemiologyLecture of epidemiology
Lecture of epidemiologyAmany El-seoud
 
Commonly used Statistics in Medical Research Handout
Commonly used Statistics in Medical Research HandoutCommonly used Statistics in Medical Research Handout
Commonly used Statistics in Medical Research HandoutPat Barlow
 
Common measures of association in medical research handout
Common measures of association in medical research handoutCommon measures of association in medical research handout
Common measures of association in medical research handoutPat Barlow
 
Common measures of association in medical research (UPDATED) 2013
Common measures of association in medical research (UPDATED) 2013Common measures of association in medical research (UPDATED) 2013
Common measures of association in medical research (UPDATED) 2013Pat Barlow
 

Viewers also liked (20)

Quality
QualityQuality
Quality
 
Life style
Life styleLife style
Life style
 
Social marketing
Social marketingSocial marketing
Social marketing
 
The Development of the Biostatistics & Clinical Epideimiolgy Skills (BACES) A...
The Development of the Biostatistics & Clinical Epideimiolgy Skills (BACES) A...The Development of the Biostatistics & Clinical Epideimiolgy Skills (BACES) A...
The Development of the Biostatistics & Clinical Epideimiolgy Skills (BACES) A...
 
Auditing1
Auditing1Auditing1
Auditing1
 
New Benchmark 500 Uploads!
New Benchmark 500 Uploads!New Benchmark 500 Uploads!
New Benchmark 500 Uploads!
 
Bad Statistics, Bad Reporting, Bad Impact on Patients: The Story of the PACE ...
Bad Statistics, Bad Reporting, Bad Impact on Patients: The Story of the PACE ...Bad Statistics, Bad Reporting, Bad Impact on Patients: The Story of the PACE ...
Bad Statistics, Bad Reporting, Bad Impact on Patients: The Story of the PACE ...
 
Complex sampling design & analysis
Complex sampling design & analysisComplex sampling design & analysis
Complex sampling design & analysis
 
Research Made Easy
Research Made EasyResearch Made Easy
Research Made Easy
 
Medical statistics2
Medical statistics2Medical statistics2
Medical statistics2
 
Regression analysis
Regression analysisRegression analysis
Regression analysis
 
Fundamentals of measurement
Fundamentals of measurementFundamentals of measurement
Fundamentals of measurement
 
Brief Look at Association vs causation
Brief Look at Association vs causationBrief Look at Association vs causation
Brief Look at Association vs causation
 
Sociology
SociologySociology
Sociology
 
Comparing research designs fw 2013 handout version
Comparing research designs fw 2013 handout versionComparing research designs fw 2013 handout version
Comparing research designs fw 2013 handout version
 
Data management & statistics in clinical trials
Data management & statistics in clinical trialsData management & statistics in clinical trials
Data management & statistics in clinical trials
 
Lecture of epidemiology
Lecture of epidemiologyLecture of epidemiology
Lecture of epidemiology
 
Commonly used Statistics in Medical Research Handout
Commonly used Statistics in Medical Research HandoutCommonly used Statistics in Medical Research Handout
Commonly used Statistics in Medical Research Handout
 
Common measures of association in medical research handout
Common measures of association in medical research handoutCommon measures of association in medical research handout
Common measures of association in medical research handout
 
Common measures of association in medical research (UPDATED) 2013
Common measures of association in medical research (UPDATED) 2013Common measures of association in medical research (UPDATED) 2013
Common measures of association in medical research (UPDATED) 2013
 

Similar to Application of assessment and evaluation data to improve a dynamic graduate medical education curriculum smith et al 2012

Application of Assessment and Evaluation Data to Improve a Dynamic Graduate M...
Application of Assessment and Evaluation Data to Improve a Dynamic Graduate M...Application of Assessment and Evaluation Data to Improve a Dynamic Graduate M...
Application of Assessment and Evaluation Data to Improve a Dynamic Graduate M...Tiffany Smith
 
Pet 735 presentation week 15
Pet 735 presentation week 15Pet 735 presentation week 15
Pet 735 presentation week 15rrbrown
 
online-notebook-XL.pptx Field Study for Teaching Assisstantship
online-notebook-XL.pptx Field Study for Teaching Assisstantshiponline-notebook-XL.pptx Field Study for Teaching Assisstantship
online-notebook-XL.pptx Field Study for Teaching AssisstantshipJesselQuitorio4
 
Summary of course curriculum evaluation
Summary of course curriculum evaluationSummary of course curriculum evaluation
Summary of course curriculum evaluationShafeeq Hussain
 
Jace Hargis Designing Online Teaching
Jace Hargis Designing Online TeachingJace Hargis Designing Online Teaching
Jace Hargis Designing Online TeachingJace Hargis
 
501 assignment 8 slideshare evaluation
501 assignment 8 slideshare evaluation501 assignment 8 slideshare evaluation
501 assignment 8 slideshare evaluationKaWright1961
 
Educational supervision presentation
Educational supervision presentationEducational supervision presentation
Educational supervision presentationuniversity of karachi
 
WhatWhy-and-How-to-Evaluate-a-Curriculum.pptx
WhatWhy-and-How-to-Evaluate-a-Curriculum.pptxWhatWhy-and-How-to-Evaluate-a-Curriculum.pptx
WhatWhy-and-How-to-Evaluate-a-Curriculum.pptxEckelleGraceMagalay
 
Sensemaking LS and DL
Sensemaking LS and DLSensemaking LS and DL
Sensemaking LS and DLPhilwood
 
Online assessment
Online assessmentOnline assessment
Online assessmentNisha Singh
 
Interrogating evaluation 2015 inductionb
Interrogating evaluation 2015 inductionbInterrogating evaluation 2015 inductionb
Interrogating evaluation 2015 inductionbRita Ndagire Kizito
 
Interrogating evaluation 2015 induction
Interrogating evaluation 2015 inductionInterrogating evaluation 2015 induction
Interrogating evaluation 2015 inductionRita Ndagire Kizito
 
Designing and conducting summative evaluations
Designing and conducting summative evaluationsDesigning and conducting summative evaluations
Designing and conducting summative evaluationsMichael8531
 
Designing and conducting summative evaluations
Designing and conducting summative evaluationsDesigning and conducting summative evaluations
Designing and conducting summative evaluationsMichael8531
 
CHAPTER 6 curriculum Evaluation 1.2.pptx
CHAPTER 6 curriculum Evaluation 1.2.pptxCHAPTER 6 curriculum Evaluation 1.2.pptx
CHAPTER 6 curriculum Evaluation 1.2.pptxAngelouRivera
 
Phases of Administering the Curriculum
Phases of Administering the CurriculumPhases of Administering the Curriculum
Phases of Administering the CurriculumSharon Geroquia
 
UBD Presentation for schools and application.pptx
UBD Presentation for schools and application.pptxUBD Presentation for schools and application.pptx
UBD Presentation for schools and application.pptxmarianarocamoraalt
 
Ped 104 curriculum improvement final (1)
Ped 104 curriculum improvement final   (1)Ped 104 curriculum improvement final   (1)
Ped 104 curriculum improvement final (1)JOHNDAVEANIONBARTE
 

Similar to Application of assessment and evaluation data to improve a dynamic graduate medical education curriculum smith et al 2012 (20)

Application of Assessment and Evaluation Data to Improve a Dynamic Graduate M...
Application of Assessment and Evaluation Data to Improve a Dynamic Graduate M...Application of Assessment and Evaluation Data to Improve a Dynamic Graduate M...
Application of Assessment and Evaluation Data to Improve a Dynamic Graduate M...
 
Pet 735 presentation week 15
Pet 735 presentation week 15Pet 735 presentation week 15
Pet 735 presentation week 15
 
online-notebook-XL.pptx Field Study for Teaching Assisstantship
online-notebook-XL.pptx Field Study for Teaching Assisstantshiponline-notebook-XL.pptx Field Study for Teaching Assisstantship
online-notebook-XL.pptx Field Study for Teaching Assisstantship
 
Summary of course curriculum evaluation
Summary of course curriculum evaluationSummary of course curriculum evaluation
Summary of course curriculum evaluation
 
Jace Hargis Designing Online Teaching
Jace Hargis Designing Online TeachingJace Hargis Designing Online Teaching
Jace Hargis Designing Online Teaching
 
501 assignment 8 slideshare evaluation
501 assignment 8 slideshare evaluation501 assignment 8 slideshare evaluation
501 assignment 8 slideshare evaluation
 
Educational supervision presentation
Educational supervision presentationEducational supervision presentation
Educational supervision presentation
 
WhatWhy-and-How-to-Evaluate-a-Curriculum.pptx
WhatWhy-and-How-to-Evaluate-a-Curriculum.pptxWhatWhy-and-How-to-Evaluate-a-Curriculum.pptx
WhatWhy-and-How-to-Evaluate-a-Curriculum.pptx
 
Presentation: Assessments & Rubrics
Presentation: Assessments & RubricsPresentation: Assessments & Rubrics
Presentation: Assessments & Rubrics
 
Sensemaking LS and DL
Sensemaking LS and DLSensemaking LS and DL
Sensemaking LS and DL
 
Online assessment
Online assessmentOnline assessment
Online assessment
 
Interrogating evaluation 2015 inductionb
Interrogating evaluation 2015 inductionbInterrogating evaluation 2015 inductionb
Interrogating evaluation 2015 inductionb
 
Interrogating evaluation 2015 induction
Interrogating evaluation 2015 inductionInterrogating evaluation 2015 induction
Interrogating evaluation 2015 induction
 
Designing and conducting summative evaluations
Designing and conducting summative evaluationsDesigning and conducting summative evaluations
Designing and conducting summative evaluations
 
Designing and conducting summative evaluations
Designing and conducting summative evaluationsDesigning and conducting summative evaluations
Designing and conducting summative evaluations
 
Assessment and Rubrics
Assessment and RubricsAssessment and Rubrics
Assessment and Rubrics
 
CHAPTER 6 curriculum Evaluation 1.2.pptx
CHAPTER 6 curriculum Evaluation 1.2.pptxCHAPTER 6 curriculum Evaluation 1.2.pptx
CHAPTER 6 curriculum Evaluation 1.2.pptx
 
Phases of Administering the Curriculum
Phases of Administering the CurriculumPhases of Administering the Curriculum
Phases of Administering the Curriculum
 
UBD Presentation for schools and application.pptx
UBD Presentation for schools and application.pptxUBD Presentation for schools and application.pptx
UBD Presentation for schools and application.pptx
 
Ped 104 curriculum improvement final (1)
Ped 104 curriculum improvement final   (1)Ped 104 curriculum improvement final   (1)
Ped 104 curriculum improvement final (1)
 

More from Pat Barlow

REVISED 5-14: Curriculum vitae Barlow
REVISED 5-14: Curriculum vitae BarlowREVISED 5-14: Curriculum vitae Barlow
REVISED 5-14: Curriculum vitae BarlowPat Barlow
 
Commonly Used Statistics in Medical Research Part I
Commonly Used Statistics in Medical Research Part ICommonly Used Statistics in Medical Research Part I
Commonly Used Statistics in Medical Research Part IPat Barlow
 
Commonly Used Statistics in Survey Research
Commonly Used Statistics in Survey ResearchCommonly Used Statistics in Survey Research
Commonly Used Statistics in Survey ResearchPat Barlow
 
What's Significant? Hypothesis Testing, Effect Size, Confidence Intervals, & ...
What's Significant? Hypothesis Testing, Effect Size, Confidence Intervals, & ...What's Significant? Hypothesis Testing, Effect Size, Confidence Intervals, & ...
What's Significant? Hypothesis Testing, Effect Size, Confidence Intervals, & ...Pat Barlow
 
Retrospective application of systems thinking and isomorphism to a complex mu...
Retrospective application of systems thinking and isomorphism to a complex mu...Retrospective application of systems thinking and isomorphism to a complex mu...
Retrospective application of systems thinking and isomorphism to a complex mu...Pat Barlow
 
Comparing Research Designs
Comparing Research DesignsComparing Research Designs
Comparing Research DesignsPat Barlow
 

More from Pat Barlow (6)

REVISED 5-14: Curriculum vitae Barlow
REVISED 5-14: Curriculum vitae BarlowREVISED 5-14: Curriculum vitae Barlow
REVISED 5-14: Curriculum vitae Barlow
 
Commonly Used Statistics in Medical Research Part I
Commonly Used Statistics in Medical Research Part ICommonly Used Statistics in Medical Research Part I
Commonly Used Statistics in Medical Research Part I
 
Commonly Used Statistics in Survey Research
Commonly Used Statistics in Survey ResearchCommonly Used Statistics in Survey Research
Commonly Used Statistics in Survey Research
 
What's Significant? Hypothesis Testing, Effect Size, Confidence Intervals, & ...
What's Significant? Hypothesis Testing, Effect Size, Confidence Intervals, & ...What's Significant? Hypothesis Testing, Effect Size, Confidence Intervals, & ...
What's Significant? Hypothesis Testing, Effect Size, Confidence Intervals, & ...
 
Retrospective application of systems thinking and isomorphism to a complex mu...
Retrospective application of systems thinking and isomorphism to a complex mu...Retrospective application of systems thinking and isomorphism to a complex mu...
Retrospective application of systems thinking and isomorphism to a complex mu...
 
Comparing Research Designs
Comparing Research DesignsComparing Research Designs
Comparing Research Designs
 

Recently uploaded

The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxheathfieldcps1
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.christianmathematics
 
How to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSHow to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSCeline George
 
On National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan FellowsOn National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan FellowsMebane Rash
 
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17  How to Extend Models Using Mixin ClassesMixin Classes in Odoo 17  How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17 How to Extend Models Using Mixin ClassesCeline George
 
Sociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning ExhibitSociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning Exhibitjbellavia9
 
Food safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfFood safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfSherif Taha
 
General Principles of Intellectual Property: Concepts of Intellectual Proper...
General Principles of Intellectual Property: Concepts of Intellectual  Proper...General Principles of Intellectual Property: Concepts of Intellectual  Proper...
General Principles of Intellectual Property: Concepts of Intellectual Proper...Poonam Aher Patil
 
PROCESS RECORDING FORMAT.docx
PROCESS      RECORDING        FORMAT.docxPROCESS      RECORDING        FORMAT.docx
PROCESS RECORDING FORMAT.docxPoojaSen20
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdfQucHHunhnh
 
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...Nguyen Thanh Tu Collection
 
Magic bus Group work1and 2 (Team 3).pptx
Magic bus Group work1and 2 (Team 3).pptxMagic bus Group work1and 2 (Team 3).pptx
Magic bus Group work1and 2 (Team 3).pptxdhanalakshmis0310
 
Understanding Accommodations and Modifications
Understanding  Accommodations and ModificationsUnderstanding  Accommodations and Modifications
Understanding Accommodations and ModificationsMJDuyan
 
Making communications land - Are they received and understood as intended? we...
Making communications land - Are they received and understood as intended? we...Making communications land - Are they received and understood as intended? we...
Making communications land - Are they received and understood as intended? we...Association for Project Management
 
Spellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please PractiseSpellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please PractiseAnaAcapella
 
Seal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptxSeal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptxnegromaestrong
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfAdmir Softic
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17Celine George
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxAreebaZafar22
 

Recently uploaded (20)

The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
How to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSHow to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POS
 
On National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan FellowsOn National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan Fellows
 
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17  How to Extend Models Using Mixin ClassesMixin Classes in Odoo 17  How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
 
Sociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning ExhibitSociology 101 Demonstration of Learning Exhibit
Sociology 101 Demonstration of Learning Exhibit
 
Food safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfFood safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdf
 
General Principles of Intellectual Property: Concepts of Intellectual Proper...
General Principles of Intellectual Property: Concepts of Intellectual  Proper...General Principles of Intellectual Property: Concepts of Intellectual  Proper...
General Principles of Intellectual Property: Concepts of Intellectual Proper...
 
PROCESS RECORDING FORMAT.docx
PROCESS      RECORDING        FORMAT.docxPROCESS      RECORDING        FORMAT.docx
PROCESS RECORDING FORMAT.docx
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
 
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
 
Magic bus Group work1and 2 (Team 3).pptx
Magic bus Group work1and 2 (Team 3).pptxMagic bus Group work1and 2 (Team 3).pptx
Magic bus Group work1and 2 (Team 3).pptx
 
Understanding Accommodations and Modifications
Understanding  Accommodations and ModificationsUnderstanding  Accommodations and Modifications
Understanding Accommodations and Modifications
 
Making communications land - Are they received and understood as intended? we...
Making communications land - Are they received and understood as intended? we...Making communications land - Are they received and understood as intended? we...
Making communications land - Are they received and understood as intended? we...
 
Spellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please PractiseSpellings Wk 3 English CAPS CARES Please Practise
Spellings Wk 3 English CAPS CARES Please Practise
 
Seal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptxSeal of Good Local Governance (SGLG) 2024Final.pptx
Seal of Good Local Governance (SGLG) 2024Final.pptx
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
Spatium Project Simulation student brief
Spatium Project Simulation student briefSpatium Project Simulation student brief
Spatium Project Simulation student brief
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 
ICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptxICT Role in 21st Century Education & its Challenges.pptx
ICT Role in 21st Century Education & its Challenges.pptx
 

Application of assessment and evaluation data to improve a dynamic graduate medical education curriculum smith et al 2012

  • 1. APPLICATION OF ASSESSMENT AND EVALUATION DATA TO IMPROVE A DYNAMIC GRADUATE MEDICAL EDUCATION CURRICULUM TIFFANY L. SMITH, PATRICK B. BARLOW, ROBERT E. HEIDEL, & WILLIAM METHENY
  • 2. A LAYOUT OF THE PRESENTATION Setting the Scene – The Task – The Complexities Explanation of the tools created and the process of creating them 1. Assessment Tool 2. Precourse Tool 3. Classroom Activities and Homework 4. An Evaluation Tool 5. Fine-Tuning The Result of Our Efforts – How this process informs our task – A lesson – Suggestions Questions
  • 3. SETTING THE SCENE Systems thinking and complexity concepts as frameworks for conceptualizing interventions (Patton, 2010)
  • 4. THE TASK The creation of a blanket syllabus and set of learning objectives for research design and statistics that can be worked into any lecture series.
  • 5. THE COMPLEXITIES • Target Audience – Time constraint – Intrinsic motivation toward research • Accreditation and Accountability • Absence of Materials • Stakeholder Buy-In
  • 6. THE PROCESS • What did we start with? • What is it like to be without a formal set of objectives or a syllabus? • What do we do to change? Where do we go from here?...
  • 7. FIRST: AN ASSESSMENT TOOL • Implementation of an initial assessment for the purposes of understanding: – Student baseline knowledge – Student progress at the completion of the series
  • 8. SECOND: A PRE-COURSE TOOL • The initiation of a pre-course survey – What do our students want to get out of the course? – Who are they? – What are their interests? – Perceptions of the usefulness of the course
  • 9. THIRD: CLASSROOM ACTIVITIES AND HOMEWORK • New classroom activities related to applying what they’ve learned • New homework assignments to assess their ability to apply course content outside of the classroom • A final research proposal project – Incorporating the course content into an oral presentation
  • 10. FOURTH: AN EVALUATION TOOL • Development of a post-course survey to assess: – Change in perceptions – Change in attitudes – Evaluation of instructor contribution – Utility of the modules
  • 11. A Constant Process of Fine-Tuning
  • 12. THE RESULT OF OUR EFFORTS TO UNDERSTAND AND OPERATE IN A DYNAMIC SYSTEM We implemented all of these sweeping curriculum and measurement changes almost exactly one year after our first experience teaching the material, and it was universally the most successful and rigorous workshop to date.
  • 13. HOW THIS PROCESS INFORMS OUR TASK • As this academic year’s workshops get underway, there will be a constant turning of the feedback wheel • Utilization of data • Constant adaptation is KEY • Constant, critical reflection on our own work (Stevahn, King, Ghere, & Minnema, 2005) • Must remember the complex nature of the task • This was not only an implementation of a course. Not just the implementation of a new assessment. • It was also the implementation of evaluation into the process of course development and modification.
  • 14. A LESSON  Learning objectives, like many things, cannot be looked at like a logic model, with rigidity and fixedness, but instead like a process that will change over time.
  • 16. Promote feedback and utilization of results
  • 17. Remember the nature of the organization
  • 19. Use reflection for improvement and development