SlideShare a Scribd company logo
1 of 24
MAKING MEASURES FOR ACCURATE INFERENCES MONIQUE BIJKER MARCEL VAN DER KLINK ELS BOSHUIZEN CELSTEC, OPEN UNIVERSITY OF THE NETHERLANDS
OVERVIEW ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
PRACTICAL BACKGROUND ,[object Object]
TOWER OF BABEL ,[object Object],[object Object],[object Object],[object Object],[object Object]
VAGUENESS ,[object Object],[object Object]
FINDINGS BASED ON LITERATURE ,[object Object],[object Object],[object Object]
FINDINGS BASED ON LITERATURE ,[object Object],[object Object],[object Object],[object Object],[object Object]
UNADDRESSED QUESTIONS ,[object Object],[object Object],[object Object]
APPROACH ,[object Object],[object Object],[object Object],[object Object],[object Object]
WHY THE RASCH MODEL? ,[object Object],[object Object],[object Object],[object Object],[object Object]
SCALE DISTANCES AND ITEM CONTRIBUTIONS
OTHER PROBLEMS: DISORDERED THRESHOLDS
FORMULA  ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
DATA  COLLECTION ,[object Object],[object Object],[object Object]
RESULTS ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
SCALES SUCH AS TSE tem Infit Outfit Measure Error PTMEA Miscellaneous 83 and 84 are similar in ES and Psy. 80  is different in ES and Psy.  77 .82 .84 1.86 .13 .57 80 1.29 1.27 1.03 .14 .42 72 .74 .74 .90 .14 .70 84 .98 .91 .51A .14 .60 70 .64 .64 .22A .15 .69 71 .77 .75 .09A .15 .72 83 .99 .94 -.41A .15 .70 73 1.13 1.07 -1.10A .15 .54 78 .88 .82 -1.16 .15 .74 All items Mean .91 .89 .21 .15 Person Reliability .79 SD. .19 .18 .94 .01 Person Separation 1.91 All persons Item Reliability .97 Mean .89 .89 1.62 .62 Item Separation 6.24 SD .64 .64 1.35 .11 Cronbach alpha .82 Average measures 1  2  3  4  5  -1.96  -.61  .58  2.37  4.10 Step calibration measures -3.79  -1.95  1.19  4.55
 
 
 
 
Implications for practice ,[object Object],[object Object],[object Object]
Implications for future research ,[object Object],[object Object],[object Object],[object Object]
Rude questions…  ,[object Object],[object Object],[object Object]
THANK YOU FOR YOUR ATTENTION.  Any questions? [email_address]

More Related Content

What's hot

Conceptualization, operationalization and measurement
Conceptualization, operationalization and measurementConceptualization, operationalization and measurement
Conceptualization, operationalization and measurementKatherine Bautista
 
Supervised Corpus-based Methods for Word Sense Disambiguation
Supervised Corpus-based Methods for Word Sense DisambiguationSupervised Corpus-based Methods for Word Sense Disambiguation
Supervised Corpus-based Methods for Word Sense Disambiguationbutest
 
Non experimental%20 quantitative%20research%20designs-1
Non experimental%20 quantitative%20research%20designs-1Non experimental%20 quantitative%20research%20designs-1
Non experimental%20 quantitative%20research%20designs-1jhtrespa
 
Week 4 variables and designs
Week 4 variables and designsWeek 4 variables and designs
Week 4 variables and designswawaaa789
 
Results, Discussion, APA Editing, and Defense
Results, Discussion, APA Editing, and DefenseResults, Discussion, APA Editing, and Defense
Results, Discussion, APA Editing, and DefenseStatistics Solutions
 
A New Theory of Classification and Feature Inference Learning: An Exemplar Fr...
A New Theory of Classification and Feature Inference Learning: An Exemplar Fr...A New Theory of Classification and Feature Inference Learning: An Exemplar Fr...
A New Theory of Classification and Feature Inference Learning: An Exemplar Fr...Robert Colner
 
Graduate Paper--Hierarchical clustring and topology for psychometrics paper
Graduate Paper--Hierarchical clustring and topology for psychometrics paperGraduate Paper--Hierarchical clustring and topology for psychometrics paper
Graduate Paper--Hierarchical clustring and topology for psychometrics paperColleen Farrelly
 
construct and variables in research methodology
 construct and variables in research methodology construct and variables in research methodology
construct and variables in research methodologyLavina Singh
 
Research Process | Step By Step | Variables In Research |
Research Process | Step By Step | Variables In Research |Research Process | Step By Step | Variables In Research |
Research Process | Step By Step | Variables In Research |FaHaD .H. NooR
 
Operational definitions
Operational definitionsOperational definitions
Operational definitionsphdserena
 
Research Methodology (MBA II SEM) - Introduction to SPSS
Research Methodology (MBA II SEM) - Introduction to SPSSResearch Methodology (MBA II SEM) - Introduction to SPSS
Research Methodology (MBA II SEM) - Introduction to SPSSGB Technical University
 
In the classroom; a summary dialogue
In the classroom; a summary dialogueIn the classroom; a summary dialogue
In the classroom; a summary dialogueIrene Rose Villote
 
Operational definition
Operational definitionOperational definition
Operational definitionAnkita Kunwar
 
The application of irt using the rasch model presnetation1
The application of irt using the rasch model presnetation1The application of irt using the rasch model presnetation1
The application of irt using the rasch model presnetation1Carlo Magno
 
Kinds Of Variables Kato Begum
Kinds Of Variables Kato BegumKinds Of Variables Kato Begum
Kinds Of Variables Kato BegumDr. Cupid Lucid
 
Theoratical framework & variables
Theoratical framework & variablesTheoratical framework & variables
Theoratical framework & variableskdsaif
 

What's hot (20)

Conceptualization, operationalization and measurement
Conceptualization, operationalization and measurementConceptualization, operationalization and measurement
Conceptualization, operationalization and measurement
 
Supervised Corpus-based Methods for Word Sense Disambiguation
Supervised Corpus-based Methods for Word Sense DisambiguationSupervised Corpus-based Methods for Word Sense Disambiguation
Supervised Corpus-based Methods for Word Sense Disambiguation
 
Non experimental%20 quantitative%20research%20designs-1
Non experimental%20 quantitative%20research%20designs-1Non experimental%20 quantitative%20research%20designs-1
Non experimental%20 quantitative%20research%20designs-1
 
Week 4 variables and designs
Week 4 variables and designsWeek 4 variables and designs
Week 4 variables and designs
 
Research: Chapter One
Research: Chapter OneResearch: Chapter One
Research: Chapter One
 
Results, Discussion, APA Editing, and Defense
Results, Discussion, APA Editing, and DefenseResults, Discussion, APA Editing, and Defense
Results, Discussion, APA Editing, and Defense
 
A New Theory of Classification and Feature Inference Learning: An Exemplar Fr...
A New Theory of Classification and Feature Inference Learning: An Exemplar Fr...A New Theory of Classification and Feature Inference Learning: An Exemplar Fr...
A New Theory of Classification and Feature Inference Learning: An Exemplar Fr...
 
Graduate Paper--Hierarchical clustring and topology for psychometrics paper
Graduate Paper--Hierarchical clustring and topology for psychometrics paperGraduate Paper--Hierarchical clustring and topology for psychometrics paper
Graduate Paper--Hierarchical clustring and topology for psychometrics paper
 
IRT in Test Construction
IRT in Test Construction IRT in Test Construction
IRT in Test Construction
 
construct and variables in research methodology
 construct and variables in research methodology construct and variables in research methodology
construct and variables in research methodology
 
Research Process | Step By Step | Variables In Research |
Research Process | Step By Step | Variables In Research |Research Process | Step By Step | Variables In Research |
Research Process | Step By Step | Variables In Research |
 
Operational definitions
Operational definitionsOperational definitions
Operational definitions
 
NCME_040916
NCME_040916NCME_040916
NCME_040916
 
Research Methodology (MBA II SEM) - Introduction to SPSS
Research Methodology (MBA II SEM) - Introduction to SPSSResearch Methodology (MBA II SEM) - Introduction to SPSS
Research Methodology (MBA II SEM) - Introduction to SPSS
 
In the classroom; a summary dialogue
In the classroom; a summary dialogueIn the classroom; a summary dialogue
In the classroom; a summary dialogue
 
Operational definition
Operational definitionOperational definition
Operational definition
 
The application of irt using the rasch model presnetation1
The application of irt using the rasch model presnetation1The application of irt using the rasch model presnetation1
The application of irt using the rasch model presnetation1
 
Variable
VariableVariable
Variable
 
Kinds Of Variables Kato Begum
Kinds Of Variables Kato BegumKinds Of Variables Kato Begum
Kinds Of Variables Kato Begum
 
Theoratical framework & variables
Theoratical framework & variablesTheoratical framework & variables
Theoratical framework & variables
 

Viewers also liked

prospek ukm dalam perdagangan bebas
prospek ukm dalam perdagangan bebasprospek ukm dalam perdagangan bebas
prospek ukm dalam perdagangan bebasGilang Jupriono
 
Covariance, contravariance 觀念分享
Covariance, contravariance 觀念分享Covariance, contravariance 觀念分享
Covariance, contravariance 觀念分享LearningTech
 
Cancer Rates on the Decline in the United States
Cancer Rates on the Decline in the United StatesCancer Rates on the Decline in the United States
Cancer Rates on the Decline in the United StatesSherif El Refai
 
Pearson/ATI Which Fixes Work for You
Pearson/ATI Which Fixes Work for You Pearson/ATI Which Fixes Work for You
Pearson/ATI Which Fixes Work for You Ken O'Connor
 
Prayag path akaal me utsav
Prayag path akaal me utsavPrayag path akaal me utsav
Prayag path akaal me utsavPankaj Subeer
 
Greater Pittsburgh Nonprofit Partnership Semi-Annual Membership Meeting
Greater Pittsburgh Nonprofit Partnership Semi-Annual Membership MeetingGreater Pittsburgh Nonprofit Partnership Semi-Annual Membership Meeting
Greater Pittsburgh Nonprofit Partnership Semi-Annual Membership MeetingGPNP
 
7 Start-up Sins by Sylvia Grubler
7 Start-up Sins by Sylvia Grubler 7 Start-up Sins by Sylvia Grubler
7 Start-up Sins by Sylvia Grubler RAMP Group
 
You Suck! Prevent & Address Negative Customer Feedback
You Suck! Prevent & Address Negative Customer FeedbackYou Suck! Prevent & Address Negative Customer Feedback
You Suck! Prevent & Address Negative Customer FeedbackAffiliate Summit
 
Ensayo final hec definitivo
Ensayo final hec definitivoEnsayo final hec definitivo
Ensayo final hec definitivosonatita
 
Медийная реклама и PR в социальных сетях
Медийная реклама и PR в социальных сетяхМедийная реклама и PR в социальных сетях
Медийная реклама и PR в социальных сетяхAnna Milyukova
 

Viewers also liked (15)

03 140911235945-phpapp01
03 140911235945-phpapp0103 140911235945-phpapp01
03 140911235945-phpapp01
 
prospek ukm dalam perdagangan bebas
prospek ukm dalam perdagangan bebasprospek ukm dalam perdagangan bebas
prospek ukm dalam perdagangan bebas
 
Unity 3 d
Unity 3 dUnity 3 d
Unity 3 d
 
Modals
ModalsModals
Modals
 
Covariance, contravariance 觀念分享
Covariance, contravariance 觀念分享Covariance, contravariance 觀念分享
Covariance, contravariance 觀念分享
 
Etapas do projeto
Etapas do projetoEtapas do projeto
Etapas do projeto
 
Cancer Rates on the Decline in the United States
Cancer Rates on the Decline in the United StatesCancer Rates on the Decline in the United States
Cancer Rates on the Decline in the United States
 
Pearson/ATI Which Fixes Work for You
Pearson/ATI Which Fixes Work for You Pearson/ATI Which Fixes Work for You
Pearson/ATI Which Fixes Work for You
 
Prayag path akaal me utsav
Prayag path akaal me utsavPrayag path akaal me utsav
Prayag path akaal me utsav
 
Greater Pittsburgh Nonprofit Partnership Semi-Annual Membership Meeting
Greater Pittsburgh Nonprofit Partnership Semi-Annual Membership MeetingGreater Pittsburgh Nonprofit Partnership Semi-Annual Membership Meeting
Greater Pittsburgh Nonprofit Partnership Semi-Annual Membership Meeting
 
7 Start-up Sins by Sylvia Grubler
7 Start-up Sins by Sylvia Grubler 7 Start-up Sins by Sylvia Grubler
7 Start-up Sins by Sylvia Grubler
 
Yang baru
Yang baruYang baru
Yang baru
 
You Suck! Prevent & Address Negative Customer Feedback
You Suck! Prevent & Address Negative Customer FeedbackYou Suck! Prevent & Address Negative Customer Feedback
You Suck! Prevent & Address Negative Customer Feedback
 
Ensayo final hec definitivo
Ensayo final hec definitivoEnsayo final hec definitivo
Ensayo final hec definitivo
 
Медийная реклама и PR в социальных сетях
Медийная реклама и PR в социальных сетяхМедийная реклама и PR в социальных сетях
Медийная реклама и PR в социальных сетях
 

Similar to Bijker, M. (2010) Making Measures And Inferences Reserve

KatKennedy REU D.C. Poster
KatKennedy REU D.C. PosterKatKennedy REU D.C. Poster
KatKennedy REU D.C. PosterKatlynn Kennedy
 
A Non-Technical Approach for Illustrating Item Response Theory
A Non-Technical Approach for Illustrating Item Response TheoryA Non-Technical Approach for Illustrating Item Response Theory
A Non-Technical Approach for Illustrating Item Response TheoryOpenThink Labs
 
EAPRIL 2012: Competencies for the Contemporary Career
EAPRIL 2012: Competencies for the Contemporary CareerEAPRIL 2012: Competencies for the Contemporary Career
EAPRIL 2012: Competencies for the Contemporary CareerJos Akkermans
 
Test equating using irt. final
Test equating using irt. finalTest equating using irt. final
Test equating using irt. finalmunsif123
 
LENGUAGE TESTING (II Bimestre Abril Agosto 2011)
LENGUAGE TESTING (II Bimestre Abril Agosto 2011)LENGUAGE TESTING (II Bimestre Abril Agosto 2011)
LENGUAGE TESTING (II Bimestre Abril Agosto 2011)Videoconferencias UTPL
 
A New Concurrent Calibration Method For Nonequivalent Group Design Under Nonr...
A New Concurrent Calibration Method For Nonequivalent Group Design Under Nonr...A New Concurrent Calibration Method For Nonequivalent Group Design Under Nonr...
A New Concurrent Calibration Method For Nonequivalent Group Design Under Nonr...Kathryn Patel
 
Revised_Motivated_Strategies_for_Learnin.pdf
Revised_Motivated_Strategies_for_Learnin.pdfRevised_Motivated_Strategies_for_Learnin.pdf
Revised_Motivated_Strategies_for_Learnin.pdfAnurupa Kundu
 
Personalized Learning_1.pptx
Personalized Learning_1.pptxPersonalized Learning_1.pptx
Personalized Learning_1.pptxWillSoo1
 
The Implementation of Structural Equation Modelling Partial Least Squares (SE...
The Implementation of Structural Equation Modelling Partial Least Squares (SE...The Implementation of Structural Equation Modelling Partial Least Squares (SE...
The Implementation of Structural Equation Modelling Partial Least Squares (SE...AJHSSR Journal
 
EDUC8102-6 MD7Assgn4: Research Application Paper #1.
EDUC8102-6 MD7Assgn4: Research Application Paper #1. EDUC8102-6 MD7Assgn4: Research Application Paper #1.
EDUC8102-6 MD7Assgn4: Research Application Paper #1. eckchela
 
Assessment For Learning In Immersive And Virtual Environments Evidence-Cent...
Assessment For Learning In Immersive And Virtual Environments   Evidence-Cent...Assessment For Learning In Immersive And Virtual Environments   Evidence-Cent...
Assessment For Learning In Immersive And Virtual Environments Evidence-Cent...Sabrina Green
 
Changing issues, changing questions, changing approaches: An overview of rese...
Changing issues, changing questions, changing approaches: An overview of rese...Changing issues, changing questions, changing approaches: An overview of rese...
Changing issues, changing questions, changing approaches: An overview of rese...Centre for Higher Education Development UCT
 
Research Methodology in management
Research Methodology in management Research Methodology in management
Research Methodology in management D Dutta Roy
 
Journal raganit santos
Journal raganit santosJournal raganit santos
Journal raganit santosessayumiyuri
 
Multi Criteria Decision Making Methodology on Selection of a Student for All ...
Multi Criteria Decision Making Methodology on Selection of a Student for All ...Multi Criteria Decision Making Methodology on Selection of a Student for All ...
Multi Criteria Decision Making Methodology on Selection of a Student for All ...ijtsrd
 
A Theory-Based Framework For Assessing Domainl-Specific Problem-Solving Ability
A Theory-Based Framework For Assessing Domainl-Specific Problem-Solving AbilityA Theory-Based Framework For Assessing Domainl-Specific Problem-Solving Ability
A Theory-Based Framework For Assessing Domainl-Specific Problem-Solving AbilityNicole Heredia
 
An Adaptive Evaluation System to Test Student Caliber using Item Response Theory
An Adaptive Evaluation System to Test Student Caliber using Item Response TheoryAn Adaptive Evaluation System to Test Student Caliber using Item Response Theory
An Adaptive Evaluation System to Test Student Caliber using Item Response TheoryEditor IJMTER
 
On the Use of the Causal Analysis in Small Type Fit Indices of Adult Mathemat...
On the Use of the Causal Analysis in Small Type Fit Indices of Adult Mathemat...On the Use of the Causal Analysis in Small Type Fit Indices of Adult Mathemat...
On the Use of the Causal Analysis in Small Type Fit Indices of Adult Mathemat...QUESTJOURNAL
 

Similar to Bijker, M. (2010) Making Measures And Inferences Reserve (20)

KatKennedy REU D.C. Poster
KatKennedy REU D.C. PosterKatKennedy REU D.C. Poster
KatKennedy REU D.C. Poster
 
A Non-Technical Approach for Illustrating Item Response Theory
A Non-Technical Approach for Illustrating Item Response TheoryA Non-Technical Approach for Illustrating Item Response Theory
A Non-Technical Approach for Illustrating Item Response Theory
 
EAPRIL 2012: Competencies for the Contemporary Career
EAPRIL 2012: Competencies for the Contemporary CareerEAPRIL 2012: Competencies for the Contemporary Career
EAPRIL 2012: Competencies for the Contemporary Career
 
Test equating using irt. final
Test equating using irt. finalTest equating using irt. final
Test equating using irt. final
 
LENGUAGE TESTING (II Bimestre Abril Agosto 2011)
LENGUAGE TESTING (II Bimestre Abril Agosto 2011)LENGUAGE TESTING (II Bimestre Abril Agosto 2011)
LENGUAGE TESTING (II Bimestre Abril Agosto 2011)
 
A New Concurrent Calibration Method For Nonequivalent Group Design Under Nonr...
A New Concurrent Calibration Method For Nonequivalent Group Design Under Nonr...A New Concurrent Calibration Method For Nonequivalent Group Design Under Nonr...
A New Concurrent Calibration Method For Nonequivalent Group Design Under Nonr...
 
Angelie
AngelieAngelie
Angelie
 
Lecture 07
Lecture 07Lecture 07
Lecture 07
 
Revised_Motivated_Strategies_for_Learnin.pdf
Revised_Motivated_Strategies_for_Learnin.pdfRevised_Motivated_Strategies_for_Learnin.pdf
Revised_Motivated_Strategies_for_Learnin.pdf
 
Personalized Learning_1.pptx
Personalized Learning_1.pptxPersonalized Learning_1.pptx
Personalized Learning_1.pptx
 
The Implementation of Structural Equation Modelling Partial Least Squares (SE...
The Implementation of Structural Equation Modelling Partial Least Squares (SE...The Implementation of Structural Equation Modelling Partial Least Squares (SE...
The Implementation of Structural Equation Modelling Partial Least Squares (SE...
 
EDUC8102-6 MD7Assgn4: Research Application Paper #1.
EDUC8102-6 MD7Assgn4: Research Application Paper #1. EDUC8102-6 MD7Assgn4: Research Application Paper #1.
EDUC8102-6 MD7Assgn4: Research Application Paper #1.
 
Assessment For Learning In Immersive And Virtual Environments Evidence-Cent...
Assessment For Learning In Immersive And Virtual Environments   Evidence-Cent...Assessment For Learning In Immersive And Virtual Environments   Evidence-Cent...
Assessment For Learning In Immersive And Virtual Environments Evidence-Cent...
 
Changing issues, changing questions, changing approaches: An overview of rese...
Changing issues, changing questions, changing approaches: An overview of rese...Changing issues, changing questions, changing approaches: An overview of rese...
Changing issues, changing questions, changing approaches: An overview of rese...
 
Research Methodology in management
Research Methodology in management Research Methodology in management
Research Methodology in management
 
Journal raganit santos
Journal raganit santosJournal raganit santos
Journal raganit santos
 
Multi Criteria Decision Making Methodology on Selection of a Student for All ...
Multi Criteria Decision Making Methodology on Selection of a Student for All ...Multi Criteria Decision Making Methodology on Selection of a Student for All ...
Multi Criteria Decision Making Methodology on Selection of a Student for All ...
 
A Theory-Based Framework For Assessing Domainl-Specific Problem-Solving Ability
A Theory-Based Framework For Assessing Domainl-Specific Problem-Solving AbilityA Theory-Based Framework For Assessing Domainl-Specific Problem-Solving Ability
A Theory-Based Framework For Assessing Domainl-Specific Problem-Solving Ability
 
An Adaptive Evaluation System to Test Student Caliber using Item Response Theory
An Adaptive Evaluation System to Test Student Caliber using Item Response TheoryAn Adaptive Evaluation System to Test Student Caliber using Item Response Theory
An Adaptive Evaluation System to Test Student Caliber using Item Response Theory
 
On the Use of the Causal Analysis in Small Type Fit Indices of Adult Mathemat...
On the Use of the Causal Analysis in Small Type Fit Indices of Adult Mathemat...On the Use of the Causal Analysis in Small Type Fit Indices of Adult Mathemat...
On the Use of the Causal Analysis in Small Type Fit Indices of Adult Mathemat...
 

Bijker, M. (2010) Making Measures And Inferences Reserve

  • 1. MAKING MEASURES FOR ACCURATE INFERENCES MONIQUE BIJKER MARCEL VAN DER KLINK ELS BOSHUIZEN CELSTEC, OPEN UNIVERSITY OF THE NETHERLANDS
  • 2.
  • 3.
  • 4.
  • 5.
  • 6.
  • 7.
  • 8.
  • 9.
  • 10.
  • 11. SCALE DISTANCES AND ITEM CONTRIBUTIONS
  • 13.
  • 14.
  • 15.
  • 16. SCALES SUCH AS TSE tem Infit Outfit Measure Error PTMEA Miscellaneous 83 and 84 are similar in ES and Psy. 80 is different in ES and Psy. 77 .82 .84 1.86 .13 .57 80 1.29 1.27 1.03 .14 .42 72 .74 .74 .90 .14 .70 84 .98 .91 .51A .14 .60 70 .64 .64 .22A .15 .69 71 .77 .75 .09A .15 .72 83 .99 .94 -.41A .15 .70 73 1.13 1.07 -1.10A .15 .54 78 .88 .82 -1.16 .15 .74 All items Mean .91 .89 .21 .15 Person Reliability .79 SD. .19 .18 .94 .01 Person Separation 1.91 All persons Item Reliability .97 Mean .89 .89 1.62 .62 Item Separation 6.24 SD .64 .64 1.35 .11 Cronbach alpha .82 Average measures 1 2 3 4 5 -1.96 -.61 .58 2.37 4.10 Step calibration measures -3.79 -1.95 1.19 4.55
  • 17.  
  • 18.  
  • 19.  
  • 20.  
  • 21.
  • 22.
  • 23.
  • 24. THANK YOU FOR YOUR ATTENTION. Any questions? [email_address]