SlideShare a Scribd company logo
1 of 21
α and β and power, oh my! Type I and Type II errors Power and effect size Shown with animation
Significance Testing and the CLT Reject-or-not decision is based on CLT. CLT: based on “many samples” our sampling statistics will eventually make a normal (ish) distribution  (assuming our conditions were met)  We can describe the shape, the center, and the spread. And we can use what we know about normal curves to find the probability of getting any one particular sample statistic.
Significance Testing and the CLT For significance testing, we start—before we’ve even taken a sample—with a hypothesis about where the center is. Set a threshold where any thing past that, we’re officially “surprised”. That area is α, our significance level. α μ0 That threshold is our critical value. In the case of sample means, it’ll be t*. In the case of sample proportions, it’ll be z*. t*
Significance Testing and the CLT Take a sample. It is in keeping with our hypothesized distribution.  It doesn’t mean our μ0 is right, but it certainly isn’t evidence against it. α μ0 FAIL TO REJECT H0. t*
Significance Testing and the CLT Take a sample. This statistic isn’t in keeping with our hypothesis.  In fact, it’s a relatively rare occurrence.  α μ0 t* Reject H0!  Embrace Ha!
What if we made a mistake? Rare vs. never Normal distribution – still possible to get tails You can do everything right, and come to the mathematically correct answer and it is still a practically incorrect answer—the H0was right, you shouldn’t have rejected. α You have made a Type I error. How often will we make a Type I error? μ0 t* P(Type I) = α.
Rejected H0.   What if we didn’t make a mistake? The true center is somewhere else. α Notice relationship between our statistic and the “true” distribution. μ0 μ X t*
What if we didn’t make a mistake? What is the probability of getting a sample statistic beyond our critical value threshold? P(Reject H0|H0 is wrong) = power of a test α μ0 μ The higher the power, the better the test is at rejecting the null hypothesis when it is wrong. t*
Can we still make a mistake, when our null hypothesis is wrong? What if we’d gotten a different sample? Look at “true” distribution: is this result possible?  Rare? What would we do with H0?  (remember, we don’t know the “true” distribution) FAIL TO  REJECT H0 μ0 μ We have made a Type II error. t*
Can we still make a mistake, when our null hypothesis is wrong? What other kind of mistake can we make? P(Type II) = β β power μ0 μ t* Notice that βis the complement of the power. Power of the test =  1 – β.
Types of errors and their probabilities To recap: Type I error: the null hypothesis is correct, but we get a sample statistic that makes us reject H0. Probability: α Type II error: the null hypothesis is wrong (and the distribution is somewhere else), but we get a sample statistic that makes us fail to reject H0. power β α Probability: β μ0 μ Power: the probability of rejecting H0 when it is, in fact, wrong. t* Probability: 1 – β.
Types of errors and their probabilities How are they related? Power and β both rely on the “true” μ Calculating β is BTS  Effect size Depend on… power β α μ0 μ t*
Types of errors and their probabilities How does effect size relate to power and β? The larger the effect size… …the larger the power of the significance test …and the smaller the probability of making a Type II error (β). Effect size power β α μ0 μ Remember, we do not control the effect size—it is what it is.  Just keep in mind its relation to both power and β. t*
Reducing the probabilities of errors Be able to put errors in context. Type I errors:  ,[object Object]
  telling a healthy man he’s sick
  thinking an improvement works when it doesn’t
  accusing a non-drug user of using drugspower β α Type II errors:  ,[object Object]
  telling someone with an STD that they don’t have one
  thinking a system improvement doesn’t work when it doesμ0 μ t*
Reducing the probabilities of errors If you decide that the cost of a Type I error is too great, how can you reduce the probability of making one? If you want to reduce the probability of a Type I error (false positive), merely reduce your significance level. β α μ0 μ That is, move your critical value threshold so that you have a lower α.   t*
Reducing the probabilities of errors Reduce the probability of making a Type I error. If αdecreases, then β must increase. We still won’t calculate what βis, but we know it has increased. If βincreased, then power must decrease—since it’s 1 – β. β α μ0 μ t*

More Related Content

What's hot

Basic theory of IS-LM model
Basic theory of IS-LM modelBasic theory of IS-LM model
Basic theory of IS-LM modelAmarjit Kumar
 
Error And Power
Error And PowerError And Power
Error And Powershoffma5
 
Discussion on Quantum Entanglement.pdf
Discussion on Quantum Entanglement.pdfDiscussion on Quantum Entanglement.pdf
Discussion on Quantum Entanglement.pdfJatinMahato1
 
Econometrics chapter 5-two-variable-regression-interval-estimation-
Econometrics chapter 5-two-variable-regression-interval-estimation-Econometrics chapter 5-two-variable-regression-interval-estimation-
Econometrics chapter 5-two-variable-regression-interval-estimation-Alamin Milton
 
Data Science - Part IV - Regression Analysis & ANOVA
Data Science - Part IV - Regression Analysis & ANOVAData Science - Part IV - Regression Analysis & ANOVA
Data Science - Part IV - Regression Analysis & ANOVADerek Kane
 
Hypothesis testing, error and bias
Hypothesis testing, error and biasHypothesis testing, error and bias
Hypothesis testing, error and biasDr.Jatin Chhaya
 
Physics project on hysteresis curve
Physics project on hysteresis curvePhysics project on hysteresis curve
Physics project on hysteresis curveVirender Sharma
 
A.6 confidence intervals
A.6  confidence intervalsA.6  confidence intervals
A.6 confidence intervalsUlster BOCES
 
Parametric vs Nonparametric Tests: When to use which
Parametric vs Nonparametric Tests: When to use whichParametric vs Nonparametric Tests: When to use which
Parametric vs Nonparametric Tests: When to use whichGönenç Dalgıç
 
Tau 09 - Uncertainty Principle!
Tau 09 - Uncertainty Principle!Tau 09 - Uncertainty Principle!
Tau 09 - Uncertainty Principle!Jessica Kabigting
 

What's hot (15)

Basic theory of IS-LM model
Basic theory of IS-LM modelBasic theory of IS-LM model
Basic theory of IS-LM model
 
Error And Power
Error And PowerError And Power
Error And Power
 
Discussion on Quantum Entanglement.pdf
Discussion on Quantum Entanglement.pdfDiscussion on Quantum Entanglement.pdf
Discussion on Quantum Entanglement.pdf
 
Qhe
QheQhe
Qhe
 
Econometrics chapter 5-two-variable-regression-interval-estimation-
Econometrics chapter 5-two-variable-regression-interval-estimation-Econometrics chapter 5-two-variable-regression-interval-estimation-
Econometrics chapter 5-two-variable-regression-interval-estimation-
 
Data Science - Part IV - Regression Analysis & ANOVA
Data Science - Part IV - Regression Analysis & ANOVAData Science - Part IV - Regression Analysis & ANOVA
Data Science - Part IV - Regression Analysis & ANOVA
 
Hypothesis testing, error and bias
Hypothesis testing, error and biasHypothesis testing, error and bias
Hypothesis testing, error and bias
 
Chi square
Chi square Chi square
Chi square
 
Physics project on hysteresis curve
Physics project on hysteresis curvePhysics project on hysteresis curve
Physics project on hysteresis curve
 
A.6 confidence intervals
A.6  confidence intervalsA.6  confidence intervals
A.6 confidence intervals
 
Parametric vs Nonparametric Tests: When to use which
Parametric vs Nonparametric Tests: When to use whichParametric vs Nonparametric Tests: When to use which
Parametric vs Nonparametric Tests: When to use which
 
Unit_2.pdf
Unit_2.pdfUnit_2.pdf
Unit_2.pdf
 
Hysteresis
HysteresisHysteresis
Hysteresis
 
Tau 09 - Uncertainty Principle!
Tau 09 - Uncertainty Principle!Tau 09 - Uncertainty Principle!
Tau 09 - Uncertainty Principle!
 
Poverty
PovertyPoverty
Poverty
 

Viewers also liked

Type i and type ii errors
Type i and type ii errorsType i and type ii errors
Type i and type ii errorsp24ssp
 
Type 1 and type 2 errors
Type 1 and type 2 errorsType 1 and type 2 errors
Type 1 and type 2 errorssmulford
 
What's Significant? Hypothesis Testing, Effect Size, Confidence Intervals, & ...
What's Significant? Hypothesis Testing, Effect Size, Confidence Intervals, & ...What's Significant? Hypothesis Testing, Effect Size, Confidence Intervals, & ...
What's Significant? Hypothesis Testing, Effect Size, Confidence Intervals, & ...Pat Barlow
 
teast mean one and two sample
teast mean one and two sampleteast mean one and two sample
teast mean one and two sampleMuzamil Hussain
 
Mpc 006 - 01-03 type i and type ii errors
Mpc 006 - 01-03 type i and type ii errorsMpc 006 - 01-03 type i and type ii errors
Mpc 006 - 01-03 type i and type ii errorsVasant Kothari
 
Hypothesis testing lectures
Hypothesis testing lectures Hypothesis testing lectures
Hypothesis testing lectures Sanjaya Sahoo
 
Multiple Choice Golden Rules
Multiple Choice Golden RulesMultiple Choice Golden Rules
Multiple Choice Golden Rulesshoffma5
 
20140602 statistical power - husnul and nur
20140602   statistical power - husnul and nur20140602   statistical power - husnul and nur
20140602 statistical power - husnul and nurMuhammad Khuluq
 
Objective Items
Objective ItemsObjective Items
Objective Itemsshoffma5
 
Validity And Reliabilty
Validity And ReliabiltyValidity And Reliabilty
Validity And Reliabiltyshoffma5
 
10. sampling and hypotehsis
10. sampling and hypotehsis10. sampling and hypotehsis
10. sampling and hypotehsisKaran Kukreja
 
Calculating Standard Deviation (Sample)
Calculating Standard Deviation (Sample)Calculating Standard Deviation (Sample)
Calculating Standard Deviation (Sample)shoffma5
 
Dte Energy Grant
Dte Energy GrantDte Energy Grant
Dte Energy Grantshoffma5
 
NOTE MATH PMR STATISTICS
NOTE MATH PMR STATISTICSNOTE MATH PMR STATISTICS
NOTE MATH PMR STATISTICSNad0209
 
Measure of Dispersion
Measure of DispersionMeasure of Dispersion
Measure of Dispersionsonia gupta
 
Standard Scores
Standard ScoresStandard Scores
Standard Scoresshoffma5
 
One Sample T Test
One Sample T TestOne Sample T Test
One Sample T Testshoffma5
 
Statistical Concepts: Introduction
Statistical Concepts: IntroductionStatistical Concepts: Introduction
Statistical Concepts: IntroductionErnie Cerado
 

Viewers also liked (20)

Type i and type ii errors
Type i and type ii errorsType i and type ii errors
Type i and type ii errors
 
Type 1 and type 2 errors
Type 1 and type 2 errorsType 1 and type 2 errors
Type 1 and type 2 errors
 
What's Significant? Hypothesis Testing, Effect Size, Confidence Intervals, & ...
What's Significant? Hypothesis Testing, Effect Size, Confidence Intervals, & ...What's Significant? Hypothesis Testing, Effect Size, Confidence Intervals, & ...
What's Significant? Hypothesis Testing, Effect Size, Confidence Intervals, & ...
 
teast mean one and two sample
teast mean one and two sampleteast mean one and two sample
teast mean one and two sample
 
Mpc 006 - 01-03 type i and type ii errors
Mpc 006 - 01-03 type i and type ii errorsMpc 006 - 01-03 type i and type ii errors
Mpc 006 - 01-03 type i and type ii errors
 
Hypothesis testing lectures
Hypothesis testing lectures Hypothesis testing lectures
Hypothesis testing lectures
 
Multiple Choice Golden Rules
Multiple Choice Golden RulesMultiple Choice Golden Rules
Multiple Choice Golden Rules
 
20140602 statistical power - husnul and nur
20140602   statistical power - husnul and nur20140602   statistical power - husnul and nur
20140602 statistical power - husnul and nur
 
Objective Items
Objective ItemsObjective Items
Objective Items
 
Validity And Reliabilty
Validity And ReliabiltyValidity And Reliabilty
Validity And Reliabilty
 
10. sampling and hypotehsis
10. sampling and hypotehsis10. sampling and hypotehsis
10. sampling and hypotehsis
 
Calculating Standard Deviation (Sample)
Calculating Standard Deviation (Sample)Calculating Standard Deviation (Sample)
Calculating Standard Deviation (Sample)
 
Dte Energy Grant
Dte Energy GrantDte Energy Grant
Dte Energy Grant
 
NOTE MATH PMR STATISTICS
NOTE MATH PMR STATISTICSNOTE MATH PMR STATISTICS
NOTE MATH PMR STATISTICS
 
Measure of Dispersion
Measure of DispersionMeasure of Dispersion
Measure of Dispersion
 
Basic One-Way ANOVA
Basic One-Way ANOVABasic One-Way ANOVA
Basic One-Way ANOVA
 
Math 102- Statistics
Math 102- StatisticsMath 102- Statistics
Math 102- Statistics
 
Standard Scores
Standard ScoresStandard Scores
Standard Scores
 
One Sample T Test
One Sample T TestOne Sample T Test
One Sample T Test
 
Statistical Concepts: Introduction
Statistical Concepts: IntroductionStatistical Concepts: Introduction
Statistical Concepts: Introduction
 

Similar to Type I Type Ii Power Effect Size Live Presentation

business research management
business research management business research management
business research management ApneetSaini
 
typeiandtypeiierrors-130201094324-phpapp02.pdf
typeiandtypeiierrors-130201094324-phpapp02.pdftypeiandtypeiierrors-130201094324-phpapp02.pdf
typeiandtypeiierrors-130201094324-phpapp02.pdfDrAmanSaxena
 
A note and graphical illustration of type II error
A note and graphical illustration of type II errorA note and graphical illustration of type II error
A note and graphical illustration of type II errorGH Yeoh
 
Chapter8 Introduction to Estimation Hypothesis Testing.pdf
Chapter8 Introduction to Estimation Hypothesis Testing.pdfChapter8 Introduction to Estimation Hypothesis Testing.pdf
Chapter8 Introduction to Estimation Hypothesis Testing.pdfmekkimekki5
 
lecture no.7 computation.pptx
lecture no.7 computation.pptxlecture no.7 computation.pptx
lecture no.7 computation.pptxssuser378d7c
 
Type I and Type II Errors in Research Methodology
Type I and Type II Errors in Research MethodologyType I and Type II Errors in Research Methodology
Type I and Type II Errors in Research MethodologyDr. Chinchu C
 
Hyphotheses testing 6
Hyphotheses testing 6Hyphotheses testing 6
Hyphotheses testing 6Sundar B N
 
Morestatistics22 091208004743-phpapp01
Morestatistics22 091208004743-phpapp01Morestatistics22 091208004743-phpapp01
Morestatistics22 091208004743-phpapp01mandrewmartin
 
Lecture2 hypothesis testing
Lecture2 hypothesis testingLecture2 hypothesis testing
Lecture2 hypothesis testingo_devinyak
 
6 estimation hypothesis testing t test
6 estimation hypothesis testing t test6 estimation hypothesis testing t test
6 estimation hypothesis testing t testPenny Jiang
 
testingofhypothesis-150108150611-conversion-gate02.pptx
testingofhypothesis-150108150611-conversion-gate02.pptxtestingofhypothesis-150108150611-conversion-gate02.pptx
testingofhypothesis-150108150611-conversion-gate02.pptxwigatox256
 

Similar to Type I Type Ii Power Effect Size Live Presentation (20)

business research management
business research management business research management
business research management
 
typeiandtypeiierrors-130201094324-phpapp02.pdf
typeiandtypeiierrors-130201094324-phpapp02.pdftypeiandtypeiierrors-130201094324-phpapp02.pdf
typeiandtypeiierrors-130201094324-phpapp02.pdf
 
A note and graphical illustration of type II error
A note and graphical illustration of type II errorA note and graphical illustration of type II error
A note and graphical illustration of type II error
 
Hypothesis
HypothesisHypothesis
Hypothesis
 
Chapter8 Introduction to Estimation Hypothesis Testing.pdf
Chapter8 Introduction to Estimation Hypothesis Testing.pdfChapter8 Introduction to Estimation Hypothesis Testing.pdf
Chapter8 Introduction to Estimation Hypothesis Testing.pdf
 
lecture no.7 computation.pptx
lecture no.7 computation.pptxlecture no.7 computation.pptx
lecture no.7 computation.pptx
 
Type I and Type II Errors in Research Methodology
Type I and Type II Errors in Research MethodologyType I and Type II Errors in Research Methodology
Type I and Type II Errors in Research Methodology
 
Hypothesis
HypothesisHypothesis
Hypothesis
 
hypothesis_testing-ch9-39-14402.pdf
hypothesis_testing-ch9-39-14402.pdfhypothesis_testing-ch9-39-14402.pdf
hypothesis_testing-ch9-39-14402.pdf
 
More Statistics
More StatisticsMore Statistics
More Statistics
 
Hyphotheses testing 6
Hyphotheses testing 6Hyphotheses testing 6
Hyphotheses testing 6
 
Hypothesis
HypothesisHypothesis
Hypothesis
 
Morestatistics22 091208004743-phpapp01
Morestatistics22 091208004743-phpapp01Morestatistics22 091208004743-phpapp01
Morestatistics22 091208004743-phpapp01
 
Lecture2 hypothesis testing
Lecture2 hypothesis testingLecture2 hypothesis testing
Lecture2 hypothesis testing
 
6 estimation hypothesis testing t test
6 estimation hypothesis testing t test6 estimation hypothesis testing t test
6 estimation hypothesis testing t test
 
11주차
11주차11주차
11주차
 
Testing of hypothesis
Testing of hypothesisTesting of hypothesis
Testing of hypothesis
 
Unit 3
Unit 3Unit 3
Unit 3
 
Inferential Statistics
Inferential StatisticsInferential Statistics
Inferential Statistics
 
testingofhypothesis-150108150611-conversion-gate02.pptx
testingofhypothesis-150108150611-conversion-gate02.pptxtestingofhypothesis-150108150611-conversion-gate02.pptx
testingofhypothesis-150108150611-conversion-gate02.pptx
 

Recently uploaded

Science 7 Quarter 4 Module 2: Natural Resources.pptx
Science 7 Quarter 4 Module 2: Natural Resources.pptxScience 7 Quarter 4 Module 2: Natural Resources.pptx
Science 7 Quarter 4 Module 2: Natural Resources.pptxMaryGraceBautista27
 
How to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERPHow to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERPCeline George
 
Choosing the Right CBSE School A Comprehensive Guide for Parents
Choosing the Right CBSE School A Comprehensive Guide for ParentsChoosing the Right CBSE School A Comprehensive Guide for Parents
Choosing the Right CBSE School A Comprehensive Guide for Parentsnavabharathschool99
 
Global Lehigh Strategic Initiatives (without descriptions)
Global Lehigh Strategic Initiatives (without descriptions)Global Lehigh Strategic Initiatives (without descriptions)
Global Lehigh Strategic Initiatives (without descriptions)cama23
 
AMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdf
AMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdfAMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdf
AMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdfphamnguyenenglishnb
 
AUDIENCE THEORY -CULTIVATION THEORY - GERBNER.pptx
AUDIENCE THEORY -CULTIVATION THEORY -  GERBNER.pptxAUDIENCE THEORY -CULTIVATION THEORY -  GERBNER.pptx
AUDIENCE THEORY -CULTIVATION THEORY - GERBNER.pptxiammrhaywood
 
What is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERPWhat is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERPCeline George
 
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITYISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITYKayeClaireEstoconing
 
Karra SKD Conference Presentation Revised.pptx
Karra SKD Conference Presentation Revised.pptxKarra SKD Conference Presentation Revised.pptx
Karra SKD Conference Presentation Revised.pptxAshokKarra1
 
FILIPINO PSYCHology sikolohiyang pilipino
FILIPINO PSYCHology sikolohiyang pilipinoFILIPINO PSYCHology sikolohiyang pilipino
FILIPINO PSYCHology sikolohiyang pilipinojohnmickonozaleda
 
Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17Celine George
 
ENGLISH6-Q4-W3.pptxqurter our high choom
ENGLISH6-Q4-W3.pptxqurter our high choomENGLISH6-Q4-W3.pptxqurter our high choom
ENGLISH6-Q4-W3.pptxqurter our high choomnelietumpap1
 
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...Nguyen Thanh Tu Collection
 
Transaction Management in Database Management System
Transaction Management in Database Management SystemTransaction Management in Database Management System
Transaction Management in Database Management SystemChristalin Nelson
 
Concurrency Control in Database Management system
Concurrency Control in Database Management systemConcurrency Control in Database Management system
Concurrency Control in Database Management systemChristalin Nelson
 
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptxECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptxiammrhaywood
 
4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptx4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptxmary850239
 
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATIONTHEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATIONHumphrey A Beña
 
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdfVirtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdfErwinPantujan2
 

Recently uploaded (20)

Science 7 Quarter 4 Module 2: Natural Resources.pptx
Science 7 Quarter 4 Module 2: Natural Resources.pptxScience 7 Quarter 4 Module 2: Natural Resources.pptx
Science 7 Quarter 4 Module 2: Natural Resources.pptx
 
How to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERPHow to do quick user assign in kanban in Odoo 17 ERP
How to do quick user assign in kanban in Odoo 17 ERP
 
Choosing the Right CBSE School A Comprehensive Guide for Parents
Choosing the Right CBSE School A Comprehensive Guide for ParentsChoosing the Right CBSE School A Comprehensive Guide for Parents
Choosing the Right CBSE School A Comprehensive Guide for Parents
 
Global Lehigh Strategic Initiatives (without descriptions)
Global Lehigh Strategic Initiatives (without descriptions)Global Lehigh Strategic Initiatives (without descriptions)
Global Lehigh Strategic Initiatives (without descriptions)
 
AMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdf
AMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdfAMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdf
AMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdf
 
AUDIENCE THEORY -CULTIVATION THEORY - GERBNER.pptx
AUDIENCE THEORY -CULTIVATION THEORY -  GERBNER.pptxAUDIENCE THEORY -CULTIVATION THEORY -  GERBNER.pptx
AUDIENCE THEORY -CULTIVATION THEORY - GERBNER.pptx
 
What is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERPWhat is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERP
 
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITYISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
 
Karra SKD Conference Presentation Revised.pptx
Karra SKD Conference Presentation Revised.pptxKarra SKD Conference Presentation Revised.pptx
Karra SKD Conference Presentation Revised.pptx
 
YOUVE_GOT_EMAIL_PRELIMS_EL_DORADO_2024.pptx
YOUVE_GOT_EMAIL_PRELIMS_EL_DORADO_2024.pptxYOUVE_GOT_EMAIL_PRELIMS_EL_DORADO_2024.pptx
YOUVE_GOT_EMAIL_PRELIMS_EL_DORADO_2024.pptx
 
FILIPINO PSYCHology sikolohiyang pilipino
FILIPINO PSYCHology sikolohiyang pilipinoFILIPINO PSYCHology sikolohiyang pilipino
FILIPINO PSYCHology sikolohiyang pilipino
 
Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17
 
ENGLISH6-Q4-W3.pptxqurter our high choom
ENGLISH6-Q4-W3.pptxqurter our high choomENGLISH6-Q4-W3.pptxqurter our high choom
ENGLISH6-Q4-W3.pptxqurter our high choom
 
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
 
Transaction Management in Database Management System
Transaction Management in Database Management SystemTransaction Management in Database Management System
Transaction Management in Database Management System
 
Concurrency Control in Database Management system
Concurrency Control in Database Management systemConcurrency Control in Database Management system
Concurrency Control in Database Management system
 
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptxECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
ECONOMIC CONTEXT - PAPER 1 Q3: NEWSPAPERS.pptx
 
4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptx4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptx
 
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATIONTHEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
 
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdfVirtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdf
 

Type I Type Ii Power Effect Size Live Presentation

  • 1. α and β and power, oh my! Type I and Type II errors Power and effect size Shown with animation
  • 2. Significance Testing and the CLT Reject-or-not decision is based on CLT. CLT: based on “many samples” our sampling statistics will eventually make a normal (ish) distribution (assuming our conditions were met) We can describe the shape, the center, and the spread. And we can use what we know about normal curves to find the probability of getting any one particular sample statistic.
  • 3. Significance Testing and the CLT For significance testing, we start—before we’ve even taken a sample—with a hypothesis about where the center is. Set a threshold where any thing past that, we’re officially “surprised”. That area is α, our significance level. α μ0 That threshold is our critical value. In the case of sample means, it’ll be t*. In the case of sample proportions, it’ll be z*. t*
  • 4. Significance Testing and the CLT Take a sample. It is in keeping with our hypothesized distribution. It doesn’t mean our μ0 is right, but it certainly isn’t evidence against it. α μ0 FAIL TO REJECT H0. t*
  • 5. Significance Testing and the CLT Take a sample. This statistic isn’t in keeping with our hypothesis. In fact, it’s a relatively rare occurrence. α μ0 t* Reject H0! Embrace Ha!
  • 6. What if we made a mistake? Rare vs. never Normal distribution – still possible to get tails You can do everything right, and come to the mathematically correct answer and it is still a practically incorrect answer—the H0was right, you shouldn’t have rejected. α You have made a Type I error. How often will we make a Type I error? μ0 t* P(Type I) = α.
  • 7. Rejected H0. What if we didn’t make a mistake? The true center is somewhere else. α Notice relationship between our statistic and the “true” distribution. μ0 μ X t*
  • 8. What if we didn’t make a mistake? What is the probability of getting a sample statistic beyond our critical value threshold? P(Reject H0|H0 is wrong) = power of a test α μ0 μ The higher the power, the better the test is at rejecting the null hypothesis when it is wrong. t*
  • 9. Can we still make a mistake, when our null hypothesis is wrong? What if we’d gotten a different sample? Look at “true” distribution: is this result possible? Rare? What would we do with H0? (remember, we don’t know the “true” distribution) FAIL TO REJECT H0 μ0 μ We have made a Type II error. t*
  • 10. Can we still make a mistake, when our null hypothesis is wrong? What other kind of mistake can we make? P(Type II) = β β power μ0 μ t* Notice that βis the complement of the power. Power of the test = 1 – β.
  • 11. Types of errors and their probabilities To recap: Type I error: the null hypothesis is correct, but we get a sample statistic that makes us reject H0. Probability: α Type II error: the null hypothesis is wrong (and the distribution is somewhere else), but we get a sample statistic that makes us fail to reject H0. power β α Probability: β μ0 μ Power: the probability of rejecting H0 when it is, in fact, wrong. t* Probability: 1 – β.
  • 12. Types of errors and their probabilities How are they related? Power and β both rely on the “true” μ Calculating β is BTS  Effect size Depend on… power β α μ0 μ t*
  • 13. Types of errors and their probabilities How does effect size relate to power and β? The larger the effect size… …the larger the power of the significance test …and the smaller the probability of making a Type II error (β). Effect size power β α μ0 μ Remember, we do not control the effect size—it is what it is. Just keep in mind its relation to both power and β. t*
  • 14.
  • 15. telling a healthy man he’s sick
  • 16. thinking an improvement works when it doesn’t
  • 17.
  • 18. telling someone with an STD that they don’t have one
  • 19. thinking a system improvement doesn’t work when it doesμ0 μ t*
  • 20. Reducing the probabilities of errors If you decide that the cost of a Type I error is too great, how can you reduce the probability of making one? If you want to reduce the probability of a Type I error (false positive), merely reduce your significance level. β α μ0 μ That is, move your critical value threshold so that you have a lower α. t*
  • 21. Reducing the probabilities of errors Reduce the probability of making a Type I error. If αdecreases, then β must increase. We still won’t calculate what βis, but we know it has increased. If βincreased, then power must decrease—since it’s 1 – β. β α μ0 μ t*
  • 22. Reducing the probabilities of errors Reduce the probability of making a Type II error In order to decrease β, we must increase α Notice, also, that if βhas been reduced, then the power (1 – β) has increased. β α μ0 μ t*
  • 23. Reducing the probabilities of errors So if you decrease the probability of Type I error, you increase the probability of a Type II error. And vice versa. Is there any way to reduce the probability of both? β α μ0 μ t* So what do we control?
  • 24. Reducing the probabilities of errors We control the spread of our normal curves. CLT If our sample size increases, the centers don’t move, and we reduce variability… So by increasing n, our sample size, we’ve reduced bothαandβ. α β And if we’ve reduced β, we’ve increased the power (1 – β). μ0 μ t*
  • 25. Review Vocabulary Type I error Type II error Power Effect size α β Critical value Significance level α β μ0 μ t*
  • 26. Review Concepts How can you reduce the probability of a Type I error? What are the consequences? How can you reduce the probability of a Type II error? What are the consequences? How are effect size and power related? How are effect size and Type II errors related? How can you reduce the probability of both kinds of errors? α β μ0 μ t*