SlideShare a Scribd company logo
1 of 38
Beyond linguistic accuracy:
What speaking tests must also evaluate
John Campbell-Larsen
Cameron Romney
Kyoto Women’s University
This Presentation
• Part one: What is speaking?
• Part two: How do you teach conversation?
• Part three: How is speaking (often) evaluated?
• Part four: Ideas to take away.
What is speaking?
Part one
Four Skills
Speaking
25%
Listening
25%
Reading
25%
Writing
25%
A Balanced Syllabus
Language in Use
Conversation
85%
Other
15%
Daily language use
“It [speaking] is the skill by which
they [learners] are most frequently
judged … It is the vehicle par
excellence of social solidarity, of
social ranking, of professional
advancement and of business.”
Martin Bygate (1987), p. vii
Genres of speaking
• Monologue (Lectures, Presentations, speeches
etc.)
• Power/rights differential dialogue (Interviews,
Formal Debates/ Discussions, etc. )
• Transactional (Service encounters, etc.)
• Conversation
How much time do you spend in
each of these genres?
Participant Question
Characteristics of Conversation
Genuine conversation is characterized by the uneven
distribution of information, the negotiation of meaning,
… topic nomination and negotiation by more than one
speaker, and the right of interlocutors to decide
whether to contribute to an interaction or not. In other
words, in genuine communication, decisions about who
says what to whom and when are up for grabs.
Nunan (1987), p.137
Characteristics of Conversation
• It is not primarily necessitated by a practical task.
• Any unequal power of participants is partially
suspended.
• The number of participants is quite small
• Turns are quite short
• Talk is primarily for the participants and not for an
outside audience.
Cook (1989), p. 56
Characteristics of Interviews
• Pre-planned, highly structured with time limits
• Often rehearsed
• Uneven distribution of speakership rights
• Topic controlled by task and/or examiner
• Roles are (mostly) adhered to
• Language is formal/neutral
• Structure is Q/A adjacency pair
Interview or Conversation?
Video Removed
for
Student Privacy
How do you teach conversation?
Part two
Creating a Venue for Conversation
• The classroom must be reconfigured as a
social rather than institutional psychological
space
• The learners must orient to a social rather
than institutional English language identity
• The learners must be made aware of the
purposes of the above
• The leaners must be afforded TIME to do so
Creating a Venue for Conversation
Video Removed
for
Student Privacy
How is speaking (often) evaluated?
Part three
Common Forms of Evaluation
• Written tests
• Presentations
• Task observations, e.g. role plays
• Oral Proficiency Interviews (OPI)
Written Tests
Positives
• Easy to evaluate large groups of students
• Student know what to do
Negatives
• Not speaking
• Often receptive skills not productive and/or
linguistic knowledge
Written Test Example
• Before (1)________ down for a nap, the boy
(2) _________ down the book.
A: Lie
B: Lay
C: Laid
D: Lay
E: Laying
F: Lying
Presentations
Positives
• Individual activity
• Clear outcomes
Negatives
• Minor speaking genre
• Rehearsed, often memorized
• Vocalization of written English
Video of a Student Presentation
Video Removed
Please see:
https://youtu.be/yRap1RlLMA0
Task Observations, a.k.a. Role-plays
Positives
• Concrete outcomes, i.e. did they accomplish
the task?
Negatives
• Usually transactional in nature
• Dependent on partner’s ability
• Dependent on knowledge of the context
Issue with Role-plays
“Role-playing ability can be compared with
acting ability, and of course not everyone is a
good actor. Nor is being a good actor equivalent
to being a good communicator. Furthermore,
role playing is a specialized kind of acting,
requiring ad-libbing ability. Not every good actor
is a good ad-libber.”
van Lier (1989), p. 502
Video of a Student Role-play
Video Removed
Please see:
https://youtu.be/pqoI7TlxKCE
Oral Proficiency Interviews
Positives:
• Students produce lots of language (ideally)
Negatives:
• Minor speaking genre
• Highly structured with time limits
• Controlled by interviewer
• One-sided interaction
Example video
Video Removed
for
Student Privacy
Example Audio
Video Removed
for
Student Privacy
Example video
Video Removed
for
Student Privacy
So, how do you evaluate
speaking?
Ideas to take away
Part Four
#1:
Speaking has
genres
DIFFERENT
Speaking Genres
• Just as teaching poetry doesn’t prepare a
student to write a business letter, teaching a
student how to give a presentation doesn’t
prepare him/her to have a conversation.
• The same for reading, writing, listening,
grammar, vocabulary, etc.
#2:
Conversation is
THE
skill
Suggestions for teaching
• Make conversation (real conversation) a
priority
• Raise student awareness of aspects of a good
conversationalist
• Correct bad conversation behaviors
• Teach conversation/communication skills
• Teach interactive skills
#3:
Test what you teach
AND
teach what you test
Suggestions for evaluation
• Make sure your evaluation matches classroom
realities.
• If you have a fixed evaluation method, include
classroom activities to match the evaluation.
Beyond linguistic accuracy:
What speaking tests must also evaluate
John Campbell-Larsen
Cameron Romney
Kyoto Women’s University

More Related Content

What's hot

Assessing speaking skills
Assessing speaking skills Assessing speaking skills
Assessing speaking skills nairubymata
 
Week 3 teaching oral skills 1
Week 3 teaching oral skills 1Week 3 teaching oral skills 1
Week 3 teaching oral skills 1sbrooksulacit
 
Teaching listening skills and Spoken Communication Skills
Teaching listening skills and Spoken Communication SkillsTeaching listening skills and Spoken Communication Skills
Teaching listening skills and Spoken Communication SkillsDokka Srinivasu
 
Factors affecting speaking skills
Factors affecting speaking skillsFactors affecting speaking skills
Factors affecting speaking skillsEng Eng
 
Developing and assessing speaking in a competence based
Developing and assessing speaking in a competence basedDeveloping and assessing speaking in a competence based
Developing and assessing speaking in a competence basedNoura Al-Budeiwi
 
ENGLISH FOR ORAL COMMUNICATION
ENGLISH FOR ORAL COMMUNICATIONENGLISH FOR ORAL COMMUNICATION
ENGLISH FOR ORAL COMMUNICATIONrosetang
 
Assessing speaking
Assessing speakingAssessing speaking
Assessing speakingjojogarcia7
 
Spoken skills session 1
Spoken skills   session 1Spoken skills   session 1
Spoken skills session 1Ania Shayan
 
Teaching Oral Communication Skills
Teaching Oral Communication SkillsTeaching Oral Communication Skills
Teaching Oral Communication SkillsMusfera Nara Vadia
 
Spoken communication skills
Spoken communication skillsSpoken communication skills
Spoken communication skillsDokka Srinivasu
 
Testing oral ability
Testing oral abilityTesting oral ability
Testing oral abilitypaoladed
 
Speaking Assessment_Language Assessment - By Sheila Chei
Speaking Assessment_Language Assessment - By Sheila CheiSpeaking Assessment_Language Assessment - By Sheila Chei
Speaking Assessment_Language Assessment - By Sheila CheiSheila Wijayanti
 
Speaking skill by
Speaking skill bySpeaking skill by
Speaking skill byShagufta9
 
Testing speaking
Testing speakingTesting speaking
Testing speakingM B
 

What's hot (20)

Assessing speaking skills
Assessing speaking skills Assessing speaking skills
Assessing speaking skills
 
Week 3 teaching oral skills 1
Week 3 teaching oral skills 1Week 3 teaching oral skills 1
Week 3 teaching oral skills 1
 
Teaching listening skills and Spoken Communication Skills
Teaching listening skills and Spoken Communication SkillsTeaching listening skills and Spoken Communication Skills
Teaching listening skills and Spoken Communication Skills
 
Factors affecting speaking skills
Factors affecting speaking skillsFactors affecting speaking skills
Factors affecting speaking skills
 
Developing and assessing speaking in a competence based
Developing and assessing speaking in a competence basedDeveloping and assessing speaking in a competence based
Developing and assessing speaking in a competence based
 
ENGLISH FOR ORAL COMMUNICATION
ENGLISH FOR ORAL COMMUNICATIONENGLISH FOR ORAL COMMUNICATION
ENGLISH FOR ORAL COMMUNICATION
 
Speaking skill
Speaking skillSpeaking skill
Speaking skill
 
Assessing speaking
Assessing speakingAssessing speaking
Assessing speaking
 
2003 Lsrw
2003 Lsrw2003 Lsrw
2003 Lsrw
 
Spoken skills session 1
Spoken skills   session 1Spoken skills   session 1
Spoken skills session 1
 
Language skills
Language skillsLanguage skills
Language skills
 
Teaching Oral Communication Skills
Teaching Oral Communication SkillsTeaching Oral Communication Skills
Teaching Oral Communication Skills
 
Spoken communication skills
Spoken communication skillsSpoken communication skills
Spoken communication skills
 
Assessing Speaking
Assessing SpeakingAssessing Speaking
Assessing Speaking
 
Testing oral ability
Testing oral abilityTesting oral ability
Testing oral ability
 
Speaking Assessment_Language Assessment - By Sheila Chei
Speaking Assessment_Language Assessment - By Sheila CheiSpeaking Assessment_Language Assessment - By Sheila Chei
Speaking Assessment_Language Assessment - By Sheila Chei
 
Mod 3 speaking skills
Mod 3 speaking skillsMod 3 speaking skills
Mod 3 speaking skills
 
Speaking skill by
Speaking skill bySpeaking skill by
Speaking skill by
 
Testing oral ability
Testing oral ability Testing oral ability
Testing oral ability
 
Testing speaking
Testing speakingTesting speaking
Testing speaking
 

Viewers also liked

TESOL 2015: Get more out of your handouts with QR coeds
TESOL 2015: Get more out of your handouts with QR coedsTESOL 2015: Get more out of your handouts with QR coeds
TESOL 2015: Get more out of your handouts with QR coedsC Romney
 
Visual Design Best Practices for Handouts
Visual Design Best Practices for HandoutsVisual Design Best Practices for Handouts
Visual Design Best Practices for HandoutsC Romney
 
Creating supplements that increase spoke interaction
Creating supplements that increase spoke interactionCreating supplements that increase spoke interaction
Creating supplements that increase spoke interactionC Romney
 
Paperless? How about less paper with QR Codes
Paperless? How about less paper with QR CodesPaperless? How about less paper with QR Codes
Paperless? How about less paper with QR CodesC Romney
 
Harnessing the pPower of Visual Design
Harnessing the pPower of Visual DesignHarnessing the pPower of Visual Design
Harnessing the pPower of Visual DesignC Romney
 
Towards Systematic Materials Design with ADDIE
Towards Systematic Materials Design with ADDIETowards Systematic Materials Design with ADDIE
Towards Systematic Materials Design with ADDIEC Romney
 
A systematic approach to make textbook supplements
A systematic approach to make textbook supplementsA systematic approach to make textbook supplements
A systematic approach to make textbook supplementsC Romney
 
The purpose of images in elt materials revisted
The purpose of images in elt materials revistedThe purpose of images in elt materials revisted
The purpose of images in elt materials revistedC Romney
 
Sourcing Images for Teacher Made Materials
Sourcing Images for Teacher Made MaterialsSourcing Images for Teacher Made Materials
Sourcing Images for Teacher Made MaterialsC Romney
 
Increase the impact of your materials with visual design
Increase the impact of your materials with visual designIncrease the impact of your materials with visual design
Increase the impact of your materials with visual designC Romney
 
Elements of visual design for language learners
Elements of visual design for language learnersElements of visual design for language learners
Elements of visual design for language learnersC Romney
 
Visual appeal of handouts and self-made classroom materials: Does it matter?
Visual appeal of handouts and self-made classroom materials: Does it matter?Visual appeal of handouts and self-made classroom materials: Does it matter?
Visual appeal of handouts and self-made classroom materials: Does it matter?C Romney
 
What teachers need to know about visual design
What teachers need to know about visual designWhat teachers need to know about visual design
What teachers need to know about visual designC Romney
 
Typography and document design for classroom materials
Typography and document design for classroom materialsTypography and document design for classroom materials
Typography and document design for classroom materialsC Romney
 
Visual Design for Classroom Materials
Visual Design for Classroom MaterialsVisual Design for Classroom Materials
Visual Design for Classroom MaterialsC Romney
 

Viewers also liked (15)

TESOL 2015: Get more out of your handouts with QR coeds
TESOL 2015: Get more out of your handouts with QR coedsTESOL 2015: Get more out of your handouts with QR coeds
TESOL 2015: Get more out of your handouts with QR coeds
 
Visual Design Best Practices for Handouts
Visual Design Best Practices for HandoutsVisual Design Best Practices for Handouts
Visual Design Best Practices for Handouts
 
Creating supplements that increase spoke interaction
Creating supplements that increase spoke interactionCreating supplements that increase spoke interaction
Creating supplements that increase spoke interaction
 
Paperless? How about less paper with QR Codes
Paperless? How about less paper with QR CodesPaperless? How about less paper with QR Codes
Paperless? How about less paper with QR Codes
 
Harnessing the pPower of Visual Design
Harnessing the pPower of Visual DesignHarnessing the pPower of Visual Design
Harnessing the pPower of Visual Design
 
Towards Systematic Materials Design with ADDIE
Towards Systematic Materials Design with ADDIETowards Systematic Materials Design with ADDIE
Towards Systematic Materials Design with ADDIE
 
A systematic approach to make textbook supplements
A systematic approach to make textbook supplementsA systematic approach to make textbook supplements
A systematic approach to make textbook supplements
 
The purpose of images in elt materials revisted
The purpose of images in elt materials revistedThe purpose of images in elt materials revisted
The purpose of images in elt materials revisted
 
Sourcing Images for Teacher Made Materials
Sourcing Images for Teacher Made MaterialsSourcing Images for Teacher Made Materials
Sourcing Images for Teacher Made Materials
 
Increase the impact of your materials with visual design
Increase the impact of your materials with visual designIncrease the impact of your materials with visual design
Increase the impact of your materials with visual design
 
Elements of visual design for language learners
Elements of visual design for language learnersElements of visual design for language learners
Elements of visual design for language learners
 
Visual appeal of handouts and self-made classroom materials: Does it matter?
Visual appeal of handouts and self-made classroom materials: Does it matter?Visual appeal of handouts and self-made classroom materials: Does it matter?
Visual appeal of handouts and self-made classroom materials: Does it matter?
 
What teachers need to know about visual design
What teachers need to know about visual designWhat teachers need to know about visual design
What teachers need to know about visual design
 
Typography and document design for classroom materials
Typography and document design for classroom materialsTypography and document design for classroom materials
Typography and document design for classroom materials
 
Visual Design for Classroom Materials
Visual Design for Classroom MaterialsVisual Design for Classroom Materials
Visual Design for Classroom Materials
 

Similar to Beyond Linguistic Accuracy: What speaking tests must also evaluate

Elt methodology teaching speaking
Elt methodology teaching speakingElt methodology teaching speaking
Elt methodology teaching speakingEhsan Ataei
 
Further oral activities as se 2017
Further oral activities as se 2017Further oral activities as se 2017
Further oral activities as se 2017Bob Gembey
 
Presentacion ana 0508 part b
Presentacion ana 0508 part bPresentacion ana 0508 part b
Presentacion ana 0508 part bAna Ramos
 
how to teach speaking
 how to teach speaking how to teach speaking
how to teach speakingSolihin Utjok
 
agung Power point listening
agung Power point listeningagung Power point listening
agung Power point listeningagungmuarief
 
the principles of teaching speaking
the principles of teaching speakingthe principles of teaching speaking
the principles of teaching speakingRead Wan
 
New sp fact ctp and growth web
New sp fact ctp and growth webNew sp fact ctp and growth web
New sp fact ctp and growth webdarrenbattaglia
 
2.4 assessing spoken language 2
2.4 assessing spoken language 22.4 assessing spoken language 2
2.4 assessing spoken language 2Jordan Green
 
Speaking assessment-..1330508 (1)
Speaking assessment-..1330508 (1)Speaking assessment-..1330508 (1)
Speaking assessment-..1330508 (1)CristinaGrumal
 
teaching-language-skills-tefl-ppt.pptx
teaching-language-skills-tefl-ppt.pptxteaching-language-skills-tefl-ppt.pptx
teaching-language-skills-tefl-ppt.pptxPhngNguynThMinh3
 
Article presentation esl 501 developing classroom speaking activities
Article presentation esl 501 developing classroom speaking activitiesArticle presentation esl 501 developing classroom speaking activities
Article presentation esl 501 developing classroom speaking activitiesCarinne
 
Chapter 7(assessing speaking )
Chapter 7(assessing speaking )Chapter 7(assessing speaking )
Chapter 7(assessing speaking )Kheang Sokheng
 
testing listening final.ppt
testing listening final.ppttesting listening final.ppt
testing listening final.pptssuser30cc6f
 
Teaching speaking in classroom
Teaching speaking in classroomTeaching speaking in classroom
Teaching speaking in classroomAbida Rehman
 
Special considerations for_teaching-1[1]
Special considerations for_teaching-1[1]Special considerations for_teaching-1[1]
Special considerations for_teaching-1[1]kristengonzales
 

Similar to Beyond Linguistic Accuracy: What speaking tests must also evaluate (20)

Elt methodology teaching speaking
Elt methodology teaching speakingElt methodology teaching speaking
Elt methodology teaching speaking
 
Further oral activities as se 2017
Further oral activities as se 2017Further oral activities as se 2017
Further oral activities as se 2017
 
Presentacion ana 0508 part b
Presentacion ana 0508 part bPresentacion ana 0508 part b
Presentacion ana 0508 part b
 
how to teach speaking
 how to teach speaking how to teach speaking
how to teach speaking
 
agung Power point listening
agung Power point listeningagung Power point listening
agung Power point listening
 
the principles of teaching speaking
the principles of teaching speakingthe principles of teaching speaking
the principles of teaching speaking
 
New sp fact ctp and growth web
New sp fact ctp and growth webNew sp fact ctp and growth web
New sp fact ctp and growth web
 
2.4 assessing spoken language 2
2.4 assessing spoken language 22.4 assessing spoken language 2
2.4 assessing spoken language 2
 
Speaking assessment-..1330508 (1)
Speaking assessment-..1330508 (1)Speaking assessment-..1330508 (1)
Speaking assessment-..1330508 (1)
 
Teaching language functions
Teaching language functionsTeaching language functions
Teaching language functions
 
teaching-language-skills-tefl-ppt.pptx
teaching-language-skills-tefl-ppt.pptxteaching-language-skills-tefl-ppt.pptx
teaching-language-skills-tefl-ppt.pptx
 
2023 MATC Scholars Program: Communication Skills
2023 MATC Scholars Program: Communication Skills2023 MATC Scholars Program: Communication Skills
2023 MATC Scholars Program: Communication Skills
 
Article presentation esl 501 developing classroom speaking activities
Article presentation esl 501 developing classroom speaking activitiesArticle presentation esl 501 developing classroom speaking activities
Article presentation esl 501 developing classroom speaking activities
 
Chapter 7(assessing speaking )
Chapter 7(assessing speaking )Chapter 7(assessing speaking )
Chapter 7(assessing speaking )
 
Tslcd ch. 14
Tslcd ch. 14Tslcd ch. 14
Tslcd ch. 14
 
Teaching oral skills
Teaching oral skillsTeaching oral skills
Teaching oral skills
 
testing listening final.ppt
testing listening final.ppttesting listening final.ppt
testing listening final.ppt
 
Teaching speaking in classroom
Teaching speaking in classroomTeaching speaking in classroom
Teaching speaking in classroom
 
Special considerations for_teaching-1[1]
Special considerations for_teaching-1[1]Special considerations for_teaching-1[1]
Special considerations for_teaching-1[1]
 
Teaching language-skills
Teaching language-skillsTeaching language-skills
Teaching language-skills
 

Recently uploaded

Student login on Anyboli platform.helpin
Student login on Anyboli platform.helpinStudent login on Anyboli platform.helpin
Student login on Anyboli platform.helpinRaunakKeshri1
 
Introduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher EducationIntroduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher Educationpboyjonauth
 
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdfssuser54595a
 
How to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxHow to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxmanuelaromero2013
 
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Krashi Coaching
 
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991RKavithamani
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactdawncurless
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...EduSkills OECD
 
Separation of Lanthanides/ Lanthanides and Actinides
Separation of Lanthanides/ Lanthanides and ActinidesSeparation of Lanthanides/ Lanthanides and Actinides
Separation of Lanthanides/ Lanthanides and ActinidesFatimaKhan178732
 
mini mental status format.docx
mini    mental       status     format.docxmini    mental       status     format.docx
mini mental status format.docxPoojaSen20
 
Hybridoma Technology ( Production , Purification , and Application )
Hybridoma Technology  ( Production , Purification , and Application  ) Hybridoma Technology  ( Production , Purification , and Application  )
Hybridoma Technology ( Production , Purification , and Application ) Sakshi Ghasle
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introductionMaksud Ahmed
 
Arihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdfArihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdfchloefrazer622
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfciinovamais
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Sapana Sha
 
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxPOINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxSayali Powar
 
Interactive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationInteractive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationnomboosow
 
Employee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptxEmployee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptxNirmalaLoungPoorunde1
 

Recently uploaded (20)

Student login on Anyboli platform.helpin
Student login on Anyboli platform.helpinStudent login on Anyboli platform.helpin
Student login on Anyboli platform.helpin
 
Introduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher EducationIntroduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher Education
 
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
 
How to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxHow to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptx
 
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
 
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impact
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
 
Separation of Lanthanides/ Lanthanides and Actinides
Separation of Lanthanides/ Lanthanides and ActinidesSeparation of Lanthanides/ Lanthanides and Actinides
Separation of Lanthanides/ Lanthanides and Actinides
 
Staff of Color (SOC) Retention Efforts DDSD
Staff of Color (SOC) Retention Efforts DDSDStaff of Color (SOC) Retention Efforts DDSD
Staff of Color (SOC) Retention Efforts DDSD
 
mini mental status format.docx
mini    mental       status     format.docxmini    mental       status     format.docx
mini mental status format.docx
 
Hybridoma Technology ( Production , Purification , and Application )
Hybridoma Technology  ( Production , Purification , and Application  ) Hybridoma Technology  ( Production , Purification , and Application  )
Hybridoma Technology ( Production , Purification , and Application )
 
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introduction
 
Arihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdfArihant handbook biology for class 11 .pdf
Arihant handbook biology for class 11 .pdf
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
 
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxPOINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
 
Interactive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communicationInteractive Powerpoint_How to Master effective communication
Interactive Powerpoint_How to Master effective communication
 
Employee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptxEmployee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptx
 

Beyond Linguistic Accuracy: What speaking tests must also evaluate

  • 1. Beyond linguistic accuracy: What speaking tests must also evaluate John Campbell-Larsen Cameron Romney Kyoto Women’s University
  • 2. This Presentation • Part one: What is speaking? • Part two: How do you teach conversation? • Part three: How is speaking (often) evaluated? • Part four: Ideas to take away.
  • 3.
  • 7. “It [speaking] is the skill by which they [learners] are most frequently judged … It is the vehicle par excellence of social solidarity, of social ranking, of professional advancement and of business.” Martin Bygate (1987), p. vii
  • 8. Genres of speaking • Monologue (Lectures, Presentations, speeches etc.) • Power/rights differential dialogue (Interviews, Formal Debates/ Discussions, etc. ) • Transactional (Service encounters, etc.) • Conversation
  • 9. How much time do you spend in each of these genres? Participant Question
  • 10. Characteristics of Conversation Genuine conversation is characterized by the uneven distribution of information, the negotiation of meaning, … topic nomination and negotiation by more than one speaker, and the right of interlocutors to decide whether to contribute to an interaction or not. In other words, in genuine communication, decisions about who says what to whom and when are up for grabs. Nunan (1987), p.137
  • 11. Characteristics of Conversation • It is not primarily necessitated by a practical task. • Any unequal power of participants is partially suspended. • The number of participants is quite small • Turns are quite short • Talk is primarily for the participants and not for an outside audience. Cook (1989), p. 56
  • 12. Characteristics of Interviews • Pre-planned, highly structured with time limits • Often rehearsed • Uneven distribution of speakership rights • Topic controlled by task and/or examiner • Roles are (mostly) adhered to • Language is formal/neutral • Structure is Q/A adjacency pair
  • 13. Interview or Conversation? Video Removed for Student Privacy
  • 14. How do you teach conversation? Part two
  • 15. Creating a Venue for Conversation • The classroom must be reconfigured as a social rather than institutional psychological space • The learners must orient to a social rather than institutional English language identity • The learners must be made aware of the purposes of the above • The leaners must be afforded TIME to do so
  • 16. Creating a Venue for Conversation Video Removed for Student Privacy
  • 17. How is speaking (often) evaluated? Part three
  • 18. Common Forms of Evaluation • Written tests • Presentations • Task observations, e.g. role plays • Oral Proficiency Interviews (OPI)
  • 19. Written Tests Positives • Easy to evaluate large groups of students • Student know what to do Negatives • Not speaking • Often receptive skills not productive and/or linguistic knowledge
  • 20. Written Test Example • Before (1)________ down for a nap, the boy (2) _________ down the book. A: Lie B: Lay C: Laid D: Lay E: Laying F: Lying
  • 21. Presentations Positives • Individual activity • Clear outcomes Negatives • Minor speaking genre • Rehearsed, often memorized • Vocalization of written English
  • 22. Video of a Student Presentation Video Removed Please see: https://youtu.be/yRap1RlLMA0
  • 23. Task Observations, a.k.a. Role-plays Positives • Concrete outcomes, i.e. did they accomplish the task? Negatives • Usually transactional in nature • Dependent on partner’s ability • Dependent on knowledge of the context
  • 24. Issue with Role-plays “Role-playing ability can be compared with acting ability, and of course not everyone is a good actor. Nor is being a good actor equivalent to being a good communicator. Furthermore, role playing is a specialized kind of acting, requiring ad-libbing ability. Not every good actor is a good ad-libber.” van Lier (1989), p. 502
  • 25. Video of a Student Role-play Video Removed Please see: https://youtu.be/pqoI7TlxKCE
  • 26. Oral Proficiency Interviews Positives: • Students produce lots of language (ideally) Negatives: • Minor speaking genre • Highly structured with time limits • Controlled by interviewer • One-sided interaction
  • 30. So, how do you evaluate speaking?
  • 31. Ideas to take away Part Four
  • 33. Speaking Genres • Just as teaching poetry doesn’t prepare a student to write a business letter, teaching a student how to give a presentation doesn’t prepare him/her to have a conversation. • The same for reading, writing, listening, grammar, vocabulary, etc.
  • 35. Suggestions for teaching • Make conversation (real conversation) a priority • Raise student awareness of aspects of a good conversationalist • Correct bad conversation behaviors • Teach conversation/communication skills • Teach interactive skills
  • 36. #3: Test what you teach AND teach what you test
  • 37. Suggestions for evaluation • Make sure your evaluation matches classroom realities. • If you have a fixed evaluation method, include classroom activities to match the evaluation.
  • 38. Beyond linguistic accuracy: What speaking tests must also evaluate John Campbell-Larsen Cameron Romney Kyoto Women’s University