SlideShare a Scribd company logo
1 of 32
June 2013
Learning Engineer/Project Manager
Mini OLI Authoring Training
Kim Larson
oli.cmu.edu
Learning Objectives
By the end of this session, you will be able to…
• Write a student centered observable or measurable
learning objective
• Identify component skills that make up that objective
• Write a learning activity, that includes hints and targeted
feedback.
oli.cmu.edu
The Course Design Triangle
Source: Eberly Center for Teaching Excellence
Carnegie Mellon
Instructional Activities
(low stakes assessments)
Objectives
Assessments
(High stakes)
Tasks that provide
feedback on students’
knowledge and skills
Descriptions of what students
should be able to do at the
end of the course
Contexts and activities that foster
students’ active engagement in
learning
oli.cmu.edu
The Course Design Triangle
Source: Eberly Center for Teaching Excellence
Carnegie Mellon
Instructional Activities
(low stakes assessments)
Objectives
Assessments
(High stakes)
Tasks that provide
feedback on students’
knowledge and skills
Descriptions of what students
should be able to do at the
end of the course
Contexts and activities that foster
students’ active engagement in
learning
oli.cmu.edu
Why Focus on Learning Objectives?
1. They communicate our intentions clearly to students and
to colleagues.
2. They provide a framework for selecting and organizing
course content.
3. They guide in decisions about assessment and
evaluation methods.
4. They provide a framework for selecting appropriate
teaching and learning activities.
5. They give students information for directing their
learning efforts and monitoring their own progress.
Based on A.H. Miller (1987), Course Design for University Lecturers. New York: Nichols Publishing.
Also see, C.I. Davidson & S. A. Ambrose (1994), The New Professor’s Handbook: A Guide to Teaching and Research in Engineering and Sciences. Bolton, MA:
Anker Publishing Company Inc.
oli.cmu.edu
Four key elements to good learning
objectives:
1.student-centered
2.component skills/sub objectives
3.use action verbs
4.observable or measurable
oli.cmu.edu
Four key elements to good learning
objectives:
Student-centered:
Learning objectives should be student-centered; for example, stated as
"Students should be able to _______.“
Component skills/sub objectives:
They should break down the task and focus on specific cognitive processes.
Many activities that faculty believe requires a single skill (for example, writing
or problem solving) actually involve a synthesis of many component skills.
Use action verbs:
Clear objectives should use action verbs that communicate to the students
the kind of intellectual effort we expect of them. Furthermore, using action
verbs reduces ambiguity in what it means to "understand."
Observable or measurable:
Clear objectives should be observable or measurable. We should be able to
easily check (that is, assess) whether students have mastered a skill (for
example, asking students to "state" a given theorem, "solve" a textbook
problem, or "identify" the appropriate principle).
oli.cmu.edu
Student Centered
Remember, the real goal of a course is not for us to teach a
body of material but rather for students to learn it.
Therefore, learning objectives are most effective when they
specify our goals from the students’ point of view.
oli.cmu.edu
Student Centered
The first key feature of a learning objective is that it expresses
what the student, not the teacher, will be doing. Look at the two
“objectives” below and ask yourself who would be accomplishing
each objective: the student or the teacher?
A. Apply two theories in social psychology to explain specific examples of
human behavior.
B. Introduce students to a range of theories in social psychology.
A describes what students will be able to do at the end of the course, it is a learning
objective.
B, however, indicates what the instructor wants to achieve and does not constitute a
learning objective.
oli.cmu.edu
Component skills/sub objectives
They should break down the task and focus on specific
cognitive processes.
Many activities that faculty believe requires a single skill (for
example, writing or problem solving) actually involve a
synthesis of many component skills.
oli.cmu.edu
Component skills/sub objectives
The objective often requires more of a synthesized activity that requires students to
be able to do a number of skills to show mastery of the objective.
For example, let's say you have a learning objective for an elementary algebra course
like this one:
Simplifying, adding, subtracting, multiplying and dividing polynomials.
The component skills would be something like this:
Combine like terms
Use order of operation
Use distributive property
You would expect that in their prior knowledge
they would already be able to:
Add
Subtract
Multiply
Divide
oli.cmu.edu
Action verbs
Actions verbs help specify what you want students to be able to do.
By telling students what to do, we provide them with benchmarks by
which to assess their process--we inform them as to which tasks they
might use to monitor whether or not their performance of certain tasks is
up to par--metacognition.
As previously discussed, learning objectives both help students monitor
their own learning and also help students focus their energy
appropriately, and action verbs are also a big part of that contribute
significantly to both parts of that.
At the same time, action verbs enable instructors to focus on and clarify
the tasks we want to evaluate.
oli.cmu.edu
Observable or measurable
Observable or measurable
Look at the two objectives below. Which one is observable?
A. Understand Newton’s Second Law
B. Explain Newton’s Second Law
Notice that A is not observable, while B is. An instructor can’t
directly witness a student’s understanding. However, she could
observe and evaluate a student’s explanation.
Observable. Avoid using words like “understand”, “comprehend”, or “appreciate”.
These are cognitive processes that take place in a student’s head and are
invisible to you. Instead, ask yourself: What would students have to do that would
show me that they understand X, comprehend Y, or appreciate Z?
oli.cmu.edu
Different Kinds of Objectives
Bloom’s Revised Taxonomy identifies six levels of cognitive
processes. http://www.celt.iastate.edu/teaching/RevisedBlooms1.html
Across these levels, knowledge is used in more
sophisticated ways:
▫ Recall: remember, recognize, identify
▫ Understand: interpret, exemplify, classify, summarize,
explain, compare
▫ Apply: execute, implement, use, carry out
▫ Analyze: differentiate, distinguish, organize, select
▫ Evaluate: check, critique, judge, monitor, test
▫ Create: generate, plan, produce, construct, hypothesize
oli.cmu.edu
NOTE: Watch Out for Verbs that are
not Observable or Measurable
In order for an objective to give maximum structure to instruction, it
should be free of vague or ambiguous words or phrases. The following
lists notoriously ambiguous words or phrases which should be avoided
so that the intended outcome is concise and explicit.
WORDS TO AVOID:
Believe, Hear, Realize, Capacity, Intelligence, Recognize, Comprehend,
Know, See Conceptualize, Listen, Self-Actualize, Depth, Memorize, Think,
Experience, Perceive, Understand, Feel
PHRASES TO AVOID:
To Become: To Reduce: Appreciation for… Acquainted with… Anxiety
Attitude of… Adjusted to… Immaturity Awareness of… Capable of…
Insecurity Comprehension of… Cognizant of… Enjoyment of… Conscious
of… Feeling for… Familiar with… Interest in… Interested in… Knowledge
of… Knowledgeable about…. Understanding of… Self-Confident in.
oli.cmu.edu
Create an objective
Create a basic objective at your table, try to choose something
that most people have domain expertise in. (It could be anything)
Then determine if there are component skills needed to for the
student to show mastery in the objective.
For example you could use something like hand signals for
driving:
OBJECTIVE:
Describe the hand signals for driving when electronic signals are
unavailable or not working in the US.
SUB SKILL
Identify the hand signal for making a right turn in the US
oli.cmu.edu
Let’s check your objective.
Checklist: Is the objective…?
• Student centered (i.e., student should be able to…)
• Broken down into component skills (grain size)
• Phrased with an action verb
• Observable or Measurable
oli.cmu.edu
The Course Design Triangle
Eberly Center for Teaching Excellence
Carnegie Mellon
Instructional Activities
Objectives
Assessments
Tasks that provide
feedback on students’
knowledge and skills
Descriptions of what students
should be able to do at the
end of the course
Contexts and activities that foster
students’ active engagement in
learning
oli.cmu.edu
What would happen if there was a learning
objective with no activities?
All sorts of awful things
▫ Fire and brimstone coming down from the skies
▫ Rivers and seas boiling
▫ 40 years of darkness
▫ Human sacrifice
▫ Dogs and cats living together
▫ Mass Hysteria!
- Ghostbusters
oli.cmu.edu
Learn By Doing
“Practice this material”
Scaffolded to give support “as needed” by providing tailored
hints and feedback.
Allow students to practice specific tasks and skills in a non-
threatening environment.
Learning Dashboard report student activity in an aggregate
format.
oli.cmu.edu
Hints
Think about when a student is given task and they become
immediately stuck.
If the student asked you for help what would you say to
student to help them figure it out.
1st Hint is strategy for answering question:
▫ General restatement of goal: your goal is X, try strategy Y (the
strategy)
2nd Hint is cognitive:
▫ Mid-level (compare angle A-B-C to X-Y-Z)
3rd Hint is bottom out, give them the answer:
▫ Answer + explanation (the angle is 45 degrees)
oli.cmu.edu
Hint 1: Example
oli.cmu.edu
Hint 2: Example
oli.cmu.edu
Hint 3: Example
oli.cmu.edu
Feedback
Initial response, then short explanation.
▫ Not quite right. As you look at the histogram, notice that the
distribution is roughly symmetric.
▫ Correct. Since the distribution is symmetric, the mean and
median would be about the same.
▫ Incorrect. This data set is skewed and the Mean/SD are affected
by skew.
Appropriate distracters(answer choices):
▫ Reflect common misconceptions or errors,
oli.cmu.edu
Feedback: Example
oli.cmu.edu
Feedback: Example
oli.cmu.edu
Feedback: Example
oli.cmu.edu
Feedback: Example
oli.cmu.edu
Create a learning activity for the
objective you wrote earlier
Think about a question you would ask students to determine
if they could master the objective. Then try to write hints and
targeted feedback for that question.
Let’s go back to our example.
I will take the sub skill:
Identify the hand signal for making a right turn in the US
Q1. Which is the correct way to hand signal making a right
turn when your vehicle does not have signal lights or has
damaged signal lights?
oli.cmu.edu
Using distractors that address common
misconceptions.
Q1. Which is the correct way to hand signal making a right
turn when your vehicle does not have signal lights or has
damaged signal lights?
A. Put your left arm out of the left front window and point your
finger toward the right.
B. Open your right front window and reach over as far as you can
and put your hand out.
C. Extend your left upper-arm out to the left, horizontally and
angle your forearm vertically upward.
oli.cmu.edu
Hints and targeted feedback
Q1. Which is the correct way to hand signal making a right turn
when your vehicle does not have signal lights or has damaged
signal lights?
Hints:
1. If you want to make a turn, think about what might be the safest and way to
convey that to other drivers and pedestrians.
2. You have to signal in a way that is visible to other drivers and pedestrian.
3. The correct answer is to extend your left upper arm out to the left, horizontally
and angel your forearm vertically.
Feedback:
A. Not quite right. While this may work it is not the universal signal in the US for
a right hand turn.
B. Incorrect. Reaching across the inside of the car to signal a turn is not a safe
way to operate your vehicle, and is not the correct way to signal.
C. Correct. This is the universal signal in the US to let other people know you
are taking a right hand turn.

More Related Content

What's hot

Simple k12 performance task assessment
Simple k12 performance task assessmentSimple k12 performance task assessment
Simple k12 performance task assessment
Jonathan Martin
 
Putting Differentiation Into Practice Maria Montalvo
Putting Differentiation Into Practice   Maria MontalvoPutting Differentiation Into Practice   Maria Montalvo
Putting Differentiation Into Practice Maria Montalvo
CARLOS MARTINEZ
 
Objectives and success criteria
Objectives and success criteriaObjectives and success criteria
Objectives and success criteria
lgreen
 
Chapter 5 product-oriented performance-based assessment
Chapter 5 product-oriented performance-based assessmentChapter 5 product-oriented performance-based assessment
Chapter 5 product-oriented performance-based assessment
Eduard Sabangan
 
Assessment 2 e-portfolio
Assessment 2 e-portfolioAssessment 2 e-portfolio
Assessment 2 e-portfolio
MarvillBautista
 
Assessment for learning_activities1[1]
Assessment for learning_activities1[1]Assessment for learning_activities1[1]
Assessment for learning_activities1[1]
jorawlings
 
DI Valemount/McBride
DI Valemount/McBrideDI Valemount/McBride
DI Valemount/McBride
dgravessd38
 
Learning Intentions Tk
Learning Intentions TkLearning Intentions Tk
Learning Intentions Tk
debs007
 
Group Powerpoint - Assessment for Learning
Group Powerpoint - Assessment for LearningGroup Powerpoint - Assessment for Learning
Group Powerpoint - Assessment for Learning
Gregory Familton
 
Afl presentation
Afl presentationAfl presentation
Afl presentation
annacb19
 

What's hot (20)

Competency-Based Curriculum Development
Competency-Based Curriculum DevelopmentCompetency-Based Curriculum Development
Competency-Based Curriculum Development
 
Identfying test objecctives (Assessment and Evaluation)
Identfying test objecctives (Assessment and Evaluation)Identfying test objecctives (Assessment and Evaluation)
Identfying test objecctives (Assessment and Evaluation)
 
Simple k12 performance task assessment
Simple k12 performance task assessmentSimple k12 performance task assessment
Simple k12 performance task assessment
 
Putting Differentiation Into Practice Maria Montalvo
Putting Differentiation Into Practice   Maria MontalvoPutting Differentiation Into Practice   Maria Montalvo
Putting Differentiation Into Practice Maria Montalvo
 
Objectives and success criteria
Objectives and success criteriaObjectives and success criteria
Objectives and success criteria
 
Performance assessment may 2015
Performance assessment may 2015Performance assessment may 2015
Performance assessment may 2015
 
Chapter 5 product-oriented performance-based assessment
Chapter 5 product-oriented performance-based assessmentChapter 5 product-oriented performance-based assessment
Chapter 5 product-oriented performance-based assessment
 
Assessment 2 e-portfolio
Assessment 2 e-portfolioAssessment 2 e-portfolio
Assessment 2 e-portfolio
 
Assessment for learning activities
Assessment for learning activitiesAssessment for learning activities
Assessment for learning activities
 
Assessment for learning_activities1[1]
Assessment for learning_activities1[1]Assessment for learning_activities1[1]
Assessment for learning_activities1[1]
 
DI Valemount/McBride
DI Valemount/McBrideDI Valemount/McBride
DI Valemount/McBride
 
25 quick formative assessments
25 quick formative assessments25 quick formative assessments
25 quick formative assessments
 
Shavon Terrell STOMP ePortfolio
Shavon Terrell STOMP ePortfolioShavon Terrell STOMP ePortfolio
Shavon Terrell STOMP ePortfolio
 
Creating Performance Tasks Easy Steps
Creating Performance Tasks Easy StepsCreating Performance Tasks Easy Steps
Creating Performance Tasks Easy Steps
 
Writing Effective Learning Outcomes
Writing Effective Learning OutcomesWriting Effective Learning Outcomes
Writing Effective Learning Outcomes
 
AfL Strategies
AfL StrategiesAfL Strategies
AfL Strategies
 
An Overview of Assessment Design
An Overview of Assessment DesignAn Overview of Assessment Design
An Overview of Assessment Design
 
Learning Intentions Tk
Learning Intentions TkLearning Intentions Tk
Learning Intentions Tk
 
Group Powerpoint - Assessment for Learning
Group Powerpoint - Assessment for LearningGroup Powerpoint - Assessment for Learning
Group Powerpoint - Assessment for Learning
 
Afl presentation
Afl presentationAfl presentation
Afl presentation
 

Similar to Open Course Design - Authoring with CMU OLI

Ubd Edi Soh Presentation
Ubd Edi Soh PresentationUbd Edi Soh Presentation
Ubd Edi Soh Presentation
Ana Banos
 
Goals and objectives
Goals and objectivesGoals and objectives
Goals and objectives
Itala Diaz
 
Lesson planning and demo teaching
Lesson planning and demo teachingLesson planning and demo teaching
Lesson planning and demo teaching
Athan Mensalvas
 
Assessment 07
Assessment 07Assessment 07
Assessment 07
fogleman
 
Bloomsobjectives
BloomsobjectivesBloomsobjectives
Bloomsobjectives
Carla Piper
 

Similar to Open Course Design - Authoring with CMU OLI (20)

Lesson plan setting aims and objecitves march 2021 mostagh for fate boot pr...
Lesson plan setting aims and objecitves  march 2021 mostagh  for fate boot pr...Lesson plan setting aims and objecitves  march 2021 mostagh  for fate boot pr...
Lesson plan setting aims and objecitves march 2021 mostagh for fate boot pr...
 
Ubd Edi Soh Presentation
Ubd Edi Soh PresentationUbd Edi Soh Presentation
Ubd Edi Soh Presentation
 
Goals and objectives
Goals and objectivesGoals and objectives
Goals and objectives
 
Lesson plan setting aims and objectives
Lesson plan     setting aims and objectivesLesson plan     setting aims and objectives
Lesson plan setting aims and objectives
 
Instructional objective
Instructional objectiveInstructional objective
Instructional objective
 
WRITING OBJECTIVES & OUTCOMES.pptx
WRITING OBJECTIVES & OUTCOMES.pptxWRITING OBJECTIVES & OUTCOMES.pptx
WRITING OBJECTIVES & OUTCOMES.pptx
 
Planning1
Planning1Planning1
Planning1
 
Lesson planning and demo teaching
Lesson planning and demo teachingLesson planning and demo teaching
Lesson planning and demo teaching
 
Objective tips
Objective tipsObjective tips
Objective tips
 
TED 453 Session 6
TED 453 Session 6TED 453 Session 6
TED 453 Session 6
 
TED 453 Session 6
TED 453 Session 6TED 453 Session 6
TED 453 Session 6
 
Bloomsobjectives
BloomsobjectivesBloomsobjectives
Bloomsobjectives
 
Assessment 07
Assessment 07Assessment 07
Assessment 07
 
Bloomsobjectives
BloomsobjectivesBloomsobjectives
Bloomsobjectives
 
Student Learning Outcomes
Student Learning OutcomesStudent Learning Outcomes
Student Learning Outcomes
 
Module 2 slides
Module 2 slidesModule 2 slides
Module 2 slides
 
John Biggs And Catherine Tang 2008
John Biggs And Catherine Tang 2008John Biggs And Catherine Tang 2008
John Biggs And Catherine Tang 2008
 
Tools for evaluating the effectiveness of your teaching technique 1
Tools for evaluating the effectiveness of your teaching technique 1Tools for evaluating the effectiveness of your teaching technique 1
Tools for evaluating the effectiveness of your teaching technique 1
 
Ch. 8 developing an instructional strategy
Ch. 8 developing an instructional strategyCh. 8 developing an instructional strategy
Ch. 8 developing an instructional strategy
 
Special topics authentic assessment
Special topics authentic assessmentSpecial topics authentic assessment
Special topics authentic assessment
 

More from OPEN4Us

Effective Open Course Design - Kim Larson, Carnegie Mellon University OLI
Effective Open Course Design - Kim Larson, Carnegie Mellon University OLIEffective Open Course Design - Kim Larson, Carnegie Mellon University OLI
Effective Open Course Design - Kim Larson, Carnegie Mellon University OLI
OPEN4Us
 
National STEM Consortium OPEN Round 2 Kick-Off Presentation 6-20-13 v2
National STEM Consortium OPEN Round 2 Kick-Off Presentation 6-20-13 v2National STEM Consortium OPEN Round 2 Kick-Off Presentation 6-20-13 v2
National STEM Consortium OPEN Round 2 Kick-Off Presentation 6-20-13 v2
OPEN4Us
 
Colorado Online Energy Project TAACCCT Round 2 Kick-Off Presentation
Colorado Online Energy Project TAACCCT Round 2 Kick-Off PresentationColorado Online Energy Project TAACCCT Round 2 Kick-Off Presentation
Colorado Online Energy Project TAACCCT Round 2 Kick-Off Presentation
OPEN4Us
 
Boyoung Chae TAACCCT Round 2 OPEN Kick-Off Presentation
Boyoung Chae TAACCCT Round 2 OPEN Kick-Off PresentationBoyoung Chae TAACCCT Round 2 OPEN Kick-Off Presentation
Boyoung Chae TAACCCT Round 2 OPEN Kick-Off Presentation
OPEN4Us
 
MoHealthWINs TAACCCT Round 2 Kick-Off Presentation
MoHealthWINs TAACCCT Round 2 Kick-Off PresentationMoHealthWINs TAACCCT Round 2 Kick-Off Presentation
MoHealthWINs TAACCCT Round 2 Kick-Off Presentation
OPEN4Us
 
Universal Design for Learning and Open Educational Resources - TAACCCT Round2...
Universal Design for Learning and Open Educational Resources - TAACCCT Round2...Universal Design for Learning and Open Educational Resources - TAACCCT Round2...
Universal Design for Learning and Open Educational Resources - TAACCCT Round2...
OPEN4Us
 

More from OPEN4Us (10)

A guide to adding the CC BY license notice
A guide to adding the CC BY license noticeA guide to adding the CC BY license notice
A guide to adding the CC BY license notice
 
OERs On Campus - Selecting and Creating Instructional Resources for All Students
OERs On Campus - Selecting and Creating Instructional Resources for All StudentsOERs On Campus - Selecting and Creating Instructional Resources for All Students
OERs On Campus - Selecting and Creating Instructional Resources for All Students
 
Content Marking for TAACCCT Grantee Deliverables
Content Marking for TAACCCT Grantee DeliverablesContent Marking for TAACCCT Grantee Deliverables
Content Marking for TAACCCT Grantee Deliverables
 
OPEN Partners Round 1 Service Introduction
OPEN Partners Round 1 Service IntroductionOPEN Partners Round 1 Service Introduction
OPEN Partners Round 1 Service Introduction
 
Effective Open Course Design - Kim Larson, Carnegie Mellon University OLI
Effective Open Course Design - Kim Larson, Carnegie Mellon University OLIEffective Open Course Design - Kim Larson, Carnegie Mellon University OLI
Effective Open Course Design - Kim Larson, Carnegie Mellon University OLI
 
National STEM Consortium OPEN Round 2 Kick-Off Presentation 6-20-13 v2
National STEM Consortium OPEN Round 2 Kick-Off Presentation 6-20-13 v2National STEM Consortium OPEN Round 2 Kick-Off Presentation 6-20-13 v2
National STEM Consortium OPEN Round 2 Kick-Off Presentation 6-20-13 v2
 
Colorado Online Energy Project TAACCCT Round 2 Kick-Off Presentation
Colorado Online Energy Project TAACCCT Round 2 Kick-Off PresentationColorado Online Energy Project TAACCCT Round 2 Kick-Off Presentation
Colorado Online Energy Project TAACCCT Round 2 Kick-Off Presentation
 
Boyoung Chae TAACCCT Round 2 OPEN Kick-Off Presentation
Boyoung Chae TAACCCT Round 2 OPEN Kick-Off PresentationBoyoung Chae TAACCCT Round 2 OPEN Kick-Off Presentation
Boyoung Chae TAACCCT Round 2 OPEN Kick-Off Presentation
 
MoHealthWINs TAACCCT Round 2 Kick-Off Presentation
MoHealthWINs TAACCCT Round 2 Kick-Off PresentationMoHealthWINs TAACCCT Round 2 Kick-Off Presentation
MoHealthWINs TAACCCT Round 2 Kick-Off Presentation
 
Universal Design for Learning and Open Educational Resources - TAACCCT Round2...
Universal Design for Learning and Open Educational Resources - TAACCCT Round2...Universal Design for Learning and Open Educational Resources - TAACCCT Round2...
Universal Design for Learning and Open Educational Resources - TAACCCT Round2...
 

Recently uploaded

FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
dollysharma2066
 
Just Call Vip call girls dharamshala Escorts ☎️9352988975 Two shot with one g...
Just Call Vip call girls dharamshala Escorts ☎️9352988975 Two shot with one g...Just Call Vip call girls dharamshala Escorts ☎️9352988975 Two shot with one g...
Just Call Vip call girls dharamshala Escorts ☎️9352988975 Two shot with one g...
gajnagarg
 
Abortion Pills in Oman (+918133066128) Cytotec clinic buy Oman Muscat
Abortion Pills in Oman (+918133066128) Cytotec clinic buy Oman MuscatAbortion Pills in Oman (+918133066128) Cytotec clinic buy Oman Muscat
Abortion Pills in Oman (+918133066128) Cytotec clinic buy Oman Muscat
Abortion pills in Kuwait Cytotec pills in Kuwait
 
Escorts Service Nagavara ☎ 7737669865☎ Book Your One night Stand (Bangalore)
Escorts Service Nagavara ☎ 7737669865☎ Book Your One night Stand (Bangalore)Escorts Service Nagavara ☎ 7737669865☎ Book Your One night Stand (Bangalore)
Escorts Service Nagavara ☎ 7737669865☎ Book Your One night Stand (Bangalore)
amitlee9823
 
Nisha Yadav Escorts Service Ernakulam ❣️ 7014168258 ❣️ High Cost Unlimited Ha...
Nisha Yadav Escorts Service Ernakulam ❣️ 7014168258 ❣️ High Cost Unlimited Ha...Nisha Yadav Escorts Service Ernakulam ❣️ 7014168258 ❣️ High Cost Unlimited Ha...
Nisha Yadav Escorts Service Ernakulam ❣️ 7014168258 ❣️ High Cost Unlimited Ha...
nirzagarg
 
➥🔝 7737669865 🔝▻ dehradun Call-girls in Women Seeking Men 🔝dehradun🔝 Escor...
➥🔝 7737669865 🔝▻ dehradun Call-girls in Women Seeking Men  🔝dehradun🔝   Escor...➥🔝 7737669865 🔝▻ dehradun Call-girls in Women Seeking Men  🔝dehradun🔝   Escor...
➥🔝 7737669865 🔝▻ dehradun Call-girls in Women Seeking Men 🔝dehradun🔝 Escor...
amitlee9823
 
👉 Call Girls Service Amritsar 👉📞 6367187148 👉📞 Just📲 Call Ruhi Call Girl Agen...
👉 Call Girls Service Amritsar 👉📞 6367187148 👉📞 Just📲 Call Ruhi Call Girl Agen...👉 Call Girls Service Amritsar 👉📞 6367187148 👉📞 Just📲 Call Ruhi Call Girl Agen...
👉 Call Girls Service Amritsar 👉📞 6367187148 👉📞 Just📲 Call Ruhi Call Girl Agen...
karishmasinghjnh
 
Verified Trusted Call Girls Adugodi💘 9352852248 Good Looking standard Profil...
Verified Trusted Call Girls Adugodi💘 9352852248  Good Looking standard Profil...Verified Trusted Call Girls Adugodi💘 9352852248  Good Looking standard Profil...
Verified Trusted Call Girls Adugodi💘 9352852248 Good Looking standard Profil...
kumaririma588
 
Whitefield Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Ba...
Whitefield Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Ba...Whitefield Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Ba...
Whitefield Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Ba...
amitlee9823
 
➥🔝 7737669865 🔝▻ dharamshala Call-girls in Women Seeking Men 🔝dharamshala🔝 ...
➥🔝 7737669865 🔝▻ dharamshala Call-girls in Women Seeking Men  🔝dharamshala🔝  ...➥🔝 7737669865 🔝▻ dharamshala Call-girls in Women Seeking Men  🔝dharamshala🔝  ...
➥🔝 7737669865 🔝▻ dharamshala Call-girls in Women Seeking Men 🔝dharamshala🔝 ...
amitlee9823
 

Recently uploaded (20)

❤Personal Whatsapp Number 8617697112 Samba Call Girls 💦✅.
❤Personal Whatsapp Number 8617697112 Samba Call Girls 💦✅.❤Personal Whatsapp Number 8617697112 Samba Call Girls 💦✅.
❤Personal Whatsapp Number 8617697112 Samba Call Girls 💦✅.
 
Q4-W4-SCIENCE-5 power point presentation
Q4-W4-SCIENCE-5 power point presentationQ4-W4-SCIENCE-5 power point presentation
Q4-W4-SCIENCE-5 power point presentation
 
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
FULL ENJOY Call Girls In Mahipalpur Delhi Contact Us 8377877756
 
Top Rated Pune Call Girls Koregaon Park ⟟ 6297143586 ⟟ Call Me For Genuine S...
Top Rated  Pune Call Girls Koregaon Park ⟟ 6297143586 ⟟ Call Me For Genuine S...Top Rated  Pune Call Girls Koregaon Park ⟟ 6297143586 ⟟ Call Me For Genuine S...
Top Rated Pune Call Girls Koregaon Park ⟟ 6297143586 ⟟ Call Me For Genuine S...
 
Just Call Vip call girls dharamshala Escorts ☎️9352988975 Two shot with one g...
Just Call Vip call girls dharamshala Escorts ☎️9352988975 Two shot with one g...Just Call Vip call girls dharamshala Escorts ☎️9352988975 Two shot with one g...
Just Call Vip call girls dharamshala Escorts ☎️9352988975 Two shot with one g...
 
Abortion Pills in Oman (+918133066128) Cytotec clinic buy Oman Muscat
Abortion Pills in Oman (+918133066128) Cytotec clinic buy Oman MuscatAbortion Pills in Oman (+918133066128) Cytotec clinic buy Oman Muscat
Abortion Pills in Oman (+918133066128) Cytotec clinic buy Oman Muscat
 
Escorts Service Nagavara ☎ 7737669865☎ Book Your One night Stand (Bangalore)
Escorts Service Nagavara ☎ 7737669865☎ Book Your One night Stand (Bangalore)Escorts Service Nagavara ☎ 7737669865☎ Book Your One night Stand (Bangalore)
Escorts Service Nagavara ☎ 7737669865☎ Book Your One night Stand (Bangalore)
 
Nisha Yadav Escorts Service Ernakulam ❣️ 7014168258 ❣️ High Cost Unlimited Ha...
Nisha Yadav Escorts Service Ernakulam ❣️ 7014168258 ❣️ High Cost Unlimited Ha...Nisha Yadav Escorts Service Ernakulam ❣️ 7014168258 ❣️ High Cost Unlimited Ha...
Nisha Yadav Escorts Service Ernakulam ❣️ 7014168258 ❣️ High Cost Unlimited Ha...
 
Just Call Vip call girls Nagpur Escorts ☎️8617370543 Starting From 5K to 25K ...
Just Call Vip call girls Nagpur Escorts ☎️8617370543 Starting From 5K to 25K ...Just Call Vip call girls Nagpur Escorts ☎️8617370543 Starting From 5K to 25K ...
Just Call Vip call girls Nagpur Escorts ☎️8617370543 Starting From 5K to 25K ...
 
➥🔝 7737669865 🔝▻ dehradun Call-girls in Women Seeking Men 🔝dehradun🔝 Escor...
➥🔝 7737669865 🔝▻ dehradun Call-girls in Women Seeking Men  🔝dehradun🔝   Escor...➥🔝 7737669865 🔝▻ dehradun Call-girls in Women Seeking Men  🔝dehradun🔝   Escor...
➥🔝 7737669865 🔝▻ dehradun Call-girls in Women Seeking Men 🔝dehradun🔝 Escor...
 
Booking open Available Pune Call Girls Nanded City 6297143586 Call Hot India...
Booking open Available Pune Call Girls Nanded City  6297143586 Call Hot India...Booking open Available Pune Call Girls Nanded City  6297143586 Call Hot India...
Booking open Available Pune Call Girls Nanded City 6297143586 Call Hot India...
 
VIP Model Call Girls Kalyani Nagar ( Pune ) Call ON 8005736733 Starting From ...
VIP Model Call Girls Kalyani Nagar ( Pune ) Call ON 8005736733 Starting From ...VIP Model Call Girls Kalyani Nagar ( Pune ) Call ON 8005736733 Starting From ...
VIP Model Call Girls Kalyani Nagar ( Pune ) Call ON 8005736733 Starting From ...
 
call girls in Kaushambi (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝...
call girls in Kaushambi (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝...call girls in Kaushambi (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝...
call girls in Kaushambi (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝...
 
👉 Call Girls Service Amritsar 👉📞 6367187148 👉📞 Just📲 Call Ruhi Call Girl Agen...
👉 Call Girls Service Amritsar 👉📞 6367187148 👉📞 Just📲 Call Ruhi Call Girl Agen...👉 Call Girls Service Amritsar 👉📞 6367187148 👉📞 Just📲 Call Ruhi Call Girl Agen...
👉 Call Girls Service Amritsar 👉📞 6367187148 👉📞 Just📲 Call Ruhi Call Girl Agen...
 
Verified Trusted Call Girls Adugodi💘 9352852248 Good Looking standard Profil...
Verified Trusted Call Girls Adugodi💘 9352852248  Good Looking standard Profil...Verified Trusted Call Girls Adugodi💘 9352852248  Good Looking standard Profil...
Verified Trusted Call Girls Adugodi💘 9352852248 Good Looking standard Profil...
 
Whitefield Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Ba...
Whitefield Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Ba...Whitefield Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Ba...
Whitefield Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Ba...
 
Sweety Planet Packaging Design Process Book.pptx
Sweety Planet Packaging Design Process Book.pptxSweety Planet Packaging Design Process Book.pptx
Sweety Planet Packaging Design Process Book.pptx
 
Call Girls Jalgaon Just Call 8617370543Top Class Call Girl Service Available
Call Girls Jalgaon Just Call 8617370543Top Class Call Girl Service AvailableCall Girls Jalgaon Just Call 8617370543Top Class Call Girl Service Available
Call Girls Jalgaon Just Call 8617370543Top Class Call Girl Service Available
 
➥🔝 7737669865 🔝▻ dharamshala Call-girls in Women Seeking Men 🔝dharamshala🔝 ...
➥🔝 7737669865 🔝▻ dharamshala Call-girls in Women Seeking Men  🔝dharamshala🔝  ...➥🔝 7737669865 🔝▻ dharamshala Call-girls in Women Seeking Men  🔝dharamshala🔝  ...
➥🔝 7737669865 🔝▻ dharamshala Call-girls in Women Seeking Men 🔝dharamshala🔝 ...
 
Pooja 9892124323, Call girls Services and Mumbai Escort Service Near Hotel Gi...
Pooja 9892124323, Call girls Services and Mumbai Escort Service Near Hotel Gi...Pooja 9892124323, Call girls Services and Mumbai Escort Service Near Hotel Gi...
Pooja 9892124323, Call girls Services and Mumbai Escort Service Near Hotel Gi...
 

Open Course Design - Authoring with CMU OLI

  • 1. June 2013 Learning Engineer/Project Manager Mini OLI Authoring Training Kim Larson
  • 2. oli.cmu.edu Learning Objectives By the end of this session, you will be able to… • Write a student centered observable or measurable learning objective • Identify component skills that make up that objective • Write a learning activity, that includes hints and targeted feedback.
  • 3. oli.cmu.edu The Course Design Triangle Source: Eberly Center for Teaching Excellence Carnegie Mellon Instructional Activities (low stakes assessments) Objectives Assessments (High stakes) Tasks that provide feedback on students’ knowledge and skills Descriptions of what students should be able to do at the end of the course Contexts and activities that foster students’ active engagement in learning
  • 4. oli.cmu.edu The Course Design Triangle Source: Eberly Center for Teaching Excellence Carnegie Mellon Instructional Activities (low stakes assessments) Objectives Assessments (High stakes) Tasks that provide feedback on students’ knowledge and skills Descriptions of what students should be able to do at the end of the course Contexts and activities that foster students’ active engagement in learning
  • 5. oli.cmu.edu Why Focus on Learning Objectives? 1. They communicate our intentions clearly to students and to colleagues. 2. They provide a framework for selecting and organizing course content. 3. They guide in decisions about assessment and evaluation methods. 4. They provide a framework for selecting appropriate teaching and learning activities. 5. They give students information for directing their learning efforts and monitoring their own progress. Based on A.H. Miller (1987), Course Design for University Lecturers. New York: Nichols Publishing. Also see, C.I. Davidson & S. A. Ambrose (1994), The New Professor’s Handbook: A Guide to Teaching and Research in Engineering and Sciences. Bolton, MA: Anker Publishing Company Inc.
  • 6. oli.cmu.edu Four key elements to good learning objectives: 1.student-centered 2.component skills/sub objectives 3.use action verbs 4.observable or measurable
  • 7. oli.cmu.edu Four key elements to good learning objectives: Student-centered: Learning objectives should be student-centered; for example, stated as "Students should be able to _______.“ Component skills/sub objectives: They should break down the task and focus on specific cognitive processes. Many activities that faculty believe requires a single skill (for example, writing or problem solving) actually involve a synthesis of many component skills. Use action verbs: Clear objectives should use action verbs that communicate to the students the kind of intellectual effort we expect of them. Furthermore, using action verbs reduces ambiguity in what it means to "understand." Observable or measurable: Clear objectives should be observable or measurable. We should be able to easily check (that is, assess) whether students have mastered a skill (for example, asking students to "state" a given theorem, "solve" a textbook problem, or "identify" the appropriate principle).
  • 8. oli.cmu.edu Student Centered Remember, the real goal of a course is not for us to teach a body of material but rather for students to learn it. Therefore, learning objectives are most effective when they specify our goals from the students’ point of view.
  • 9. oli.cmu.edu Student Centered The first key feature of a learning objective is that it expresses what the student, not the teacher, will be doing. Look at the two “objectives” below and ask yourself who would be accomplishing each objective: the student or the teacher? A. Apply two theories in social psychology to explain specific examples of human behavior. B. Introduce students to a range of theories in social psychology. A describes what students will be able to do at the end of the course, it is a learning objective. B, however, indicates what the instructor wants to achieve and does not constitute a learning objective.
  • 10. oli.cmu.edu Component skills/sub objectives They should break down the task and focus on specific cognitive processes. Many activities that faculty believe requires a single skill (for example, writing or problem solving) actually involve a synthesis of many component skills.
  • 11. oli.cmu.edu Component skills/sub objectives The objective often requires more of a synthesized activity that requires students to be able to do a number of skills to show mastery of the objective. For example, let's say you have a learning objective for an elementary algebra course like this one: Simplifying, adding, subtracting, multiplying and dividing polynomials. The component skills would be something like this: Combine like terms Use order of operation Use distributive property You would expect that in their prior knowledge they would already be able to: Add Subtract Multiply Divide
  • 12. oli.cmu.edu Action verbs Actions verbs help specify what you want students to be able to do. By telling students what to do, we provide them with benchmarks by which to assess their process--we inform them as to which tasks they might use to monitor whether or not their performance of certain tasks is up to par--metacognition. As previously discussed, learning objectives both help students monitor their own learning and also help students focus their energy appropriately, and action verbs are also a big part of that contribute significantly to both parts of that. At the same time, action verbs enable instructors to focus on and clarify the tasks we want to evaluate.
  • 13. oli.cmu.edu Observable or measurable Observable or measurable Look at the two objectives below. Which one is observable? A. Understand Newton’s Second Law B. Explain Newton’s Second Law Notice that A is not observable, while B is. An instructor can’t directly witness a student’s understanding. However, she could observe and evaluate a student’s explanation. Observable. Avoid using words like “understand”, “comprehend”, or “appreciate”. These are cognitive processes that take place in a student’s head and are invisible to you. Instead, ask yourself: What would students have to do that would show me that they understand X, comprehend Y, or appreciate Z?
  • 14. oli.cmu.edu Different Kinds of Objectives Bloom’s Revised Taxonomy identifies six levels of cognitive processes. http://www.celt.iastate.edu/teaching/RevisedBlooms1.html Across these levels, knowledge is used in more sophisticated ways: ▫ Recall: remember, recognize, identify ▫ Understand: interpret, exemplify, classify, summarize, explain, compare ▫ Apply: execute, implement, use, carry out ▫ Analyze: differentiate, distinguish, organize, select ▫ Evaluate: check, critique, judge, monitor, test ▫ Create: generate, plan, produce, construct, hypothesize
  • 15. oli.cmu.edu NOTE: Watch Out for Verbs that are not Observable or Measurable In order for an objective to give maximum structure to instruction, it should be free of vague or ambiguous words or phrases. The following lists notoriously ambiguous words or phrases which should be avoided so that the intended outcome is concise and explicit. WORDS TO AVOID: Believe, Hear, Realize, Capacity, Intelligence, Recognize, Comprehend, Know, See Conceptualize, Listen, Self-Actualize, Depth, Memorize, Think, Experience, Perceive, Understand, Feel PHRASES TO AVOID: To Become: To Reduce: Appreciation for… Acquainted with… Anxiety Attitude of… Adjusted to… Immaturity Awareness of… Capable of… Insecurity Comprehension of… Cognizant of… Enjoyment of… Conscious of… Feeling for… Familiar with… Interest in… Interested in… Knowledge of… Knowledgeable about…. Understanding of… Self-Confident in.
  • 16. oli.cmu.edu Create an objective Create a basic objective at your table, try to choose something that most people have domain expertise in. (It could be anything) Then determine if there are component skills needed to for the student to show mastery in the objective. For example you could use something like hand signals for driving: OBJECTIVE: Describe the hand signals for driving when electronic signals are unavailable or not working in the US. SUB SKILL Identify the hand signal for making a right turn in the US
  • 17. oli.cmu.edu Let’s check your objective. Checklist: Is the objective…? • Student centered (i.e., student should be able to…) • Broken down into component skills (grain size) • Phrased with an action verb • Observable or Measurable
  • 18. oli.cmu.edu The Course Design Triangle Eberly Center for Teaching Excellence Carnegie Mellon Instructional Activities Objectives Assessments Tasks that provide feedback on students’ knowledge and skills Descriptions of what students should be able to do at the end of the course Contexts and activities that foster students’ active engagement in learning
  • 19. oli.cmu.edu What would happen if there was a learning objective with no activities? All sorts of awful things ▫ Fire and brimstone coming down from the skies ▫ Rivers and seas boiling ▫ 40 years of darkness ▫ Human sacrifice ▫ Dogs and cats living together ▫ Mass Hysteria! - Ghostbusters
  • 20. oli.cmu.edu Learn By Doing “Practice this material” Scaffolded to give support “as needed” by providing tailored hints and feedback. Allow students to practice specific tasks and skills in a non- threatening environment. Learning Dashboard report student activity in an aggregate format.
  • 21. oli.cmu.edu Hints Think about when a student is given task and they become immediately stuck. If the student asked you for help what would you say to student to help them figure it out. 1st Hint is strategy for answering question: ▫ General restatement of goal: your goal is X, try strategy Y (the strategy) 2nd Hint is cognitive: ▫ Mid-level (compare angle A-B-C to X-Y-Z) 3rd Hint is bottom out, give them the answer: ▫ Answer + explanation (the angle is 45 degrees)
  • 25. oli.cmu.edu Feedback Initial response, then short explanation. ▫ Not quite right. As you look at the histogram, notice that the distribution is roughly symmetric. ▫ Correct. Since the distribution is symmetric, the mean and median would be about the same. ▫ Incorrect. This data set is skewed and the Mean/SD are affected by skew. Appropriate distracters(answer choices): ▫ Reflect common misconceptions or errors,
  • 30. oli.cmu.edu Create a learning activity for the objective you wrote earlier Think about a question you would ask students to determine if they could master the objective. Then try to write hints and targeted feedback for that question. Let’s go back to our example. I will take the sub skill: Identify the hand signal for making a right turn in the US Q1. Which is the correct way to hand signal making a right turn when your vehicle does not have signal lights or has damaged signal lights?
  • 31. oli.cmu.edu Using distractors that address common misconceptions. Q1. Which is the correct way to hand signal making a right turn when your vehicle does not have signal lights or has damaged signal lights? A. Put your left arm out of the left front window and point your finger toward the right. B. Open your right front window and reach over as far as you can and put your hand out. C. Extend your left upper-arm out to the left, horizontally and angle your forearm vertically upward.
  • 32. oli.cmu.edu Hints and targeted feedback Q1. Which is the correct way to hand signal making a right turn when your vehicle does not have signal lights or has damaged signal lights? Hints: 1. If you want to make a turn, think about what might be the safest and way to convey that to other drivers and pedestrians. 2. You have to signal in a way that is visible to other drivers and pedestrian. 3. The correct answer is to extend your left upper arm out to the left, horizontally and angel your forearm vertically. Feedback: A. Not quite right. While this may work it is not the universal signal in the US for a right hand turn. B. Incorrect. Reaching across the inside of the car to signal a turn is not a safe way to operate your vehicle, and is not the correct way to signal. C. Correct. This is the universal signal in the US to let other people know you are taking a right hand turn.

Editor's Notes

  1. Component skillsTo master these complex skills, students must practice and gain proficiency in the discrete component skills. For example, writing may involve identifying an argument, enlisting appropriate evidence, organizing paragraphs, and so on, whereas problem solving may require defining the parameters of the problem, choosing appropriate formulas, and so on.Identifying and describe measures of center in context in statistics, would require the student to identify, mean, mode, and median, interpret a histogram.