SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
Follow the Successful Crowd: Raising MOOC Completion Rates through Social Comparison at Scale
1. FOLLOW THE SUCCESSFUL CROWD
RAISING MOOC COMPLETION RATES THROUGH SOCIAL COMPARISON AT SCALE
DAN DAVIS
IOANA JIVET
RENÉ KIZILCEC LAMBDA-LAB
GUANLIANG CHEN
CLAUDIA HAUFF
GEERT-JAN HOUBEN
7. SOCIAL COMPARISON THEORY
Establish social and personal worth by comparing
ourselves to others (Festinger, 1954)
Comparison with slightly-better-performing peers
has a beneficial effect on students’ grades (Huguet, 2001)
10. DESIGN GOALS
provide feedback on behavior extracted from edX’s
log traces
afford learners the ability to intuitively understand
and explore the information presented (Kay)
show learners specific ways to take action and
change their behavior
Traceable
Scrutable
Actionable
11. Learning tracker
Average graduate You kAverage graduate next week
Time on the
platform
Time watching
videos
Fraction of time
spent watching
videos while on
the platform
Videos watched
Quiz answers
submitted
Timeliness of
quiz answer
submission
12. FEEDBACK SYSTEM DESIGN
1. Embodied representation of multiple metrics
2. Numerous indicators displayed in a small space
3. Easily comparable
21. WaterX
C 1,268 160
MOOC COND. N # PASS PASS RATE
T 1,251 188
12.6%
15.0%
UrbanX
C 771 136
T 746 165
17.6%
22.1%
BusinessX
C 164 46
T 160 54
28.0%
33.8%
OVERALL
C 2,203 342
T 2,157 407
15.5%
18.9%
22. WaterX
C 1,268 160
MOOC COND. N # PASS PASS RATE
T 1,251 188
12.6%
15.0%
UrbanX
C 771 136
T 746 165
17.6%
22.1%
BusinessX
C 164 46
T 160 54
28.0%
33.8%
OVERALL
C 2,203 342
T 2,157 407
15.5%
18.9%
**
24. RQ1
Does social comparison-based learner
feedback lead to increased achievement
and increased self-regulatory behavior for
MOOC learners?
Providing learners a comparison of their own behavior to that
of previously successful peers will increase learner
achievement.
H1.1
25. RQ1
Does social comparison-based learner
feedback lead to increased achievement
and increased self-regulatory behavior for
MOOC learners?
Providing learners a comparison of their own behavior to that
of previously successful peers will increase learner
achievement and engagement
H1.1
Learners will change the aspects of their behavior that the
Feedback System makes them aware of.
H1.2
X
46. RQ3
Does feedback framed in line with a
learner’s cultural context make it more
effective?
Feedback in line with a learner’s cultural individualism index
will increase its impact on the learner
H3.1
X
47. RQ3
Does feedback framed in line with a
learner’s cultural context make it more
effective?
Feedback in line with a learner’s cultural individualism index
will increase its impact on the learner
H3.1
Feedback in alignment with a learner’s cultural tightness will
increase its impact on the learner
H3.2
X