How can Learning Analytics be used to bring about the true revolution traditionally assumed for MOOCs? With audiences in the thousands of users, the key is massive personalization, and Learning Analytics privide an ideal paradigm for this.

1. thisisbossi flickr.com
Pushing the MOOC envelope
with Learning Analytics
Seminar on the Future of MOOCs
and Digital Libraries
Fukuoka, 24 February 2013
Abelardo Pardo (@abelardopardo)
The University of Sydney
www.slideshare.net/abelardo_pardo

2. DarrelBirkett Flickr
Associate Head of Teaching and
Learning
Two courses Tech to empower
Grad/Undergrad individuals and
communities
Active learning Behavioral analytics
Use of technology User validation
Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 2

3. Simonov flickr.com
Where: MOOC Scenario
What: Challenges
How: Solutions
Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 3

4. Simonov flickr.com
Where: MOOC Scenario
Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 4

5. IAN RANSLEY DESIGN + ILLUSTRATION flickr.com
MOOCs
Course in a stadium
Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 5

6. Emorse flickr.com
Overcome initial
surprise!
Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 6

7. Daikrieg flickr.com
Why should we be impressed
that an online course can reach
100,000 students at once?
(Guthrie, 2012)
Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 7

8. danceinthesky flickr.com
MOOCs change
interaction radically
Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 8

9. Some interactions do not scale!
Deep and meaningful formal learning occurs if
one of the interactions is at a high level
(Anderson, 2003)
Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 9

10. nateOne flickr.com
Say Hi!
1,200
emails
Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 10

11. Curious
but...
Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 11

12. paddynapper Flickr.com
Discussion board
Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 12

13. HikingArtist.com Flickr.com
Massive activity misfit!
Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 13

14. Secretlondon123 Flickr.com
Ideal for polls
Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 14

15. Simonov flickr.com
Where: MOOC Scenario
What: Challenges
Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 15

16. Size vs Interactivity
Intense
course
Level of interaction
cMOOCs
Transition to
MOOC easier
Cs
High
when low
O
O
interactivity
M
effort
xMOOCs
Trivial
course Low effort
Number of students
Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 16

17. Size vs Tutoring
Manually Technologically
Unfeasible Challenging
Tutoring intensity
Technological
intervention is
Learning Analytics
Intense
course essential!
High Cs
O
O
effort
M
Trivial
course Low effort
Number of students
Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 17

18. Scope vs Automation
MOOCs
Scope of intervention
Learning
Analytics allow
s
ic
yt
more generic
al
An
interventions
ng
ni
ar
Le
Intelligent Tutoring Systems
Level of automation
Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 18

19. Chandra Marsono Flickr.com
Massive automatic
assessment
Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 19

20. Joe Flickr.com
Early drop-out
detection
Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 20

21. dklimke Flickr.com
Erratic
engagement
Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 21

22. Quinn.Anya Flickr.com
Process, digest,
Connect prior summarize, apply
knowledge
Feedback
Focus
Attention Interaction with others
(Svinicki, 2012)
Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 22

23. Simonov flickr.com
Where: MOOC Scenario
What: Challenges
How: Solutions
Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 23

24. Werner Kunz Flickr.com
Refine Collect
Act The five steps Report
of analytics
Predict
(Campbell, De Blois, Oblinger 2007)
Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 24

25. Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 25

26. Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 26

27. Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 27

28. burge5k Flickr.com
Microscopic
view of learning
events
Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 28

29. Riccardo Cecchi Flickr.com
A clearly identified
environment within
your computer
(Romero-Zaldívar et al., 2012)
Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 29

30. Track App Usage
kvnmcl Flickr.com
Collect interaction
events
Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 30

31. Sean Dreilinger flickr.com
Automatic discovery
of complementary
learning resources
(Romero-Zaldívar et al., 2011)
Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 31

32. Unobtrusive Collection
Embedded Question
Collect feedback Effort
(Pardo et al., 2012)
Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 32

33. Monitor Writing
(Calvo et al., 2011)
Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 33

34. Measure Engagement
(Liu et al., 2013, To appear)
Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 34

35. Eleaf Flickr.com
Automatic Question Generation
What evidence is provided to ...?
What are the strength and
limitations of ...?
(Liu et al., 2010)
Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 35

36. Facial Expressions
Detect emotions
(Monkaresi et al., 2012)
Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 36

37. robpatrick Flickr.com
Massive
Personalization of
Interactions
Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 37

38. Mary Witzig Flickr.com
Massively Personalized Online Open Course
Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 38

39. ribarnica Flickr.com
Massive Hyper-Personalization
“The Snowflake Effect”
(Duval & Hodgins, 2006)
Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 39

40. Personalize Everything
woody1778a Flickr.com
Which notifications?
Work individually? Collaboratively?
Reduce interaction to a small group
Hierarchical summaries of contributions
Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 40

41. pylbug Flickr.com
Learning Analytics
Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 41

42. thisisbossi flickr.com
Pushing the MOOC envelope
with Learning Analytics
Seminar on the Future of MOOCs
and Digital Libraries
Fukuoka, 24 February 2013
Abelardo Pardo (@abelardopardo)
The University of Sydney
www.slideshare.net/abelardo_pardo

43. References
Dogh Guthrie, 2012.
Jump Off the Coursera Wagon
The Chronicle of Higher Education, 17 December 2012
T. Anderson, 2003.
Getting the Mix Right Again: An updated and theoretical rationale for interaction Equivalency of Interaction
The International Review of Research in Open and Distance Learning, 4 (2)
Academic Analytics
Campbell J., DeBlois P., Oblinger D.
EDUCAUSE White paper, 2007
MOOCs: What Part of Learning Goes on Where and How?
Marilla Svinicki
The National Teaching and Learning Forum, Dec, 2012
http://ntlf.com/sample-articles/moocs-what-part-of-learning-goes-on-where-and-how.aspx
The signal project
Purdue University
http://www.itap.purdue.edu/studio/signals/
Last accessed February 2013
Blackboard Analytics
Blackboard Inc.
http://www.blackboard.com/Platforms/Analytics/Overview.aspx
Last accessed February 2013
Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 43

44. References (II)
Desire2Learn Analytics
Desire2Learn
http://www.desire2learn.com/products/analytics/
Last accessed February 2013
Romero-Zaldívar, V.A., Crespo García, R., Burgos, D., Delgado Kloos, C., Pardo, A., 2012
Automatic Discovery of Complementary Learning Resources
European Conference on Technology Enhanced Learning, 2011
Romero-Zaldívar, V.A., Pardo, A., Burgos, D., Delgado Kloos, C., 2012
Monitoring Student Progress Using Virtual Appliances: A Case Study
Computer & Education, 58(4):10580–1067, 2012
Pardo, A., Pérez-Sanagustín, M., Parada G., H., Leony, D. 2012
Flip with Care
SoLAR Southern Flare Conference, November, 2012
Calvo, R., O’Rourke, S.T., Jones, J., Yacef, K., Reimann, P., 2011
Collaborative Writing Support Tools on the Cloud
IEEE Transactions on Learning Technologies, 4(1):88–97
Liu M., Calvo, R.; Pardo, A., 2013
Visualizing the effect of actions in personal informatics systems
Workshop on Personal Informatics, CHI’13
Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 44

45. References (III)
Liu M., Calvo, R.; Rus, V., 2010
Automatic Question Generation for Literature Review Writing Support
Intelligent Tutoring Systems 2010
Monkaresi, H., Hussain, M. S., Calvo, R., 2012
A dynamic approach for detecting naturalistic affective states from facial videos during HCI
Australasian Joint Conference on Artificial Intelligence, Sydney, Australia. LNAI, Springer 2012, pp.170-181
Duval, E., Hodgins, W., 2006
Standardized Uniqueness: Oxymoron or Vision of the Future?
IEEE Computer, 32(3):96-98
Abelardo Pardo Pushing the MOOC envelope with Learning Analytics 45