Description of how to use learning analytics techniques to collect evidence about student engagement while preparing a flipped classroom. A case study is presented in which students interact with various electronic resources and a measure of such engagement is produced and returned to them.

1. Karl-LudwigPoggemannFlickr
Connecting Pedagogical Intent with
Analytics in a Flipped Classroom
The University of Texas at Arlington
September 2014
Dr Abelardo Pardo (@abelardopardo)
The University of Sydney
slideshare.net/abelardo_pardo

2. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 2
MartinFischflickr.com
Context
Flipped
Classroom
Learning
Analytics
Case
Study
Design

3. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 3
MartinFischflickr.com
Context

4. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 4
FlaMFlickr
Lecturer at School of
Electrical and Information
Engineering
Student at
the center
Instruction
as facilitator
Technology
to improve
experience

5. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 5
QuinnAnyaflickr.com
Technology works: tangible improvement, transparent

6. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 6
Wroteflickr.com
Technology fails: hinders, prevents, complicates ...

7. Technology Fails
Negligible Cost of Failure
Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 7

8. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 8
MaryWitzigflickr.com
Personalized Learning in a Digital Environment

9. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 9
HikingArtist
Learning Technology fails:
hinders, prevents, complicates ...

10. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 10
Anthonyflickr.com
Tech affordances
must have strong,
realistic
pedagogical
foundations

11. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 11
MartinFischflickr.com
Context
Flipped
Classroom

12. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 12
KreativeKewlflickr.com
Flipped Classroom
does not exist!
(Bergmann & Sams, 2012)

13. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 13
Krugazorflickr.com
(Mazur, 2009)
Simple transfer of information does not work

14. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 14
JuantanKwonflickr.com
Resources
everywhere!

15. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 15
Fellmanniaflickr.com
Face-to-face time
is very valuable!

16. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 16
-NACH-flickr.com
Remember
Understand
Apply
Analyze
Evaluate
Create
InclassAssignments
Can we do better?

17. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 17
-NACH-flickr.com
Remember
Understand
Apply
Analyze
Evaluate
Create
Pre-assignmentsInclass

18. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 18
ChandraMarsonoflickr.com
Does it work?
Sometimes

19. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 19
SepehrEhsaniflickr.com
Not as expected Yes!
(Strayer, 2012) (Ruddick, 2012)(Bishop, 2013)
(Zappe et al., 2009)

20. How to Design Flipped Learning
abelardopardo.blogspot.com
Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 20

21. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 21
srharrisflickr.com
1) Pick an objective, concept, topic

22. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 22
p_a_hflickr.com
2) Previous activities (Be prepared!)

23. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 23
Hijukalflickr.com
3) Activities face-to-face

24. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 24
blog.peerinstruction.net/2012/04/06/can-you-flip-large-classes/
Be creative!

25. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 25
Krugazor
Instead...

26. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 26
MartinFischflickr.com
Context
Flipped
Classroom
Learning
Analytics

27. Humans are Subjective
Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 27
Mind Sights: Original Visual Illusions, Ambiguities, and Other Anomalies, With a Commentary on the Play of Mind in Perception and Art, Roger N. Shepard, 1990

28. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 28
VanessaOflickr.com
“Historically, humanity has made sense of the world
through discourse, dialogue, artifacts, myth, story,
and metaphor. While those sensemaking approaches
won’t disappear, they will be augmented by data and
analytics.”
(Siemens, 2014 www.elearnspace.org/blog)

29. Learning Analytics
Measurement, collection, analysis
and reporting of data about learners
and their contexts, for purposes of
understanding and optimizing
learning and the environments in which
it occurs.
Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 29
(SoLAR, Society for Learning
Analytics Research)

30. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 30
WernerKunzFlickr.com
(Campbell, De Blois, Oblinger 2007, Academic Analytics, EDUCAUSE)
Collect
Report
Predict
Act
Refine
The five
steps of
analytics

31. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 31
ChefCookeFlickr.com
Observe while
working on
course
activities

32. A clearly identified
environment within
your computer
Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 32
KevinDaviesflickr.com
(Pardo & Delgado Kloos, 2011)

33. Instrumentation
Personal Computer
Computer
Tool 1
Computer
Tool 2
Computer
Tool 3
Computer
Tool 4
Authenticated
Virtual Computer
Computer
Tool
Computer
Tool
Computer
Tool
Computer
Tool
Computer
Tool
Event
Dataset
Personal
Data
Encoding
Report
Infer
Act
InstructorStudent
Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 33

34. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 34
HoriaVarlanflickr.com
Tool usage vs academic performance
(Romero-Zaldívar et al., 2012)

35. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 35
Chiot’sRunFlickr.com
Collect URLs Compare with
course notes
Detect new
resources
(Romero-Zaldívar et al., 2011)

36. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 36
AdventuresinLibrarianshipflickr.com
Detect engagement
while writing
(Calvo et al., 2011, Liu et al., 2013)

37. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 37
Secretlondon123flickr.com
1 Context
2 Questions
3 Data + algorithms
4 Prediction/Intervention

38. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 38
Shaylorflickr.com
1 Context: Flipped Classroom
2 Questions: Are they engaged
during preparation?
3 Data + algorithms: ?
4 Intervention: ?

39. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 39
MartinFischflickr.com
Context
Flipped
Classroom
Learning
Analytics
Case
Study

40. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 40
BenjaminEshamflickr.com
First Year
Engineering Course
Computer Systems
Enrolment: 300
students
1 Lecture (2 hours) +
1 tutorial (2 hours) +
1 lab (3 hours)
Flipped Lecture
Assess Participation
100% Digital Material
Midterm + Final +
Project

41. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 41

42. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 42

43. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 43
Track

44. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 44
Track
Track

45. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 45

46. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 46

47. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 47
Track
Track

48. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 48

49. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 49
Track

50. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 50

51. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 51
Track

52. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 52

53. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 53
Track

54. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 54

55. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 55

56. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 56
Track

57. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 57

58. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 58

59. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 59

60. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 60

61. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 61
MartinFischflickr.com
Context
Flipped
Classroom
Learning
Analytics
Case
Study
Design

62. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 62
Agile Authoring!

63. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 63
Minimum markup. Sensors automatically generated.

64. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 64
Solutions, tutor guide, in a single document

65. Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 65
billBradfordflickr.com
Plain Text Template-based design

66. Karl-LudwigPoggemannFlickr
Connecting Pedagogical Intent with
Analytics in a Flipped Classroom
The University of Texas at Arlington
September 2014
Dr Abelardo Pardo (@abelardopardo)
The University of Sydney
slideshare.net/abelardo_pardo

67. References
Bergmann, J., Sams, A., (2012)
Flip Your Classroom: Reach Every Student in Every Class Every Day
Hawker Brownlow Education
Mazur, E., (2009)
Farewell, Lecture?
Science, 323, pp. 50-51.
Strayer, J. F. (2012).
How learning in an inverted classroom influences cooperation, innovation and task orientation.
Learning Environments Research, 15(2), 171–193.
Zappe, S., & Leicht, R. (2009).
Flipping the classroom to explore active learning in a large undergraduate course.
In Proceedings of the American Society for Engineering Education Annual Conference and Exhibition.
Bishop, J. L., and Verleger, M. A. (2013)
The Flipped Classroom: A Survey of the Research.
In Proceedings of the ASEE Annual Conference and Exposition (pp. 1–18).
Ruddick, K. W. (2012).
Improving chemical education from high school to college using a more hands-on approach.
PhD Thesis. The University of Memphis.
Campbell, J. P., DeBlois, P. B., & Oblinger, D. G. (2007).
Academic Analytics.
Educause Review (Vol. 42). EDUCAUSE White Paper.
Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 67

68. References II
Pardo, A., Delgado Kloos, C., 2011,
Stepping out of the box. Towards analytics outside the Learning Management System
International Conference on Learning Analytics and Knowledge, pp, 163-167, ACM New York, USA
Romero-Zaldívar, V.A., Pardo, A., Burgos, D., Delgado Kloos, C., 2012
Monitoring Student Progress Using Virtual Appliances: A Case Study
Computer & Education, 58(4):10580–1067, 2012
Romero-Zaldívar, V.A., Crespo García, R., Burgos, D., Delgado Kloos, C., Pardo, A., 2012
Automatic Discovery of Complementary Learning Resources
European Conference on Technology Enhanced Learning, 2011
Calvo, R., O’Rourke, S.T., Jones, J., Yacef, K., Reimann, P., 2011
Collaborative Writing Support Tools on the Cloud
IEEE Transactions on Learning Technologies, 4(1):88–97
Liu M., Calvo, R.; Pardo, A., 2013
Visualizing the effect of actions in personal informatics systems
Workshop on Personal Informatics, CHI’13
Abelardo Pardo Connecting Pedagogical Intent with Analytics in a Flipped Classroom 68