Practical skills training, co-located group interactions, and tasks alternative to the classic desktop-based learning scenario represent still a big set of learning activities taking place in the classroom and at the workplace. Physical interactions are most of the time offline moments, not captured by the data collection therefore not included in the datasets used for data analysis. Bringing these moments into account requires extending the data collection from conventional data sources (LMS, MOOC data etc.) to data “beyond user-computer interaction” coming from multiple modalities. ShareAlike 4.0 International (CC BY-SA 4.0)

1. Workshop @ JTELSS18
15th May 2018 – Durrës, Albania
Sensors for Learning
Daniele DI MITRI & Jan SCHNEIDER

2. What people think about TEL:
Pagina 2

3. How people actually learn:
Pagina 3

4. How can technology support
these learning experiences?
Discuss with the person next to you

5. Multimodal experiments
@OUNL & @DIPF

6. Presentation Trainer
Pagina 6
Schneider, J., Börner, D., Van Rosmalen, P., & Specht, M. (2015, November). Presentation
trainer, your public speaking multimodal coach. In Proceedings of the 2015 ACM on
International Conference on Multimodal Interaction (pp. 539-546). acm.ISO 690
https://www.youtube.com/watch?v=ElB6OvbL8fA

7. Calligraphy Tutor
Pagina 8

8. Learning Pulse – are you in the Flow?
Pagina 9
(Csikszentmihalyi, 1972)
Di Mitri, D., Scheffel, M., Drachsler, H., Börner, D., Ternier, S., & Specht, M. (2017). Learning
Pulse: a machine learning approach for predicting performance in self-regulated learning using
multimodal data.ISO 690

9. WEKIT.eu project
Pagina 10
https://www.youtube.com/watch?v=RkGXdpSB_AM

10. Workshop toys for today

11. The Learning Hub
Leap
Motion
Myo
Empatica
Emotiv
Modalities Sensors Controllers
Gateway
Learning
Hub

12. The 5 steps of multimodal
learning analytics
Pagina 14

13. Task for today
Divide in 2 groups and design your “multimodal
learning experience” using the available sensors

14. Recordings

15. Q&A
Thanks for listening!
Daniele Di Mitri & Jan Schneider