How ready are you to implement learning analytics in your institution? Jisc has been offering an institutional readiness assessment to institutions involved in the development phases of the learning analytics project. Building on the learning so far we will provide participants of this workshop with questions and activities that will start you on the journey. The workshop will explore legal and ethical issues that you may need to address; technical and data challenges that may have to be overcome and cultural issues that are required.

1. Getting ready for
learning analytics

2. Introductions
Facilitators
»Paul Bailey
»Shri Footring
»Niall Sclater
»RobWyn Jones
»George Munroe
3/03/2016 Getting ready for learning analytics

3. Overview
» Toolkit
› Discovery
› Code of practice
› Technical and data definitions
» Community
› Network Meetings
› http://analytics.jiscinvolve.org/wp/
› analytics@jiscmail.ac.uk
» Technical architecture
Jisc learning analytics project
3/03/2016 Getting ready for learning analytics

4. Activity 1
1. How would you define learning analytics?
2. What do you want to gain from using learning
analytics at your institution?
Discussion questions
3/03/2016 Getting ready for learning analytics

5. A definition of learning analytics
“Learning analytics is the measurement, collection, analysis and
reporting of data about learners and their contexts, for purposes of
understanding and optimising learning and the environments in which
it occurs”
SoLAR – Society for learning analytics research
3/03/2016 Getting ready for learning analytics

6. Finding a starting point…
“I think one of the main problems with analytics is finding a starting
point. Going through the Discovery phase does give a number of
starting points.”
Sheila MacNeill
https://howsheilaseesit.wordpress.com/2016/02/09/clawing-
my-way-up-through-the-trough-of-disillusionment-with-learning-analytics/
3/03/2016 Getting ready for learning analytics

7. Activity 2: Getting ready…

8. Activity 2: Getting Ready….
1. Are you aware of the Legal and Ethical issues relating to
learning analytics?
2. What the technical and data challenges you need to consider?
3. Are you culturally ready for learning analytics?
3/03/2016 Getting ready for learning analytics

9. Legal and ethical
3/03/2016 Getting ready for learning analytics

10. Legal and ethical
3/03/2016 Getting ready for learning analytics
Group Name Question Main type Importance Responsibility
2 Consent Adverse impact of
opting out on individual
If a student is allowed to opt out of data collection and
analysis could this have a negative impact on their
academic progress?
Ethical 1 Analytics Committee
7 Action Conflict with study goals What should a student do if the suggestions are in
conflict with their study goals?
Ethical 3 Student
8 Adverse impact Oversimplification How can institutions avoid overly simplistic metrics and
decision making which ignore personal circumstances?
Ethical 1 Educational
researcher
86 issues in
9 groups

11. Legal and ethical
Code of practice for learning
analytics.
Available at:
jisc.ac.uk/guides/code-of-
practice-for-learning-analytics
3/03/2016 Getting ready for learning analytics

12. Technical and data
»What data must be collected to provide useful learning analytics?
You might need…
› Historical (18 months minimum) for Predictive modelling
› LIVE data to refine the model moving forwards
› Student data, assignment and examination marks plus results/
grade data, etc.
› Activity data –VLE, library, attendance, etc.
»How long should data be preserved?
3/03/2016 Getting ready for learning analytics

13. Technical and data
»How can this be collected from the various systems involved?
› Do data from different systems need to be mapped to each other
to be useful?
› How can any required mappings be achieved?
› Should mapped data be stored separately from the sources?
› Where should mapped data be stored?
3/03/2016 Getting ready for learning analytics

14. Technical and data
»What analysis outputs are of most interest?
› What would bring confidence to making important decisions
based on analysis outputs?
› What would erode confidence in making those
important decisions?
3/03/2016 Getting ready for learning analytics

15. Culture
»Leadership
»Wide engagement
»A shared vision
»Staff skills
»Effective interventions
»Support for learners
3/03/2016 Getting ready for learning analytics

16. Discussion Questions…
»Should students be asked for consent to use their data for
learning analytics?
»Can students access all the data held about them in
your institution?
»Should interventions always be human-mediated?
Legal and Ethical
3/03/2016 Getting ready for learning analytics

17. Discussion Questions…
»What sources/ good indicators of student engagement or
activity exist?
»What problems are foreseen with LIVE student data capture?
Institutional Culture
»Who will you involve in implementing learning analytics in
your institution?
»What is the strategic driver? Quality, finance,student satisfaction?
Technical and Data
3/03/2016 Getting ready for learning analytics

18. Plenary
1. Are you aware of the Legal and Ethical issues relating to
learning analytics?
2. What the technical and data challenges you need to consider?
3. Are you culturally ready for learning analytics?
3/03/2016 Getting ready for learning analytics

19. jisc.ac.uk
Learning analytics
Further information
Paul Bailey
Senior Co-design manager
paul.bailey@jisc.ac.uk
3/03/2016 Getting ready for learning analytics