1. Evaluation, Evidence and Enhancement:
Inspiring Staff and Students
The 15th Enhancement Conference
Glasgow Caledonian University
7 June 2018
Future possibilities:
analytics and
enhancement
Rebecca Ferguson, The Open University
2. Evidence for Enhancement: Improving the Student Experience
Learning analytics
The measurement, collection,
analysis and reporting of data
about learners and their contexts,
for purposes of understanding
and optimizing learning and the
environments in which it occurs.
3. Evidence for Enhancement: Improving the Student Experience
Learning analytics help us to
identify and make sense of
patterns in the data to enhance
our teaching, our learning and
our learning environments.
4. Evidence for Enhancement: Improving the Student Experience
Learners use analytics to
Monitor their own activities and interactions
Monitor the learning process
Compare their activity with that of others
Increase awareness, reflect and self reflect
Improve discussion participation
Improve learning behavior
Improve performance
Become better learners
Learn!
Chatti, M.A., Dyckhoff, A.L.,
Schroeder, U. and Thüs, H.,
2012. A reference model for
learning analytics. IJTEL, 4 (5-6).
5. Evidence for Enhancement: Improving the Student Experience
Educators use analytics to
Monitor the learning process
Explore student data and discover patterns
Identify problems
Find early indicators for success or poor marks
Assess usefulness of learning materials
Increase awareness, reflect and self reflect
Improve teaching, resources and environment
Intervene, advise and assist
Improve performance
Chatti, M.A., Dyckhoff, A.L.,
Schroeder, U. and Thüs, H.,
2012. A reference model for
learning analytics. IJTEL, 4 (5-6).
7. Evidence for Enhancement: Improving the Student Experience
SNAPP: Network analysis
Bakharia, A. & Dawson, S., 2011.
SNAPP: a bird’s-eye view of
temporal participant interaction.
LAK11, Banff, Canada
8. Evidence for Enhancement: Improving the Student Experience
Academic Writing Analytics
utscic.edu.au/tools/awa
AWA higlights
sentences that
appear to exemplify
writing which are
reflective about
one’s learning.
AWA does not of
course, know
whether it is
beautifully crafted
nonsense! You must
decide that…
11. Evidence for Enhancement: Improving the Student Experience
Planning for the future
2012: ‘Year of the MOOC’
2007: Launch of the iPhone
2006: First tweets
12. Evidence for Enhancement: Improving the Student Experience
EU priority areas for education
Open and innovative education and training,
fully embracing the digital era.
Strong support for teachers, trainers, school
leaders and other educational staff.
Relevant and high-quality knowledge, skills
and competences developed throughout
lifelong learning.
Focus on learning outcomes for employability,
innovation, active citizenship and well-being
and inclusive education, equality, equity,
non-discrimination and the promotion of
civic competences.
13. Evidence for Enhancement: Improving the Student Experience
Scottish Government
We want every child, no matter their background,
to have an equal chance of entering and
succeeding in higher education. By 2030, we want
20% of students entering university to be from
Scotland's 20% most deprived backgrounds.
We are supporting a range of initiatives aimed at
widening access to higher education
We are also reviewing the learner journey for 15 to
24 year olds to ensure the education system is
as effective and efficient as possible
14. Evidence for Enhancement: Improving the Student Experience
Improving the student experience
Identify the issues that would
benefit from intervention
Help prioritise interventions
for improving the student
experience
Evaluate the effectiveness of
those interventions
16. Evidence for Enhancement: Improving the Student Experience
LACE project
Learning Analytics Community
Exchange (LACE)
Bringing together higher education,
schools and workplace learning
Building networks that outlived the
project’s funding period
Helping to develop learning analytics
capability
Creating and sharing resources
Developing visions of the future and
agreeing how to work towards them
http://www.laceproject.eu/
17. Evidence for Enhancement: Improving the Student Experience
Provocation 1:
A decade from
now, learners
are monitored
by their learning
environment
https://bit.ly/2H1SqP3
18. Evidence for Enhancement: Improving the Student Experience
Provocation 2:
A decade from
now, learners’
personal data
are tracked
https://bit.ly/2H1SqP3
19. Evidence for Enhancement: Improving the Student Experience
Provocation 3:
A decade from
now, analytics
are rarely used
https://bit.ly/2H1SqP3
20. Evidence for Enhancement: Improving the Student Experience
Provocation 4:
A decade from
now, learners
control their
own data
https://bit.ly/2H1SqP3
21. Evidence for Enhancement: Improving the Student Experience
Provocation 5:
A decade from
now, open
systems are
widely adopted
https://bit.ly/2H1SqP3
22. Evidence for Enhancement: Improving the Student Experience
Provocation 6:
A decade from
now, learning
analytics are
essential tools
https://bit.ly/2H1SqP3
23. Evidence for Enhancement: Improving the Student Experience
Provocation 7:
A decade from
now, analytics
help learners
make the right
choices
https://bit.ly/2H1SqP3
24. Evidence for Enhancement: Improving the Student Experience
Provocation 8:
A decade from
now, analytics
have largely
replaced
teachers
https://bit.ly/2H1SqP3
25. Evidence for Enhancement: Improving the Student Experience
New provocations from Neil Selwyn
•Socially sympathetic design
•Transparency of algorithms
•Student control
•Sharing the profits of learning data
•Working towards a better public
understanding of analytics
•Seeing ethics in terms of power
Image / Ideas: Neil Selwyn, LAK18
27. Evidence for Enhancement: Improving the Student Experience
Action for analytics
Strategy
Research and development
Infrastructure
Context
Standards
Skills
Outreach
28. Evidence for Enhancement: Improving the Student Experience
Strategy
• Align work on learning analytics with
strategic objectives and priority areas for
education and training
• Develop a roadmap for learning analytics
• Assign responsibility for development of
learning analytics
• Identify and build on work in
related areas and other countries
• Build on learning analytics
work to develop new priorities
29. Evidence for Enhancement: Improving the Student Experience
Research and development
• Develop pedagogy that makes good use of
analytics
• Develop analytics that address strategic
objectives and priorities
• Develop technology that enables
deployment of analytics
• Develop frameworks that enable
development of analytics
Image: sheilaproject.eu
30. Evidence for Enhancement: Improving the Student Experience
Infrastructure
• Increase data-handling capability
• Create organisational structures to
support use of learning analytics
• Use Evidence Hub to identify areas
for development
• Develop methods of
sharing experience
and good practice
LACE Evidence Hub
31. Evidence for Enhancement: Improving the Student Experience
Context
• Align learning analytics work with
different sectors of education
• Develop practices that
are appropriate to different contexts
• Identify successful financial models
32. Evidence for Enhancement: Improving the Student Experience
Standards
• Adapt and employ interoperability
standards
• Develop and employ ethical
standards, including data protection
• Align analytics with
assessment practices
• Develop a robust quality
assurance process
• Develop evaluation frameworks
33. Evidence for Enhancement: Improving the Student Experience
Skills
• Identify the skills required in different
areas
• Train and support educators to use
analytics to support achievement
• Train and support researchers and
developers to work in this field
• Develop and support educational
leaders to implement these changes
• Educate learners to use analytics to
support their own achievement
34. Evidence for Enhancement: Improving the Student Experience
Outreach
• Engage stakeholders
throughout the learning
analytics process
• Support collaboration with
commercial organisations
• Promote awareness of learning
analytics
35. Evidence for Enhancement: Improving the Student Experience
Stay connected
solaresearch.org • LAK conference • LASI events • LACE