Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
What do students want? Towards an instrument for
students’ evaluation of quality of learning analytics
services
Alexander ...
Aims
• Highlight the importance of service quality in learning analytics.
• Develop an instrument to explore student expec...
What is service quality?
• Subjective assessment of the degree to which a service user’s needs
or expectations were met (P...
What is service quality? (Contd.)
• Encourages users to use own service over competitors (Parasuraman,
Zeithaml, & Berry, ...
Service Quality in Learning Analytics
• Learning analytics services designed to support learning.
• Various stakeholder gr...
Questionnaire Development
• Measuring student expectations of learning analytics.
• Development of institutional policies ...
Questionnaire Development (Contd.)
• Identifying themes within past literature (Ifenthaler & Schumacher,
2016; Sclater, 20...
Questionnaire Development (Contd.)
Expectations
Predictive Desired
Swan & Trawick (1980)
Questionnaire Development (Contd.)
Created 79
Items
Peer Review
Pilot Study
with 37 Items
Exploratory
Factor Analysis
Redi...
Pilot Study Results
• Instrument reduced to 19 items.
• Two factor solution for both scales:
• Service expectations:
o Des...
Pilot Study Results (Contd.)
Pilot Study Results (Contd.)
Pilot Study Results (Contd.)
Pilot Study Results (Contd.)
Pilot Study Results (Contd.)
Future Directions
• Develop the corresponding perceptions scale.
• Model intentions towards using learning analytics.
Atti...
Questions?
Upcoming SlideShare
Loading in …5
×

What do students want? Towards an instrument for students’ evaluation of quality of learning analytics services

Student expectations about learning analytics for LAK17.

  • Be the first to comment

  • Be the first to like this

What do students want? Towards an instrument for students’ evaluation of quality of learning analytics services

  1. 1. What do students want? Towards an instrument for students’ evaluation of quality of learning analytics services Alexander Whitelock-Wainwright, Dragan Gašević, & Ricardo Tejeiro A.Wainwright@Liverpool.ac.uk
  2. 2. Aims • Highlight the importance of service quality in learning analytics. • Develop an instrument to explore student expectations towards learning analytics. • Steps towards a model of learning analytics use.
  3. 3. What is service quality? • Subjective assessment of the degree to which a service user’s needs or expectations were met (Parasuraman, Zeithaml, & Malhotra , 2005). Expectations Service Usage/Exposure Perceptions Attitude
  4. 4. What is service quality? (Contd.) • Encourages users to use own service over competitors (Parasuraman, Zeithaml, & Berry, 1988). • Service quality in higher education (Spooren, Brockx, & Mortelmans, 2013). • Ideological gap (Ng & Forbes, 2009).
  5. 5. Service Quality in Learning Analytics • Learning analytics services designed to support learning. • Various stakeholder groups within learning analytics (e.g., students, teachers, managers) (Clow, 2012). • Quality indicators of learning analytics tools (Scheffel, Drachsler, Stoyanov, & Specht, 2014).
  6. 6. Questionnaire Development • Measuring student expectations of learning analytics. • Development of institutional policies (SHEILA). • Theories of human behaviour.
  7. 7. Questionnaire Development (Contd.) • Identifying themes within past literature (Ifenthaler & Schumacher, 2016; Sclater, 2016; West, Heath, & Huijser, 2016): • Ethics and Privacy • Meaningfulness • Agency • Interventions
  8. 8. Questionnaire Development (Contd.) Expectations Predictive Desired Swan & Trawick (1980)
  9. 9. Questionnaire Development (Contd.) Created 79 Items Peer Review Pilot Study with 37 Items Exploratory Factor Analysis Redistribute the Questionnaire
  10. 10. Pilot Study Results • Instrument reduced to 19 items. • Two factor solution for both scales: • Service expectations: o Desires scale – 0.88 alpha. o Predictive scale – 0.88 alpha. • Ethical expectations: o Desires scale – 0.82 alpha. o Predictive scale – 0.86 alpha.
  11. 11. Pilot Study Results (Contd.)
  12. 12. Pilot Study Results (Contd.)
  13. 13. Pilot Study Results (Contd.)
  14. 14. Pilot Study Results (Contd.)
  15. 15. Pilot Study Results (Contd.)
  16. 16. Future Directions • Develop the corresponding perceptions scale. • Model intentions towards using learning analytics. Attitudes Social Norms Intentions to Use Learning Analytics Perceived Behavioural Control
  17. 17. Questions?

×