SlideShare a Scribd company logo
1 of 17
Working together on using learning
analytics and learning design to
improve (international) student
outcomes
UNISA 24 January 2017
Ashley Gunter, Clare Madge,
Jenna Mittelmeier, Paul Prinsloo,
Parvati Raghuram, Katharine
Reedy, Jekaterina Rogaten, Bart
Rienties
(Social) Learning Analytics
“LA is the measurement, collection, analysis and reporting of data about learners
and their contexts, for purposes of understanding and optimising learning and the
environments in which it occurs” (LAK 2011)
Social LA “focuses on how learners build knowledge together in their cultural
and social settings” (Ferguson & Buckingham Shum, 2012)
Dyckhoff, A. L., Zielke, D., Bültmann, M., Chatti, M. A., & Schroeder, U. (2012). Design and Implementation of a Learning Analytics Toolkit for Teachers. Journal of Educational Technology & Society, 15(3), 58-76.
Performance
(e.g., Grade,
Adjustment,
GPA)
Time
A-student
B-student
C-student
A vast body of research shows that Affective, Behavioural, and Cognitive factors (Searle and Ward, 1990; Jindal-
Snape & Rienties, 2016) influence academic and social adjustment over time, which in turn predicts learning
outcomes (Crede et al. 2012; Rienties et al. 2012). Some students develop appropriate ABC and ac + soc.
Adjustment strategies and become “A-students”, others progress reasonably well (B-student) and some students
drop out over time (C-student).
What predicts (international) student progression?
Input Process Output
Learner characteristics
(incl. prior education, gender,
cultural background)
Academic adjustment
(incl. personal-emotional adjustment,
attachment to institute)
Social adjustment
(incl. study support, satisfaction with social
Environment, financial support)
Family characteristics
(incl. support, finance, child-
care)
Learning design
(incl. assessment, learning
materials, communication)
Engagement with learning
(incl. VLE engagement, attending sessions,
submitting assignments, social media)
Academic performance
over time
(incl. grades, credits, GPA)
Degree outcomes
(incl. Employment, migration,
etc)
Three-level Growth Curve Model
Level 1
Level 2
Level 3
TMA1
Student1
TMA3 TMA1 TMA2 TMA3 TMA1 TMA2 TMA3TMA2
Student2 Student3
Module1 Module2
TMA1 TMA2 TMA3
Student4
TMA1 TMA2 TMA3
Student5
Module3
Rogaten, J., Rienties, B, Whitelock, D. (2016). Assessing learning gains, TEA Conference, Tallinn, Estonia
VLE VLEVLE
Participants
11,909 Social Science students of whom 72% were females and 28% were males
with average age of M = 30.6, SD = 9.9
5,791 Science students of whom 58.2% were females and 41.8% were males
with average age of M = 29.8, SD = 9.6.
Measures
Tutor Marked Assessments (TMA)
Socio demographics (gender, ethnicity, prior educational qualification)
Across 111 modules
Rogaten, J., Rienties, B, Whitelock, D. (2016). Assessing learning gains, TEA Conference, Tallinn, Estonia
Descriptive statistics: Social Science
Trellis plot Students’ growth-curve Modules’ growth-curve
Rogaten, J., Rienties, B, Whitelock, D. (2016). Assessing learning gains, TEA Conference, Tallinn, Estonia
Descriptive statistics: Science
Trellis plot Students’ growth-curve Modules’ growth-curve
Rogaten, J., Rienties, B, Whitelock, D. (2016). Assessing learning gains, TEA Conference, Tallinn, Estonia
The 3-level model accounted for total of:
6% and 33% of variance in students initial scores
19% and 26% of variance in students subsequent learning gains
Socio-demographic variables are strong predictors of
variance in initial achievements and also in subsequent
learning gains
Main effect of socio-demographic variables and Interaction between
TMAs socio-demographic variables showed that single most
important predictors of initial achievements and growth were ethnicity
and prior education level (White students with A levels show high
initial achievements and subsequent high learning gain)
Rogaten, J., Rienties, B, Whitelock, D. (2016). Assessing learning gains, TEA Conference, Tallinn, Estonia
Toetenel, L. & Rienties, B. (2016). Analysing 157 Learning Designs using Learning Analytic approaches as a means to evaluate the impact of pedagogical
decision-making. British Journal of Educational Technology.
Method – data sets
• Combination of four different data sets:
• learning design data (189 modules mapped,
276 module implementations included)
• student feedback data (140)
• VLE data (141 modules)
• Academic Performance (151)
• Data sets merged and cleaned
• 111,256 students undertook these modules
Constructivist
Learning Design
Assessment
Learning Design
Productive
Learning Design
Socio-construct.
Learning Design
VLE Engagement
Student
Satisfaction
Student
retention
150+ modules
Week 1 Week 2 Week30
+
Rienties, B., Toetenel, L., (2016). The impact of learning design on student behaviour, satisfaction and performance: a cross-institutional comparison across
151 modules. Computers in Human Behavior, 60 (2016), 333-341
Communication
Performance
(e.g., Grade,
Adjustment,
GPA)
Months
A-student
B-student
C-student
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
Interviews
Interviews
Interviews
1 2 2 2
1 = Instrument on students’ first weeks (e.g. welcoming, internet access)
2= Measurement of ac + soc. Adjustment (e.g., SACQ)
3= Fine-grained interviews unpacking why some students become A, others B, and others C
3
3
3
Working together on using learning
analytics and learning design to
improve (international) student
outcomes
UNISA 24 January 2017
Ashley Gunter, Clare Madge,
Jenna Mittelmeier, Paul Prinsloo,
Parvati Raghuram, Katharine
Reedy, Jekaterina Rogaten, Bart
Rienties

More Related Content

What's hot

ASCILITE Webinar: A review of five years of implementation and research in al...
ASCILITE Webinar: A review of five years of implementation and research in al...ASCILITE Webinar: A review of five years of implementation and research in al...
ASCILITE Webinar: A review of five years of implementation and research in al...Bart Rienties
 
The power of learning analytics for UCL: lessons learned from the Open Univer...
The power of learning analytics for UCL: lessons learned from the Open Univer...The power of learning analytics for UCL: lessons learned from the Open Univer...
The power of learning analytics for UCL: lessons learned from the Open Univer...Bart Rienties
 
Learning Design and Analytics in Learning and Teaching: The Role of Big Data
Learning Design and Analytics in Learning and Teaching: The Role of Big DataLearning Design and Analytics in Learning and Teaching: The Role of Big Data
Learning Design and Analytics in Learning and Teaching: The Role of Big DataBart Rienties
 
Keynote EARLI SIG17 The power of learning analytics: a need to move towards n...
Keynote EARLI SIG17 The power of learning analytics: a need to move towards n...Keynote EARLI SIG17 The power of learning analytics: a need to move towards n...
Keynote EARLI SIG17 The power of learning analytics: a need to move towards n...Bart Rienties
 
The Power of Learning Analytics: Is There Still a Need for Educational Research?
The Power of Learning Analytics: Is There Still a Need for Educational Research?The Power of Learning Analytics: Is There Still a Need for Educational Research?
The Power of Learning Analytics: Is There Still a Need for Educational Research?Bart Rienties
 
INVITED WORKSHOP: THREE DIFFERENT PERSPECTIVES ON WHY YOU NEED LEARNING ANALY...
INVITED WORKSHOP: THREE DIFFERENT PERSPECTIVES ON WHY YOU NEED LEARNING ANALY...INVITED WORKSHOP: THREE DIFFERENT PERSPECTIVES ON WHY YOU NEED LEARNING ANALY...
INVITED WORKSHOP: THREE DIFFERENT PERSPECTIVES ON WHY YOU NEED LEARNING ANALY...Bart Rienties
 
AI in Education Amsterdam Data Science (ADS) What have we learned after a dec...
AI in Education Amsterdam Data Science (ADS) What have we learned after a dec...AI in Education Amsterdam Data Science (ADS) What have we learned after a dec...
AI in Education Amsterdam Data Science (ADS) What have we learned after a dec...Bart Rienties
 
200_Topcu and Koculu_ECER 2021 Geneva (online)
200_Topcu and Koculu_ECER 2021 Geneva (online)200_Topcu and Koculu_ECER 2021 Geneva (online)
200_Topcu and Koculu_ECER 2021 Geneva (online)Asli Koculu
 
Assessment & Feedback Literature Review
Assessment & Feedback Literature ReviewAssessment & Feedback Literature Review
Assessment & Feedback Literature ReviewMorse Project
 
HESA JISC DATA The Power of Learning Analytics with(out)leanring design
HESA JISC DATA The Power of Learning Analytics with(out)leanring designHESA JISC DATA The Power of Learning Analytics with(out)leanring design
HESA JISC DATA The Power of Learning Analytics with(out)leanring designBart Rienties
 
Assessment & feedback Literature Review
Assessment & feedback Literature ReviewAssessment & feedback Literature Review
Assessment & feedback Literature ReviewMorse Project
 
22 January 2018 HEFCE open event “Using data to increase learning gains and t...
22 January 2018 HEFCE open event “Using data to increase learning gains and t...22 January 2018 HEFCE open event “Using data to increase learning gains and t...
22 January 2018 HEFCE open event “Using data to increase learning gains and t...Bart Rienties
 
Society for Research into Higher Education conference presentation
Society for Research into Higher Education conference presentationSociety for Research into Higher Education conference presentation
Society for Research into Higher Education conference presentationChristian Bokhove
 
An analytical review of the literature on e-feedback
An analytical review of the literature on e-feedbackAn analytical review of the literature on e-feedback
An analytical review of the literature on e-feedbackanyakirax
 
Integration of GeoGebra in Teaching Mathematics
Integration of GeoGebra in Teaching MathematicsIntegration of GeoGebra in Teaching Mathematics
Integration of GeoGebra in Teaching MathematicsNiroj Dahal
 
Benefit(s)/effectiveness of Google Classroom
Benefit(s)/effectiveness of Google ClassroomBenefit(s)/effectiveness of Google Classroom
Benefit(s)/effectiveness of Google ClassroomNiroj Dahal
 
M Phil Dissertation Viva-Voce_Niroj Dahal(Final)
M Phil Dissertation Viva-Voce_Niroj Dahal(Final) M Phil Dissertation Viva-Voce_Niroj Dahal(Final)
M Phil Dissertation Viva-Voce_Niroj Dahal(Final) Niroj Dahal
 
Exploring classroom interaction with dynamic social network analysis
Exploring classroom interaction with dynamic social network analysisExploring classroom interaction with dynamic social network analysis
Exploring classroom interaction with dynamic social network analysisChristian Bokhove
 
How can we engage mathematics ITE students with research?
How can we engage mathematics ITE students with research?How can we engage mathematics ITE students with research?
How can we engage mathematics ITE students with research?Christian Bokhove
 
The power of learning analytics to unpack learning and teaching: a critical p...
The power of learning analytics to unpack learning and teaching: a critical p...The power of learning analytics to unpack learning and teaching: a critical p...
The power of learning analytics to unpack learning and teaching: a critical p...Bart Rienties
 

What's hot (20)

ASCILITE Webinar: A review of five years of implementation and research in al...
ASCILITE Webinar: A review of five years of implementation and research in al...ASCILITE Webinar: A review of five years of implementation and research in al...
ASCILITE Webinar: A review of five years of implementation and research in al...
 
The power of learning analytics for UCL: lessons learned from the Open Univer...
The power of learning analytics for UCL: lessons learned from the Open Univer...The power of learning analytics for UCL: lessons learned from the Open Univer...
The power of learning analytics for UCL: lessons learned from the Open Univer...
 
Learning Design and Analytics in Learning and Teaching: The Role of Big Data
Learning Design and Analytics in Learning and Teaching: The Role of Big DataLearning Design and Analytics in Learning and Teaching: The Role of Big Data
Learning Design and Analytics in Learning and Teaching: The Role of Big Data
 
Keynote EARLI SIG17 The power of learning analytics: a need to move towards n...
Keynote EARLI SIG17 The power of learning analytics: a need to move towards n...Keynote EARLI SIG17 The power of learning analytics: a need to move towards n...
Keynote EARLI SIG17 The power of learning analytics: a need to move towards n...
 
The Power of Learning Analytics: Is There Still a Need for Educational Research?
The Power of Learning Analytics: Is There Still a Need for Educational Research?The Power of Learning Analytics: Is There Still a Need for Educational Research?
The Power of Learning Analytics: Is There Still a Need for Educational Research?
 
INVITED WORKSHOP: THREE DIFFERENT PERSPECTIVES ON WHY YOU NEED LEARNING ANALY...
INVITED WORKSHOP: THREE DIFFERENT PERSPECTIVES ON WHY YOU NEED LEARNING ANALY...INVITED WORKSHOP: THREE DIFFERENT PERSPECTIVES ON WHY YOU NEED LEARNING ANALY...
INVITED WORKSHOP: THREE DIFFERENT PERSPECTIVES ON WHY YOU NEED LEARNING ANALY...
 
AI in Education Amsterdam Data Science (ADS) What have we learned after a dec...
AI in Education Amsterdam Data Science (ADS) What have we learned after a dec...AI in Education Amsterdam Data Science (ADS) What have we learned after a dec...
AI in Education Amsterdam Data Science (ADS) What have we learned after a dec...
 
200_Topcu and Koculu_ECER 2021 Geneva (online)
200_Topcu and Koculu_ECER 2021 Geneva (online)200_Topcu and Koculu_ECER 2021 Geneva (online)
200_Topcu and Koculu_ECER 2021 Geneva (online)
 
Assessment & Feedback Literature Review
Assessment & Feedback Literature ReviewAssessment & Feedback Literature Review
Assessment & Feedback Literature Review
 
HESA JISC DATA The Power of Learning Analytics with(out)leanring design
HESA JISC DATA The Power of Learning Analytics with(out)leanring designHESA JISC DATA The Power of Learning Analytics with(out)leanring design
HESA JISC DATA The Power of Learning Analytics with(out)leanring design
 
Assessment & feedback Literature Review
Assessment & feedback Literature ReviewAssessment & feedback Literature Review
Assessment & feedback Literature Review
 
22 January 2018 HEFCE open event “Using data to increase learning gains and t...
22 January 2018 HEFCE open event “Using data to increase learning gains and t...22 January 2018 HEFCE open event “Using data to increase learning gains and t...
22 January 2018 HEFCE open event “Using data to increase learning gains and t...
 
Society for Research into Higher Education conference presentation
Society for Research into Higher Education conference presentationSociety for Research into Higher Education conference presentation
Society for Research into Higher Education conference presentation
 
An analytical review of the literature on e-feedback
An analytical review of the literature on e-feedbackAn analytical review of the literature on e-feedback
An analytical review of the literature on e-feedback
 
Integration of GeoGebra in Teaching Mathematics
Integration of GeoGebra in Teaching MathematicsIntegration of GeoGebra in Teaching Mathematics
Integration of GeoGebra in Teaching Mathematics
 
Benefit(s)/effectiveness of Google Classroom
Benefit(s)/effectiveness of Google ClassroomBenefit(s)/effectiveness of Google Classroom
Benefit(s)/effectiveness of Google Classroom
 
M Phil Dissertation Viva-Voce_Niroj Dahal(Final)
M Phil Dissertation Viva-Voce_Niroj Dahal(Final) M Phil Dissertation Viva-Voce_Niroj Dahal(Final)
M Phil Dissertation Viva-Voce_Niroj Dahal(Final)
 
Exploring classroom interaction with dynamic social network analysis
Exploring classroom interaction with dynamic social network analysisExploring classroom interaction with dynamic social network analysis
Exploring classroom interaction with dynamic social network analysis
 
How can we engage mathematics ITE students with research?
How can we engage mathematics ITE students with research?How can we engage mathematics ITE students with research?
How can we engage mathematics ITE students with research?
 
The power of learning analytics to unpack learning and teaching: a critical p...
The power of learning analytics to unpack learning and teaching: a critical p...The power of learning analytics to unpack learning and teaching: a critical p...
The power of learning analytics to unpack learning and teaching: a critical p...
 

Similar to ESRC International Distance Education and African Students Advisory Panel Meeting

Predictive Learning Analytics Professor Bart Rienties (Open University)
Predictive Learning Analytics Professor Bart Rienties (Open University)Predictive Learning Analytics Professor Bart Rienties (Open University)
Predictive Learning Analytics Professor Bart Rienties (Open University)Bart Rienties
 
Learning analytics adoption in Higher Education: Reviewing six years of exper...
Learning analytics adoption in Higher Education: Reviewing six years of exper...Learning analytics adoption in Higher Education: Reviewing six years of exper...
Learning analytics adoption in Higher Education: Reviewing six years of exper...Bart Rienties
 
Keynote SEC2019 Leeds: The power of learning analytics to impact learning and...
Keynote SEC2019 Leeds: The power of learning analytics to impact learning and...Keynote SEC2019 Leeds: The power of learning analytics to impact learning and...
Keynote SEC2019 Leeds: The power of learning analytics to impact learning and...Bart Rienties
 
A Hybrid Approach To Promoting Students Web-Based Problem-Solving Competence...
A Hybrid Approach To Promoting Students  Web-Based Problem-Solving Competence...A Hybrid Approach To Promoting Students  Web-Based Problem-Solving Competence...
A Hybrid Approach To Promoting Students Web-Based Problem-Solving Competence...Amy Roman
 
Closing The 2-Sigma Gap Eight Strategies to Replicate One-to-One Tutoring in ...
Closing The 2-Sigma Gap Eight Strategies to Replicate One-to-One Tutoring in ...Closing The 2-Sigma Gap Eight Strategies to Replicate One-to-One Tutoring in ...
Closing The 2-Sigma Gap Eight Strategies to Replicate One-to-One Tutoring in ...David Denton
 
Edutech_Europe Keynote Presentation: Implementing learning analytics and lear...
Edutech_Europe Keynote Presentation: Implementing learning analytics and lear...Edutech_Europe Keynote Presentation: Implementing learning analytics and lear...
Edutech_Europe Keynote Presentation: Implementing learning analytics and lear...Bart Rienties
 
A Three-Pronged Model To Learning Analysis And Instructional Design
A Three-Pronged Model To Learning Analysis And Instructional DesignA Three-Pronged Model To Learning Analysis And Instructional Design
A Three-Pronged Model To Learning Analysis And Instructional DesignCourtney Esco
 
Learning Analytics and libraries
Learning Analytics and librariesLearning Analytics and libraries
Learning Analytics and librariesTalis
 
Keynote Presentation: Implementing learning analytics and learning design at ...
Keynote Presentation: Implementing learning analytics and learning design at ...Keynote Presentation: Implementing learning analytics and learning design at ...
Keynote Presentation: Implementing learning analytics and learning design at ...Bart Rienties
 
Keynote PBL, Transfer and New Media
Keynote PBL, Transfer and New MediaKeynote PBL, Transfer and New Media
Keynote PBL, Transfer and New MediaBart Rienties
 
Research on Technology Integration
Research on Technology IntegrationResearch on Technology Integration
Research on Technology Integrationginaphipps
 
Educational Technology - opportunities and pitfalls How to make the most use...
Educational Technology - opportunities and pitfalls  How to make the most use...Educational Technology - opportunities and pitfalls  How to make the most use...
Educational Technology - opportunities and pitfalls How to make the most use...Bart Rienties
 
AERA 2010 - First Year Student Adjustment, Success, and Retention - Structura...
AERA 2010 - First Year Student Adjustment, Success, and Retention - Structura...AERA 2010 - First Year Student Adjustment, Success, and Retention - Structura...
AERA 2010 - First Year Student Adjustment, Success, and Retention - Structura...Martin Sandler
 
Learning Analytics and the Scholarship of Teaching and Learning - an obvious ...
Learning Analytics and the Scholarship of Teaching and Learning - an obvious ...Learning Analytics and the Scholarship of Teaching and Learning - an obvious ...
Learning Analytics and the Scholarship of Teaching and Learning - an obvious ...Blackboard APAC
 
Using Analytics to Transform the Library Agenda - Linda Corrin | Talis Insigh...
Using Analytics to Transform the Library Agenda - Linda Corrin | Talis Insigh...Using Analytics to Transform the Library Agenda - Linda Corrin | Talis Insigh...
Using Analytics to Transform the Library Agenda - Linda Corrin | Talis Insigh...Talis
 

Similar to ESRC International Distance Education and African Students Advisory Panel Meeting (20)

Predictive Learning Analytics Professor Bart Rienties (Open University)
Predictive Learning Analytics Professor Bart Rienties (Open University)Predictive Learning Analytics Professor Bart Rienties (Open University)
Predictive Learning Analytics Professor Bart Rienties (Open University)
 
Learning analytics adoption in Higher Education: Reviewing six years of exper...
Learning analytics adoption in Higher Education: Reviewing six years of exper...Learning analytics adoption in Higher Education: Reviewing six years of exper...
Learning analytics adoption in Higher Education: Reviewing six years of exper...
 
Using Large Scale Assessments to improve schools
Using Large Scale Assessments to improve schoolsUsing Large Scale Assessments to improve schools
Using Large Scale Assessments to improve schools
 
Keynote SEC2019 Leeds: The power of learning analytics to impact learning and...
Keynote SEC2019 Leeds: The power of learning analytics to impact learning and...Keynote SEC2019 Leeds: The power of learning analytics to impact learning and...
Keynote SEC2019 Leeds: The power of learning analytics to impact learning and...
 
A Hybrid Approach To Promoting Students Web-Based Problem-Solving Competence...
A Hybrid Approach To Promoting Students  Web-Based Problem-Solving Competence...A Hybrid Approach To Promoting Students  Web-Based Problem-Solving Competence...
A Hybrid Approach To Promoting Students Web-Based Problem-Solving Competence...
 
Rhine VITAE
 Rhine VITAE Rhine VITAE
Rhine VITAE
 
Closing The 2-Sigma Gap Eight Strategies to Replicate One-to-One Tutoring in ...
Closing The 2-Sigma Gap Eight Strategies to Replicate One-to-One Tutoring in ...Closing The 2-Sigma Gap Eight Strategies to Replicate One-to-One Tutoring in ...
Closing The 2-Sigma Gap Eight Strategies to Replicate One-to-One Tutoring in ...
 
Supporting the Assessment of Problem Solving Competences through Inquiry-base...
Supporting the Assessment of Problem Solving Competences through Inquiry-base...Supporting the Assessment of Problem Solving Competences through Inquiry-base...
Supporting the Assessment of Problem Solving Competences through Inquiry-base...
 
Edutech_Europe Keynote Presentation: Implementing learning analytics and lear...
Edutech_Europe Keynote Presentation: Implementing learning analytics and lear...Edutech_Europe Keynote Presentation: Implementing learning analytics and lear...
Edutech_Europe Keynote Presentation: Implementing learning analytics and lear...
 
Coi Comprehension.
Coi Comprehension.Coi Comprehension.
Coi Comprehension.
 
A Three-Pronged Model To Learning Analysis And Instructional Design
A Three-Pronged Model To Learning Analysis And Instructional DesignA Three-Pronged Model To Learning Analysis And Instructional Design
A Three-Pronged Model To Learning Analysis And Instructional Design
 
Learning Analytics and libraries
Learning Analytics and librariesLearning Analytics and libraries
Learning Analytics and libraries
 
Keynote Presentation: Implementing learning analytics and learning design at ...
Keynote Presentation: Implementing learning analytics and learning design at ...Keynote Presentation: Implementing learning analytics and learning design at ...
Keynote Presentation: Implementing learning analytics and learning design at ...
 
Keynote PBL, Transfer and New Media
Keynote PBL, Transfer and New MediaKeynote PBL, Transfer and New Media
Keynote PBL, Transfer and New Media
 
Research on Technology Integration
Research on Technology IntegrationResearch on Technology Integration
Research on Technology Integration
 
Eli11 utk
Eli11 utkEli11 utk
Eli11 utk
 
Educational Technology - opportunities and pitfalls How to make the most use...
Educational Technology - opportunities and pitfalls  How to make the most use...Educational Technology - opportunities and pitfalls  How to make the most use...
Educational Technology - opportunities and pitfalls How to make the most use...
 
AERA 2010 - First Year Student Adjustment, Success, and Retention - Structura...
AERA 2010 - First Year Student Adjustment, Success, and Retention - Structura...AERA 2010 - First Year Student Adjustment, Success, and Retention - Structura...
AERA 2010 - First Year Student Adjustment, Success, and Retention - Structura...
 
Learning Analytics and the Scholarship of Teaching and Learning - an obvious ...
Learning Analytics and the Scholarship of Teaching and Learning - an obvious ...Learning Analytics and the Scholarship of Teaching and Learning - an obvious ...
Learning Analytics and the Scholarship of Teaching and Learning - an obvious ...
 
Using Analytics to Transform the Library Agenda - Linda Corrin | Talis Insigh...
Using Analytics to Transform the Library Agenda - Linda Corrin | Talis Insigh...Using Analytics to Transform the Library Agenda - Linda Corrin | Talis Insigh...
Using Analytics to Transform the Library Agenda - Linda Corrin | Talis Insigh...
 

More from Bart Rienties

Applying and translating learning design and analytics approaches in your ins...
Applying and translating learning design and analytics approaches in your ins...Applying and translating learning design and analytics approaches in your ins...
Applying and translating learning design and analytics approaches in your ins...Bart Rienties
 
How can you use learning analytics in your own research and practice: an intr...
How can you use learning analytics in your own research and practice: an intr...How can you use learning analytics in your own research and practice: an intr...
How can you use learning analytics in your own research and practice: an intr...Bart Rienties
 
SAAIR: Implementing learning analytics at scale in an online world: lessons l...
SAAIR: Implementing learning analytics at scale in an online world: lessons l...SAAIR: Implementing learning analytics at scale in an online world: lessons l...
SAAIR: Implementing learning analytics at scale in an online world: lessons l...Bart Rienties
 
OU/Leverhulme Open World Learning: Knowledge Exchange and Book Launch Event p...
OU/Leverhulme Open World Learning: Knowledge Exchange and Book Launch Event p...OU/Leverhulme Open World Learning: Knowledge Exchange and Book Launch Event p...
OU/Leverhulme Open World Learning: Knowledge Exchange and Book Launch Event p...Bart Rienties
 
Keynote Learning & Innovation Maastricht University
Keynote Learning & Innovation Maastricht UniversityKeynote Learning & Innovation Maastricht University
Keynote Learning & Innovation Maastricht UniversityBart Rienties
 
Education 4.0 and Computer Science: A European perspective
Education 4.0 and Computer Science: A European perspectiveEducation 4.0 and Computer Science: A European perspective
Education 4.0 and Computer Science: A European perspectiveBart Rienties
 
Keynote Data Matters JISC What is the impact? Six years of learning analytics...
Keynote Data Matters JISC What is the impact? Six years of learning analytics...Keynote Data Matters JISC What is the impact? Six years of learning analytics...
Keynote Data Matters JISC What is the impact? Six years of learning analytics...Bart Rienties
 
What have we learned from 6 years of implementing learning analytics amongst ...
What have we learned from 6 years of implementing learning analytics amongst ...What have we learned from 6 years of implementing learning analytics amongst ...
What have we learned from 6 years of implementing learning analytics amongst ...Bart Rienties
 
Using Learning analytics to support learners and teachers at the Open University
Using Learning analytics to support learners and teachers at the Open UniversityUsing Learning analytics to support learners and teachers at the Open University
Using Learning analytics to support learners and teachers at the Open UniversityBart Rienties
 
Using student data to transform teaching and learning
Using student data to transform teaching and learningUsing student data to transform teaching and learning
Using student data to transform teaching and learningBart Rienties
 
How learning gains and Quality Assurance are (mis)Aligned: An Interactive Wor...
How learning gains and Quality Assurance are (mis)Aligned: An Interactive Wor...How learning gains and Quality Assurance are (mis)Aligned: An Interactive Wor...
How learning gains and Quality Assurance are (mis)Aligned: An Interactive Wor...Bart Rienties
 
Lecture series: Using trace data or subjective data, that is the question dur...
Lecture series: Using trace data or subjective data, that is the question dur...Lecture series: Using trace data or subjective data, that is the question dur...
Lecture series: Using trace data or subjective data, that is the question dur...Bart Rienties
 
How to analyse questionnaire data: an advanced session
How to analyse questionnaire data: an advanced sessionHow to analyse questionnaire data: an advanced session
How to analyse questionnaire data: an advanced sessionBart Rienties
 
Questionnaire design for beginners (Bart Rienties)
Questionnaire design for beginners (Bart Rienties)Questionnaire design for beginners (Bart Rienties)
Questionnaire design for beginners (Bart Rienties)Bart Rienties
 
«Learning Analytics at the Open University and the UK»
 «Learning Analytics at the Open University and the UK» «Learning Analytics at the Open University and the UK»
«Learning Analytics at the Open University and the UK»Bart Rienties
 
Presentation LMU Munich: The power of learning analytics to unpack learning a...
Presentation LMU Munich: The power of learning analytics to unpack learning a...Presentation LMU Munich: The power of learning analytics to unpack learning a...
Presentation LMU Munich: The power of learning analytics to unpack learning a...Bart Rienties
 
Unpacking academic and social adjustment of internationalisation at a distanc...
Unpacking academic and social adjustment of internationalisation at a distanc...Unpacking academic and social adjustment of internationalisation at a distanc...
Unpacking academic and social adjustment of internationalisation at a distanc...Bart Rienties
 
Internationalisation at a Distance and at Home: Academic and Social Adjustmen...
Internationalisation at a Distance and at Home: Academic and Social Adjustmen...Internationalisation at a Distance and at Home: Academic and Social Adjustmen...
Internationalisation at a Distance and at Home: Academic and Social Adjustmen...Bart Rienties
 
Overview of Effective Learning Analytics Using data and analytics to support ...
Overview of Effective Learning Analytics Using data and analytics to support ...Overview of Effective Learning Analytics Using data and analytics to support ...
Overview of Effective Learning Analytics Using data and analytics to support ...Bart Rienties
 
Lessons learned from 200K students and 2 GB of learning gains data.
Lessons learned from 200K students and 2 GB of learning gains data.Lessons learned from 200K students and 2 GB of learning gains data.
Lessons learned from 200K students and 2 GB of learning gains data.Bart Rienties
 

More from Bart Rienties (20)

Applying and translating learning design and analytics approaches in your ins...
Applying and translating learning design and analytics approaches in your ins...Applying and translating learning design and analytics approaches in your ins...
Applying and translating learning design and analytics approaches in your ins...
 
How can you use learning analytics in your own research and practice: an intr...
How can you use learning analytics in your own research and practice: an intr...How can you use learning analytics in your own research and practice: an intr...
How can you use learning analytics in your own research and practice: an intr...
 
SAAIR: Implementing learning analytics at scale in an online world: lessons l...
SAAIR: Implementing learning analytics at scale in an online world: lessons l...SAAIR: Implementing learning analytics at scale in an online world: lessons l...
SAAIR: Implementing learning analytics at scale in an online world: lessons l...
 
OU/Leverhulme Open World Learning: Knowledge Exchange and Book Launch Event p...
OU/Leverhulme Open World Learning: Knowledge Exchange and Book Launch Event p...OU/Leverhulme Open World Learning: Knowledge Exchange and Book Launch Event p...
OU/Leverhulme Open World Learning: Knowledge Exchange and Book Launch Event p...
 
Keynote Learning & Innovation Maastricht University
Keynote Learning & Innovation Maastricht UniversityKeynote Learning & Innovation Maastricht University
Keynote Learning & Innovation Maastricht University
 
Education 4.0 and Computer Science: A European perspective
Education 4.0 and Computer Science: A European perspectiveEducation 4.0 and Computer Science: A European perspective
Education 4.0 and Computer Science: A European perspective
 
Keynote Data Matters JISC What is the impact? Six years of learning analytics...
Keynote Data Matters JISC What is the impact? Six years of learning analytics...Keynote Data Matters JISC What is the impact? Six years of learning analytics...
Keynote Data Matters JISC What is the impact? Six years of learning analytics...
 
What have we learned from 6 years of implementing learning analytics amongst ...
What have we learned from 6 years of implementing learning analytics amongst ...What have we learned from 6 years of implementing learning analytics amongst ...
What have we learned from 6 years of implementing learning analytics amongst ...
 
Using Learning analytics to support learners and teachers at the Open University
Using Learning analytics to support learners and teachers at the Open UniversityUsing Learning analytics to support learners and teachers at the Open University
Using Learning analytics to support learners and teachers at the Open University
 
Using student data to transform teaching and learning
Using student data to transform teaching and learningUsing student data to transform teaching and learning
Using student data to transform teaching and learning
 
How learning gains and Quality Assurance are (mis)Aligned: An Interactive Wor...
How learning gains and Quality Assurance are (mis)Aligned: An Interactive Wor...How learning gains and Quality Assurance are (mis)Aligned: An Interactive Wor...
How learning gains and Quality Assurance are (mis)Aligned: An Interactive Wor...
 
Lecture series: Using trace data or subjective data, that is the question dur...
Lecture series: Using trace data or subjective data, that is the question dur...Lecture series: Using trace data or subjective data, that is the question dur...
Lecture series: Using trace data or subjective data, that is the question dur...
 
How to analyse questionnaire data: an advanced session
How to analyse questionnaire data: an advanced sessionHow to analyse questionnaire data: an advanced session
How to analyse questionnaire data: an advanced session
 
Questionnaire design for beginners (Bart Rienties)
Questionnaire design for beginners (Bart Rienties)Questionnaire design for beginners (Bart Rienties)
Questionnaire design for beginners (Bart Rienties)
 
«Learning Analytics at the Open University and the UK»
 «Learning Analytics at the Open University and the UK» «Learning Analytics at the Open University and the UK»
«Learning Analytics at the Open University and the UK»
 
Presentation LMU Munich: The power of learning analytics to unpack learning a...
Presentation LMU Munich: The power of learning analytics to unpack learning a...Presentation LMU Munich: The power of learning analytics to unpack learning a...
Presentation LMU Munich: The power of learning analytics to unpack learning a...
 
Unpacking academic and social adjustment of internationalisation at a distanc...
Unpacking academic and social adjustment of internationalisation at a distanc...Unpacking academic and social adjustment of internationalisation at a distanc...
Unpacking academic and social adjustment of internationalisation at a distanc...
 
Internationalisation at a Distance and at Home: Academic and Social Adjustmen...
Internationalisation at a Distance and at Home: Academic and Social Adjustmen...Internationalisation at a Distance and at Home: Academic and Social Adjustmen...
Internationalisation at a Distance and at Home: Academic and Social Adjustmen...
 
Overview of Effective Learning Analytics Using data and analytics to support ...
Overview of Effective Learning Analytics Using data and analytics to support ...Overview of Effective Learning Analytics Using data and analytics to support ...
Overview of Effective Learning Analytics Using data and analytics to support ...
 
Lessons learned from 200K students and 2 GB of learning gains data.
Lessons learned from 200K students and 2 GB of learning gains data.Lessons learned from 200K students and 2 GB of learning gains data.
Lessons learned from 200K students and 2 GB of learning gains data.
 

Recently uploaded

Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeThiyagu K
 
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdfBASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdfSoniaTolstoy
 
Solving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptxSolving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptxOH TEIK BIN
 
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptx
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptxContemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptx
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptxRoyAbrique
 
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxPOINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxSayali Powar
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxheathfieldcps1
 
A Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformA Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformChameera Dedduwage
 
Employee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptxEmployee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptxNirmalaLoungPoorunde1
 
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991RKavithamani
 
Mastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionMastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionSafetyChain Software
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...EduSkills OECD
 
CARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptxCARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptxGaneshChakor2
 
Concept of Vouching. B.Com(Hons) /B.Compdf
Concept of Vouching. B.Com(Hons) /B.CompdfConcept of Vouching. B.Com(Hons) /B.Compdf
Concept of Vouching. B.Com(Hons) /B.CompdfUmakantAnnand
 
Science 7 - LAND and SEA BREEZE and its Characteristics
Science 7 - LAND and SEA BREEZE and its CharacteristicsScience 7 - LAND and SEA BREEZE and its Characteristics
Science 7 - LAND and SEA BREEZE and its CharacteristicsKarinaGenton
 
Introduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher EducationIntroduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher Educationpboyjonauth
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introductionMaksud Ahmed
 
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdfssuser54595a
 
How to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxHow to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxmanuelaromero2013
 

Recently uploaded (20)

Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and Mode
 
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdfBASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
 
Solving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptxSolving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptx
 
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptx
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptxContemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptx
Contemporary philippine arts from the regions_PPT_Module_12 [Autosaved] (1).pptx
 
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptxPOINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
POINT- BIOCHEMISTRY SEM 2 ENZYMES UNIT 5.pptx
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
 
A Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformA Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy Reform
 
Employee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptxEmployee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptx
 
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
 
Mastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionMastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory Inspection
 
Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
 
CARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptxCARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptx
 
Concept of Vouching. B.Com(Hons) /B.Compdf
Concept of Vouching. B.Com(Hons) /B.CompdfConcept of Vouching. B.Com(Hons) /B.Compdf
Concept of Vouching. B.Com(Hons) /B.Compdf
 
Science 7 - LAND and SEA BREEZE and its Characteristics
Science 7 - LAND and SEA BREEZE and its CharacteristicsScience 7 - LAND and SEA BREEZE and its Characteristics
Science 7 - LAND and SEA BREEZE and its Characteristics
 
Introduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher EducationIntroduction to ArtificiaI Intelligence in Higher Education
Introduction to ArtificiaI Intelligence in Higher Education
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introduction
 
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
 
How to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxHow to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptx
 
Model Call Girl in Bikash Puri Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Bikash Puri  Delhi reach out to us at 🔝9953056974🔝Model Call Girl in Bikash Puri  Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Bikash Puri Delhi reach out to us at 🔝9953056974🔝
 

ESRC International Distance Education and African Students Advisory Panel Meeting

  • 1. Working together on using learning analytics and learning design to improve (international) student outcomes UNISA 24 January 2017 Ashley Gunter, Clare Madge, Jenna Mittelmeier, Paul Prinsloo, Parvati Raghuram, Katharine Reedy, Jekaterina Rogaten, Bart Rienties
  • 2. (Social) Learning Analytics “LA is the measurement, collection, analysis and reporting of data about learners and their contexts, for purposes of understanding and optimising learning and the environments in which it occurs” (LAK 2011) Social LA “focuses on how learners build knowledge together in their cultural and social settings” (Ferguson & Buckingham Shum, 2012)
  • 3. Dyckhoff, A. L., Zielke, D., Bültmann, M., Chatti, M. A., & Schroeder, U. (2012). Design and Implementation of a Learning Analytics Toolkit for Teachers. Journal of Educational Technology & Society, 15(3), 58-76.
  • 4. Performance (e.g., Grade, Adjustment, GPA) Time A-student B-student C-student A vast body of research shows that Affective, Behavioural, and Cognitive factors (Searle and Ward, 1990; Jindal- Snape & Rienties, 2016) influence academic and social adjustment over time, which in turn predicts learning outcomes (Crede et al. 2012; Rienties et al. 2012). Some students develop appropriate ABC and ac + soc. Adjustment strategies and become “A-students”, others progress reasonably well (B-student) and some students drop out over time (C-student).
  • 5. What predicts (international) student progression? Input Process Output Learner characteristics (incl. prior education, gender, cultural background) Academic adjustment (incl. personal-emotional adjustment, attachment to institute) Social adjustment (incl. study support, satisfaction with social Environment, financial support) Family characteristics (incl. support, finance, child- care) Learning design (incl. assessment, learning materials, communication) Engagement with learning (incl. VLE engagement, attending sessions, submitting assignments, social media) Academic performance over time (incl. grades, credits, GPA) Degree outcomes (incl. Employment, migration, etc)
  • 6. Three-level Growth Curve Model Level 1 Level 2 Level 3 TMA1 Student1 TMA3 TMA1 TMA2 TMA3 TMA1 TMA2 TMA3TMA2 Student2 Student3 Module1 Module2 TMA1 TMA2 TMA3 Student4 TMA1 TMA2 TMA3 Student5 Module3 Rogaten, J., Rienties, B, Whitelock, D. (2016). Assessing learning gains, TEA Conference, Tallinn, Estonia VLE VLEVLE
  • 7. Participants 11,909 Social Science students of whom 72% were females and 28% were males with average age of M = 30.6, SD = 9.9 5,791 Science students of whom 58.2% were females and 41.8% were males with average age of M = 29.8, SD = 9.6. Measures Tutor Marked Assessments (TMA) Socio demographics (gender, ethnicity, prior educational qualification) Across 111 modules Rogaten, J., Rienties, B, Whitelock, D. (2016). Assessing learning gains, TEA Conference, Tallinn, Estonia
  • 8. Descriptive statistics: Social Science Trellis plot Students’ growth-curve Modules’ growth-curve Rogaten, J., Rienties, B, Whitelock, D. (2016). Assessing learning gains, TEA Conference, Tallinn, Estonia
  • 9. Descriptive statistics: Science Trellis plot Students’ growth-curve Modules’ growth-curve Rogaten, J., Rienties, B, Whitelock, D. (2016). Assessing learning gains, TEA Conference, Tallinn, Estonia
  • 10. The 3-level model accounted for total of: 6% and 33% of variance in students initial scores 19% and 26% of variance in students subsequent learning gains Socio-demographic variables are strong predictors of variance in initial achievements and also in subsequent learning gains Main effect of socio-demographic variables and Interaction between TMAs socio-demographic variables showed that single most important predictors of initial achievements and growth were ethnicity and prior education level (White students with A levels show high initial achievements and subsequent high learning gain) Rogaten, J., Rienties, B, Whitelock, D. (2016). Assessing learning gains, TEA Conference, Tallinn, Estonia
  • 11.
  • 12. Toetenel, L. & Rienties, B. (2016). Analysing 157 Learning Designs using Learning Analytic approaches as a means to evaluate the impact of pedagogical decision-making. British Journal of Educational Technology.
  • 13.
  • 14. Method – data sets • Combination of four different data sets: • learning design data (189 modules mapped, 276 module implementations included) • student feedback data (140) • VLE data (141 modules) • Academic Performance (151) • Data sets merged and cleaned • 111,256 students undertook these modules
  • 15. Constructivist Learning Design Assessment Learning Design Productive Learning Design Socio-construct. Learning Design VLE Engagement Student Satisfaction Student retention 150+ modules Week 1 Week 2 Week30 + Rienties, B., Toetenel, L., (2016). The impact of learning design on student behaviour, satisfaction and performance: a cross-institutional comparison across 151 modules. Computers in Human Behavior, 60 (2016), 333-341 Communication
  • 16. Performance (e.g., Grade, Adjustment, GPA) Months A-student B-student C-student 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 Interviews Interviews Interviews 1 2 2 2 1 = Instrument on students’ first weeks (e.g. welcoming, internet access) 2= Measurement of ac + soc. Adjustment (e.g., SACQ) 3= Fine-grained interviews unpacking why some students become A, others B, and others C 3 3 3
  • 17. Working together on using learning analytics and learning design to improve (international) student outcomes UNISA 24 January 2017 Ashley Gunter, Clare Madge, Jenna Mittelmeier, Paul Prinsloo, Parvati Raghuram, Katharine Reedy, Jekaterina Rogaten, Bart Rienties

Editor's Notes

  1. Level 1 – TMA: repeated measures on students and tell us about students learning trajectory Level 2 – student: between students variations Level 3 – module: between course variation
  2. Based on the results of these two basic three-level growth-curve models, there is a potential ceiling effect on Student and Module levels in Science, and on Module level in Social Science. Thus, comparing Figures 2 and 3 it is noticeable that in Social Science there is a fanning out in students’ predicted growth curves, which indicates that over a period of a semester students with initial high achievements showed increase in their subsequent achievements, while students with initial low achievements showed drop in their subsequent achievements. That was not the case for Science students where students with initial high achievements had lower subsequent achievements than students who had initially low achievements and gradually obtained better grades. On the module level, Social Science modules showed strong fanning in, whereas it was less noticeable in Science modules. This indicates that Social Science students vary much stronger in their assessment results that Science students do.
  3. Learning Design Team has mapped 100+ modules
  4. For each module, the learning design team together with module chairs create activity charts of what kind of activities students are expected to do in a week.
  5. 5131 students responded – 28%, between 18-76%
  6. Cluster analysis of 40 modules (>19k students) indicate that module teams design four different types of modules: constructivist, assessment driven, balanced, or socio-constructivist. The LAK paper by Rienties and colleagues indicates that VLE engagement is higher in modules with socio-constructivist or balanced variety learning designs, and lower for constructivist designs. In terms of learning outcomes, students rate constructivist modules higher, and socio-constructivist modules lower. However, in terms of student retention (% of students passed) constructivist modules have lower retention, while socio-constructivist have higher. Thus, learning design strongly influences behaviour, experience and performance. (and we believe we are the first to have mapped this with such a large cohort).