This document outlines different research approaches and methods for studying technology-enhanced learning. It discusses three main research typologies: 1) hypothesis testing, exploratory, and design-based research approaches; 2) quantitative and qualitative research methods; and 3) research purposes like data collection, development, and analysis. For each typology, it provides examples and explanations of specific methods. A common challenge in this research field is that technologies are always new, which can lead to biases like an association of technologies with positive changes or novelty effects.

1. RESEARCH METHODS
IN TECHNOLOGY-ENHANCED LEARNING
A presentation by Sandra Schön
& Martin Ebner

2. Adjunct Professor of Innovations in Learning
at Universitas Negeri Malang
Project manager at Forum New Media in
Higher Education Austria (fnma.at)
Senior Researcher at Graz University of
Technology (Educational Technology), Austria
DR. SANDRA SCHÖNTHISISME!

3. License
This presentation is published under the
CC BY-SA international 4.0 license, see
https://creativecommons.org/licenses/by-sa/4.0/deed.en
Please attribute to Sandra Schön and Martin Ebner

4. THREE WAYS OF RESEARCH
METHODS TYPOLOGIES
• Different research approaches
• Qualitative vs. Quantitative approach
• Different research purposes

5. THREE WAYS OF RESEARCH
METHODS TYPOLOGIES
• Different research approaches
• Qualitative vs. Quantitative approach
• Different research purposes

6. Sandra Schön
2020
S. Schön & M. Ebner
Three Research
Approaches
https://yout
u.be/SEBbB
46ojTs

7. different research
approaches:3• Hypothesis testing research
• Explorative research
• Design-based research
You should have an idea of…

8. METHODS TYPOLOGY 1
HYPOTHESIS
TESTING
APPROACH
DESIGN-
BASED
APPROACH
EXPLORATIVE
APPROACH

9. METHODS TYPOLOGY 1
HYPOTHESIS
TESTING
APPROACH
DESIGN-
BASED
APPROACH
EXPLORATIVE
APPROACH
IS A CERTAIN
“HYPOTHESIS“
RIGHT?

10. METHODS TYPOLOGY 1
HYPOTHESIS
TESTING
APPROACH
DESIGN-
BASED
APPROACH
EXPLORATIVE
APPROACH
IS A CERTAIN
“HYPOTHESIS“
RIGHT?
ARE THERE
ANY
…RULES?
…EXPLANATION?

11. METHODS TYPOLOGY 1
HYPOTHESIS
TESTING
APPROACH
DESIGN-
BASED
APPROACH
EXPLORATIVE
APPROACH
IS A CERTAIN
“HYPOTHESIS“
RIGHT?
ARE THERE
ANY
…RULES?
…EXPLANATION?
HOW TO
DEVELOP/
IMPLEMENT
S.TH. NOVEL

12. THREE WAYS OF RESEARCH
METHODS TYPOLOGIES
• Different research approaches
• Qualitative vs. Quantitative approach
• Different research purposes

13. METHODS TYPOLOGY 2
QUANTITATIVE
METHODS
QUALITATIVE
METHODS

14. METHODS TYPOLOGY 2
QUANTITATIVE
METHODS
QUALITATIVE
METHODS

15. METHODS TYPOLOGY 2
EXAMPLES
QUANTITATIVE
METHODS
QUALITATIVE
METHODS
FIELD / PARTICPATIVE
RESEARCH
STATISTICS

16. METHODS TYPOLOGY 2
QUANTITATIVE
METHODS
QUALITATIVE
METHODS

17. METHODS TYPOLOGY 2
QUANTITATIVE
METHODS
QUALITATIVE
METHODS
METHOD
MIX

18. THREE WAYS OF RESEARCH
METHODS TYPOLOGIES
• Different research approaches
• Qualitative vs. Quantitative approach
• Different research purposes

19. METHODS TYPOLOGY 3
DIFFERENT RESEARCH PURPOSES
DATA
COLLECTION
DEVELOP-
MENT
DATA
ANALYSIS

20. HOW TO
GET
DATA?
HOW TO
DEAL WITH
DATA?
HOW TO
IMPLEMENT
S.TH.
NEW?
METHODS TYPOLOGY 3
DIFFERENT RESEARCH PURPOSES
DATA
COLLECTION
DEVELOP-
MENT
DATA
ANALYSIS

21. HOW TO
GET
DATA?
HOW TO
DEAL WITH
DATA?
HOW TO
IMPLEMENT
S.TH.
NEW?
METHODS TYPOLOGY 3
DIFFERENT RESEARCH PURPOSES
DATA
COLLECTION
DEVELOP-
MENT
DATA
ANALYSIS

22. DATA COLLECTION
• OBSERVATION

23. DATA COLLECTION
• OBSERVATION
• SURVEY • ORAL/WRITTEN/ONLINE
• OPEN/STANDARDIZED QUESTIONS
• …

24. DATA COLLECTION
• OBSERVATION
• SURVEY
• TEST
• ORAL/WRITTEN/ONLINE
• OPEN/STANDARDIZED QUESTIONS
• …
• STANDARDIZED, APPROVED, e.g. INTELLIGENCE TEST

25. DATA COLLECTION
IF YOU WANT TO COMPARE
GROUP
A
GROUP
B

26. DATA COLLECTION
IF YOU WANT TO COMPARE
PRE-
TEST
POST-
TEST
INTER-
VENTION

27. DATA COLLECTION
EXPERIMENT
COMPLETELY CONTROLLED SETTING

28. DATA COLLECTION
EXPERIMENT
CONTROLLED
CHANGE OF
INDEPENDENT
VARIABLE
COMPLETELY CONTROLLED SETTING

29. DATA COLLECTION
EXPERIMENT
DEPENDENT
VARIABLE
CONTROLLED
CHANGE OF
INDEPENDENT
VARIABLE
COMPLETELY CONTROLLED SETTING

30. DATA COLLECTION
EXPERIMENT
DEPENDENT
VARIABLE
CONTROLLED
CHANGE OF
INDEPENDENT
VARIABLE
E.G. LIGHT
COMPLETELY CONTROLLED SETTING
E.G. TEST RESULT

31. DATA COLLECTION
EXPERIMENTS IN LEARNING/TEACHING

32. DATA COLLECTION
EXPERIMENTS IN LEARNING/TEACHING
• CONTROLLING OTHER
VARIABLES (prior
knowledge,
communication)

33. DATA COLLECTION
EXPERIMENTS IN LEARNING/TEACHING
• CONTROLLING OTHER
VARIABLES (prior
knowledge, communication)
• REAL EXPERIMENTS ARE
VERY SELDOM!

34. DATA ANALYSIS
• Statistical
approaches
(descriptive,
inference)

35. DATA ANALYSIS
• Statistical
approaches
(descriptive,
inference)
• Algorithmic
approaches
(decision tree,
cluster)
Children
Age < 8 Age > 8
girls boys

36. DATA ANALYSIS
• Educational Data Mining
(esp. explorative!)

37. DATA ANALYSIS
• Educational Data Mining
(esp. explorative!)
• Learning Analytics
(to support learners)

38. DATA ANALYSIS
• QUALITATIVE
APPROACHES

39. DATA ANALYSIS
• QUALITATIVE
APPROACHES
e.g. identifying
categories for
school-drop-outs in
open interviews

40. DEVELOPMENT
TEACHING/LEARNING
• Instructional Design Theory
• E.g. ADDIE-Model (Analysis, Design,
Development, Implementation, Evaluation)

41. DEVELOPMENT
TEACHING/LEARNING
• Instructional Design Theory
• E.g. ADDIE-Model (Analysis, Design,
Development, Implementation, Evaluation)
TECHNOLOGIES
• User Centred Design
• Prototyping

42. THREE WAYS OF RESEARCH
METHODS TYPOLOGIES
• Different research approaches
• Qualitative vs. Quantitative approach
• Different research purposes
I PRESENTED …

43. Schön, Sandra & Ebner, Martin (2020).
Research approaches and methods in
technology-enhanced learning.
(Version July 2020).
And more links and materials can be
found here:
https://sansch.wordpress.com/?p=8065
READ MORE

44. COMMON CHALLENGE
IN RESEARCH IN TECHNOLOGY-ENHANCED LEARNING

45. COMMON CHALLENGE
IN RESEARCH IN TECHNOLOGY-ENHANCED LEARNING
TECHNOLOGIES
ARE NEW

46. COMMON CHALLENGE
IN RESEARCH IN TECHNOLOGY-ENHANCED LEARNING
TECHNOLOGIES
ARE NEWAssociation
of positive
change

47. COMMON CHALLENGE
IN RESEARCH IN TECHNOLOGY-ENHANCED LEARNING
TECHNOLOGIES
ARE NEWAssociation
of positive
change
Expectation
of positive
change

48. COMMON CHALLENGE
IN RESEARCH IN TECHNOLOGY-ENHANCED LEARNING
TECHNOLOGIES
ARE NEWAssociation
of positive
change
Expectation
of positive
change
File-drawer
effect
(bias)

49. COMMON CHALLENGE
IN RESEARCH IN TECHNOLOGY-ENHANCED LEARNING
TECHNOLOGIES
ARE NEWAssociation
of positive
change
Expectation
of positive
change
File-drawer
effect
(bias)
novelty
effects

50. Adjunct Professor of Innovations in Learning
at Universitas Negeri Malang
https://sandra-schoen.de
DR. SANDRA SCHÖN
THANKS!

51. Sources
• Photos are from pixabay.de (CC 0)
• Schön, Sandra & Ebner, Martin (2020).
Research approaches and methods in
technology-enhanced learning.
(Version July 2020)
• Drawings by Sandra Schön (CC BY 4.0 Int.)