The European Technology Enhanced Learning Landscape
1. 8th Joint European Summer School on
Technology Enhanced Learning (JTEL)
May 20-25, 2012
Estoril, Portugal
TeLLNet
The European Technology Enhanced
Learning Landscape
Michael Derntl and Ralf Klamma
RWTH Aachen University
Advanced Community Information Systems (ACIS)
{derntl,klamma}@dbis.rwth-aachen.de
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
I5-MD-0512-1 This work is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License.
2. Advanced Community Information Systems
(ACIS)
TeLLNet
Web Engineering Responsive
Community
Web Analytics
Open
Visualization
Community
and
Information
Simulation
Systems
Community Community
Support Analytics
Lehrstuhl Informatik 5
Requirements
(Information Systems)
Prof. Dr. M. Jarke
I5-MD-0512-2
Engineering
3. Motivation:
TEL as a Research Community
Observable change of communication
TeLLNet
– New events: EC-TEL, JTEL Summer School, Professional Training
Facts, Alpine-Rendezvous, …
– New journals: IEEE Transactions on Learning Technologies,
Journal of Technology Enhanced Learning, …
– New media: Blogs, Twitter, Facebook, LinkedIn, …
Funding situation in FP 6 – FP 7
– Several NoE: KALEIDOSCOPE, PROLEARN, STELLAR, GALA
– Overcoming fragmentation: What happened so far?
– Driving excellence: What should happen?
Tools for the TEL community
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
I5-MD-0512-3
– Online, Open Source, Open Access
5. Research Context
TeLLNet
Mapping and roadmapping for TEL
Understanding the current TEL landscape
Strong and weak signals for change at different levels
Different data sources
Different methods, e.g. Delphi, Community modeling,
Text analysis, Social Network Analysis, etc.
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
I5-MD-0512-5
6. TEL Mediabase –
Data Sources Overview
TeLLNet
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
I5-MD-0512-6
7. TEL Publications
TeLLNet
Published paper represents (finished) research work
Points of interest
– Venue analysis important TEL venues
– Co-authorships collaboration networks
– Paper topics
Data set:
– DBLP Bibliography integrated with CiteSeerX
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
I5-MD-0512-7
8. TEL Publication Venues – Approach
TeLLNet
Seed venue: ECTEL
Author overlap := fraction of authors of the smaller venue
who also have paper(s) in the other (larger) venue
Identify venues that have at least 10% author “overlap”
with ECTEL; repeat
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
I5-MD-0512-8
9. TEL Publication Venues
TeLLNet
Artificial
Intelligence
HCI
Web /
Hypermedia
61 nodes, 209 edges
Avg. Degree = 6.8
Lehrstuhl Informatik 5 Diameter = 4
(Information Systems)
Prof. Dr. M. Jarke
Avg. Path len = 2.2
I5-MD-0512-9 Clustering = .49
10. TEL Publication Venues
TeLLNet
Strong role of conferences in
– Dissemination of results
– Shaping and maintaining the TEL community
Example co-authorship networks:
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
I5-MD-0512-10 Pham, Derntl, Klamma: Development Patterns of Scientific Communities in Technology Enhanced Learning. ET&S (in press)
11. TEL Conference Communities –
Current State
TeLLNet
TEL conferences exhibit mixed patterns
– Some moving towards focused topology
– Some stuck in the bonding/emergence phase
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
I5-MD-0512-11 Pham, Derntl, Klamma: Development Patterns of Scientific Communities in Technology Enhanced Learning. ET&S (in press)
12. TEL Communities –
Analysis Tool: AERCS
Returning authors
TeLLNet
Co-Authorship – Largest Component
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
I5-MD-0512-12 http://tiny.cc/aercs
13. Top Authors by # Venues
Number of distinct Author # Venues # Papers ICALT ECTEL
TeLLNet Peter Brusilovsky 20 65 X X
venues, where author
Kinshuk 18 89 X X
has published Vladan Devedzic 18 38 X X
Arthur C. Graesser 17 50 X
Yoneo Yano 16 56 X
Requirement: Wolfgang Nejdl 16 55 X X
ICALT … most central venue Paul De Bra 16 41 X X
ECTEL … seed venue Kenneth R. Koedinger 15 93 X
Maria Grigoriadou 15 42 X
Gordon I. McCalla 15 35 X
Caution! Daniel D. Suthers 15 31 X
Gerhard Fischer 15 31 X
Lora Aroyo 15 29 X
Claude Frasson 14 72 X X
Toshio Okamoto 14 70 X
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
I5-MD-0512-13
14. Top Authors’ Paper Titles 2005+
TeLLNet
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
I5-MD-0512-14
15. Top Authors’ Paper Titles 2005+
TeLLNet
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
I5-MD-0512-15
16. Authors’ Topics –
All JTEL Participants
TeLLNet
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
I5-MD-0512-16
17. Authors’ Topics –
JTEL Instructors vs Students
TeLLNet
Instructors
Lehrstuhl Informatik 5
(Information Systems)
Students
Prof. Dr. M. Jarke
I5-MD-0512-17
18. TEL Projects
TeLLNet
Project as a funded collaborative R&D effort
Important role in the R&D value chain
Points of interest
– Organizational collaboration
– Progression of consortia
– Impact on the landscape
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
I5-MD-0512-18
19. TeLLNet
Main
source:
EC
project
fact
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
sheets
I5-MD-0512-19
20. Data Set
Progr. Call # Projects (acronyms)
Call 2005 4 CITER, JEM, MACE, MELT
TeLLNet
Call 2006 7 COSMOS, EdReNe, EUROGENE, eVip, Intergeo, KeyToNature, Organic.Edunet
ECP
Call 2007 3 ASPECT, iCOPER, EduTubePlus
Call 2008 5 LiLa, Math-Bridge, mEducator, OpenScienceResources, OpenScout
IST-2002- CONNECT, E-LEGI, ICLASS, KALEIDOSCOPE, LEACTIVEMATH, PROLEARN,
8
2.3.1.12a TELCERT, UNFOLD
IST-2004- APOSDLE, ARGUNAUT, ATGENTIVE, COOPER, ECIRCUS, ELEKTRA, I-MAESTRO,
FP6 2.4.10b
14
KP-LAB, L2C, LEAD, PALETTE, PROLIX, RE.MATH, TENCOMPETENCE
IST-2004- ARISE, CALIBRATE, ELU, EMAPPS.COM, ICAMP, LOGOS, LT4EL, MGBL, UNITE,
10
2.4.13c VEMUS
ICT-2007.4.1d 6 80DAYS, GRAPPLE, IDSPACE, LTFLL, MATURE, SCY
ICT-2007.4.3d 7 COSPATIAL, DYNALEARN, INTELLEO, ROLE, STELLAR, TARGET, XDELIA
FP7
ALICE, ARISTOTELE, ECUTE, GALA, IMREAL, ITEC, METAFORA, MIROR,
ICT-2009.4.2b 13
MIRROR, NEXT-TELL, SIREN, TEL-MAP, TERENCE
Lehrstuhl Informatik 5
Total: 77
(Information Systems) a … Technology-enhanced learning and access to cultural heritage” c … Strengthening the Integration of the ICT research effort in an Enlarged Europe”
Prof. Dr. M. Jarke b … Technology-Enhanced Learning d … Digital libraries and technology-enhanced learning”
I5-MD-0512-20
21. TEL Projects as Social Networks
Projects Organizations
TeLLNet
Project consortium progression
Nodes: Projects
Edges: Overlap of consortia (directed, weighted)
Organizational collaboration
Nodes: Organizations
Edges: Collaboration in multiple projects (undirected, weighted)
Bipartite
Nodes: Projects, Organizations
Lehrstuhl Informatik 5
Edges: Consortium memberships
(Information Systems)
Prof. Dr. M. Jarke
I5-MD-0512-21
22. Project Consortium Progression
“TEL Projects History”
TeLLNet
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
I5-MD-0512-22
23. Cross-Programme Collaboration Ties
FP7
Strong ties
ALICE
SIREN
MATURE ARISTOTELE
TeLLNet
NEXT-TELL IMREAL
ECUTE TARGET
MIROR
among FP6, COSPATIAL
INTELLEO MIRROR
GALA
80DAYS
METAFORA
FP7 and ECP
DYNALEARN
GRAPPLEIDSPACE
XDELIA SCY
ROLE
TERENCE
STELLAR
ITEC
TEL-MAP
eContentplus LTFLL
LiLa eViP
FP6
I-MAESTRO
mEducator
ECIRCUS
MACE
EdReNe KeyToNature APOSDLE
UNFOLD
OpenScout
COOPER
ASPECT
JEM Math-Bridge
TELCERT RE.MATH
iCOPER
EUROGENE
PROLEARN
MELT KALEIDOSCOPE CONNECT
EduTubePlus Intergeo
COSMOS MGBL ARGUNAUTARISE
ELEKTRA
PROLIX
Organic.Edunet
TENCOMPETENCE
OpenScienceResources
CITER E-LEGI UNITE LEACTIVEMATH
PALETTE
LT4EL ICLASS
VEMUS
ICAMP ELU
KP-LAB
Lehrstuhl Informatik 5 L2C
LEAD
(Information Systems)
LOGOS
Prof. Dr. M. Jarke CALIBRATE
ATGENTIVE
EMAPPS.COM
I5-MD-0512-23
24. Project Impact on the Landscape
Measure impact of project consortium members on
TeLLNet
sustaining and shaping the social TEL project ties after
the project start.
Variables:
… successor projects of p starting m months after p
… all potential successor projects of p
… consortium members of p Cumulative fraction of successor
Successor projects
projects filled up with p's members
relative to opportunity
Impact:
∩
∙
∈
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
I5-MD-0512-24 Derntl, Klamma: The European TEL projects community from an SNA perspective. ECTEL 2012 (submitted)
25. Project Impact – Ranking
# Project Runtime m€ Type ROI
TeLLNet 1 PROLEARN 2004-07 6.01 FP6 NoE 22 past networks of excellence
All 43 69 0.47 2.83
2 KALEIDOSCOPE
All programmes 9.35
2004-07 FP6 NoE 83 among69 11 ranks.
55 top 0.14 1.27
represented, with FP6
3 GRAPPLE 2008-11 3.85 FP7 IP 15 two inaugural 0.25 on top
The 15 28 NoEs 0.96
strongest
4 MACE 2006-09 3.15 ECP CEP 13 19 41 0.31 0.96
5 TELCERT 2004-06 1.80 FP6 STREP 9 21 69 0.53 0.95
6 iCOPER 2008-11 4.80 ECP BPN 23 13 25 0.16 0.75
7 E-LEGI 2004-07 5.95 FP6 UNFOLD has best impact 0.12
IP 22 31 69 0.72
for money
8 PROLIX 2005-09 7.65 FP6 IP 19 19 49 0.09 0.71
9 UNFOLD 2004-05 0.66 FP6 CSA 4 13 69 1.07 0.71
10 ROLE 2009-13 6.60 FP7 IP 16 10 18 0.08 0.56
11 STELLAR 2009-12 4.99 FP7 NoE 16 9 18 0.11 0.53
12 LTFLL running projects in
Two 2008-11 2.85 FP7 STREP 11 10 28 0.18 0.52
13 COOPER the list 2005-07 1.95 FP6 STREP 8 11 49 0.26 0.51
14 ICLASS 2004-08 12.59 FP6 IP 17 20 69 0.04 0.49
Lehrstuhl Informatik 5 15 ARGUNAUT 2005-08 1.63 FP6 STREP 7 12 49 0.30 0.49
(Information Systems)
Prof. Dr. M. Jarke
I5-MD-0512-25
26. Running Projects
# Project End m€ Type ROI
TeLLNet 1 ROLE 2013-01-31 6.60 FP7 IP 16 10 18 0.08 0.56
2 STELLAR 2012-05-31 4.99 FP7 NoE 16 9 18 0.11 0.53
3 TARGET 2012-07-31 6.79 FP7 IP 15 8 18 0.06 0.41
4 ALICE 2012-05-31 1.80 FP7 STREP 5 3 9 0.15 0.27
5 MIRROR 2014-06-30 6.45 FP7 IP 15 3 4 0.02 0.15
6 OpenScout 2012-08-31 2.80 ECP TP 18 4 13 0.05 0.14
7 OpenScienceResources 2012-05-31 2.60 ECP TP 20 2 14 0.01 0.01
Also running: ARISTOTELE, ECUTE, GALA, IMREAL, ITEC, METAFORA, MIROR, NEXT-TELL,
SIREN, TEL-MAP, TERENCE
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
I5-MD-0512-26
27. Organizational Collaboration Ties
TeLLNet
600+ organizations, 9K+ collaboration ties
FP7 project partners map
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
I5-MD-0512-27
30. Projects Space @
LearningFrontiers.eu
TeLLNet
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
I5-MD-0512-30
31. Projects Space @
LearningFrontiers.eu
TeLLNet
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
I5-MD-0512-31
32. Projects Space @
LearningFrontiers.eu
TeLLNet
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
I5-MD-0512-32
33. TEL Blogosphere
Collection of blogs and entries
TeLLNet
Crawled nightly and fed into DB
Backwards retrieval beyond feed limits
Kickoff in 2006 (PROLEARN)
1,000 929 450,000
TEL Blogs
900 All Blogs 400,000
TEL Entries
800 All Entries 382,618 350,000
700
300,000
600
# Blog Entries
# Blogs
250,000
500
200,000
400
288 150,000
300
200 72,849 100,000
100 50,000
Lehrstuhl Informatik 5
(Information Systems) 0 0
Prof. Dr. M. Jarke
I5-MD-0512-33
2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012
34. Blogosphere Model
TeLLNet
has Comment
N
1
Entry entry_urls URL
N N
N 1
1
Burst source_entries actor_url Tag
N is_a
1 N
1 1
Source is_a
Actor actor_tag
N
1 1
Lehrstuhl Informatik 5
(Information Systems)
Prof. Dr. M. Jarke
I5-MD-0512-34