EDUPUB Tokyo 2014 JEPA 日本電子出版協会

1. The
IMS
Specifica7ons
for
Learning
Content:
Common
Cartridge,
LTI,
QTI/APIP,
Caliper
and
EDUPUB
Colin
Smythe
(IMS
Chief
Architect)
csmythe@imsglobal.org
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
1

2. Talk
Objec7ves
• To
introduce
the
following
IMS
Standards
and
ac7vi7es:
– IMS
Learning
Tools
Interoperability®
(LTI®)
– IMS
Common
Cartridge™
(CC)
– IMS
Ques7on
&
Test
Interoperability®
(QTI®)
– IMS
Accessible
Portable
Item
Protocol™
(APIP)
– IMS
Caliper
Learning
Analy7cs
– EDUPUB
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
2

3. Timetable
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
3
Time
Topic
14:00-­‐14:30
Plug
&
Play
Educa7onal
Apps
and
Content:
Common
Cartridge
and
Learning
Tools
Interoperability
14:30-­‐15:00
Interoperable
Assessment:
QTI,
APIP
and
EDUPUB
QTI
15:00-­‐15:30
Break
15:30-­‐16:00
Making
Educa7on
Data
Easy:
Caliper
Analy7cs
16:00-­‐16:30
IMS
Standards
in
Ac7on:
EDUPUB
Demonstra7on
&
Development
Community

4. Biography
• Joined
IMS
in
May
1999
• Responsible
for
the
development
of
many
IMS
specifica7ons
inc.
Ques7on
&
Test
Interoperability
(QTI),
Content
Packaging,
Accessible
Portable
Item
Protocol
(APIP),
Learning
Informa7on
Services
(LIS),
etc.
• Currently
IMS
Chief
Architect
and
responsible
for:
– How
the
specifica7ons
fit
together
– Overseeing
the
technical
details
of
the
specifica7ons
– Suppor7ng
adop7on
of
the
specifica7ons
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
4

5. Ques7ons
&
Comments
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
5

6. • Plug
&
Play
Educa7onal
Apps
and
Content:
Common
Cartridge
and
Learning
Tools
Interoperability
• Interoperable
Assessment:
QTI,
APIP
and
EDUPUB
QTI
• Making
Educa7on
Data
Easy:
Caliper
Analy7cs
• IMS
Standards
in
Ac7on:
EDUPUB
Demonstra7on
&
Development
Community
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
6

7. What is Common Cartridge?
• Common
Cartridge
(CC)
is
a
specifica7on
for
packaging
and
exchanging
learning
and
assessment
content
• The
CC
package
dis7lls
the
latest
and
best
community
prac7ces
for
sharing
digital
content
among
authoring
tools
and
learning
plaborms
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
7

8. The
Problem
for
CC
to
Solve
Because
learning
plaborms
and
authoring
tools
are
all
different,
there
is
a
need
for
a
standard
interoperable
format.
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
8

9. What
CC
Does
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
9

10. A
Common
Cartridge
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
Common Cartridge
imsmanifest.xml
Cartridge meta-data
Organization
Resources
resource meta-data
Web Content Folder
Resource 1
Resource n
Resource Folder 1
Resource a
Resource n’
Resource Folder n
Resource x
Resource n’’
Object bank
LTI Resource type for
integration with web
applications and eBooks.
Extended roles meta-data
vocabulary
{Instructor, Learner,
Mentor}
Multilingual support using
alternative resources for
web content and
assessments
Learning objectives
assigned to resources using
curriculum standards
Assessment resources
now include instructions
to guide the learner in
completing the
assessment
Human readable lesson
plans provided to guide the
instructor in using the
cartridge content
10

11. Supported
Content
Formats
• IMS-­‐derived
– QTI
Assessments
&
Object
Banks
– Web
Links/URLs
– LTI
Links
– Discussion
Topics
– Interac7ve
White
Board
(IWB)
– Accessible
Portable
Item
Protocol
(APIP)
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
11
• Other
– Web
Content
(HTML)
– Web
Content
(non-­‐HTML)
– EPUB3
– Extension

12. ©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
Thin
CC
• Requirements
are:
– Acts
as
a
TOC
for
externally
hosted
content
– Support
K-­‐12
specific
metadata
– Allow
conformance
against
Thin
CC
features
only
• Constraints
are:
– A
CCv1.3
system
should
be
able
to
import/export
Thin
CC
without
change
• Only
Permijed
Content
– Web
Links/URLs
– LTI
Links
12

13. IMS
Validator
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
13

14. CC
Conformance
Program
• Membership
in
the
Common
Cartridge
Alliance
is
the
only
way
to
achieve
official
conformance
to
the
CC.
• Digital
content
or
learning
plaborms
must
exhibit
the
marks
shown
here,
signifying
achievement
of
the
official
conformance
process,
to
be
compliant
with
IMS
Common
Cartridge.
• Products
without
this
mark
are
not
considered
to
be
compliant
by
IMS
Global.
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
14
hjp://www.imsglobal.org/developers/alliance/conformance.cfm

15. CC
Adop7on
• A
wide
range
of
systems
suppor7ng
CC
impor7ng
(read),
expor7ng
(write)
and
rendering
(play)
– hjp://www.imsglobal.org/cc/statuschart.cfm
• ‘Thin
CC’
conformance
soon
• CCv1.4
under
development
by
APMG
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
15

16. Learning
Tools
Interoperability
• To
enable
Remote
Tools
and
Content
to
be
easily
integrated
into,
and
accessed
from,
an
LMS
(not
limited
to
LMSs)
• Several
versions
now
available
to
support
evolving
requirements
• Key
concepts
are
the:
– Tool
Provider
(TP)
and
Tool
Consumer
(TC)
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
16

17. Tool
Proxy
Run7me
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
17
Seongs
Roster
Outcomes
Launch++
Tool
Consumer
Tool
Provider
TC
Admin
TP
Admin
Tool
Secret
Tool
Proxy
Secret
TC
User
IMS Learning Tools
Interoperability (LTI)
Profile
Tool
Profile

18. LTI
&
Common
Cartridge
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
18
L
M
Premium
S
Learning
Content
Common Cartridge
L
M
S
When
LTI
is
combined
with
the
IMS
CC
publishers
can
distribute
cartridges
containing
ac7ve,
authen7cated
links
back
to
centrally
hosted
content.

19. LTI
1.0/1.1
Messaging
Admin
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
Tool Provider
Tool Consumer
1.
URL,
key,
secret
2.
Configure
3.
Click
link
System
Administrator
Teacher
or
Student
Outcomes
service
(read,
update,
delete)
19
Out-­‐of-­‐band
connec7on
Browser
connec7on
Server-­‐to-­‐server
connec7on

20. LTI
1.2
Messaging
Admin
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
Tool Provider
Tool Consumer
1.
URL,
key,
secret
2.
Configure
3.
Click
link
System
Administrator
Teacher
or
Student
Outcomes
service
(read,
update,
delete)
20
Out-­‐of-­‐band
connec7on
Browser
connec7on
Server-­‐to-­‐server
connec7on

21. Learning
Tools
Interoperability
v2.0
• LTIv2.0
is
LTIv1.0
on
steriods!
– Now
a
plaborm
for
suppor7ng
the
en7re
lifecycle
of
a
tool
with:
• Service
discovery
• An
extensible
service
framework
(core+custom)
– Uses
REST/JSON-­‐LD
as
the
binding
form
• An
excellent
tutorial
is
available
at
– hjp://developers.imsglobal.org/tutorials.html#l72
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
21

22. LTI
v2.0
Messaging
Admin
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
Tool Provider
Tool Consumer
1.
Tool
registra7on
4.
Enable
tool(s)
6.
Click
link
System
Administrator
Teacher
or
Student
Tool
22
Out-­‐of-­‐band
connec7on
Browser
connec7on
Server-­‐to-­‐server
connec7on

23. Comparison
of
LTI
Versions
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
23
Feature
LTI
1.0
LTI
1.1
LTI
1.2
LTI
2.0
Comment
Basic
Launch
X
X
X
X
LTI2
reduces
op7onal
data
requirements
Simple
Outcomes
X
X
X
Return
single
numeric
value.
TC
Profile
X
X
Metadata
for
the
TC’s
available
services.
Tool
Proxy
X
Metadata
for
the
TC/TP
interface
contract.
Creden7al
Mangmt
X
Automa7c
secure
exchange
of
key/secret.
Registra7on
Flow
X
TC
ini7ated
new
tool
provisioning.
Model-­‐Driven
Doc
X
X
Tool
generated
docs
from
UML.
REST
Services
X
X
LTIv1.2
limits
REST
to
TC
only.

24. LTI
Conformance
Tes7ng
• The
LTI
Conformance
Test
System
– hjp://www.imsglobal.org/developers/alliance/LTI/cert/
index.php
• Separate
tes7ng
for
the
Tool
Provider
and
Tool
Consumer
• Follow
the
associated
test
script
to
drive
the
predefined
set
of
tests
• See
the
Screencasts
that
describe
how
to
use
the
LTI
Conformance
Test
Systems
– hjp://www.imsglobal.org/developers/alliance/LTI/cert/
demo/
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
24

25. LTI
Adop7on
• Extensive
range
of
LTI
cer7fied
tools
now
available
– hjp://developers.imsglobal.org/catalog.html
• Working
with
the
community
to
move
towards
LTIv2.0
adop7on
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
25

26. • Plug
&
Play
Educa7onal
Apps
and
Content:
Common
Cartridge
and
Learning
Tools
Interoperability
• Interoperable
Assessment:
QTI,
APIP
and
EDUPUB
QTI
• Making
Educa7on
Data
Easy:
Caliper
Analy7cs
• IMS
Standards
in
Ac7on:
EDUPUB
Demonstra7on
&
Development
Community
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
26

27. The
QTI
Specifica7on
• It
is
a
specifica7on
to
support
the
exchange
of
Ques7ons
(Items)
and
Tests
(Assessments)
and
to
Report
the
associated
outcomes.
The
objec7ves
are
to:
– Be
pedagogy
independent
– Support
common
&
esoteric
ques7on
types
– Cover
the
func7onally
‘low-­‐lying
fruit’
– Enable
rich
feature
support
in
the
future
– Support
accessible
content
needs
– Support
summa7ve
and
forma7ve
tes7ng
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
27

28. Historic
Perspec7ve
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
28
Version
Date
Descrip>on
QTIv1.0
June
2000
Original
QTI
release
based
upon
basic
research
by
ETS
and
the
Four
Process
Cycle.
QTIv1.1
Mar
2001
Inclusion
of
new
‘flow’
structure
to
support
block-­‐based
content.
Release
of
QTI-­‐Lite.
QTIv1.2
Feb
2002
Addi7on
of
Results
Repor7ng,
Selec7on
&
Ordering
of
Sec7ons,
Outcomes
Processing
for
Tests.
QTIv1.2.1
Mar
2003
Set
of
correc7ons
to
the
QTIv1.2
release.
QTIv2.0
Jan
2005
New
QTI
Item
model.
Based
upon
XHTML.
Reworking
of
ques7on
structures
using
new
set
of
Interac7ons.
QTIv2.1
Jan
2013
Full
QTI
reworking
to
include
Tests
and
Sec7on.
New
support
for
QTI
Metadata,
Results
Repor7ng
and
Usage
Data
Sta7s7cs.

29. The
Four
Cycle
Process
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
29
Summary
Feedback
Assessment/sec>on
Processing
Presenta>on
Process
Item
Response
Processing
Ac>vity
Selec>on
Process
Item
Level
Feedback
Task/Evidence
Composite
Library
Administrator
Examinee

30. ©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
30
Assessment,
Sec7ons
&
Items
• Assessment
– The
Test,
Quiz,
etc.
• Testpart
– Subtests
• Sec7on
– Groups
of
Sec7ons/Items
• Item
– The
ques7on

31. A
Deconstructed
MC
Ques7on
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
31
• Extensive
range
of
Interac7on
types
• Response
Processing
• Various
levels
of
Feedback
• Response
Processing
Templates
• Outcomes
Processing
• Hints
plus
scoring
implica7ons
• Template-­‐based
Item
construc7on
• Alterna7ve
accessibility
content
• Item-­‐level
rubric

32. The
set
of
Interac7ons
• associateInterac7on
• choiceInterac7on
• customInterac7on
• drawingInterac7on
• endAjemptInterac7on
• extendedTextInterac7on
• gapMatchInterac7on
• graphicAssociateInterac7on
• graphicGapMatchInterac7on
• graphicOrderInterac7on
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
32
• hotspotInterac7on
• hojextInterac7on
• inlineChoiceInterac7on
• matchInterac7on
• orderInterac7on
• posi7onObjectInterac7on
• selec7onPointInterac7on
• sliderInterac7on
• textEntryIntera7on
• uploadInterac7on

33. Packaging
the
QTI
-­‐
I
*
*
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
33
IMS
Content
Package
AssessmentItem
AssessmentSec7on
AssessmentTest
imsmanifest.xml
Folders
Folders
Folders
Assets
• Audio
• Video
• Images
• Tools
• etc.

34. Accessible
Portable
Item
Protocol
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
(APIP)
• To
enable
the
exchange
of
accessibility-­‐enabled
Tests
&
Ques7ons
using
a
common
format
• To
include
support
for
a
wide
range
of
physical
and
cogni7ve
accessibility
needs
• Combines
IMS
QTI
with
the
IMS
Access
for
All
Personal
Needs
&
Preferences
(AFA
PNP)
v2.0
specifica7ons
plus:-­‐
– Extensive
profiling
– Addi7on
of
new
specifica7ons
• APIPv1.0
released
in
May
2012
– hjp://www.imsglobal.org/apip/index.html
34

35. QTI/APIP
APMG
&
Conformance
• QTI/APIP
APMG
responsible
for
the
specifica7ons
and
conformance
• Conformance
against:
– Profile
e.g.
APIP
(more
to
be
added)
– Baseline
Specifica7on
• Conformance
of:
– QTI
Packages
– Authoring
Systems,
Delivery
Systems,
Item/Test
Banks
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
35

36. QTI/APIP
Adop7on
• Several
authoring
systems
have
been
cer7fied
• Race-­‐to-­‐the-­‐Top
Assessment
– An
ini7a7ve
in
the
USA
to
encourage
K-­‐12
in
the
States/Districts
to
adopt
standards-­‐based
online
assessment
($400millions)
– Adop7ng
the
IMS
QTI/APIP
Standard
for
accessible
assessment
interoperability
• Netherlands
Department
of
Educa7on
– Deploying
a
country-­‐wide
schools-­‐level
online
assessment
system
for
assessment
authoring,
delivery
and
results
repor7ng
– Working
with
IMS
to
develop
the
Dutch
DoE
Assessment
systems
conformance
cer7fica7on
process
based
on
QTIv2.2
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
36

37. EDUPUB
IMS
Work
Summary
Ini7al
best
prac7ces
doc
and
code
base
(using
Readium)
published:
hjp://www.imsglobal.org/edupub/index.html
• LTI
enablement
• Caliper
analy7cs
enablement
• QTI
enablement
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
37

38. IMS
EDUPUB
Technology
Context
Student
Information
System
(SIS)
Learning
Management
System
Learning
Management
System
Learning
Management
(SIS)
System
(LMS)
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
(SIS)
ePub Reader
eBook
Analytics
System
Assessment
System
Enrollments
Outcomes
Gradebooks
Timetables Assessment
Outcomes
Scores
Tracking
Tracking
Scores
Outcomes
…
Outcomes
Gradebook
Tracking
Scores
3rd Party
Tools/Apps
38

39. LTI-­‐Enabled
QTI
Approach
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
39

40. EPUB3-­‐Embedded
QTI
Approach
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
40

41. Proposed
Workflow
• Forma7ve
Assessment
(Quiz)
supplied
in
QTI-­‐XML
Package
(reference
form)
• Transform
from
the
QTI-­‐XML
to
the
target
EDUPUB
formats
and
embed
in
EPUB3
• Add
the
JScript
libraries
to
provide
the
run-­‐7me
features
e.g.
naviga7on,
response
processing,
analy7cs
repor7ng,
etc.
• Complete
EPUB3
packaging
and
release
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
41

42. Best
Prac7ces
Doc
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
Using IMS Caliper Analytics™, Question
and Test Interoperability™ and Learning
Tools Interoperability™ with EPUB3TM:
EDUPUB Best Practices
Title: Using IMS Caliper, Question & Test Interoperability (QTI) and Learning
Tools Interoperability (LTI) with EPUB3: EDUPUB Best Practices
Authors: Lisa Mattson (IMS Global, USA)
Colin Smythe (IMS Global, UK)
Stephen Vickers (IMS Global, UK)
Thor Anderson (IMS Global, USA)
Chris Vento (Intellify Learning, USA)
Prashant Nayak (Intellify Learning, USA)
Version: PUBLIC DRAFT
Version Date: 16th June 2014
Release: 1.0
Status: Discussion Document
Summary: This document presents the best practice recommendations for using IMS
Learning Tools Interoperability™ (LTI™), IMS Caliper Analytics™ and
IMS Question & Test Interoperability™ (QTI™) based content within an
EPUB3 context. These form a key part of the EDUPUB standard.
Examples of these best practices are presented using the Readium open
source EPUB3 reader but are generally applicable to other EPUB3 readers
provided they follow the conformance requirements.
© 2014 IMS Global Learning Consortium. All Rights Reserved.
The$IMS$Logo$and$Learning$Tools$Interoperability®$(LTI®),$Accessible$Portable$Item$Protocol™$(APIP™),$Question$
and$Test$Interoperability®$(QTI®),$Common$Cartridge™$(CC™),$AccessForAll™,$Caliper$Analytics™$and$Sensor$API™$
are$trademarks$of$IMS$Global$Learning$Consortium,$Inc.$in$the$United$States$and/or$other$countries.$

43. IMS
EDUPUB
Recommenda7ons
• Ensure
eBook/EPUB3
readers
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
are
IMS
LTIv1.1
compliant
• Ensure
eBook/EPUB3
readers
are
IMS
Caliper
compliant
• Ensure
eBook/EPUB3
readers
become
IMS
LTIv2.0
compliant
• Establish
best
prac7ces
for
using
these
in
EPUB3
publica7ons
43

44. IMS
EDUPUB
Informa7on
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
44
hjp://www.imsglobal.org/edupub/

45. • Plug
&
Play
Educa7onal
Apps
and
Content:
Common
Cartridge
and
Learning
Tools
Interoperability
• Interoperable
Assessment:
QTI,
APIP
and
EDUPUB
QTI
• Making
Educa7on
Data
Easy:
Caliper
Analy7cs
• IMS
Standards
in
Ac7on:
EDUPUB
Demonstra7on
&
Development
Community
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
45

46. IMS
Learning
Analy7cs
• This
is
the
IMS
framework
for
standardizing
the
collec7on
of
learning
metric
data
and
the
dissemina7on
of
learning
analy7cs
informa7on
• IMS
is
concerned
with
learning
analy7cs
interoperability
i.e.
data
collec7on
from
disparate
systems
and
informa7on
repor7ng
to
other
disparate
systems
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
46

47. ©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
47

48. The
Metric
Profiles
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
48

49. Caliper
Events
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
49

50. Sensor
API
Service
Framework
• Different
tools,
apps,
systems
and
content
will
drive
the
local
Sensor
API
• Sensor
API
is
responsible
for:
– Sending
data
to
a
service
end-­‐point
(normally
a
learning
analy7cs
repository)
– Ensuring
the
data
is
protected
during
transmission
– Only
accessed
by
an
authen7cated
service-­‐end
point
• Open
issues
– Offline
usage/data
caching/data
synchroniza7on
– Content-­‐based/tool-­‐based
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
Sensor
API
usage/interac7ons
50

51. Sensor
API
&
Metric
Profiles
• Defining
the
set
of
Caliper
Events
for
some
MPs
• Current
set
of
MPs
being
defined
are:
– Reading
-­‐
reading
textual
content
– Assessment
-­‐
undertaking
a
test
or
quiz
– Annota7on
-­‐
annota7ng
content
– Performance
–
grading/scoring
of
some
content
– Media
–
interac7on
with
video/audio
systems
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
51

52. Caliper
&
LTI
• LTI
launch
of
a
tool
that
supports
the
Sensor
API
e.g.
eBook
reader
• Use
LTI
to
provide
the
key
informa7on
for
the
learning
context
– Supplied
as
LTI
launch
parameters
– Id
for
the
learner,
etc.
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
52

53. Caliper
EDUPUB
Deployment
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
53
ePub
Reader
Widgets
(ePub3)
edu
Apps
(LTI)
edu
App
(LTI)
Learning
Environment
Widget(s)
(ePub3)
edu
App
(LTI)
Analy>cs
Data
Store
Caliper
(Sensor
Endpoint)
S
S
S
S
S
=
Caliper
Sensor
LTI
(Consumer)
LTI
(Provider)
LTI
(Provider)
LTI
Reading
Metrics
(Consumer)
LMS
Metrics
Widget
Metrics
edu
App
Metrics
edu
App(s)
(LTI)
A
=
AuthN
Service
A
A

54. The
Learning
Analy7cs
Repository
• The
digital
repository
to
which
the
Sensor
API
sends
its
data
• Must
support
the
Sensor
API
i.e.
receive
and
store
the
caliper
event
data
• Must
provide
some
of:-­‐
– Analy7cs
algorithms
– Informa7on
visualiza7on
– Informa7on
export/repor7ng
– Repository-­‐to-­‐repository
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
exchange
54

55. Learning
Analy7cs
Repository
API
• This
has
not
been
defined
yet
• May
include:
– Capability
to
read
Sensor
sourced
data
– Capability
to
read
processed
data
– Exchange
data
with
another
LA
repository
• Constraints
are:
– Authen7cated
access
– Permijed
access
to
specific
Sensor
data
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
55

56. Defining
a
Metric
Profile
• Iden7fy
the
learning
ac7vity
• Define
the
set
of
state
diagrams/tables
• Create
the
event
label
vocabulary
• Establish
the
set
of
parameters
for
each
caliper
event
• Define
the
learning
context/descrip7on
informa7on
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
56

57. Caliper
Conformance
Process
• This
is
not
yet
agreed
• Will
be
based
upon
a
tool/app/system/content:
– Sensor
API
‘on-­‐the-­‐wire’
messages
– Confirm
correct
opera7on
specific
MPs
– Require
the
vendor
to
create
test
content
to
drive
the
Sensor
API
to
produce
the
required
set
of
messages
– Sensor
API
messages
logged
at
IMS
Sensor
Conformance
Test
Repository
and
analysed
for
correctness
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
57

58. Caliper
Timeline
• Alpha
release
of
Sensor
APIs
(Sept
2014)
• Alpha
release
of
MPs
(Sept
2014)
• IMS
Quarterly
mee7ng
(Nov
2014)
– Beta
release
of
Sensor
APIs
– Beta
release
of
MPs
– Sensor
API
v1.0
Specifica7on
Public
Draz
– Ini7al
set
of
MP
Specifica7ons
as
Public
Draz
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
58

59. • Plug
&
Play
Educa7onal
Apps
and
Content:
Common
Cartridge
and
Learning
Tools
Interoperability
• Interoperable
Assessment:
QTI,
APIP
and
EDUPUB
QTI
• Making
Educa7on
Data
Easy:
Caliper
Analy7cs
• IMS
Standards
in
Ac7on:
EDUPUB
Demonstra7on
&
Development
Community
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
59

60. EDUPUB
Desk-­‐top
Demonstra7on
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
60
• Desktop
version
of
Readium
• Accessed
using
Chrome/Readium
app
• Standard
Readium
distribu7on
• Only
embedded
Quiz
access
available

61. TAO
QTI
Demonstra7on
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
61
• Using
TAO
Test
Delivery
System
• TAO
hosted
service
• Same
test
as
per
EDUPUB
demonstra7on
• Imported
the
test
as
an
IMS
QTIv2.1
Package

62. ©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
62

63. ©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
63

64. ©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
64

65. ©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
65

66. Caliper
&
EDUPUB
Demonstra7on
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
66
• Using
IMS
hosted
Moodle
• Using
IMS
version
of
Readium
• Same
test
as
per
EDUPUB
local
demonstra7on
• LTI-­‐based
access
to
• Caliper
Repository
• Ques7onmark
remote
test
delivery
system

67. Readium
Codebase
• Readium
is
an
open
source
EPUB3
reader
ini7a7ve
(grew
from
IDPF
but
now
standalone
ac7vity)
• Readium
used
as
our
EPUB3
reader
codebase
(Hosted
service
and
desktop
versions)
• IMS
has
made
a
code
fork
for
the
EDUPUB
work
– LTIv1.0
enabled
(Consumer
and
Provider)
– Sensor
API
enabled
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
67

68. ©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
68

69. ©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
69

70. ©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
70

71. ©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
71

72. ©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
72

73. Making
Adop7on
Easy
• Interoperability
is
a
means
to
the
end
of
improving
learning
impact
• Moving
from
just
specifica7on
crea7on
to
direct
solu7on
support
via
APIs
and
reference
implementa7ons
• IMS
need
more
involvement
from
the
developer
community
to
improve
our
implementa7on
aids
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
73

74. Boot-­‐camps
&
Development
• Bootcamps
– Hands-­‐on
events
on
various
IMS
specifica7ons
– Use
the
various
IMS
test
and
implementa7on
materials
– Work
on
APIs
and
implementa7on
issues
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
74
• Developer
Community
– Community
App
Store
Architecture
(CASA)
– Caliper/Sensor
APIs
– New
community
efforts
to
be
announced
shortly

75. Summary
• E-­‐learning
interoperability
is
one
way
to
improve
learning
impact
• IMS
has
an
extensive
set
of
specifica7ons
released
and
adopted
throughout
the
World
• The
specifica7on
focus
is
now
on
making
it
easier
to
adopt
e.g.
Bootcamps
• The
success
of
IMS
is
heavily
dependent
on
the
Members’
involvement
in
the
IMS
ac7vi7es
and
not
just
paying
the
membership
fee
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
75

76. Ques7ons
&
Comments
©
2014
IMS
Global
Learning
Consor7um,
Inc.
All
Rights
Reserved
76