Three data sets on student experience.

1. Dr Stephen Webb
Head ofTechnology Enhanced Learning, University of Portsmouth
Using digital insights
to drive change at
Portsmouth
23/11/2018
Three data sets on
student experience

2. 0 20
Motivation for running theTracker…
»UoP: initial pilot institution March–April 2016
»But why run it?
23/11/2018 Using digital insights to drive change at Portsmouth 2

3. 0 20
…we need to navigate tricky conditions
23/11/2018 Using digital insights to drive change at Portsmouth 3
Rebrand
New estate
New SRS New website New CRM
New curriculum framework
EVIDENCE © twofortheworld

4. 0 20
Some tips – recognise constraints!
23/11/2018 Using digital insights to drive change at Portsmouth 4
Concerns: are we
over-surveying
our students?
© customer thermometer
Warnings: We must not
get in the way of the NSS
What works for us:
*involve the StudentVoice group
*target L4 students

5. 0 20
Some tips – getting students engaged
23/11/2018 Using digital insights to drive change at Portsmouth 5
Sweets always
help!F2F events with 30
Chromebooks
Students’ Union
involvement
Targeted emails
from AD(S)s

6. 0 20
Some tips – getting students engaged
23/11/2018 Using digital insights to drive change at Portsmouth 6
change the
stats regularly not sure this
is useful!

7. 0 20
Analysis
»Do the stats! In 2016, UoP had 3.5% margin of error…
»Benchmarking – provides valuable sense-checking
»Free text comment boxes hold treasure!
»Newman, Beetham, Knight: nice NVivo thematic analysis
»Iteration 1 ofTracker: analysis was time-consuming
»Iteration 2: I delegated…
»Iteration 3: Jisc templates!!!
23/11/2018 Using digital insights to drive change at Portsmouth 7

8. 0 20
Dissemination
»Danger that a report is
read then buried
»Stakeholders want evidence
– Library / IT are grateful
»Use as many channels as
possible, eg blog +Twitter
»“You said, we did” posters
can be effective
23/11/2018 Using digital insights to drive change at Portsmouth 8

9. 0 20
Acting on insights - 1/5
23/11/2018 Using digital insights to drive change at Portsmouth 9
Response
• student–staff groups to develop
a new Moodle theme – notable
improvement
• student–staff groups to enforce
a template for 2019 – politically
tricky but happening
Insight
• need an improved,
less “clunky”
Moodle interface
• need more
consistent staff
use of Moodle
Note timescales: it’s like changing the course of a ship!

10. 0 20
Acting on insights - 2/5
23/11/2018 Using digital insights to drive change at Portsmouth 10
Insight
need more
consistent use of
lecture capture
Response
student–staff group to scope a
solution (existing approaches
won’t scale)
We are taking the chance to look at content capture more
broadly – the use of BoB,TED, etc in different contexts

11. 0 20
Acting on insights - 3/5
23/11/2018 Using digital insights to drive change at Portsmouth 11
Insight
students (not
surprisingly) want
reliableWiFi
Response
WiFi question in 2016:
65% (±3.5%)
WiFi question in 2018:
82% (±4%)

12. 0 20
Acting on insights - 4/5
23/11/2018 Using digital insights to drive change at Portsmouth 12
Insight
below sector in
terms of guidance/
support for digital
Response
invested resource, eg developed
Learning@Portsmouth site to
support transition

13. 0 20
Acting on insights - 5/5
23/11/2018 Using digital insights to drive change at Portsmouth 13
Insight
• assessment is a
problem area;
students want:
o more online
submission
o fewer
pinchpoints
Response
• have moved to an online-only
submission policy (part of wider
EMA project)
• implementedTESTA
methodology in some depts
• tagging assignments in Moodle
for better reporting

14. 0 20
Dithering on insights
23/11/2018 Using digital insights to drive change at Portsmouth 14
Students complain about teaching style – death by PPT; lack of
interactivity; not knowing where the on switch is…
Should be easy to fix.
Surprisingly hard to change!
Address by team
restructure?
An issue of
digital capability

15. 0 20
Digital capability
»Digital capability: different
Jisc CoP - but linked!
»Secondment of an IT trainer
to work with us to develop
badged Moodle courses on
digital capability
»Implemented Lynda.com
»Building digital capability –
an ongoing issue…
23/11/2018 Using digital insights to drive change at Portsmouth 15
© Jisc

16. 0 20
Focusing effort
»Is focusing our effort paying off? Maybe ... in 2018, 93% of
students rate our digital provision as good or above
»But – by definition we are ignoring some areas:
› learning analytics – we’re behind
› gamification
› teaching spaces
› augmented/virtual reality
› …
23/11/2018 Using digital insights to drive change at Portsmouth 16

17. 0 20
Other benefits of insights
»Peace of mind we are not doing anything crazy!
23/11/2018 Using digital insights to drive change at Portsmouth 17
National Portsmouth

18. 0 20
Other benefits of insights
»A better appreciation that what we think we provide isn’t
necessarily what students experience
23/11/2018 Using digital insights to drive change at Portsmouth 18

19. 0 20
Future plans 1
»Accessibility is a key priority
»Legislation – but also accessible design helps everyone
»Alistair McNaught (Jisc) - an “accessibility snapshot”
»We are implementing Blackboard Ally plug-in
»But I’d like to see us gain more insight around this
23/11/2018 Using digital insights to drive change at Portsmouth 19

20. 0 20
Future plans 2
»We need more insight into the digital experience of our
distance learners (our sample is not statistically
significant)
»We need more insight into the digital experience of our
overseas students (hoping to be involved with the Jisc
TNE pilot)
»We need more insight into the digital experience of our
staff
23/11/2018 Using digital insights to drive change at Portsmouth 20

21. 0 20
Future plans 3
»We need to develop a digital education strategy. Or else…
23/11/2018 Using digital insights to drive change at Portsmouth 21
© RedCoat10