The ‘Measuring the Business Impact of Learning’ benchmarking survey, conducted by LEO Learning and Watershed (on behalf of Learning Technologies Group) is entering its fourth year. With the survey launching on November 1st and closing on December 13th, LEO Learning and Watershed are holding a webinar to reflect on the results so far, plus discuss how organizations they’re working with have overcome the barriers in measurement planning and implementation. The insights are drawn from their group experience working with a range of clients in this field and should be valuable for anyone who wants to get going in learning analytics and sustainable business impact assessment.
Join your hosts as they cover the state of the world of measurement, and you’ll receive:
An understanding of how well-known organizations have overcome the barriers in measurement planning and implementation.
Real-world examples of how to get management buy-in, designing for data, building data ecosystems, implementing a learning analytics strategy and more.
The opportunity to take this years ‘Measuring the Business Impact of Learning’ survey, and see the results coming in live!
MEASURING THE BUSINESS IMPACT OF LEARNING: WHAT WE’VE LEARNED
The presentation will begin at the top of the hour.
A dial in number will not be provided.
Listen to today’s webinar using your computer’s
speakers or headphones.
Welcome to the webinar!
Tools You Can Use
– A dial in number will not be provided.
– The audio will stream through your
headphones or computer speakers.
– Also check your computer’s volume for
external speakers or headsets.
Questions and Handouts
You can submit questions by clicking on
this icon here.
Download a PDF of the slides here.
1. May I receive a copy of the slides?
YES! Click on the handouts located on the right portion of
2. May I review the webinar recording at a later date?
YES! You may log in again using today’s link to review the
3. Is this webinar HRCI or SHRM certified?
YES! The HRCI and SHRM certification codes will be sent in
the follow up email.
Frequently Asked Questions
Learning Design Director
Measuring the business impact of
learning: What we’ve learned
Director of Strategy
Chief Strategy Officer
Learning Technologies Group
The state of
Biggest barriers to
Practical steps to
in a nutshell
Barriers to measurement:
Getting buy in Getting Data
But First: Remember measurement is ongoing & iterative
Watershed Method for Learning
Categories of analytics
Complexities of analytics
Start with what you can control.
I don’t know how to get started.
What do people
need to learn?
What do people
need to do?
Was the goal
Getting Started: Link design to measurement
How In Practice: Get your team to understand
Develop a bespoke
Upskill the trainers
to operate as
first in the design
Building internal measurement capability
• Clarify the business goals
• Define the business objectives
• Create a business impact action plan
• Identify the business
• Write the learning
• Specify the learning outcomes
• Identify the learning data
• Refine the measurement
• Identify whether the required data can
• Baseline the data
• Design how the data will be displayed
• Pilot the learning
• Gather the business and learning data
• Check the quality of the data and
move to full roll-out
• Explore the business and
learning data for insights
• Report back on initial findings
and improve training
• Develop a deep
understanding of the
business performance gaps
• Create a draft
• Modify programme /
manage learners as
Getting Started: Map out your ecosystem
current tools and
Choose an area to
test your new
It’s easier than you think
1 2 3
There was a 2% sales lift during
the four-week period when video and
assessment were used as planned.
Show them what it could look like.
Competing Priorities: How to get budget and time?
Getting Buy-In: Define a strategy
Key components of a measurement strategy
The chain of evidence
Engagement Learning Behaviour Results
Measurement – sources of evidence
• Portal/learning visits and
behaviour data (which
courses, by whom, for
• Star rating
• User Surveys
• Learner voice
• User acceptance
• Annual staff survey
• Individual 360
• Survey of departmental
K, S, A
• Upfront diagnostics
• Post intervention Online
& after 3 months)
• Marked work (essays,
• Peer assessment
• Confidence measure
taken after every
• User surveys
• Manager surveys
• Interviews (in
• Surveys of coaches and
• User observation
• Service user feedback
(net promoter score)
• Activity monitoring
• Use of learning journals
• Business Metrics & KPIs
• Profitability, Growth,
• Improved staff retention
• Faster turnaround times
• Money saved by new
• Money saved by
Getting Data: Ask for help
Get the best team
round the table
○ Design for data
○ Start small, test and learn
○ DIY: Learn about it yourself
Get Buy in
○ Define a measurement strategy
○ Map out your ecosystem/what’s available to you already
○ Align vendors and tools for long term success
○ Ask for help