Most organizations struggle to turn their data into a strategic asset. Oftentimes they lack the data they need, and don’t trust the data they have. This results in a struggle to surface meaningful opportunities, quantify the value of those opportunities, and transform insight into action. In this webinar, your host Tom Burton shares strategies for improving data literacy, ensuring data quality, and expanding data utilization.
This interactive, “choose your own adventure” style experience, allowed attendees to discover how investing in a deliberate, principle-based strategy can help them navigate the complexities of data governance and maximize the value of data for outcomes improvement.
View the webinar and learn:
- Demonstrate how to unleash data at your organization with efforts across the improvement spectrum.
- Recognize how to sustain and spread improvements across your entire organization.
- Illustrate the importance of investing in analytics training and infrastructure to prepare for massive improvement in healthcare outcomes.
- Understand the 5 key stages of the Data Life Cycle.
- Demonstrate strategies to overcome the common challenges around data quality, data utilization, and data literacy.
- Show how a data governance framework can accelerate improvement in clinical, cost, and experience outcomes.
5. • Lack of data skills, knowledge
and attitudes
• Wrong mix of resources (e.g.
too many report writers not
enough analytic engineers)
• Lack of interoperability
• Lack of contextual training
causes incorrect interpretation
/ conclusions
• Fear of loss of privacy
prevents appropriate
utilization for improvement
• Culture of data fiefdoms –
that’s “our” data
• Data capture is incomplete,
delayed, or inaccurate
• Consolidating to a single
EMR can take too much time
and money
• Integrating data into fixed
models from different sources
is error prone
Data Driven Culture
• Data is not driving better
decision making
• Data infrastructure is seen
as an expense not an asset
The Data Life Cycle
5
7. Elevate the status of data
as a strategic asset of
your organization
What would make your
data a distinguishing asset
of your clinical and
business objectives?
Build your data
governance org
structure
Who are the best
individuals and how
should you organize to
realize the vision?
Identify, prioritize and
execute on data
governance improvements
in the data lifecycle
How do you ensure all are
equipped with data for better
decision making – from the
bedside to the boardroom?
How do you ensure
your data investments
are built to last?
Sustain and extend
the initial gains
Elevate Establish Execute Extend
Data Governance Framework: The 4 E’s
7
8. Overview – 10 min
• Core Data Governance
Principles – 25 min
• Advanced Data Governance
Principles – 25 min
• Conclusion – 5 min
Agenda
13. Deliver Insight
Principle:
Identify opportunities and insights across
the spectrums of value and effort
(typically performed by an analytics
engineer or outcomes analyst)
Data-driven opportunity:
Identify variation with
key process analysis for
deep improvements
Pain-point opportunity:
Identify data hunger
pain points where self-
service may be helpful
13
14. Organic Improvement
Let innovation happen - Light Effort
Fast track Improvement
Medium Effort
Comprehensive outcomes
High Effort
Value Across the spectrum of improvement effort, the value may be light, medium, or high value.
Enablers Highly trained and engaged team members and a robust analytics infrastructure (both platform & applications)
Volume
1,000s of day-to-day better data driven
decisions
100s of quick win improvements using data
10s of deep changes, eliminating unwarranted
clinical, operational and/or financial variation
Examples
• 2 hour ad-hoc analysis by senior analyst
reveals insight that expanding clinic hours,
versus building an observation wing, will save
$3Min capital expense.
• Automated dashboard saves 4 hours of
manual data collection/reporting per week.
• Data helps clinicians identify high maternal
hypertension rates; insights + interventions
results in 15% improvement in hypertension
rates.
• Dashboard helps identify missing
documentation on high dollar accounts,
improving AR days by 10%.
• Deep process redesign, leveraging
predictive models, reduces sepsis mortality
rate by 15%, saves 125 lives per year, and
reduces costs by $1.6 M.
• Redesigning care management workflow
using mobile technology increases care plan
effectiveness by 28% and saves $3.4 M.
Sample Results
Measures
Technology utilization, number of lives impacted/saved, intervention rates, number/percent improvement, additional revenue, cost savings, cost
avoidance…
Sample
Communications
Vignettes, improvement snapshots, case study briefs, case studies, webinars, publications…
Unleashing Data to Achieve Massive Improvements
1414
15. Financial Value
Clinical Value
Experience Value
X
Effort
High
Light High
Value Improvement Type
Self-service
dashboards
Key process analysis
– variation analysis
The Improvement Spectrum Matrix – Value
and Effort
15
17. • Access to content enabled
through a security model
endorsed by senior
leadership
• Provisioning process well
defined and
operationalized
Broadly Accessible
Data
• Analytic tool capabilities
support what end users
are trying to do
• Analytic community has
the ability to share and
distribute content
Analytic Toolset
Alignment
• Teams are provided
education on the core
capabilities to support
their use of the data
• Support function available
to answer and direct
questions
Training & Support
• Continuants understand
what is available, what is
changing, and what is
coming
• Value being delivered by
the platform is
consistently and broadly
being messaged
Communication
• Individual or group is on point to grow analytics capabilities
• Ensure evolving roadmap aligns with business/clinical priorities
Analytics Leadership
The Prerequisites of Organic
Improvement
Self-service
dashboards
17
25. Run a Large Process with Significant Variation
through some Data Life Cycle Questions
Do we have all the data we need
to ideally manage this process?
Is some data missing or
inaccurate?
Have we integrated clinical,
financial and experience data
together?
Do those making decisions have
access to ALL the data that could
promote the best decisions?
What insights could be
presented at the right time in
the workflow to encourage
better decision making?
Do we measure how well we act?
What % of the time are achievable
benefits not achieved?
25
Return to Core Principles
33. Integrate Data Gartner: Health Data
Convergence Hub
“Definition: The health data convergence hub is the orchestration platform
that brings together data from across the consumer/citizen/patient health
and wellness continuum and prepares the data for delivery to downstream
consumption platforms, applications, analytics and "things." It automates
the ingestion of data — both structured and unstructured — from all
identified and permissioned sources; provides tracking and traceability; and
manages identity, compliance and security. It may process algorithms and
deliver the output to the correct modality.”
- Laura Craft, Vi Shaffer, “Gartner: Hype Cycle for Healthcare Providers, 2017”
33
52. Governance Framework
Advanced Principle:
Increase strategic coordination by appointing
a Chief Analytics Officer (CAO) who is tightly
connected to improvement governance to
lead data governance
52
55. 1 2 3 4 5 6 7
Analyze the
Opportunity
and Define the
Problem
Scope the
Opportunity
and Set Goals
Explore Root
Causes and
Set Process
Aims
Design
Interventions
and Plan Initial
Implementation
Implement
Interventions
and Measure
Results
Monitor,
Adjust, and
Continually
Learn
Diffuse and
Sustain
Is it an adoption
problem?
Are data valid?
Do we need to
adjust
our interventions?Do we need
to reevaluate
root cause?
Start with a directive from executive leadership based on high-level opportunity analysis and readiness assessment
55
The Seven Essential Elements of Improvement
75. Defines
Find, develop, and retain the
right people and get them in the
needed right seat so they and
the organization can be
successful
Needed Competencies (KSCs)
• Knowledge
• Skills
• Character
Performance Metrics
Talent (The best of the best)
Systematic Process
(Continuous Improvement Flywheel)
Learning Flywheel (Mentor Based)
Informs
7
LEARNING
EXPERIENCES
AND RESOURCES
LEARNING
ASSESSMENTS
COMPETENCIES
(KSCs)
75
79. Diffusion of Innovation
Change Agents Are Typically Early Adopter SMEs
innovators
early
adopters
early
majority
laggards
(never adopters)
* Adapted from Rogers, E. Diffusion of Innovations. New York, NY: 1995.
late
majority
Innovators. Recruit
innovators to re-design
care delivery
processes
TheChasm
N = number of individuals in group
N
N = number needed to influence group
(but they must be the right individuals)
Early adopters. Recruit early adopters to
chair improvement and to lead
implementation at each site.
(key individuals who can rally support)
79
84. Readiness Assessment
• Quickly asses readiness with on-line surveys. (e.g. use something like survey monkey or Health
Catalyst provides a free on-line Outcomes Improvement Readiness Assessment at
https://oira.healthcatalyst.com
• As you focus in on specific initiatives spend the time to interview key stakeholders of the most
important improvement initiatives and assess capability, capacity and willingness.
84
85. Example Stakeholder Analysis
STAKEHOLDER IMPACT IMPORTANCE MATRIX AREA
(see Stakeholder Matrix)
Current HEAT
Projected
HEAT
Projected HEAT
Name of functional
role/group affected by the
change
Degree of impact
on this stakeholder
Level of
stakeholder's
influence on the
success of the
change
Where do they land
on the stakeholder
matrix?
Today
After CEO Email
goes out
After the details
of the role changes
are shared
SVPs (SEL) significant medium a. KEY PLAYER productive zone productive zone productive zone
SVPs (IL) significant high a. KEY PLAYER overwhelmed overwhelmed overwhelmed
EL significant medium a. KEY PLAYER underwhelmed productive zone productive zone
STDs significant high a. KEY PLAYER underwhelmed overwhelmed overwhelmed
TDs significant high a. KEY PLAYER underwhelmed productive zone productive zone
SDAs / DAs
(Tech Ops Pool)
significant high a. KEY PLAYER underwhelmed underwhelmed overwhelmed
Domain Experts (IL) significant high a. KEY PLAYER underwhelmed overwhelmed overwhelmed
Analytic Dirs (IL) significant a. KEY PLAYER underwhelmed overwhelmed overwhelmed
SDAs / DAs (IL) significant high a. KEY PLAYER underwhelmed underwhelmed overwhelmed
Analysts (Prod Dev) significant a. KEY PLAYER underwhelmed underwhelmed overwhelmed
Leadership Team moderate high a. KEY PLAYER overwhelmed overwhelmed overwhelmed
HR minor or none medium c. keep informed productive zone productive zone productive zone
Finance - FPA moderate medium a. KEY PLAYER underwhelmed productive zone productive zone
Accounting moderate Low c. keep informed underwhelmed productive zone productive zone
Marketing minor or none Low c. keep informed underwhelmed productive zone productive zone
Customers moderate Low d. Keep satisfied productive zone underwhelmed productive zone
Identify Champions
to represent large
groups.
Keep Satisfied
Meet Their Needs
Key Player
Manage Closely
Monitor
Minimum Effort
Keep Informed
Show Consideration
Low High
High
Low
Interest of Stakeholders
Power/Influence
ofStakeholders
85
87. Women & Newborn Guidance Team - Prioritization
Structure Typically Needed for Deep Effort Improvements
• Meet quarterly to prioritize allocation of
technical staff
• Approves improvement AIMs
• Reviews progress and removes road
blocks
OB NewbornGYN
Women & Newborn Guidance Leadership Dyad:
1) MD Clinical Program Director 2) Administrative Director
Domain Leadership Dyads:
1) MD Lead & 2) RN Lead
SME
Data Steward
Analytics
Engineer
Analytics Team covers
entire guidance team
Financial
Analyst
Small Teams - Innovation • Integrates Data from all relevant sources
• Meet weekly in iteration planning meeting to identify improvement opportunity and insights
• Build DRAFT processes, metrics, interventions & presents DRAFT work to Broader Teams
• Grants access of analytic assets to broader team
Domain Leadership Dyad
+ Analytics Team
OB Workgroup
Broad Teams – Adoption
• Broad RN and MD representation across system
• Meet monthly to review, adjust and approve DRAFTs
• Act as change agents to lead rollout of new process and measurement
Guidance Leadership Dyad
+ Domain Leadership Dyad
+ Analytics Team
+ Clinical representation from across system
*All resources serve in these improvement roles part time ranging from
5% (MDs) to 50% (Analytics Engineer) of their time87
Return to Advanced Principles
98. Funding Improvement Work:
Balancing Value Mix Helps Fund
Clinical & Experience Improvements
As your governance team
prioritizes improvement initiative
make sure that the projected
hard $ cost savings can fund
the improvement efforts required
across all value types
IDEAL: Even spread across the Improvement Spectrum Matrix
98
99. Note: For green arrows,
savings from waste
elimination accrue to
the care delivery
organization; for red
arrows, savings go to
payer organizations.
Case-rate utilization
(# cases per population)
Within-case utilization
(# and type of units per case)
Efficiency
(cost per unit of care)
FFS
Per
case
Provider
at risk
WASTE REMOVAL
LEVEL
PAYMENT METHOD
1.
2.
3.
% of all
waste
45%
50%
5%
*James Brent C and Poulsen Gregory P. The case for capitation: It’s the only way to cut waste
while improving quality. Harv Bus Rev 2016; 94(7-8):102-11, 134 (Jul-Aug).
Experts Estimate $1 Trillion of Waste in Healthcare*
Financial incentive alignment under different
payment mechanisms
99
100. Case-rate utilization
(# cases per population)
Within-case utilization
(# and type of units per case)
Efficiency
(cost per unit of care)
1.
2.
3.
% of all waste
45%
50%
5%
Waste class
a) Inappropriate cases (risk outweighs benefit)
(e.g., many cath lab procedures; CTPA)
b) Preference-sensitive cases
(when given a fair choice, many patients opt out)
(e.g., elective hips, knees; end-of-life care)
c) Avoidable cases(hot spotting; move upstream)
(e.g., team-based care)
Waste subclasses
a) Supply chain
b) Administrative & Technical inefficiencies
(e.g., regulatory reporting burden; redundant manual reporting;
current EMR function; billing/rev cycle thrash; long patient wait times)
a) Clinical variation
(e.g., QUE studies; surgical equipment)
b) Avoidable patient injuries
(e.g., serious safety event systems; CLABSI)
Examples of Removing Waste
100
101. Types of Best Practice Knowledge Assets
Admits/1000 members
IP days/1000 members
OP visits/1000 members
Procedures/1000 members
ED visits/1000 members
Readmissions/1000 members
Utilization
Who should
get the care?
Cost/case
Cost/procedure
OR minutes
L&D minutes
Other LOS
Order Sets
Clinical
Support
Workflow
Cost per case
Nursing hours by unit
OR minutes
L&D minutes
Cycle times
Cost per ancillary test
Environmental services
What care
should be
included?
How can care
be delivered
efficiently ?
Indications for Intervention
Diagnostic algorithms
Indications for Referral
Triage Criteria
Treatment and Monitoring
Algorithms
Health Maintenance and
Preventive Guidelines
Standardized Follow-up Checklist
Post-acute care order sets
IP (SNF, IRF)
Home health, Hospice
Clinical Ops Procedure Guidelines
Knowledge
Asset Type
Substance Selection Clinical Supply Chain
Management
Admission Order Sets Supplementary Order Sets
Pre-Procedure Order Sets
Post-procedure Order Sets
Bedside Care Practice Guidelines
Discharge Checklist
Patient Injury Prevention Protocol
Risk Assessment
Transfer Checklist
Question to
ask
Examples Possible Measures
Administrative
Support
Workflow
How can
administrative
operations be
performed
efficiently ?
AR Escalation Process
Network Design Process
Recruiting/Onboarding Process
AR Days
% out of network utilization
% Turnover
Team member
satisfaction/engagement
AR Escalation Process
Budgeting Process
Supply Chain Procurement
101
102. = Negative Impact = Positive or Negative = Positive Impact
Knowledge Asset
Type
Discounted
FFS
Per Diem
Per Case Bundled Per Case
Condition
Capitation
Full
Capitation
CMS Commercial CMS Commercial
Financial Alignment AND Best Practice
Operational Workflow
Diagnostic Variation
Standing Orders
Substance Selection
Triage Criteria
Patient Safety
Treatment and Monitoring
Algorithms
Indications for Referral
Indications for Intervention
Administrative Workflow
Case-rate
utilization
(# cases per population)
Within-case
utilization
(# and type of units per
case)
Efficiency
(cost per unit of care)
FFS Per case Provider at risk
102
107. ExtendExecuteEstablishElevate
Data Governance Framework: The 4 Es
evate
Elevate the status of data
as a strategic asset of
your organization
What would make your
data a distinguishing asset
of your clinical and
business objectives?
Build your data
governance org
structure
Who are the best
individuals and how
should you organize to
realize the vision?
Identify, prioritize and
execute on data
governance improvements
in the data lifecycle
How do you ensure all are
equipped with data for better
decision making – from the
bedside to the boardroom?
How do you ensure
your data investments
are built to last?
Sustain and extend
the initial gains
107
108. Essential Elements for Improving a Process
Each key
process has an
embedded data
lifecycle
108
111. Governance Framework
Advanced Principle:
Increase strategic coordination by appointing a
Chief Analytics Officer (CAO) who is tightly
connected to improvement governance to lead
data governance
Advanced Principle:
Assess and prioritize data governance initiatives
by the three common challenges: Data Literacy,
Data Quality and Data Utilization
111
112. Capture
Advanced Principle:
Improve Data Quality (timely,
accurate, complete) at the
source
Advanced Principle:
Identify meaningful data to
capture beyond the EMR, which
will improve decision making
Advanced Principle:
Capture the data needed to
manage and improve processes
in the most efficient way possible
112
114. Grant Access
Principle:
Trust AND verify – grant broad access but audit
Advanced Principle:
Establish streamlined Data Access processes
114
115. Deliver Insight
Principle:
Identify opportunities
and insights across
the spectrums of
value and effort
Advanced
Principle:
Promote better
decisions with the 5
rights of data
delivery
Advanced
Principle:
Deliberately hire
and train for Data
Literacy
Advanced
Principle:
Adopt a hub-and-
spoke structural
strategy
115
116. Action
Principle:
Use improvement governance to encourage a
data-driven culture
Advanced Principle:
Measure cost, quality, and experience outcomes
in conjunction with measuring data utilization
116
Tom’s Notes
“The Data Maze Game is designed to teach you how to use data as a strategic asset in outcomes improvement work. This is a collaborative game, where teams work together as a table to uncover the most improvement opportunities.”