These slides use concepts from my (Jeff Funk) course entitled analyzing hi-tech opportunities to analyze the increasing economic feasibility of wearable electronics in health care applications. Rapid improvements in sensors, integrated circuits, transceivers, displays, mobile phones, and wireless networks are causing the cost to fall and the performance to rise for wearable applications. These slides analyze hand, head, and body worn electronics in detail including smart watches, wrist and finger devices, smart glasses and textiles, patches, and foot and arm wear. They also analyze a wide variety of sensors for collecting healthcare information including inertial, bio, chemical, and haptic sensors.
2. AGENDA
I. Introduction
II. Data Collection
III. Data Processing
IV. Data Display
V. Impact on Healthcare
VI. Is success of wearables possible ?
VII. Conclusion
3. I. INTRODUCTION
Wearables are small electronic devices, often consisting of one or more
sensors and having computational capability. They play an important
role in healthcare monitoring, analyzing and even healing.
6. WEARABLE ELECTRONICS BY USE
Wearable Electronic Devices
Hand Worn
Smart Watch
Wrist Wear
Finger Wear
Head Worn
Smart Glasses
HMD / HUD
Body Worn
Smart Textile
Wearable Patches
Foot and Arm
Wear
Apple
Samsung
Jawbone
Google
Optinvent
OMsignal
Intel
7. § Fitness and health tracker
§ IntelligentM Bracelet (how well you wash your hand)
§ Wearable computers
§ Amon
§ Watch
§ Pebble Smartwatch
§ Martian Notifier Smartwatch
§ Apple watch
§ Samsung gear
§ Wristband
§ MIT Wristband
§ The Tactilu Bracelet
HAND WORN
Wristband
Watch
Wearable
computer
Hand Worn
8. § Smart glasses
§ Google Glasses
§ Vuzix
§ Optinvent ORA
§ Buhel
§ Medical headsets (EEG)
§ Breathing masks
§ Brain-sensing headband (Muse-InteraXon)
§ Communication helmets
§ O.R.B
HEAD WORN
9. BODY WORN
§ Smart textile
§ Smart T-Shirt with integrated sensors (fitness trackers)
§ Smart armband (Myo)
§ Safety baby worn blanket (Philips)
§ Foot and Arm wear
§ RunScribe
§ Wearable Patches
§ E-skin
10. COMPONENTS OF WEARABLES
Sensors Inertial
sensors Biosensors
Other sensors
(Haptics…)
Connectivity Bluetooth WiFi GPS
Battery Conventional Flexible
battery
Energy
harvesting
module
Interfaces Speech
recognition
Haptics /
Touch
recognition
Gesture
recognition
Non-invasive
Interfaces
Materials /
Algorithms
Electronic
textiles and
joints
Flexible
displays
Accurate
interpretation
of measured
data
11. RATES OF IMPROVEMENT
Next generation of Wearable devices
Batteries are the bottleneck
Change in the architecture and power usage of ICs to make them more efficient
Source: http://www.newelectronics.co.uk/electronics-blogs/powering-wearables-and-giving-batteries-a-better-life/64664/
12. DATA COLLECTING
Inertial Sensors
ü To monitor body movements
Bio-Sensors
ü To monitor heart rate
ü Cholesterol
ü Sweat
Haptics
ü To enhance touch experience
13. INERTIAL SENSORS
TO TRACK BODY MOVEMENT
Accelerometers and gyros
ü Continuous real-time
data recording
ü Accurate
ü Body angles
ü Angular acceleration
14. INERTIAL SENSORS
TO TRACK BODY MOVEMENT
Integrated Motion tracking
Remote patient
monitoring
Patient’s
motion
data
Doctors
and
Physician
InvenSense’s Motion Tracking device
² 6 axis
(3-axis accelerometer)
+
(3-axis gyroscope)
² 9 axis
(additional 3-axis ecompass)
Source: http://www.invensense.com/mems/wearablesensors.html
16. OPTICAL SENSORS
TO MONITOR HEART RATE
ü Acceptable accuracy for over than 15 min use
ü Commonly used in wrist bands
Wearble Sensors, ISBN: 978-0-12-418662-0
good
accuracy
17. BIO-SENSORS
TO MEASURE CHOLESTEROL
Electrochemical
ü Electrochemical are considered
to be the most important
cholesterol biosensor
ü Based on enzymatic catalysis of
a reaction
ü Low response time
ü High sensitivity
ü Low cost and low power required
Optical
ü Employs an optical fiber as a
platform for the biological
recognition element
ü Involves diffusion of analytes
ü Higher response time
ü Good sensitivity
ü High cost and high power required
18. PERFORMANCE OF
ELECTROCHEMICAL VS OPTICAL
Electrochemical sensors seem to dominate pertaining the performance
Source: http://www.slideshare.net/Funk98/cholesterol-bio-sensors-getter-better-fast
19. NON-INVASIVE ASSISTIVE INTERFACES
ü Brain computer interface vs. Tongue control
interface
ü Tongue computer interface might be better ?
Mean responsibility of correct choices
Information transfer rate (bits per min)
Source: Wearable Sensors, ISBN: 978-0-12-418662-0
Table: Comparison between the Tongue Drive System and
other BCIs/TCIs*
Type Number of
Commands
Response Time
(s)
IRT (Bits/min)
EEG-BCI 2 - 4 3 - 4 25
TTK-TCI* 9 3,5 40
TCI*-1 5 2,4 58
TCI*-2 6 1 95
* TCI Tongue Computer Interface
20. SWEAT SENSOR
ü Used in wearable textiles
ü Considerable
improvements required
Graph: Textile humidity sensor (upper left) and its calibration
curve compared to a commercial humidity sensor
Source: Wearable Sensors, ISBN: 978-0-12-418662-0
21. HAPTICS
TO ENHANCE TOUCH EXPERIENCE
ü Enables virtual reality
ü Weight illusions based on fingertip deformation
ü Sensorimotor enhancer improves tactile sensitivity in human fingertips
Source: Wearable Sensors, ISBN: 978-0-12-418662-0
Graph: Desired and measured eccentricity
23. DATA PROCESSING
Internal Processing
ü Data is processed within the wearable
ü Higher battery consumption
ü Efficient algorithms required
External Processing
ü Data sent to another device or cloud
ü Data processing on another device
ü Could use higher computational capabilities
24. PROCESSOR UNITS
Apple processor unit for healthcare and fitness data processing:
ü Embedded accelerometer, gyroscope and compass
ü Online process of motion data
ü Analysis of motion-related healthcare problems
ü Tested in IPhone 5 and will be used in Apple watch
25. PROCESSOR TRENDS
ü Performance
ü Power consumption
ü flexibility
Past trend Future trend
Source: “Wearable biosensing: signal processing and communication architectures issues” P. Cleka, R. Vetter, J. Telecom. Info. Tech, 2005
26. FIRST GEN OF WEARABLE PROCESSOR
Ineda systems
Hierarchical CPU
ü Devised for wearable
electronics
ü Nano: always on
ü Low power consumption
ü Support more
sophisticated display
and input requirements
27. ALGORITHMS
Noise reduction !
Source: “Wearable biosensing: signal processing and communication architectures issues” P. Cleka, R. Vetter, J. Telecom. Info. Tech, 2005
28. ALGORITHMS FOR SPEECH RECOGNITION
ü Reasonable accuracy
ü Better algorithms are being developed
Wearble Sensors, ISBN: 978-0-12-418662-0
29. ALGORITHMS FOR GESTURE RECOGNITION
ü Good precision for higher samples
ü Well established algorithms are currently available
Source: Wearable Sensors, ISBN: 978-0-12-418662-0
30. ALGORITHMS FOR EEG AND ECG
Algorithms for EEG and ECG
ü High sensitivity
ü Accurate
ü Power performance
ü Detection rate
Source: Wearable Sensors, ISBN: 978-0-12-418662-0
31. CONNECTIVITY
Bluetooth v4.0 includes Bluetooth low energy marketed as “Bluetooth smart”
80
70
60
50
40
30
20
10
0
2012 2013 2014 2015 2016 2017 2018
% with Bluetooth low power chips
all wireless sports and fitness monitoring devices
(according to IMS research)
>70%
Source: http://www.nordicsemi.com/eng/News/ULP-Wireless-Update/Health-improvements-by-the-numbers
32. INTERNAL VS. EXTERNAL PROCESSING
Internal
ü Devices with low
computational requirements
ü High performance to size ratio
of processors
ü Connectivity is poor
ü Processing is essential to display
results
Ex: Smart Watch
External
ü Devices with higher
computational requirements
ü Existing processor capabilities
are enough
ü Connectivity is not a
bottleneck
ü Internal processing is not
essential
Ex: EEG devices
HYBRID devices ?
33. DATA DISPLAY
Internal Display
ü Data displayed in the device or projected
somewhere
ü Flexible display and electronics desired
ü Larger wearables
External Display
ü Data displayed in another device (E.g. Phones,
tabs)
ü Existing display devices are sufficient
ü Smaller wearables
34. FLEXIBLE DISPLAYS
ü Better materials need to be discovered
ü Low stiffness, low thickness, better resolution are desired
ü Production costs are falling
http://www.displaysearch.com/cps/rde/xchg/displaysearch/hs.xsl/140716_amoled_mobile_phone_panel_costs_expected_to_fall_below_lcd.asp
35. FLEXIBLE ELECTRONICS
ü Flexible electronics would be very important
ü Strain vs. performance of transistor is an indicator
Wearble Sensors, ISBN: 978-0-12-418662-0
36. INTERNAL VS. EXTERNAL DISPLAY
Internal Display
ü Devices with minimum
information to be displayed
ü Devices that can project data
ü Connectivity is poor
ü Larger size is desirable
ü Improvements in flexible, thin
display systems
ü Improvements in flexible
electronics also necessary
Ex: Wrist Bands
External Display
ü Devices that need detailed
analysis of data
ü Connectivity is good
ü Existing display systems are
sufficient
ü Smaller size is desirable
Ex: Medical Devices
Hybrid systems likely to be used mostly!
37. IMPACT ON HEALTHCARE
q Fitness tracking and improvement
q Management of hospital organization
q Personal drug dosage tracking
q Tele-medicine
q Rehabilitation
q Healthcare Big Data
38. FITNESS TRACKING AND IMPROVEMENT
Hand-worn
and body-worn
• Jawbone, Apple watch,
Polo Tech Shirt
Tracking
• Personal physiological and
biological parameters, activity
and performance
Data
collected
• Heart rate, stress, obesity,
sleep, calories, 02 saturation,
blood pressure
Virtual
coaching • Apps
39. RUNSCRIBE
A small 9-axis sensor
Uploaded via Bluetooth to your
devices
Data stored locally
Measures 13
kinematic
metrics
pace Impact
Attached to the
heel of any shoe
Gs
Braking
Gs
Pronation
excursion
Pronation
velocity …
Weight
15 g
40. MILLION KG CHALLENGE
Application: Million Kg Challenge
ü 80,000 signed up
ü 42,000 pledging to lose weight
ü 6,000 lost overall 20,000 Kg in 6 months
Apps
§ iDAT
§ MyFitnessPal
§ RunKeeper
§ LoseIt
Wearable fitness trackers
§ Jawbone Up24
§ Withings Pulse O2
§ Samsung Gear Fit
§ Nike+ FuelBand SE
§ Garmin Forerunner 15
§ Apple Watch (available 2015)
41. MANAGEMENT OF HOSPITAL
ORGANIZATION
Collecting
ü Continuous tracking of physiological data
ü Hand, head & body-worn
ü Sterility
Processing
ü Identify priority patients according to their needs
ü Better diagnosis
Display
ü Efficient staffing of nurses and doctors
ü Avoid useless displacement of staff
ü Efficient drug and equipment management
ü Assisting doctors in operating rooms
basis
42. PERSONAL DRUG DOSAGE TRACKING
Wearable drug reminding devices
ü Haptic, visual or sound drug reminder
ü Drug taking devices for the elderly
Wearable tracking and healing devices
ü Insulin monitoring – direct injection by the wearable
ü Baby care – fever, pain, antibiotics…
Insulin Nano-pump
with MEMS
Apps to remind you
when to take your pills
Sproutling wearable
baby monitor
43. TELE-MEDICINE
Local and International applications
ü Health information technology
ü Distant and early diagnosis
ü Emergency tele-medicine
ü Health assistance to third world countries
ü Tele-medicine for soldiers on the battle field
Tele-medical services
ü Tele-pharmacy, Healthcare delivery
ü Tele-radiology, tele-cardiology
ü Tele-psychiatry
ü Tele-nursing
44. REHABILITATION
Handicapped people
ü Physical activity tracking to evaluate improvement –
better identification of physical weaknesses
ü Optimized HCI control – Voice control, non invasive
tongue control…
ü Sensors to compensate the loss of sight or speaking
ü eLEGS to help paraplegics to walk
The Elderly
ü Posture tracking to avoid falling
ü Retirement houses: better accommodation to
wearable computing
46. HEALTHCARE BIG DATA
Large pool of data
about health population
Aggregate data from
wearables with other health
information
Bring together people
with a common interest
such as weight loss
Create a community
Build engagement and
compile information
Complete and essentially real-time data to treat
and manage the health of individual patients
Opens up Entrepreneurial Opportunities
www.healthcaredatasolutions.com
47. IS SUCCESS OF WEARABLES POSSIBLE?
q Forecasts on Wearables and Healthcare
q What Reality in Healthcare ?
q The Right Time
q Success of Wearables as Interconnected Devices
48. Head-worn
FORECASTS ON WEARABLES
Hand-worn
Body-worn
Global market of
wearable electronics
2018
$30 billion
2014
$3-5 billion
2024
$94
billion
35% CAGR 2014-2024
Wearable devices
2013
14 million
2018
500
million
Source: Deloitte, Visiongain, BIS Research, IHS
49. FORECASTS ON HEALTHCARE
Worldwide Public and Private Health Expenditure
ü Estimated at $7.3 trillion in 2012
ü 7% estimated annual growth in the next decade
ü Personal care consumption: $1.7 trillion in 2012 should
reach $2.2 trillion in 2017
ü Tele-health patients to near 2 million by 2018
Healthcare wearables
ü ~30% of wearables market value: already $1.1 billion in
2014
Source: MaRS Market Insights, March 2014, Wearable Tech: Leveraging Canadian Innovation to Improve Health
50. WHICH REALITY IN HEALTHCARE ?
Dreams
• Instant access 24/7
• High quality healthcare
• Empowerment
• My health data
• Coordinated and coherent
• One point of contact
• Moving health care to me
Reality
• Gatekeepers
• Budget driven
• Didactive and controlling
• Unavailable health data
• Fragmented
• Falling between sectors
• Patients move to healthcare
Source: Moving healthcare to your fingertips: Klaus Phanareth at TEDxCopenhagen 2012
https://www.youtube.com/watch?v=_cGm_wJbyhU
51. THE RIGHT TIME
Time Magazine,
ü Improved customer value proposition September 22, 2014
ü Numerous features enabled by scaled sensors and
displays
ü Established adoption of smartphones, tablets – products
close to wearables
ü Rising life expectancy, more seniors and chronic diseases
ü Decrease the length of hospital stays
ü Long-term care
52. INTERCONNECTION OF WEARABLES
Jawbone RunScribe
Apple
Watch
Polo Tech Shirt
Google
Glass
Computers, smartphones,
tablets and the Cloud
Cloud
Apps
Wearables
53. INTERCONNECTION OF WEARABLES
Jawbone RunScribe
Apple
Watch
Polo Tech Shirt
Google
Glass
Wearables
Most successful wearables will be
ü ‘Plug and play’ compatible with
all wearables
ü Bounded to an ergonomic app
ü Connected to the Cloud to save
and manage data
54. CONCLUSION
ü Real and meaningful purpose for Wearable Electronics
ü Collection of all physiological and biological data
ü Worldwide health data management
ü Breakthrough applications will emerge
55. A BREAKTHROUGH APPLICATION:
BREAST TISSUE SCREENING
A real issue
§ Each year, 1,000,000 women are diagnosed with breast cancer
§ More than 400,000 die
§ 1 in 8 women contracts some form of breast cancer
Early detection is still the cornerstone
3 years 12 years
56. A BREAKTHROUGH APPLICATION:
BREAST TISSUE SCREENING
⇒ The First Warning Systems' Breast Tissue Screening Bra to assist
in the breast self exam (BSE)
§ Painless
§ Noninvasive
§ Highly accurate
As easy as wearing sports bra
Collect data
and send to the Internet
Process with sophisticated
algorithms and display to
3 clinical trials 90% + of accuracy
the user
Predicts tissue abnormalities