A day in my life - how smartphones (with sensors and big-data) are affecting our lives
1. harigottipati@
A day in my life in 2015 -
how smartphones (with
sensors and big-data) are
affecting our lives
by Hari Gottipati
Phoenix Mobile Festival 2014 #phxmobi
September 27th, 2014
2. harigottipati@
About me
• By profession a software architect who
codes
• By passion a software developer who
understands architecture
• By interest a speaker, freelance writer and
blogger
• Focus areas : Internet Scaling, Big Data,
Machine language/AI, Mobile (beacons,
IoT, M2M)
3. harigottipati@
About the presentation
• Why 2015 – some of the apps don’t exist today,
but they are very close to reality
• September 28th, 2015 – a year from now
• It’s not a typical day – picked a day that covers
max no. of use cases
• May jump between various devices to cover
various use cases
• Typical user may not have all the sensors/gadgets
that covered in the presentation
• Some apps/devices are in experimental stage –
results may vary, may not be accurate initially
6. harigottipati@
• Sense from Hello - simple system in your
bedroom
• Monitors sleeping activity, light, noise,
temperature
• Analyzes conditions that are leading to good
sleep
• Wakes you at right interval
8. harigottipati@
• Woke up in the middle of night
• Sense detected that I woke up and changed the context to
“woke up”
• Always on smartphone responded to my voice command
“lights on” and turned on Phillips Hue light in the bedroom
• Since it is a middle of night, the light is soothing yellow
• Going to kitchen to drink water
• Smart lights (SmartThings platform) detected motion and
turned on lights in the kitchen
10. harigottipati@
• Back in the bed room
• LIFX light flashing dim light indicating some important email
• Voice command “play light music”
• Music is on with low volume as it is night time
• Falling sleep, sense changed light, noise as per my sleeping
needs
• Fell sleep, sense changed the context to “sleep” mode and
switched off lights and stopped music
13. harigottipati@
• Nest thermostat reduced AC based on my
preferences – low after 1PM
• Creates a personalized schedule based on the
temperature changes you’ve made and continually
adapts to your changing life
• Can turn on/off, read/set temperatures from
smartphones remotely
• In direct sunlight, it automatically adjusts to read and
sets the right temperature
15. harigottipati@
• Google Now is setting my alarm based on
my past wake up patterns on Monday
morning and based on my calendar
• Usually I wake up at 5:30AM, but my day
is going to be bit busy, so the alarm is set
to 5AM
17. harigottipati@
• Woke up and sense changed the context
to “woke up”
• Google now shows my day
• Important emails
• Important news - FB knows what I read
19. harigottipati@
• Going to Gym in car
• Phone is connected to
CarPlay/Android Auto/Navdy
• Waze is showing
directions/traffic to Gym
• Dash/Vinli (OBD adapter+app)
is providing car diagnostic info
• Vinli can alert family/911 in case
of accident
21. harigottipati@
• Reached Gym
• Google contact lens showing my glucose
levels
• Sensor inside contact lens
• Constantly measures glucose levels in tears
• Sends data to smartphone
22. harigottipati@
• Smart pill by Proteus Digital Health
• Dissolvable senor
• Activates as soon as it touches stomach fluids
• Sends info to patch attached to body, from patch to a smartphone
• Tells doctors and family members if patients are taking their medicine properly
• In 2012, it was estimated that people not taking their prescribed medication cost $258 billion in
emergency room
• Average of 130,000 Americans die each year because they don’t follow their prescriptions
regimens closely enough
• Can also monitor vital signs such as heart rate, respiration
• FDA approved
23. harigottipati@
• Pillcam – capsule endoscopy by GivenImaging
• Two tiny cameras with flashing led light
• 10-hour battery life
• Disposable capsule will pass naturally with a bowel movement
• Takes 18 photos per second
• Transfer images wirelessly to an external receiver worn by the
patients, from receiver to computer
• FDA approved
24. harigottipati@
• Pulsepoint – based on 911 call it alerts nearby EMT
volunteers with location
• Asthmapolis - connected asthma healer. Uses
location based data to alter asthma sufferer’s
patterns, warning them to avoid certain areas thus to
prevent attacks/medications/ER visits
• EPFL blood monitoring implant will predict a heart
attack hours before it occurs
• DermoScan – can detect skin cancer – requires a
magnifying glass which you can attach to phone
• Breezing – portable metabolism tracker that which
you can attach to phone – just breath to track
metabolism
• SHE (Society Harnessing Equipment) bra – delivers
3800kv electric shock to any would-be rapist. Also
sends text message to relative/friend phone or 911
with victim’s location
25. harigottipati@
• First Warning Systems bra – early breast cancer
discovery - sensors can detect small changes in
temperatures in breast tissue. Using smartphone
it can send collected data to Internet to be
analyzed by sophisticated algorithms. Results will
be displayed back to smartphone.
• uCheck – pee on a strip and snap a photo from a
mobile app for urinalysis
• Beam – sensor-enabled toothbrush that measures
how long and how often you brush. It reports the
data to your smart phone.
• Phillips is developing a sensor-enabled
toothbrush that will sense tooth decay and text
messages to the user as well as the dentist
• Gero – from your activity tracker data it can
diagnose chronic diseases in early stage
30. harigottipati@
• Google now says I have meeting at 8AM at
work and I need to leave at 7:15AM based
on current traffic conditions
• Waze is showing alternate route based on
the traffic conditions
• Following Waze directions and checking
where my friends are
32. harigottipati@
• Context app launcher launched work app
• Reaching building entrance
• Beacon at entrance detected who I am
• Challenged for finger print scan
34. harigottipati@
• Lights in my office are controlled by my presence
• Lights and A/C in hallway, corner, meeting rooms are
controlled by the presence of employees
• Using beacons with latest sensors, apps (Robin app) can
detect nearby people and things
• Stop wasting time looking for people and available
conference rooms
• Automate conference room booking for users just by walking
into room
36. harigottipati@
• Checking my emails
• Got smoke alert from Nest protect at home
• Nest protector tells you if there’s smoke or carbon
monoxide and which room it is in
• It can guide you the best way to exit your home
and avoid running into fire on the way out
37. harigottipati@
• Not sure, whether it is a smoke or my wife is cooking
some thing.
• Family app (from Sygic) shows my wife and kids are
at home
• I sent a message to my wife using family app
• Nest alert is turning into yellow and got the message
from my wife saying it’s under control
• Nest alert is green
39. harigottipati@
• Got the alert saying no one is at home
• My wife must have been out to drop the
kid at day care
• Lock up automatically when you leave the
home or remotely lock home
41. harigottipati@
• Got the alert saying my elder son is out of
the safe zone
• Family app shows he is moving away from
school
• Sent a message and he replied back
reminding it’s field trip day
44. harigottipati@
• My young kid at day school is getting anxious for
some reason (new teacher?)
• MyTJacket (hug jacket) he is wearing is sending
anxious alert to my smartphone
• Remotely you can simulate the feeling of a hug
with laterally applied air pressure to calm, comfort
and sooth the nerves of anyone who is
stressed/anxious
46. harigottipati@
• My auto refill groceries order pop-ups on my smart
phone
• Checked to see if milk bottle is in the fridge
• Internet of Things connects every thing to internet
• Added milk to the order
• Amazon Fresh (or Google shopping express/Walmart
to go/Instacart) showing that the groceries will be
delivered to home in 1 hr.
48. harigottipati@
• Done at work, going to mall to buy cloths for my trip in the noon
• Planning to buy from Nordstrom
• Context app launcher launched Macys app while passing Macys
store
• Macys pushed a coupon saying 20% of on Temple Run jeans
• Walked into Macys
• App is showing in-store direction to Temple Run jeans area
• App is recommending yellow T-Shirt goes great with the jeans
• App is showing directions to yellow T-Shirt area
50. harigottipati@
• Reached home
• Door unlocked automatically when
the smart lock detected my
smartphone presence
• Grocery/lunch delivered
• Feels like watching TV
• NextGuide tells what to watch
based on what I watched/interests
• Remote app can change the
channel/media based on interests
• Finished lunch
• Packed for the trip
52. harigottipati@
• Google Now says my flight is at 4:00PM
• To catch that I need to be at airport by 2:00PM
• Based on Waze traffic, Google Now says I need to
start at 1:30PM
• Waze says there is an accident on L202 near Rural
• Waze says take street road and go to Skyharbor
• Heavy traffic on 48th St - updated Waze for others
54. harigottipati@
• Reached Skyharbor
• Context app launcher launched Skyharbor app
• Beacons at parking entrance recognized me who I
am and greeted
• No parking ticket
• Skyharbor app displays I should park in level 3,
section E, row 3, parking spot 12
57. harigottipati@
• Context app launcher launched US Airways and showing
walking directions to gate
• Walked into smart phone line at security check point
• Boarding pass from passbook
• Photo cameras scanned me and pulled my personal info -
submitted my personal info with picture to USCIS earlier
• Put my laptop, wallet, shoes, keys on X-Ray conveyor belt
• Went through scanning
58. harigottipati@
• Picked laptop, wallet, shoes... forgot keys
• While I am moving away my smartphone noticed the BLE
signal from keys is becoming weak. After a certain threshold,
it warned me that I left keys some where. It provided walking
directions to keys
• On the way to my terminal, Skyharbor app warned me about
weather at destination
• It's going to rain when I land and it asked whether I want to
buy umbrella
60. harigottipati@
• MyBasis notified Vessyl that I walked 1500 steps
• Vessyl alerted me on my smartphone that I need to drink more water
• Vessyl knows what’s inside – what kind of drink, amount, calories, protein,
caffeine, sodium, fat, sugars. It also estimates, tracks and displays your
real-time hydration needs.
• Feels like walking into Starbucks for more caffeine
• Vessyl app showed I already had enough caffeine for the day,
recommended no more
• Feels hungry - I pointed food tracker app with camera on a near Pizzeria
• Food tracker app warned me that my glucose levels are high this morning.
• Picked salad.
62. harigottipati@
• Boarding – app notified US Airways system
while entering into jet bridge. Nothing to give
or show.
• Uber app detected I am travelling and
prompts “do you want the cab at SFO airport
terminal 2 at 5:30PM” – yes
64. harigottipati@
• Flight landed. SFO airport app shows walking directions to
cab area
• Using Apple watch for directions
• Tabs for left or right
• While walking received a tweet from my friend “celebrating
my birthday @ Fourpeaks”. Location says Tempe, AZ
• Using Slingr app, I placed an order for a drink and the venue
made sure he is still there before accepting the order. Venue
delivered the drink to him saying “Happy Birthday from Hari”
66. harigottipati@
• Uber shows walking directions to Uber ride
• As I go near Uber car, the driver walks out and greets
“Hello Mr. Hari, welcome to San Francisco”
• “Your reservation shows you are staying at Marriot
near Airport. Do you want to go there or some where
else”
• On the way to Marriot, I booked Uber from Marriot to
49ers.
68. harigottipati@
• Reached Marriot - Marriot app started
• App sends my info to the system in the lobby. Doorman at gate
greeted “Hello Mr.Hari welcome to Marriot”
• Automatically checked-in
• Walking directions to my room
• Using NFC/beacon, the room is unlocked
• Got alert saying garden frost is too high in my backyard garden
• Messaged my wife to cover the plants in backyard
70. harigottipati@
• Used Uber again to reach 49ers.
• Context app launcher launched Levi’s stadium app
• Guided to parking lot entrance closest to my seat
• Entrance beacon knows who I am and validated ticket from passbook
• Walking directions to my seat
• Can order food and drink from my seat and it will be directly delivered to
my seat
• Can watch replay (currently limited to 4 replays) on my smartphone, seeing
the exact replays shown by the studio on the TV
• Can guide to the closest concession stand and bathroom with the shortest
lines
72. harigottipati@
• On the way back to hotel using Uber
• Checked family – all family members are at
home
• Checked locks – main door is locked
• Checked lights – lights are still on in kids
room
• Set the lights to turn off at 9:30PM
• Room temperature is good
• CO2 levels are good
• Checked my glucose levels
• Checked my water consumptions
• Checked my steps/calories/activity
74. harigottipati@
• No need to set alarm – Google now
knows when to wake me up based on my
schedule/location
• It knows when to book Uber/Lyft and what
time/location
• I don’t’ need to do any thing
• I am simply going to bed, because of the
magical device in my hand
76. harigottipati@
• We are not just living in connected world
• We are living in context world
• No more Chipotle in Tempe, AZ or 85226
• Just search for Chipotle
• Sub sequent search have the context
• Searching for Hotels after Chicago search means you
are looking for Hotels in Chicago
• On top of context, we are living in everything
connected world
• 26 billion appliances will be connected by 2020 –
Gartner
• IoT (internet of things) and M2M (machine 2
machine) are going to be big
77. harigottipati@
• PCAs (Personal Contextual Assistant) like
Google now can learn from you and can
predict your next move
• AI/Machine language will help you lot but
apps need to learn about you
• Help PCAs to help you
78. harigottipati@
Your smartphone is:
• Your PCA
• Your GPS
• Your music device
• Your key
• Your switch to control light, music, temperature,
humidity etc.
• Your wallet
• Your fitness device
• Your activity tracker
• Your beacon reader (can read from any
appliance/sensor)
• Your health tracker
• Your organizer
• Your <name your own>