Recently held in Toronto, Canada, the ACM CHI Conference on Human Factors in Computing Systems is the premier international conference of Human-Computer Interaction.
Arnel, Judith and Manna from our Toronto office recently held a Lunch & Learn to share what they learned over four very full days of talks, courses and demos, covering everything from best practices in research to robotics.
2. Proprietary & Confidential 2
Agenda
CHI 2014
2
• What is CHI?
• Manna: Research Methods & Tools
• Arnel: Power to the People!
• Judith: Mobile HCI; Hardware & Interaction
3. Proprietary & Confidential 3
CHI the premier international conference
of Human-Computer Interaction.
CHI 2014
4. Proprietary & Confidential 4
A typical day…
CHI 2014
• 9am – 5pm
• Approx . 50 sessions per day
• Academic papers, courses, special
interest groups, panels
6. Proprietary & Confidential
Course:
Methods of Design Synthesis –Moving from Data to Innovation
Jon Kolko – VP of Product, Innovation, and Design at MyEdu
and founder of Austin Center for Design
6CHI 2014
7. Proprietary & Confidential 7
Data Information Knowledge Wisdom
Making5Meaning5
out5of5Data
Methods:5
affinity5diagramming
hierarchy5creation
flow5diagramming
scenario5development
Experience5
Frameworking
Methods:5
concept5mapping
temporal5zoom
semantic5zoom
storyboarding
Gaining5Empathy
Methods:5
reframing
insight'combination
participatory5design
The process…
CHI 2014
8. Proprietary & Confidential 8
Method: Insight Combination
A method of building on insights and established
design patterns in order to create initial design ideas
9. Proprietary & Confidential 9
I saw this + I know this = Insight
Method: Insight Combination
Data gathered through research Ethics, morals, world view,
experience
Clear, deep, meaningful perception into
human behavior in a particular design
context
CHI 2014
10. Proprietary & Confidential 10
Insight + Design Pattern = Design Idea
Method: Insight Combination
Clear, deep, meaningful
perception into human behavior in
a particular design context
A trending paradigm or piece of
culture and society
A new, creative concept, somewhat
facilitated by existing design paradigms
CHI 2014
11. Proprietary & Confidential 11
Insight + Design Pattern = Design Idea
Exercise: Insight Combination
People are expanding their
understanding of “appropriate”
human to human interactions as
they search for meaning in the
minutia of their daily lives.
Reality TV has moved from realistic
to surreal, to ‘car-crash-in-slow-
motion’.
A dating site that puts people into
finite situations of absurdity, which is
live-streamed to the internet and open
to online commentary.
CHI 2014
13. Proprietary & Confidential 13
What is a survey?
A method of gathering
information about a
population by asking
questions to a sample.
CHI 2014
14. Proprietary & Confidential 14
Biases
CHI 2014
• Satisficing
• Acquiescence
• Question Order
• Social Desirability
• Answer Options
• Hypotheticals
• Leading Info
15. Proprietary & Confidential 15
Activity
CHI 2014
• Select a questionnaire
• Identify the biases
• Re-write questions to improve
• Discuss findings as a group
16. Proprietary & Confidential
Special Interest Group:
Effectively communicating user research in order to drive
design and product decisions
Karen Holtzblatt, InContext Design
Shoshana Holtzblatt, Google
16CHI 2014
18. Proprietary & Confidential 18
Tips from Shoshana
CHI 2014
① Forget Numbers – Make Themes
② Pretty Counts
③ Make it Interactive
19. Proprietary & Confidential 19
Tips from Karen
CHI 2014
① Immersion – own the customer data
② Translate data into:
a. Contextual models
b. Affinity diagrams
c. Identity models
d. Sensation boards
20. Proprietary & Confidential
Course:
Mobile Human-Computer Interaction
Niels Henze – University of Stuttgart, Germany
Enrico Rukzio – University of Ulm, Germany
20CHI 2014
21. Proprietary & Confidential 21CHI 2014
Mobile Human-Computer Interaction:
The design of interactive mobile
systems for human users in their
surrounding context
22. Proprietary & Confidential 22
What’s Changed Since the iPhone Launched?
2007: the first iPhone 2014: the iPhone 5S
CHI 2014
23. Proprietary & Confidential 23
Challenges in Mobile HCI
CHI 2014
1. Limited Input Capabilities
2. Limited Output Capabilities
3. Unknown Contexts
4. Interaction in the Real World
24. Proprietary & Confidential
Paper:
Is My Phone Alive? A Large Scale Study of Shape Change in
Handheld Devices Using Video
Esben W. Pedersen - University of Copenhagen
Sriram Subramanian - University of Bristol
Kasper Hornbæk - University of Copenhagen
24CHI 2014
25. Proprietary & Confidential 25
Early Prototypes of Shape Changing Devices
Morphees Nokia Kinetic
CHI 2014
26. Proprietary & Confidential 26
Video Prototypes & User Testing
CHI 2014
o Produced 51 videos of a shape-
changing handheld device
o Assessed user reactions to videos
using open-ended questionnaire
o Related differences in
experiences back to model
parameters
o Key Assumption: User reactions
to videos capture (at least
partially) how they’d perceive
physical devices
Smartphone Shown in Video
160x90x4 mm
6.9” screen
Thickness of 4 mm
Moving Beyond Physical Prototypes
34. Proprietary & Confidential 34
Empirical Study
CHI 2014
o 200 participants recruited through
Amazon Mechanical Turk
o Each participant shown 3 videos in
random order
o Each participant asked to complete a
UX questionnaire evaluating:
hedonic quality, pragmatic quality,
goodness, beauty, urgency, & attend to
35. Proprietary & Confidential 35CHI 2014
AREA: a device’s ability to change its surface area
Finding: Strongly correlated to pragmatic qualities like predictable & simple
36. Proprietary & Confidential 36CHI 2014
ZERO CROSSING: the capability of a shape to have wave-like patterns
Finding: Strongly correlated to hedonic qualities like stylish & creative
37. Proprietary & Confidential 37CHI 2014
TAPERING: diminishing or reducing the thickness toward one end
Finding: Tapering towards the user increases level of urgency
38. Proprietary & Confidential 38
Conclusion:
Manipulations of shape and the level of shape
change had large effects on experience,
perceived urgency and emotions.
CHI 2014
39. Proprietary & Confidential
Paper:
Paddle – Highly Deformable Mobile Devices with Physical
Controls
Raf Ramakers, Johannes Schoning &
Kris Luyten
Hasselt University – tUL – iMinds
Expertise Centre for Digital Media
Diepenbeek, Belgium
39CHI 2014
40. Proprietary & Confidential 40
The Current Smartphone: A Nontransformable Device
CHI 2014
The Design Problem:
Touch screens don’t provide
physical controls or affordances
41. Proprietary & Confidential 41CHI 2014
Paddle:
A highly deformable mobile device that
can be transformed into various special-
purpose physical controls.
42. Proprietary & Confidential 42CHI 2014
What is Paddle?
A loop of square sized tiles held together by wires.
How does it work?
Through tiny infrared reflective markers and an optical tracking system. Projection
provides visual output. Touch interactions are enabled via markers on the user’s fingers.
43. Proprietary & Confidential 43
Paddle Transformations
Paddle as Map:
Shape Fits Digital Content
Paddle as Game Controller:
Ergonomically Designed
CHI 2014
46. Proprietary & Confidential
Paper:
Panelrama: Enabling Easy Specification of Cross-Device Web
Applications
Jishuo Yang & Daniel Wigdor
University of Toronto
Department of Computer Science
46CHI 2014
47. Proprietary & Confidential 47CHI 2014
Panelrama:
A web framework that facilitates the
automatic distribution of UI elements
across multiple devices
48. Proprietary & Confidential 48CHI 2014
How Does Panelrama Work?
02 03Rank Usability of
Device Characteristics
Distribute Each Panel
to Best-Fit Device01Divide UI Elements into
Panels
54. Proprietary & Confidential
Paper:
Persuasive Technology in the Real World: A Study of the Long-
Term Use of Activity Sensing Devices for Fitness
Thomas Fritz - University of Zurich
Elaine Huang - University of Zurich
Gail Murphy - University of British Columbia
Thomas Zimmermann - Microsoft Research
54CHI 2014
55. Proprietary & Confidential 55
Have I Reached 10,000 Steps Yet!?
CHI 2014
FitBit as Persuasive Technology
Study:
Examined long term use of the
FitBit to identify if there’s a
threshold for use
Participants:
30 (16 F & 14 M) with average of
15 months of use
Findings:
Motivation persists over long
periods of time and increased
activity level maintained
Metrics and numbers become more
important than actual health
benefits
56. Proprietary & Confidential
Panel:
Can You Do Good and Do Well? Exploring HCI Careers in
Development
Ed Cutrell - Microsoft Research India Bangalore
Tawanna Dillahunt - University of Michigan
Jacob Korenblum - Souktel
Rowena Luk - Dimagi Inc.
56CHI 2014
57. Proprietary & Confidential 57
What is HCI for Development?
CHI 2014
• A growing field of HCI practitioners
and researchers who create tools to
impact international development,
human rights and socio-economic
development
– Focus on 80% of the world that
makes <$10/day
– Work on low-tech solutions, think
Nokia phones
58. Proprietary & Confidential 58
CommCare by Dimagi
CHI 2014
• A free and open-source platform
for creating forms and capturing
form data in an electronic
repository
• Examples:
– Rural clinics in Zambia
– Educating clients of low-literacy
health activists in India
59. Proprietary & Confidential 59
Job Matching by Souktel
CHI 2014
• Low-cost platform that connects
job seekers with employers using
SMS technology
• Examples:
– Youth employment in Gaza
– Female job-seekers in
conservative areas
60. Proprietary & Confidential
Course:
Make This! Introduction to Electronics Prototyping Using
Arduino
Dave Sirkin – Stanford University
Wendy Ju - Stanford University
60CHI 2014
61. Proprietary & Confidential 61
What is Arduino?
CHI 2014
• An electronics prototyping kit. Like LEGO
for prototyping electronic devices.
• Composed of:
– Arduino microcontroller: hooks up to
your computer and programs the circuit
board and the doodads attached to it
– Breadboard: circuit board, no soldering
needed
– Doodads include: potentiometer, LEDs,
resistors, light sensors, switches,
motors, etc.
Arduino
so,ware
Breadboard
Doodads
63. Proprietary & Confidential 63
Why I took this course
CHI 2014
• Get out of my comfort zone of 2D
interfaces, I’m intimidated by
electronics
• Eventually want to learn how to create a
full on robot!
• If you ever get a chance to do something
at a conference that looks fun but not
part of your discipline, DO IT!
65. Proprietary & Confidential 65
We could be heading towards a UX Disaster
CHI 2014
• The more things we build around the Internet of Things, the more we have
to be careful of the UX (Kindle vs. Bluetooth)
• Bad design could cause a cascade of errors that negatively affect our lives
66. Proprietary & Confidential 66
The “Shape of Innovation”
CHI 2014
• Step 1: inappropriately recycle an
old model, get familiar with it
(tillers on cars)
• Step 2: technology matures
(steering wheel)
• Step 2.5: getting attached with this
solution. We get so attached to it
we don’t want to give it up. Holds
us back from a revolution.
67. Proprietary & Confidential 67
Look past the iPhone Apps …
CHI 2014
• We are stuck in the iPhone model of apps
• To move forward with the Internet of Things, we need to look past this
model of Native Apps
68. Proprietary & Confidential 68
… and step into the Physical Web
CHI 2014
• There are going to be 1000s of
devices and objects to interact with
in the future
• Current, Unscalable model: a native
app for each device
• Instead, Just in Time interaction:
make all mobile devices be able scan
interactable objects in an area. That
object points users to webpages that
they can use to interact with the
object
69. Proprietary & Confidential 69
In conclusion
CHI 2014
• As innovators we need to be aware of the Shape of Innovation to make sure
we’re not getting stuck. Native Apps = Technology Tiller.
• Revolution requires freeing ourselves from the constraints of Native Apps.
Power to the people!
Part of ACM: association for computing machinery – CHI (Computer- human interaction) is a special interest group – multi disciplinary group composed of computer scientists, software engineers, psychologists, interaction designers, graphic designers, sociologists, multi-media designers, and anthropologists…
Margaret Atwood: - author - robotics in my work and life – in 2004 she co-invented the ‘long pen’ – a remote signing device that allows someone to write in ink anywhere in the world via tablet PC and the internet
Scott Jenson – Google – ‘the internet of things is a UX disaster and we are on the verge of an entirely new way of interacting with devices…
Externalize the process – get out of your laptop – invite collaboration
Make diagrams (of everything and anything)
Interpret heavily – assign meaning to data – make inferences. Force yourself to assign meaning to data even if its not there.
Walked through a bunch of techniques on how to do this: concept mapping and flow diagrams and insight combination
Insight = provocative statement of truth (and it may be wrong)
Insight combination: a method of building on insights and established design patterns in order to create initial design ideas.
Characteristics of a high-quality survey: valid, reliable and actionable
Use of surveys: understand attitudes and behaviors, goals and intents, ux feedback, user characteristics, awareness, comparisons…
Satisficing = short-cutting the answering process (avoid including ‘opt-out’ options)
Acquiescence = tendency to agree with any statement (avoid agreement scales)
Question order = tendency to be influenced by questions that appear earlier in the survey
Social Desirability = sticking to norms and expectations (keep surveys anonymous – move personal/sensitive questions to the end)
Answer options = tendency to infer a higher-level meaning from the answer options and their order
Hypotheticals = tendency to falsely predict the future (ask about current situation instead and make informed decision as a researcher)
Leading info = tendency for any additional info in the survey to bias the respondent
Characteristics of a high-quality survey: valid, reliable and actionable
Use of surveys: understand attitudes and behaviors, goals and intents, ux feedback, user characteristics, awareness, comparisons…
Characteristics of a high-quality survey: valid, reliable and actionable
Use of surveys: understand attitudes and behaviors, goals and intents, ux feedback, user characteristics, awareness, comparisons…
Purpose of a contextual model
Mturk is a crowdsourcing internet marketplace that enables individuals or businesses to coordinate the use of human intelligence to perform tasks that computers are currently unable to do. The Requester posts a task known as a Human Intelligence Task and the Worker can browse among tasks and complete theme for money.
Hedonic quality – is this tacky or stylish. Captivating, premium, creative
Pragmatic quality – was it predictable or unpredictable. Structured, practical. simple
Goodness – 7 point differential from bad to good
Beauty – 7 point scale from ugly to beautiful
Urgency – a scale to indicate if the parameter implied that something super urgent requiring immediate attention happened, or can it be dismissed
- Worked well for displaying notifications and engendering a strong hedonic surprise
- Focus on 80%...: developing world but also underserved parts of the US like Detroit
Clinics in Zambia use it as a part of a program to improve maternal and child mortality rates. Health workers can use cell phones to track health data and sync it to a central server using the cellphone network.
In india, Health Activists, trained people who are not nurses/doctors who are able to improve health outcomes in areas of extreme poverty typically have low literacy are able to use the CommCare interface as it can provide audio clips and images to help educate their clients
In Gaza, traditionally people had to find jobs by going door to door. This usually takes a whole day as they have to cross numerous check points and go into potentially dangerous areas. With Job-Matching they can have access to many employers w/o ever leaving their house. Souktel also empowers female job-seekers who live in conservative areas since their only other alternative is going to an internet café which are very male dominated