Presented at ISTS 2018 on 9/15/2018 in Yeosu, Korea.

2. Jeong-Yoon Lee, Ph.D.
Sr. Applied Machine Learning Scientist, Microsoft
Science Advisor, Neofect, Conversion Logic
KDD Cup 2012, 2015 Winner
Top 10, Kaggle 2015
KDD Cup 2018 Co-Chair, ACM SIGKDD

3. Artificial
General Intelligence Narrow Artificial Intelligence
Machine Learning
Deep Learning
Computer Vision
Robotics Natural
Language
Processing
AI
ML
DL Speech

6. 1997
Deep Blue beat Garry
Kasparov at Chess
2016
Alpha Go beat Lee
Sedol at Go
2011
Watson won at
Jeopardy!
2018
OpenAI Five beat
former pros at Dota 2
$1B
Netflix saves every year
with its personalized
recommendations
70%
Of HP’s 600MM
technical support cases
per year handled by AI
20%
Otto cut surplus stock
with better demand
forecasting
20%
Washington Post freed
up reporters’ time with
automated articles

7. Vision Speech Language

9. https://blog.piekniewski.info/2018/02/09/a-v-safety-2018-update/

10. AI makes mistakes
https://www.aclu.org/blog/privacy-technology/surveillance-technologies/amazons-face-recognition-falsely-matched-28

11. https://blog.openai.com/adversarial-example-research/

18. Microsoft Healthcare NExT
EMPOWER
care teams
& employees
Virtual Health
Mixed Reality
Intelligent
Clinician Assistant
ENGAGE
patients
& customers
Triage Bots
Personal Health
Insights
Dynamic Care
Plans
OPTIMIZE
clinical &
operational
effectiveness
Artificial
Intelligence
Video Analytics
Natural Language
Processing
TRANSFORM
health
Genomics
Precision
Medicine
Bio-surveillance

19. Health Bot Service
Intelligent and compliant virtual health
assistants for triage and inquiries
Health Bot
Cortana
• World knowledge
• Location
• Calendar
HealthVault
• Personal health records
• Prescriptions
• Wearable data
Third party & customer data
• Authoritative medical protocols
• Service provider lookup and scheduling

20. Health Bot Service
Intelligent and compliant virtual health
assistants for triage and inquiries
Health Bot
Cortana
• World knowledge
• Location
• Calendar
HealthVault
• Personal health records
• Prescriptions
• Wearable data
Third party & customer data
• Authoritative medical protocols
• Service provider lookup and scheduling

21. EmpowerMD
Medicalconversations to medical intelligence

22. EmpowerMD
Giving physicians the time
and tools to put patients first

24. Project InnerEye
Turning Radiological Images into Measuring
Devices
“What used to take hours
can now be done in minutes”
Dr. R. Jena, Radiation Oncologist,
University of Cambridge Hospitals

25. InnerEye – assistive AI for radiotherapy planning

26. Automatic 3D segmentation
Two axial slices of the same CT scan Natively 3D segmentation
Bladder
Overlaid axial segmentations
Prostate, seminal vesicles, rectum, bladder, left femur, right femur, skin

28. Hololens
Mixed reality for medical training and
surgical assistance

29. “We are on the cusp of a new frontier in simulation for healthcare… We look forward to offering it
as a key training solutions technology to our industry partners.”
Dr. Robert Amyot, president of CAE Healthcare
VimedixAR is an ultrasound
simulator. Freed from the limits of a
2D environment inside a monitor,
healthcare professionals can display,
enlarge, and rotate realistic-looking
anatomical parts and can witness, in
real time, the ultrasound beam as it
cuts through human anatomy.

30. “Integrating mixed-reality tools into surgery is a huge technological advancement toward enhancing
a surgeon’s vision and may provide greater benefits to patients.”
Christian Woiciechowsky, Chief of Clinic at Vivantes Humboldt, Germany
Scopis created the Holographic
Navigation Platform to offer greater
precision and speed to surgeons,
and better outcomes to patients
undergoing open and minimally-
invasive spinal procedures. The
system overlays the planned position
of the pedicle screws onto the patient
in the surgeon’s field of vision.

35. https://imaginecup.microsoft.com/en-us/winners/2018WorldChampions
https://www.sciencealert.com/this-teenage-girl-invented-a-brilliant-ai-
based-app-that-can-quickly-diagnose-eye-disease

36. How to Approach AI
Embrace it: The world is changing, with or without you.
Start simple: Try Cognitive Services, for free.
Stay tuned: The dream of today can be the reality of tomorrow.
Work with experts: We want to work with you.
Be aware of issues: Ethics, security, regulation, leaks.

37. A Tale of Two Algorithms
GBM Deep Learning
No. 1 winning algorithm at most
machine learning competitions
Highlight
Most popular algorithm across media,
industry, and academia
Decision Tree
(Morgan & Sonquist 1963)
Base algorithm
Perceptron
(Rosenblatt 1958)
Structured, categorical data Use cases Image, speech, natural language data
Feature engineering Crucial step
Architecture design.
Finding pre-trained models
LightGBM, XGBoost, CatBoost, H2O Open source tools
Keras, PyTorch, Tensorflow, CNTK,
MXNet, Caffe