SlideShare a Scribd company logo
1 of 44
http://linkedin.com/in/shahedc
http://www.meetup.com/DC-MS-Devs
http://twitter.com/shahedC
http://WakeUpAndCode.com
Future of Mixed Reality and A.I.
https://www.linkedin.com/pulse/future-mixed-reality-artificial-intelligence-michael-thibodeau
https://www.youtube.com/watch?v=aThCr0PsyuA
What is HoloLens?
Augmented Reality Mixed Reality Virtual Reality
Augments the real world with helpful information
Blends holograms with your real world
Can transport you to a virtual world
Replaces the real world
https://developer.microsoft.com/en-us/windows/mixed-reality/spectator_view
HoloLens: Dev Edition vs Commercial Suite
http://hololens.com/buy
Windows Mixed Reality: More Devices!
https://aka.ms/windows-mixed-reality
Getting Started
Tools and Documentation
Start Here for Guides, Docs, Community
https://developer.microsoft.com/en-us/windows/mixed-reality
https://developer.microsoft.com/en-us/windows/mixed-reality/install_the_tools
Install the Tools: HoloLens
Things to Know
• Gaze
• Gesture
• Voice
• 3D vs 2D
Gaze
https://developer.microsoft.com/en-US/windows/mixed-reality/gaze
Gestures
https://developer.microsoft.com/en-US/windows/mixed-reality/gestures
Voice Input
https://developer.microsoft.com/en-US/windows/mixed-reality/voice_input
Shahed Chowdhuri, Sr. Technical Evangelist @ Microsoft
Commercial Software Engineering
Shahed Chowdhuri, Sr. Technical Evangelist @ Microsoft
Commercial Software Engineering
Capture
Image
via
HoloLens
/// <summary>
/// Begin process of Image Capturing and send To Azure Computer Vision service.
/// </summary>
private void ExecuteImageCaptureAndAnalysis()
{
// Set the camera resolution to be the highest possible
Resolution cameraResolution = PhotoCapture.SupportedResolutions.OrderByDescending
((res) => res.width * res.height).First();
Texture2D targetTexture = new Texture2D(cameraResolution.width, cameraResolution.height);
// Begin capture process, set the image format
PhotoCapture.CreateAsync(false, delegate (PhotoCapture captureObject)
{
photoCaptureObject = captureObject;
CameraParameters c = new CameraParameters();
c.hologramOpacity = 0.0f;
c.cameraResolutionWidth = targetTexture.width;
c.cameraResolutionHeight = targetTexture.height;
c.pixelFormat = CapturePixelFormat.BGRA32;
// Capture the image from the camera and save it in the App internal folder
captureObject.StartPhotoModeAsync(c, delegate (PhotoCapture.PhotoCaptureResult result)
{
string filename = string.Format(@"CapturedImage{0}.jpg", tapsCount);
string filePath = Path.Combine(Application.persistentDataPath, filename);
VisionManager.instance.imagePath = filePath;
photoCaptureObject.TakePhotoAsync
(filePath, PhotoCaptureFileOutputFormat.JPG, OnCapturedPhotoToDisk);
});
});
}
Prepare & send request to Azure…
… receive and process response!
Email: shchowd@microsoft.com  Twitter: @shahedC

More Related Content

What's hot

What's hot (20)

Intro to Xamarin: Cross-Platform Mobile Application Development
Intro to Xamarin: Cross-Platform Mobile Application DevelopmentIntro to Xamarin: Cross-Platform Mobile Application Development
Intro to Xamarin: Cross-Platform Mobile Application Development
 
Azure for Hackathons
Azure for HackathonsAzure for Hackathons
Azure for Hackathons
 
Going Serverless with Azure Functions
Going Serverless with Azure FunctionsGoing Serverless with Azure Functions
Going Serverless with Azure Functions
 
Xbox One Dev Mode
Xbox One Dev ModeXbox One Dev Mode
Xbox One Dev Mode
 
Universal Apps for Windows 10
Universal Apps for Windows 10Universal Apps for Windows 10
Universal Apps for Windows 10
 
BizSpark & Azure for Startups
BizSpark & Azure for StartupsBizSpark & Azure for Startups
BizSpark & Azure for Startups
 
Intro to Xamarin
Intro to XamarinIntro to Xamarin
Intro to Xamarin
 
Game On with Windows & Xbox One @ .NET Conf UY
Game On with Windows & Xbox One @ .NET Conf UYGame On with Windows & Xbox One @ .NET Conf UY
Game On with Windows & Xbox One @ .NET Conf UY
 
How to Win #BestMicrosoftHack with Azure
How to Win #BestMicrosoftHack with AzureHow to Win #BestMicrosoftHack with Azure
How to Win #BestMicrosoftHack with Azure
 
Web App Security
Web App SecurityWeb App Security
Web App Security
 
SharePoint Fest DC 2018 - Everything your need to know about the Microsoft Gr...
SharePoint Fest DC 2018 - Everything your need to know about the Microsoft Gr...SharePoint Fest DC 2018 - Everything your need to know about the Microsoft Gr...
SharePoint Fest DC 2018 - Everything your need to know about the Microsoft Gr...
 
Indie Game Development
Indie Game DevelopmentIndie Game Development
Indie Game Development
 
Developing apps for share point 2013
Developing apps for share point 2013Developing apps for share point 2013
Developing apps for share point 2013
 
Chatbot development with Microsoft Bot Framework and LUIS
Chatbot development with Microsoft Bot Framework and LUISChatbot development with Microsoft Bot Framework and LUIS
Chatbot development with Microsoft Bot Framework and LUIS
 
Introduction to BOT Framework- Global Azure Bootcamp 2017
Introduction to BOT Framework- Global Azure Bootcamp 2017Introduction to BOT Framework- Global Azure Bootcamp 2017
Introduction to BOT Framework- Global Azure Bootcamp 2017
 
Azure mobile services
Azure mobile servicesAzure mobile services
Azure mobile services
 
Azure: PaaS or IaaS
Azure: PaaS or IaaSAzure: PaaS or IaaS
Azure: PaaS or IaaS
 
SharePoint Framework -The future of SharePoint/ Office 365 developer ecosystem.
SharePoint Framework -The future of SharePoint/ Office 365 developer ecosystem. SharePoint Framework -The future of SharePoint/ Office 365 developer ecosystem.
SharePoint Framework -The future of SharePoint/ Office 365 developer ecosystem.
 
Typescript 102 angular and type script
Typescript 102   angular and type scriptTypescript 102   angular and type script
Typescript 102 angular and type script
 
Activate bots within SharePoint Framework
Activate bots within SharePoint FrameworkActivate bots within SharePoint Framework
Activate bots within SharePoint Framework
 

Similar to Cloud-Backed Mixed Reality: HoloLens & Azure Cognitive Services

Similar to Cloud-Backed Mixed Reality: HoloLens & Azure Cognitive Services (20)

CodeMash – VR/AR talk
CodeMash – VR/AR talkCodeMash – VR/AR talk
CodeMash – VR/AR talk
 
BIMO Forum 2017 - Présentation Microsoft HoloLens
BIMO Forum 2017 - Présentation Microsoft HoloLensBIMO Forum 2017 - Présentation Microsoft HoloLens
BIMO Forum 2017 - Présentation Microsoft HoloLens
 
Mixed Reality Introduction
Mixed Reality IntroductionMixed Reality Introduction
Mixed Reality Introduction
 
El Bruno - Hololens development for 2D developers
El Bruno - Hololens development for 2D developersEl Bruno - Hololens development for 2D developers
El Bruno - Hololens development for 2D developers
 
Mixed Reality
Mixed RealityMixed Reality
Mixed Reality
 
Developing Immersive Experiences With Windows Mixed Reality
Developing Immersive Experiences With Windows Mixed RealityDeveloping Immersive Experiences With Windows Mixed Reality
Developing Immersive Experiences With Windows Mixed Reality
 
Matt Zeller (Microsoft): Windows Mixed Reality: Holograms to VR, and Everythi...
Matt Zeller (Microsoft): Windows Mixed Reality: Holograms to VR, and Everythi...Matt Zeller (Microsoft): Windows Mixed Reality: Holograms to VR, and Everythi...
Matt Zeller (Microsoft): Windows Mixed Reality: Holograms to VR, and Everythi...
 
From Oculus to HoloLens: Building Virtual & Mixed Reality Apps & Games
From Oculus to HoloLens: Building Virtual & Mixed Reality Apps & GamesFrom Oculus to HoloLens: Building Virtual & Mixed Reality Apps & Games
From Oculus to HoloLens: Building Virtual & Mixed Reality Apps & Games
 
Building Mixed Reality Experiences with the HoloToolkit for Unity
Building Mixed Reality Experiences with the HoloToolkit for UnityBuilding Mixed Reality Experiences with the HoloToolkit for Unity
Building Mixed Reality Experiences with the HoloToolkit for Unity
 
Getting Social with OpenSocial
Getting Social with OpenSocialGetting Social with OpenSocial
Getting Social with OpenSocial
 
Social Media Marketing Open Social App Standards
Social Media Marketing Open Social App StandardsSocial Media Marketing Open Social App Standards
Social Media Marketing Open Social App Standards
 
Hacking For Innovation
Hacking For InnovationHacking For Innovation
Hacking For Innovation
 
Using CoSpaces Edu to Create Virtual and Augmented Reality Experiences
Using CoSpaces Edu to Create Virtual and Augmented Reality ExperiencesUsing CoSpaces Edu to Create Virtual and Augmented Reality Experiences
Using CoSpaces Edu to Create Virtual and Augmented Reality Experiences
 
Matt Zeller (Microsoft): Getting started with Microsoft HoloLens
Matt Zeller (Microsoft): Getting started with Microsoft HoloLensMatt Zeller (Microsoft): Getting started with Microsoft HoloLens
Matt Zeller (Microsoft): Getting started with Microsoft HoloLens
 
2017 03 22 Lessons learned building Hololens 3D apps from a 2D app developer
2017 03 22 Lessons learned building Hololens 3D apps from a 2D app developer2017 03 22 Lessons learned building Hololens 3D apps from a 2D app developer
2017 03 22 Lessons learned building Hololens 3D apps from a 2D app developer
 
The Future of Virtual Worlds
The Future of Virtual WorldsThe Future of Virtual Worlds
The Future of Virtual Worlds
 
Taking the Magical Leap with Immersive Technologies in Libraries
Taking the Magical Leap with Immersive Technologies in LibrariesTaking the Magical Leap with Immersive Technologies in Libraries
Taking the Magical Leap with Immersive Technologies in Libraries
 
App-for-that template
App-for-that templateApp-for-that template
App-for-that template
 
2017 06 Ontario Hololens Tour
2017 06 Ontario Hololens Tour2017 06 Ontario Hololens Tour
2017 06 Ontario Hololens Tour
 
Tbjsphx918
Tbjsphx918Tbjsphx918
Tbjsphx918
 

More from Shahed Chowdhuri

More from Shahed Chowdhuri (14)

ASP.NET Core 2.1: The Future of Web Apps
ASP.NET Core 2.1: The Future of Web AppsASP.NET Core 2.1: The Future of Web Apps
ASP.NET Core 2.1: The Future of Web Apps
 
ASP.NET Core 2.1: The Future of Web Apps
ASP.NET Core 2.1: The Future of Web AppsASP.NET Core 2.1: The Future of Web Apps
ASP.NET Core 2.1: The Future of Web Apps
 
ASP.NET Core 2.1: The Future of Web Apps
ASP.NET Core 2.1: The Future of Web AppsASP.NET Core 2.1: The Future of Web Apps
ASP.NET Core 2.1: The Future of Web Apps
 
Microsoft Cognitive Services
Microsoft Cognitive ServicesMicrosoft Cognitive Services
Microsoft Cognitive Services
 
Game On with Windows & Xbox One!
Game On with Windows & Xbox One!Game On with Windows & Xbox One!
Game On with Windows & Xbox One!
 
ASP.NET Core 2.0: The Future of Web Apps
ASP.NET Core 2.0: The Future of Web AppsASP.NET Core 2.0: The Future of Web Apps
ASP.NET Core 2.0: The Future of Web Apps
 
What's New at Microsoft?
What's New at Microsoft?What's New at Microsoft?
What's New at Microsoft?
 
ASP.NET Core MVC + Web API with Overview
ASP.NET Core MVC + Web API with OverviewASP.NET Core MVC + Web API with Overview
ASP.NET Core MVC + Web API with Overview
 
ASP.NET Core 1.0 Overview
ASP.NET Core 1.0 OverviewASP.NET Core 1.0 Overview
ASP.NET Core 1.0 Overview
 
Capture the Cloud with Azure
Capture the Cloud with AzureCapture the Cloud with Azure
Capture the Cloud with Azure
 
ASP.NET Core MVC + Web API with Overview (Post RC2)
ASP.NET Core MVC + Web API with Overview (Post RC2)ASP.NET Core MVC + Web API with Overview (Post RC2)
ASP.NET Core MVC + Web API with Overview (Post RC2)
 
ASP.NET Core 1.0 Overview: Post-RC2
ASP.NET Core 1.0 Overview: Post-RC2ASP.NET Core 1.0 Overview: Post-RC2
ASP.NET Core 1.0 Overview: Post-RC2
 
ASP.NET Core 1.0 Overview: Pre-RC2
ASP.NET Core 1.0 Overview: Pre-RC2ASP.NET Core 1.0 Overview: Pre-RC2
ASP.NET Core 1.0 Overview: Pre-RC2
 
ASP.NET Core 1.0 Overview
ASP.NET Core 1.0 OverviewASP.NET Core 1.0 Overview
ASP.NET Core 1.0 Overview
 

Recently uploaded

Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
vu2urc
 

Recently uploaded (20)

How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 

Cloud-Backed Mixed Reality: HoloLens & Azure Cognitive Services