Hello Babel fish! - A mixed reality workshop for better communication
•Download as PPTX, PDF•
0 likes•250 views
This are the slides for the workshop @ #lakesidehackfest in Klagenfurt. During the 3 hours workshop, a collaborative virtual space was created in unity with the use of photon networking. Additionally Microsoft Cognitive Services were used to translate speech in real time into multiple languages for every user in this virtual room.
Recommended
More Related Content
Similar to Hello Babel fish! - A mixed reality workshop for better communication
Similar to Hello Babel fish! - A mixed reality workshop for better communication (20)
More from Stefan Wasserbauer
Recently uploaded
Recently uploaded (20)
Hello Babel fish! - A mixed reality workshop for better communication
- 1. Hello Babel fish! A mixed realityworkshop for better communication.
- 2. Confidential 2 Hello mynameis Stefan Wasserbauer @wassx
- 3. Confidential 3 Lorem ipsumdolor sit amet
- 4. Confidential 4 Lorem ipsumdolor sit amet
- 5. Confidential 5 Lorem ipsumdolor sit amet
- 6. Confidential 6 Lorem ipsumdolor sit amet
- 7. Confidential 7 What’sallaboutthis workshop • Introductionto Unityand XRTK(pronounced “Mixed Reality Toolkit”) • Microsoft cognitive services (Speech) • Runthis in a mixed reality environment(with all others)
- 9. 9Confidential Start yourengines! • Check-outboiler plate: https://github.com/wassx/Babelfish • Download Unity 2019.1.14f1 • Download Visual Studio 2019or Jetbrains Rider • Checkyour windows version Windows 10Version 1903(at least 1809) • Create youraccount (free) on https://azure.microsoft.com/en-us/
- 10. Confidential 10 • Easy setup (Content Creator / Developer / Expert) Mixed Reality Toolkit
- 11. Confidential 11 • Easy setup (Content Creator / Developer / Expert) • Quickstart for multiple devices (HoloLens, Magic Leap, Oculus,….) Mixed Reality Toolkit
- 12. Confidential 12 • Easy setup (Content Creator / Developer / Expert) • Quickstart for multiple devices (HoloLens, Magic Leap, Oculus,….) • One Service Locator to avoid raceconditions inunity lifecycle Mixed Reality Toolkit
- 13. Confidential 13 • Easy setup (Content Creator / Developer / Expert) • Quickstart for multiple devices (HoloLens, Magic Leap, Oculus,….) • One Service Locator to avoid raceconditions inunity lifecycle • Components which focus on specific functionality Mixed Reality Toolkit
- 14. Confidential 14 • Easy setup (Content Creator / Developer / Expert) • Quickstart for multiple devices (HoloLens, Magic Leap, Oculus,….) • One Service Locator to avoid raceconditions inunity lifecycle • Components which focus on specific functionality • Easy to extend Mixed Reality Toolkit
- 15. 15Confidential • Vision Recognize,identify,caption, index, andmoderateyourpictures,videos, anddigitalink content. Microsoft CognitiveServices
- 16. 16Confidential • Vision Recognize,identify,caption, index, andmoderateyourpictures,videos, anddigitalink content. • Language Convertspeechintotextand textintonatural-soundingspeech.Translate fromone languagetoanotherandenable speakerverificationand recognition. Microsoft CognitiveServices
- 20. Confidential 20 Theplan Hello my name is,...
- 21. Confidential 21 Theplan Hello my name is,...
- 22. Confidential 22 Theplan Hello my name is,... ،اسمي مرحبا...
- 23. Confidential 23 Theplan Hello my name is,... ،اسمي مرحبا... Sync text label and position
- 24. Confidential 24 Theplan Hello my name is,... ،اسمي مرحبا... Cool Sync text label and position
- 25. Confidential 25 Hacktime • Checkout the boilerplate code from github: https://github.com/wassx/Babelfish • Open unityand the project • Go to File -> build settings -> switch platform to UWP • I‘ll explain some basics of unity and the scenes • Start coding
- 26. Confidential 26 Questions,Feedback,Chat,… Stefan Wasserbauer @wassx stefan.wasserbauer@dynatrace.com
- 27. Confidential 27 Resources, Links,… Youtube: Babel fish – Hitchhiker‘s Guide to the Galaxy XRTK – Mixed Reality Toolkit Github Microsoft Cognitive Services – Speech for Unity Windows Mixed Reality headsets Photon Unity Networking