slides from presentation for UNSW CSE in September 2019

1. sa2019.siggraph.org
Hybrid Analytics
Expand Perception and Interaction
Tomasz Bednarz
Director at the EPICentre, UNSW Art & Design | Team Leader Visual Analytics, CSIRO Data61 | SA2019 Conference Chair

2. CONFERENCE 17-20 November 2019 - EXHIBITION 18-20 November 2019 - BCEC, Brisbane, AUSTRALIA
SA2019.SIGGRAPH.ORG
About Tomasz
• Director and Head of Visualization at the Expanded
Perception and Interaction Centre (EPICentre), UNSW Art &
Design.
• Team Leader (Visual Analytics) at the CSIRO Data61.
• Individual Member at the Khronos Group.
• Adjunct A/Professor at UniSA and QUT.
• SIGGRAPH Asia 2019 Conference Chair.
tomasz.bednarz@siggraph.org | @tomaszbednarz

4. Role of visualisation
• Visual Analytics and Automated/Statistical
Methods are complementary approaches for
Data Analysis.
• Automated/Statistical Methods approaches
work best for problems
• complete information
• well-defined questions.
• Visual Analytics benefits from Human Traits
that are difficult to replicate:
• Pattern Recognition
• Contextual Knowledge
• Intuitive Intelligence
• Prediction
Visualisation Grammar | EPICentre4 |

5. Effective visual communication
Visualisation Grammar | EPICentre5 |
Colour (highlight important information)
Typography (fonts for communication style)
Layout (logical hierarchy, consistency)
Callouts (highlight key information)
Space (avoid clutter and incoherence)
Illustration (to enhance the content)
Iconography (enhance comprehension)
Data (reveal patters using visuals)
Proportion (items properly sized)
Simplicity (zen of visualisation)

6. Milgram’s Reality Virtuality Continuum
Immersive and Big Data Visualisation
The area between the completely real and completely virtual, consists of both augmented reality, where the
virtual augments the real, and augmented virtuality, where the real augmented the virtual.
P. Milgram and A.F. Kishino, Taxonomy of Mixed Reality Visual Displays, IEICE Transactions on Information and Systems, E77-D(12), pp. 1321-1329, 1994.
@tomaszbednarz

7. Reaching Through the Looking Glass | Craig James7 |
Firing the Imagination

8. a heritage building at UNSW Art & Design in Paddington Sydney

9. • Visual Analytics
• High Performance Visualisation
• Visualisation + Simulation + AI
• Virtual Reality and Augmented Reality
• Human in the Loop, HCI Research
• Interdisciplinary Research
Expanded Perception and Interaction Centre
EPICentre - Expanded Perception and Interaction Centre | To engage or organise a tour please contact Tomasz Bednarz (Tomasz.Bednarz@data61.csiro.au)
Partnership

10. EPICENTRE
LABS
EPICYLINDER
DOME LAB
XR LAB
AVIE-SC
SUPER COMPUTERS

11. EPICYLIDNER

12. GENOMICS
VIEWER

13. Cell Lifelines
Temporal Dimension
Immersive and Big Data Visualisation

14. Cell Comparison
Linked Brushing
Immersive and Big Data Visualisation

15. Large-Scale Multiple Views
Immersive and Big Data Visualisation

16. DRUG
DISCOVERY
Collaborative Visual Analytics

17. MASSIVE
NETWORKS

18. Visualisation Design as Language Transformations
IV19 | Daniel Filonik, Marcus Foth, Markus Rittenbruch, Tomasz Bednarz18 |
1 32

19. HoloCity
HoloCity aims to integrate big transport data feeds into
meaningful insights in a collaborative mixed reality
environment

20. https://www.mapbox.com/augmented-reality/
Now we can interact with AR urban city models
globally, and rapidly, through free API services,
e.g. MapBox …

21. CREATIVE
MATH

22. CREATIVE
MATH

23. • Multi-modal API for immersive data vis
• Desktop/CAVE/Dome/XR
• Single-node/Clustered
• Multi-user/interconnected platforms
• Various methods of interaction
– Controllers/Touch/HoloLens/Gestures
• Current iterations
• Unity3D/C#
• C++/OpenGL/Vulkan
• Future iterations
• Python
Visualisation Grammar | EPICentre
High-End Visualisation System (HEVS)
23 |

24. BLOOD

25. Automatic Site Selection of Cultural Venues
• A cGAN outputs zones from urban data as a constraint prior to a
stochastic optimisation of site locations of cultural venues.
AI25 |

26. TELEOPERATION

27. Spherical Projection Example
Overview | Tomasz Bednarz
• Spherical digital video camera
• Collects video from >80% of the full sphere
• 12MP resolution at 15fps
• Six separate 2MP Sony CCD (1616x1232)
http://www.ptgrey.com
3-D Polygon Mesh

28. Visual Analytics for Mining
Immersive and Big Data Visualisation
• Hemispherical dome
• Calibration software
• Remote data streaming

29. HYBRID ANALYTICS
FOR CONSERVATION

30. Great Barrier Reef health: a local, national and
international community concern

31. Video - Citizen Scientists and the Reef – 2 minutes
Citizen scientists can help obtain needed data to improve
reef health monitoring

32. Prototype
System Components
• Spatial Modelling
• Web Interface for Citizens
• Virtual Reality Experiences
• Workflow Framework
• Key Point: general nature of
framework
• Potential to apply to other
domains; river health, invasive
species, amongst others
Spatial
Modelling
Web
Interface for
Citizens
Workflow
Framework
Virtual
Reality

33. Saving Jaguars – VR, Gaming, GPUs, Stats

34. https://www.youtube.com/watch?v=Ti5rFSuk08M

35. Saving Jaguars

36. COMPUTATIONAL PLATFORMS

37. Cloud-based Image analysis and processing toolbox
Overview | Tomasz Bednarz
Available now: http://cloudimaging.net.au, see our demos

38. Scientific Visualisation – CT Reconstruction
Insect CT scan, rendered using Drishi (http://anusf.anu.edu.au/Vizlab/drishti/) Sherry Mayo (CSIRO)

39. Cloud based imaging
Overview | Tomasz Bednarz
Research Community 4Research Community 3Research Community 2
HCA-Vision
X-TRACT
MILXView
IAWIAW
IAW
CSIRO Supported
Imaging Tools
WorkflowEditorTools
Templates
Research Community 1
Imaging
ApplicationsandServices
WorkflowManagementFramework
ParallelExecution Monitoring Fault-Tolerance DataManagement
General Purpose Imaging Tools fromVL
NeCTAR Research Cloud
DataGPU CPU
DataDataGPU CPU
GPU CPU
Virtual
Laboratory
VisualisationEnabledResults
Public Cloud
Australian Synchrotron and
Advanced CT Research Community
Advanced MRI/PET
Research Community
Neuroscience
Research Community
Characterisation VL
(MASSIVE)
Other
Biomedical Applications
Templates
Templates
Customisations Tools using underlying
workflow management
Template
Design

40. Cloud-based Image analysis and processing toolbox
Currently using WebGL based 3D viewer Slice:Drop http://slicedrop.com
Need for WebCL/WebGL → for interactive parameters tuning

41. • Transient flow:
Applications: scaling analysis
• Used to predict behaviour of the fluid flow for different cases.
• Approach: by comparing terms of governing equations.
https://bitbucket.org/tomaszbednarz/hsmac-bfc-2d

42. OpenCL Fluid Solver

43. CONFERENCE 17-20 November 2019 - EXHIBITION 18-20 November 2019 - BCEC, Brisbane, AUSTRALIA
SA2019.SIGGRAPH.ORG
SIGGRAPH Asia 2019 Brisbane
• Date: 17-20 November 2019
• Location: BCEC, Brisbane, AUSTRALIA
• Programs:
• Courses, Art Gallery, Computer Animation
Festival, Doctorial Consortium, Emerging
Technologies, XR, Real-time Live!, Technical Briefs
& Posters, Birds of a Feather, Featured Sessions
• SA2019 Demoscene
• Business and Innovation
• Theme: DREAM ZONE!
• Collocated events:
• VRST 2019, VRCAI 2019, OzViz 2019, SSS
Tomasz Bednarz
SA2019 Conference Chair

44. CONFERENCE 17-20 November 2019 - EXHIBITION 18-20 November 2019 - BCEC, Brisbane, AUSTRALIA
SA2019.SIGGRAPH.ORG
Lady Elliot Island, Queensland
Image courtesy Tourism Australia
Koala
Great Barrier Reef, Queensland
Unique Nature

45. CONFERENCE 17-20 November 2019 - EXHIBITION 18-20 November 2019 - BCEC, Brisbane, AUSTRALIA
SA2019.SIGGRAPH.ORG
BRISBANE CBD & BRISBANE RIVER

47. Thank you
sa2019.siggraph.org
See you in 2019 in Brisbane!