Cwin16 tls cnes-realite_augmentee_eng_v1 2

How can Augmented Reality
accelerate and secure the assembly
of satellites
Toulouse, 29/09/2016, V. DENYS

How can Augmented Reality accelerate and secure the assembly of satellites | 2016, 29th September
Copyright © 2016 Capgemini and Sogeti. All rights reserved. 2
Table of Contents
 Start with some definitions
 Context of the project
 Approach and organization
 Characterization of Augmented Reality
solution
 Prototyping and comparison
 Vuforia solution
 Diota solution
 Outputs and conclusion

Virtual EnvironmentReal Environment Augmented Reality Virtual Reality
Virtual and Augmented Reality
From real environment to virtual world
Mixed Reality Continuum

Project Context
 Today there is a concern of process maturity between
the engineering and manufacturing teams working on the
project TARANIS
 Mainly manual processes
 Lots of paper documents
 Loss of continuity between As
Design and As Built
 Today the Assembly Integration Testing
(AIT) teams seek to demonstrate the
relevance of RA techniques to optimize
and secure the work of technicians and
operators.
Taranis is the first satellite dedicated to the
observation of lightning that explode between
20 and 100 km altitude.
Ready to be launched in 2018, is eagerly
awaited by scientists around the world

Project organization – Overall approach
Technological State of the art
Business needs and business context
AR Solution characterization
Prototyping and benchmark
Advanced prototyping
Iterative and collaborative approach
 Interviews
 Co-design workshops
 Progress meetings: visibility, anticipation, adaptation

Business context
 CNES always works on a prototype (= one specimen) therefore material
evolution is permanent.
 They don’t work on an assembly line with an established configuration.
 The specimen will have its configuration evolving through time:
 % of integrated equipment
 Opened or closed panels configuration state
 Integration or not of ground systems, etc.

Use Cases identified
 Tasks can be eligible to the use of augmented reality, with a measurable ROI:
• Quality control in the integration phase
• Help in finding the location of a fixture, reservations and
fastening elements during an assembly task
 Immediate benefits identified :
• Securing and optimizing task
• Securing associated schedules
• Facilitation and simplification of the task

Technical challenge
Determine the best physical device that will
support augmented reality and fit the context of
the AIT teams in their work environment (a
camera, a tablet, connected glasses, the
combination of multiple physical devices, etc.)
The technological solution which is based on
augmented reality, whose entry point is the digital
model.

State of the art of physical devices
 Comparison of physical devices
 The retinal devices are the most effective but the technology is not mature enough
 Head-up devices have some issues for industrial use (autonomy, field of vision,
etc.)
 The devices carried by hand are the most suitable and most efficient in industry
Head-Up
display
Worn
displays
Fixed
displays
Display worn
on the head
Pico projector
Object of
interest
Retinal display
Display worn by hand
Worn pico projector
Fixed display
Projector
User

Characterization of the solution: chosen solutions
Physicaldevice
•Diota Surface Pro 4
customized Tablet
•HD Camera with
ergonomic handle
•WireLess Display
Adapter
Technologicalsolution
•Unity 3D
•Diota technology
(Diotaplayer,
DiotaStudio)
Diota Solution Vuforia Solution
Physicaldevice
• Android Sony
Xperia Z3 Tablet
• Integrated HD
camera
• WireLess
Display Adapter
Technologicalsolution
• Unity 3D
• Vuforia
Framework
• SLAM Constraint (Simultaneous Localization And
Mapping)
• No marker (direct object recognition)
• Need for an initialization phase
• Hybrid method
• Marker for detection
• 3D map dynamic creation after detection (=
no need to always see the marker)

REX Solution Vuforia
 Issues related to the definition and positioning of the marker:
 Positioning on the frame: need to have the frame modeled into CAD
 Issues with shadows
 Gaps between CAD and real position of the opened panels
Shadows

REX Solution Vuforia
 Issues related to the definition and positioning of the marker:
 Positioning small markers directly on the panels
Tape thickness Small marker on the panel
1cm drift
Reality
Augmentation
of reality
Substantial efforts to characterize industrialized
solution based on markers that can easily adapt to
different configurations and different satellites;
We couldn’t go through all tests cases

REX Solution Diota
 Owner solution
 Need to learn about using the development
tools and the specific environment
 Sometimes tedious initialization phase,
between 2 and 5 min
 V1 of the product
 Unable to select certain elements in touch
mode: Need for a tree product
 Conformity Check native module unsuited to
AIT context
 Need to create and configure JobCards
(requires knowing how to use Unity3D)
 Need to buy licenses

REX Diota Solution
 We could run through all the tests cases
 We could easily find a workaround regarding the issue with panels not being exactly
90° opened
 Example with a screw:
CAD Reality Augmented reality

REX Diota Solution
 Need to develop a specific add-on to meet business needs
Product tree
Chose item to display
Help localization
tools
Quality check:
Chose
configuration,
state,
Technical issue
Choose
transparency
Change item color
Chose depth mask

Solutions comparison synthesis
Covered
Partially
covered
Not covered
 Today Augmented Reality technology is quite mature.
 The question is not whether it works, but how can I instantiate it into
my Information System and what is the added value (ROI)?

Outputs and conclusion
 No universal and out-of-the-box solution in terms of physical device and technology
 Configuration and settings needed (it’s not magic  )
 Very strong link with the environment
 Brightness
 Shapes and sizes
 Materials
 Dimensions / Accessibility
 CAD Adequacy vs real object
 Constraints resulting from the business context
 Need to have a representative environment to develop, ideally to be directly on site
next to the object of interest in the environment
 Stakes related to User eXperience (UX)
 Augmented reality can bring productivity gains, with
measurable ROI.
 This is one brick of DIGITAL MANUFACTURING

Contact information
Vincent
DENYS
Architect/Project Manager
vincent.denys@capgemini.com
Capgemini
109 avenue du Général
Eisenhower 31000 Toulouse
Richard
BARRE
Commercial
richard.barre@capgemini.com
Capgemini
109 avenue du Général
Eisenhower 31000 Toulouse

www.capgemini.com
The information contained in this presentation is proprietary.
Copyright © 2016 Capgemini and Sogeti. All rights reserved.
Rightshore® is a trademark belonging to Capgemini.
www.sogeti.com
About Capgemini and Sogeti
With more than 180,000 people in over 40 countries, Capgemini is a
global leader in consulting, technology and outsourcing services. The
Group reported 2015 global revenues of EUR 11.9 billion. Together
with its clients, Capgemini creates and delivers business, technology
and digital solutions that fit their needs, enabling them to achieve
innovation and competitiveness. A deeply multicultural organization,
Capgemini has developed its own way of working, the Collaborative
Business Experience™, and draws on Rightshore®, its worldwide
delivery model.
Sogeti is a leading provider of technology and software testing,
specializing in Application, Infrastructure and Engineering
Services. Sogeti offers cutting-edge solutions around Testing,
Business Intelligence & Analytics, Mobile, Cloud and Cyber
Security. Sogeti brings together more than 23,000 professionals in
15 countries and has a strong local presence in over 100 locations
in Europe, USA and India. Sogeti is a wholly-owned subsidiary of
Cap Gemini S.A., listed on the Paris Stock Exchange.

Cwin16 tls cnes-realite_augmentee_eng_v1 2

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (20)

Similar to Cwin16 tls cnes-realite_augmentee_eng_v1 2

Similar to Cwin16 tls cnes-realite_augmentee_eng_v1 2 (20)

More from Capgemini

More from Capgemini (20)

Recently uploaded

Recently uploaded (18)

Cwin16 tls cnes-realite_augmentee_eng_v1 2