1. AUGMENTED REALITY IN INDUSTRY 4.0:
ENABLING TECHNOLOGIES AND THE
POTENTIAL FOR SMEs
GULAY EKREN
Sinop University
BIRGIT OBERER
Sakarya University
ALPTEKIN ERKOLLAR
Sakarya University
2. Co-workers
Alptekin ERKOLLAR, Phd
Sakarya University, TURKEY
Faculty of Management, Department of Management Information Systems
erkollar@sakarya.edu.tr
Birgit OBERER, Phd
Sakarya University, TURKEY
Faculty of Management, Department of Management Information Systems
oberer@sakarya.edu.tr
Gülay EKREN, Phd Student
Sinop University, TURKEY
Departmant of Computer Technologies, Vocational School of Ayancık
gekren@sinop.edu.tr
3. Introduction
• Industry 4.0 (I4.0)
• I4.0 required
• advanced technologies (e.g. artificial intelligence,
robotics, 3D printing) and business models
• a high level of maturity
• small and medium-sized businesses (SMEs)
• face difficulties in adopting Industry 4.0 ideas
• hesitant to invest in new technologies (QR codes,
RFID tags, AR markers etc.)
4. Introduction
• Augmented Reality (AR)
• plays a significant role in industrial environments
• support and facilitating opportunities for SMEs
• new technologies should be developed for SMEs in
coming years
5. Aims
• Industry 4.0 (I4.0)
• I4.0 required
• advanced technologies (e.g. artificial intelligence,
robotics, 3D printing) and business models
• a high level of maturity
• small and medium-sized businesses (SMEs)
• face difficulties in adopting Industry 4.0 ideas
• hesitant to invest in new technologies (QR codes,
RFID tags, AR markers etc.)
• This study aims
• to introduce industrial AR technologies that
SMEs can use to improve their Industrial 4.0
capabilities
• potentials that facilitate the process of SMEs'
adaptation to Industry 4.0.
• a set of case studies is presented to examine
opportunities of AR technologies for SMEs.
6. SMEsandI4.0
• Criteria for inclusion; Research should be:
• Conducted in the context of distance higher education
• Examined the effect of openness on distance
education.
• used quantitative, qualitative, mixed or other research
methods.
• providing necessary information for openness in its
abstract.
• Digital transition
• in Europe the initiatives named as "Industrie 4.0"
in Germany, "Catapult" in the United Kingdom,
"Factory of the Future" in France and Italy
• in China, a range of activities named as "Made in
China 2025" initiative
• in the USA, a whole range of federally funded
programs have been initiated to promote
advanced manufacturing
7. SMEsandI4.0
• Criteria for inclusion; Research should be:
• Conducted in the context of distance higher education
• Examined the effect of openness on distance
education.
• used quantitative, qualitative, mixed or other research
methods.
• providing necessary information for openness in its
abstract.
• SMEs are socially and economically important
• represent 99% of all enterprises as well as
around 65 million employments in the Europe
(http://ec.europa.eu).
Criteria for micro, small or medium-sized enterprises (EC, 2015)
9. Technologies
RelatedtoAR
• Criteria for inclusion; Research should be:
• Conducted in the context of distance higher education
• Examined the effect of openness on distance
education.
• used quantitative, qualitative, mixed or other research
methods.
• providing necessary information for openness in its
abstract.
• AR markers (e.g. QR code),
• displays and hologram technologies (e.g. head-
mounted devices, glasses),
• mobile devices,
• cloud computing,
• tracking technologies (e.g. GPS, RFID, Infra-red
LEDs),
• interaction technologies (e.g. touch screen,
speech recognition).
10. Technologies
RelatedtoAR
• Criteria for inclusion; Research should be:
• Conducted in the context of distance higher education
• Examined the effect of openness on distance
education.
• used quantitative, qualitative, mixed or other research
methods.
• providing necessary information for openness in its
abstract.
• AR markers
11. Technologies
RelatedtoAR
• Criteria for inclusion; Research should be:
• Conducted in the context of distance higher education
• Examined the effect of openness on distance
education.
• used quantitative, qualitative, mixed or other research
methods.
• providing necessary information for openness in its
abstract.
• Displays and Hologram technologies
Elevator maintenance with Microsoft HoloLens
(https://www.youtube.com/watch?v=8OWhGiyR4Ns)
12. Technologies
RelatedtoAR
• Criteria for inclusion; Research should be:
• Conducted in the context of distance higher education
• Examined the effect of openness on distance
education.
• used quantitative, qualitative, mixed or other research
methods.
• providing necessary information for openness in its
abstract.
• Mobile devices and Cloud computing
AR experience using a mobile device
(Speicher et al., 2015)
13. CaseStudies
• Index AR Solutions (http://www.indexarsolutions.com/)
An AR application of Index AR Solutions
(https://www.youtube.com/watch?v=oBzIKZqEGwI)
14. CaseStudies
• AR Solutions of Immersion (http://www.immersion.fr)
An AR tool of Sunna Design
(https://www.youtube.com/watch?v=NIyyb5Jj7tk )
15. CaseStudies
• AR Solutions of VTScada (https://www.trihedral.com/ )
SCADA systems control with HoloLens
(https://www.youtube.com/watch?v=XK_hW_c99Xs)
16. CaseStudies
• The SCS Concept and DMG solutions
(http://scsconcept.com, http://www.dmgsolutions.net/)
A visual production guide for manufacturing
(https://www.youtube.com/watch?v=0m67O1Em7dY)
17. CaseStudies
• Solutions of EquipCodes (http://www.equipcodes.com/)
An AR equipment training & maintenance app
(https://www.youtube.com/watch?v=nHfY56lHZjU)
18. InClosing
• SMEs for Industry 4.0
• There is a high potential,
• a lack of adoption the emerging technologies
• AR technology
• Early enterprise adopters will gain a significant
competitive advantage
• A range of case studies presented here can help
SMEs to add value to their business processes
through AR technology in the vision of Industry 4.0.
19. Alam, M. F., Katsikas, S., Beltramello, O., & Hadjiefthymiades, S. (2017). Augmented and virtual reality based monitoring and safety system: A
prototype IoT platform. Journal of Network and Computer Applications, 89, 109-119.
Bareño, J. (2014). Large-scale Integrated Project (IP). Available from:
https://forge.fiware.org/docman/view.php/7/5017/D11.2.3_Exploitation_Plan,_including_IPR_Managementv_M44.pdf [accessed July 14, 2017].
Billinghurst, M., Clark, A., & Lee, G. (2015). A survey of augmented reality. Foundations and Trends® in Human–Computer Interaction, 8(2-3), 73-272.
Broll, W., Meier, E., & Schardt, T. (2000, September). The virtual round table-a collaborative augmented multi-user environment. In Proceedings of the
third international conference on Collaborative virtual environments (pp. 39-45). ACM.
Chi, H. L., Kang, S. C., & Wang, X. (2013). Research trends and opportunities of augmented reality applications in architecture, engineering, and
construction. Automation in construction, 33, 116-122.
Cordis Project (2017). SME 4.0. Available from http://cordis.europa.eu/project/rcn/207061_en.pdf [July 21, 2017]
Decker, A. (2017). Industry 4.0 and SMEs in the Northern Jutland Region. In Value Creation in International Business (pp. 309-335). Springer
International Publishing.
EC, European Commission (2015). SME Definition - user guide 2015. Available from:
http://ec.europa.eu/DocsRoom/documents/15582/attachments/1/translations [accessed July 17, 2017].
Erol, S., Jäger, A., Hold, P., Ott, K., & Sihn, W. (2016). Tangible Industry 4.0: a scenario-based approach to learning for the future of
production. Procedia CIRP, 54, 13-18.
Faller, C., & Feldmüller, D. (2015). Industry 4.0 learning factory for regional SMEs. Procedia CIRP, 32, 88-91.
Gammeter, S., Gassmann, A., Bossard, L., Quack, T., & Van Gool, L. (2010, June). Server-side object recognition and client-side object tracking for
mobile augmented reality. In Computer Vision and Pattern Recognition Workshops (CVPRW), 2010 IEEE Computer Society Conference on (pp. 1-8).
IEEE.
Gervautz, M. & Schmalstieg, D. (2012). Anywhere Interfaces Using Handheld Augmented Reality. IEEE Computer Society. (pp. 26-31).
Gracia, L., Perez-Vidal, C., Mronga, D., de Paco, J. M., Azorin, J. M., & de Gea, J. (2017). Robotic manipulation for the shoe-packaging process. The
International Journal of Advanced Manufacturing Technology, 1-15.
Guerin, K. R., Lea, C., Paxton, C., & Hager, G. D. (2015, May). A framework for end-user instruction of a robot assistant for manufacturing. In Robotics
and Automation (ICRA), 2015 IEEE International Conference on (pp. 6167-6174). IEEE.
Han, D. I., Jung, T., & Gibson, A. (2013). Dublin AR: implementing augmented reality in tourism. In Information and communication technologies in
tourism 2014 (pp. 511-523). Springer, Cham.
Izkara, J. L., Pérez, J., Basogain, X., & Borro, D. (2007, June). Mobile augmented reality, an advanced tool for the construction sector. In Proceedings of
the 24th W78 conference, Maribor, Slovenia (pp. 190-202).
20. Kleindienst, M. & Ramsauer, C. (2016). SMEs and Industry 4.0 – Introducing a KPI based Procedure Model to identify Focus Areas in Manufacturing
Industry. Athens Journal of Business and Economics, 2(2), 109-122.
Kwon, O. S., Park, C. S., & Lim, C. R. (2014). A defect management system for reinforced concrete work utilizing BIM, image-matching and augmented
reality. Automation in construction, 46, 74-81.
Langlotz, T., Degendorfer, C., Mulloni, A., Schall, G., Reitmayr, G. & Schmalstieg, D. (2011). Robust detection and tracking of annotations for outdoor
augmented reality browsing. Computers & Graphics, 35, 831–840.
Materna, Z., Kapinus, M., Beran, V., SmrĚ, P., Giuliani, M., Mirnig, N., ... & Tscheligi, M. (2017, March). Using persona, scenario, and use case to develop a
human-robot augmented reality collaborative workspace. In Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-
Robot Interaction (pp. 201-202). ACM.
Malý, I., Sedláček, D., & Leitão, P. (2016, July). Augmented reality experiments with industrial robot in industry 4.0 environment. In Industrial Informatics
(INDIN), 2016 IEEE 14th International Conference on (pp. 176-181). IEEE.
Ong, S. K., Yuan, M. L., & Nee, A. Y. C. (2008). Augmented reality applications in manufacturing: a survey. International journal of production
research, 46(10), 2707-2742.
Quigley, M., & Burke, M. (2013). Low-cost Internet of Things digital technology adoption in SMEs. International Journal of Management Practice, 6(2),
153-164.
Pan, Z., Polden, J., Larkin, N., Van Duin, S., & Norrish, J. (2012). Recent progress on programming methods for industrial robots. Robotics and Computer-
Integrated Manufacturing, 28(2), 87-94.
Paelke, V. (2014). Augmented reality in the smart factory: Supporting workers in an industry 4.0. environment. In Emerging Technology and Factory
Automation (ETFA), 2014 IEEE (pp. 1-4). IEEE.
Papagiannakis, G., Singh, G., & Magnenat‐Thalmann, N. (2008). A survey of mobile and wireless technologies for augmented reality systems. Computer
Animation and Virtual Worlds, 19(1), 3-22.
Schröder, C. (2017). The Challenges of Industry 4.0 for Small and Medium-sized Enterprises. A project by the friedrich-ebert-stiftung 2015–2017.
Available from http://library.fes.de/pdf-files/wiso/12683.pdf
Shi, L. (2017). Improving AR tracking and registration with markerless technology (Master's thesis, Universitat Politècnica de Catalunya).
Speicher, M., Kristina T., Simon H. & Harry H. (2015). "Enabling Industry 4.0 with holobuilder". In: INFORMATIK 2015. Ed. By D. W. Cunningham, P.
Hofstedt, K. Meer & I. Schmitt. 246, (pp. 1561–1575). Available from
https://www.researchgate.net/publication/282293186_Enabling_Industry_40_with_holobuilder [accessed July 14, 2017].
21. Stock, T., & Seliger, G. (2016). Opportunities of sustainable manufacturing in industry 4.0. Procedia Cirp, 40, 536-541.
Tabusca, A., & Maniu, L. C. (2017). Modern Technologies and Innovation-Source of Competitive Advantage for Tourism SMEs. Journal of Information
Systems & Operations Management, 83.
Thalen, J. P., & van der Voort, M. C. (2012). Facilitating user involvement in product design through virtual reality. In Virtual Reality-Human Computer
Interaction. Intech.
Unzeitig, W., Wifling, M., Stocker, A., & Rosenberger, M. (2015, June). Industrial challenges in human-centred production. In MOTSP 2015-International
Conference Management of Technology (pp. 10-12).
Van Krevelen, D. W. F., & Poelman, R. (2010). A survey of augmented reality technologies, applications and limitations. International Journal of Virtual
Reality, 9(2), 1.
Velandia, D. M. S., Kaur, N., Whittow, W. G., Conway, P. P., & West, A. A. (2016). Towards industrial internet of things: Crankshaft monitoring, traceability
and tracking using RFID. Robotics and Computer-Integrated Manufacturing, 41, 66-77.
Zhou, F., Duh, H. B. L., & Billinghurst, M. (2008). Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR.
In Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality (pp. 193-202). IEEE Computer Society.
Editor's Notes
Ladies and gentelman,
Welcome to our presentation. Thank you for your participation. Our title is «AUGMENTED REALITY IN INDUSTRY 4.0: ENABLING TECHNOLOGIES AND THE POTENTIAL FOR SMEs»
I’m Gülay Ekren. I’m from Turkey. I’m a Phd student in the department of Management Information Systems of Sakarya University. I’m very glad to be here with you.
I want to introduce you my co-workers. They are from Turkey, too.
Birgit OBERER and Alptekin ERKOLLAR from Sakarya University, Department of Management Information Systems
I want to start with industry 4.0. Industry 4.0 is expected to reach a high level of growth and productivity above forecasts over the next decade.
Industry 4.0 also requires the acquisition of new technologies and business models.
Providing access to advanced technologies (e.g. artificial intelligence, robotics, 3D printing) offered by Industry 4.0 requires a high level of maturity, especially for small and medium-sized businesses (SMEs)
Hence, SMEs face difficulties in adopting Industry 4.0 ideas and they are hesitant to invest in new technologies such as; printed QR codes, embedded Radio Frequency Identification (RFID) tags, embedded devices, and Augmented Reality (AR) markers because of their high initial costs and a lack of trained manpower for using them
AR means the integration of the information generated in the computer to the real life.
AR plays a significant role in industrial environments. Most existing AR applications display the user's current environment with computer graphics, allowing the user to access and interact with information that is directly related to the environment in which they are located.
They also offer support and facilitating opportunities for SMEs to comply with Industry 4.0. Most of the research efforts have focused on providing a suitable robotic programming method for SMEs using new concepts such as AR. They suggest that new technologies should be developed for SMEs in coming years.
Current research activities indicate that there are deficiencies through enabling business applications that will align SMEs with Industry 4.0 as well as the necessary conversions, especially in areas such as production, retail, advertising, after-sales support, and marketing.
This study aims to introduce industrial AR technologies that SMEs can use to improve their Industrial 4.0 capabilities as well as potentials that facilitate the process of SMEs' adaptation to Industry 4.0. Besides, a set of case studies is presented to examine opportunities of AR technologies for SMEs.
Nowadays, there is a range of initiatives that have been launched in many industrialized countries to help SMEs make the digital transition.
For example, in Europe, the initiatives named as "Industrie 4.0" in Germany, "Catapult" in the United Kingdom, and "Factory of the Future" in France and Italy.
Besides, in China, a range of activities named as "Made in China 2025" initiative drives for more digitalization.
Similarly, in the USA, a whole range of federally funded programs have been initiated to promote advanced manufacturing.
SMEs are socially and economically important, since they represent 99% of all enterprises as well as around 65 million employments in the Europe
European Commission (EC) has defined micro, small or medium-sized enterprises with specific, quantifiable boundaries taken into consideration with staff numbers and monetary amounts as shown in Table
This table provides an overview of SMEs for their adoption to Industry 4.0. According to this table, direct consequences and challenges of SMEs for their adoption to Industry 4.0 based on such issues: horizontal integration over value-creation networks, consistency of engineering over the whole lifecycle, vertical integration and cross-linked production systems, new social infrastructures of work, and continuous development of cross-sectional technologies.
From the micro perspective, Industry 4.0 mainly covers the horizontal integration as well as the vertical integration within smart factories. The horizontal integration is characterized by the cross-linked value creation modules along the material flow of the smart factory whereas vertical integration describes the intelligent crosslinking of the value creation factors such as product, equipment and human (Stock & Seliger, 2016). SMEs need the support and knowledge to develop those integrations in an efficient way (Faller & Feldmüller, 2015).
Nowadays, AR moves from laboratories to various industries and consumer markets. It potentially can apply to all senses, including hearing, touch, smell and sight. Displays, trackers, software, graphics and computers are the fundamental parts of an AR system.
In this study, rapidly emerging technologies that will play significant roles in the application of AR in SMEs are introduced. These technologies are determined as the most mature ones as well as shown the greatest development in the past decades.
Tags are used in most of the current AR environments. These settings provide advanced physical interactions to users by pointing the portable and mobile devices as well as projectors on specific AR markers.
Additionally, an AR tracking software can be used to identify and track specific markers resulting in 3D interactive representation.
SMEs are usually lack of knowledge and training to develop AR markers such as QR Codes and to adopt new practices. However, these technologies are invaluable for supporting SMEs on how to improve their business processes without significantly increasing costs. Moreover, the usage of large-scale production systems via robots is not usually suitable for SMEs since the products are customized for a particular contact in SMEs.
Visualization devices are one of the main elements of the augmented reality systems.
AR applications usually rely on computer capabilities of mobile devices to produce visual output by using a geometric model of the real objects in the scene, or sensors that display navigation aids and information bubbles on a real-world view.
Hologram technology is the next evolution in computing. Microsoft HoloLens is a wearable computer that can create holograms. Figure presents the predictive maintenance service for elevators which visualize and identify problems with elevators using Microsoft HoloLens.
Nowadays, mobile devices come equipped with capabilities such as high-resolution touch screens, cameras, accelerometers, GPS, and compass, which make them ideal platforms for AR applications.
However; they have limited resources related to their memory or processing power, and so these features restrict the techniques that are applicable in practice of AR when compared to dedicated industrial sensors used in previous larger AR setups.
On the other hand, cloud computing technology providers to access and process significant amounts of data in real time as well as software-based functionalities on an ad-hoc basis, comparable with application programs that can be uploaded to portable and mobile devices when needed.
Here are a few case studies to illustrate the diversity of opportunities for industrial needs of SMEs through AR technology.
One of them is Index AR Solutions. This tool can be used to see pipe fittings of a ship that walks through the walls. When a staff overlaid the tool on the physical aspects of the ship, it gives the staff a 3D view of what they are looking at -- resulting in significant savings in time and stress
Immersion demonstrates its AR capabilities via Sunna Design.
They use an AR tool allows the whole staff to self-train quickly on the workstation. This tool reduces training time 80% for the entire staff as well as work arduousness 70%, and surface area 30% for per product. Hence, a production capacity multiplied by five compared to initial goal. This SME can be seen as a factory of future, and also a showroom.
VTScada provides a product for SCADA (Supervisory Control and Data Acquisition) industry.
A plant uses AR solutions of VTScada to run their operations for water and waste water treatment for the town of Windsor in Canada. An augmented reality product; HoloLens have been using in their SCADA systems’ control.
The SCS Concept and DMG provide an AR solution for manufacturing processes. A visual production guide can manage the production workflow according to the instructions for full operator guidance. Errors are automatically detected; for example, if the operator picks the wrong piece of assembly, the system is giving a warning as of both auditory and virtually.
EquipCodes simply tags the products with QR codes, and then they can be scanned through dedicated software on smartphones and tablets by customers for getting valuable tools or resources.
This app brings instructions out of the paper manual and presents them directly on the real equipment with AR overlays and 3D models. It is like an instructor standing right next to the equipment, so the staff can learn maintenance procedures as well as getting guidance for the most common installation correctly step by step.
The transition of Industry 4.0 expertise and its enabling technologies in SMEs have seen a significant challenge for the future.
AR technology will improve the companies in all aspects of their value chain from marketing to manufacturing and construction, to supervision, operations and maintenance. Early enterprise adopters will gain a significant competitive advantage over their competitors if they have more closely involved in this technology.
A range of case studies presented here can help SMEs to add value to their business processes through AR technology in the vision of Industry 4.0.
This study provides especially SMEs to leverage AR in their companies to gain that advantage as well as a roadmap for SMEs to adopt AR technology which has a high value in the Industry 4.0 area.
Thank you so much for listening and of course your contribution as well as attention. Any question?