Refine
Document Type
Institute
Language
- English (2)
Is part of the Bibliography
- yes (2)
Keywords
- Digital twin (2) (remove)
One goal of the project described in this paper is to create learning algorithms for machines and robots that lack a precise virtual controller for correct simulations. Using a digital twin approach, the developed mixed reality application aims for an overlay of a virtual robot model with the real world counterpart using Microsoft HoloLens 2 smart glasses. The application should help users to have an inside look into the results of the learning algorithm and therefore supervise and improve those results. The main focus of this paper is the visual representation of the digital twin on the smart glasses. One of the challenges is the level of abstraction and specific use of shaders (program code defining material attributes) to help the user differentiating between virtual and real objects. Therefore different presentation methods are described and evaluated. Study results with 48 persons show that the most abstract representation (wireframe) scores lowest, whereas a half-transparent model works best.
As the boundary between real and virtual life is becoming increasingly blurred, researchers and practitioners are looking for ways to integrate the two intending to improve human lives in a plethora of domains. A cutting-edge concept is the design of Digital Twins (DT), having a broad range of implications and applications, spanning from education, training, as well as safety and productivity in the workplace. An emergent approach for implementing DTs is the usage of mixed reality (MR) and augmented reality (AR), which are well aligned with merging real and virtual objects to enhance the human’s ability to interact with and manage DTs. Yet, this is still a novel area of research and, as such, a grounded understanding of the current state, challenges, and open questions is still lacking. Towards this, we conducted a PRISMA-based literature review of scientific articles and book chapters dealing with the use of MR and AR for digital twins. After a thorough screening phase and eligibility check, 25 papers were analyzed, sorted and compared by different categories like research topic (e.g., visualization, guidance), domain (e.g., manufacturing, education), paper type (e.g., design study, evaluation), evaluation type (user study, case study or none), used hardware (e.g., Microsoft HoloLens, mobile devices) as well as the different outcomes (result type and topic, problems, outlook). The major finding of this research survey is the predominant focus of the reviewed papers on the technology itself and the neglect of factors regarding the users. We, therefore, encourage researchers in this area to keep the importance of ease and joy of use in mind and include users in multiple stages of their work.