Human-robot interaction in mixed reality

'Digital twin as a service' platform

Authors

  • Marc Schnierle Hochschule Esslingen
  • Christopher Polak Hochschule Esslingen
  • Sascha Röck Hochschule Esslingen

DOI:

https://doi.org/10.17560/atp.v61i5.2415

Keywords:

human-robot interaction, mixed reality, digital twin

Abstract

Digital twins are increasingly being used in mechanical engineering for the commissioning, programming and monitoring of robots. Although new forms of interaction between reality and the digital twin are possible, hardly any modern visualization technologies have been used, such as augmented, mixed or virtual reality methods. This is due in part to the platform- and device-specific development of the applications and the lack of networking between modern devices, the control level, and the digital twins. This paper proposes a solution for the modelling, execution and provision of digital twins in a ‘Digital twin as a service’ platform. The platform-independent interaction between humans and the simulation model is ensured by an  abstraction layer. The concept is verified using the example of an interactive, real data driven digital twin of a collaborative two-arm robot.

References

International Federation of Robotics, Robots and the Workplace of the Future, Positioning Paper. 2018. Abgerufen von: https://ifr.org/downloads/papers/IFR_Robots_and_the_Workplace_of_the_Future_Positioning_Paper.pdf

Verband Deutscher Maschinen- und Anlagenbauer (VDMA). IT-Report Simulation und Visualisierung. 2017

Dörner, R.; Broll, W.; Grimm, P et al. : Virtual und Augmented Reality (VR/AR). Grundlagen und Methoden der Virtuellen und Augmentierten Realität. Springer Vieweg. 2013

VDI-Richtlinie 3693 Blatt 2 - Virtuelle Inbetriebnahme - Einführung der virtuellen Inbetriebnahme in Unternehmen

Milgram, P. : Augmented Reality: A class of displays on the reality-virtuality continuum, Telemanipulator and Telepresence Technologies, 1994

Azuma, R.: A Survey of Augmented Reality. Presence: Teleoperators and Virtual Environments 6 (1997) No. 4, pp. 355–385

Schneider, M.; Stricker, D.: AR-Unterstützung durch Steuerungshersteller, wt-online. 2017

Blankemeyer, S. ; Wiemann, R.; Posniak, L. et al. : Intuitive Robot Programming Using Augmented Reality, 7th CIRP Conference on Assembly Technologies and Systems. 2018

Ni, D.; Yew, A.; Ong. S. et al. : Haptic and visual augmented reality interface for programming welding robots. 2017

Malý, I.;Sedlácek,D. ; Leitao, P.: Augmented Reality Experiments with Industrial Robot in Industry 4.0 Environment, IEEE 14th International Conference on Industrial Informatics. 2016

Lambrecht, J.: Natürlich-räumliche Industrieroboterprogrammierung auf Basis markerloser Gestenerkennung und mobiler Augmented Reality, Dissertation. 2014

Plattform Industrie 4.0: Umsetzungsstrategie Industrie 4.0, 2015. Abgerufen von: https://www.bmwi.de/Redaktion/DE/Downloads/I/industrie-40-verbaendeplattform-bericht.pdf

Marc Schnierle, Sascha Röck, “Plattform für die Mixed-Reality-in-the-Loop-Simulation – Ein Beitrag zur Mixed-Reality-in-the-Loop-Simulation als Erweiterung der X-in-the-Loop-Methodenreihe”, wt-online. Internet: www.werkstattstechnik.de. Springer-VDI-Verlag. 2018

Dix, A. ; Finlay, J. ; Abowd, G.D. et al. : Human Computer Interaction. Harlow, UK: Pearson Education Limited. 2004

Downloads

Published

2019-05-07

Issue

Section

Article / Peer Review

Most read articles by the same author(s)