Context Aware 3D Image Processing and Acquisition

A Service-Oriented System in Scope of I4.0 Applications

Authors

  • Faraz Bhatti
  • Grischan Engel Hochschule Pforzheim
  • Maximilian Engelsberger Hochschule Pforzheim
  • Mathias Ziebert Karlsruhe Institute of Technology
  • Niclas Zeller Karlsruhe Institute of Applied Sciences
  • Jürgen Beyerer Karlsruhe Institute of Technology
  • Thomas Greiner Hochschule Pforzheim
  • Michael Heizmann Karlsruhe Institute of Technology
  • Franz Quint Karlsruhe Institute of Applied Sciences

DOI:

https://doi.org/10.17560/atp.v61i3.2378

Keywords:

service-oriented architecture, centext model, semantic interface, FPGA based architecture, parallelization, deflectomery sensor system, plenoptic system

Abstract

3D image processing systems require significant configuration and execution time. Thus, in this paper a smart camera based modular sensor system for context-aware optical acquisition and processing of 3D data for Industry 4.0 applications is proposed. This system is based on a modular service-oriented architecture, which encapsulates the complete functionality of the system. Additionally, functionalities and features of the modular architecture are semantically described using GenICam standard. The presented system also defines a context model that takes into account the intrinsic as well as the extrinsic influences. Likewise, sufficient responses are defined for environmental conditions. The results based on a deflectometry sensor system, obtained in a case study, show that it is dynamically adaptable to extraneous light. Finally, the FPGA based architecture reduces the execution time of the deflectometry algorithm significantly.

References

VDI/VDE 2632. (2010). Machine vision – Basics, terms and definitions. VDI/VDE: www.beuth.de

Zeller, N., Quint, F., & Stilla, U. (2015, October). Establishing a probabilistic depth map from focused plenoptic cameras. In 3D Vision (3DV), 2015 International Conference on (pp. 91-99). IEEE.

Höfer, S., Roschani, M., & Werling, S. (2013, May). Pattern coding strategies for deflectometric measurement systems. In Videometrics, Range Imaging, and Applications XII; and Automated Visual Inspection (Vol. 8791, p. 87911O). International Society for Optics and Photonics.

Focken, D., & Stiefelhagen, R. (2002). Towards vision-based 3-d people tracking in a smart room. In Proceedings. Fourth IEEE International Conference on Multimodal Interfaces (pp. 400-405). IEEE.

Fleck, S., & Straßer, W. (2008). Smart camera based monitoring system and its application to assisted living. Proceedings of the IEEE, 96(10), 1698-1714.

Choi, J., Shin, H., & Sohn, K. (2012, June). Smart stereo camera system based on visual fatigue factors. In Broadband Multimedia Systems and Broadcasting (BMSB), 2012 IEEE International Symposium on (pp. 1-5). IEEE.

Xu, Y., John, V., Mita, S., Tehrani, H., Ishimaru, K., & Nishino, S. (2017, June). 3D point cloud map based vehicle localization using stereo camera. In Intelligent Vehicles Symposium (IV), 2017 IEEE (pp. 487-492). IEEE.

Xu, Y., Long, Q., Mita, S., Tehrani, H., Ishimaru, K., & Shirai, N. (2016, June). Real-time stereo vision system at nighttime with noise reduction using simplified non-local matching cost. In Intelligent Vehicles Symposium (IV), 2016 IEEE (pp. 998-1003). IEEE.

Banz, C., Hesselbarth, S., Flatt, H., Blume, H., & Pirsch, P. (2010, July). Real-time stereo vision system using semi-global matching disparity estimation: Architecture and FPGA-implementation. In Embedded Computer Systems (SAMOS), 2010 International Conference on (pp. 93-101). IEEE.

Sweeney, R. (2010). Achieving service-oriented architecture: applying an enterprise architecture approach. John Wiley & Sons.

Webber, J., Parastatidis, S., & Robinson, I. (2010). REST in practice: Hypermedia and systems architecture. " O'Reilly Media, Inc.".

European Machine Vision Association. (2017). GenICam GenTL Standard Features Naming Convention, EMVA Version 1.1.1. Abgerufen von: https://www.emva.org/wp-content/uploads/GenICam_GenTL_SFNC_1_1_1.pdf

Dey, A. K. (2001). Understanding and using context. Personal and ubiquitous computing, 5(1), 4-7.

Curiel, P., & Lago, A. B. (2013). An Infrastructure to Enable Lightweight Context-Awareness for Mobile Users. Sensors, 13(8), 9635-9652.

Strang, T., & Linnhoff-Popien, C. (2004, September). A context modeling survey. In Workshop on advanced context modelling, reasoning and management, UbiComp (Vol. 4, pp. 34-41).

Ligeza, A. (2006). Logical foundations for rule-based systems (Vol. 11). Heidelberg: Springer.

Ziebarth, M., Zeller, N., Heizmann, M., & Quint, F. (2018). Modeling the unified measurement uncertainty of deflectometric and plenoptic 3-D sensors. Journal of Sensors and Sensor Systems, 7(2), 517-533.

Downloads

Published

2019-03-19

Issue

Vol. 61 No. 3 (2019): atp magazin

Section

Article / Peer Review

License

Die Zeitschrift und alle in ihr enthaltenen Beiträge und Abbildungen sind urheberrechtlich geschützt. Jede Verwertung außerhalb der engen Grenzen des Urheberrechtsgesetzes ist ohne Zustimmung des Verlages unzulässig und strafbar. Das gilt insbesondere für  Vervielfältigungen, Übersetzungen, Mikroverfilmungen und die Einspeicherung und Bearbeitung in elektronischen Systemen. Auch die Rechte der Wiedergabe durch Vortrag, Funk- und Fernsehsendung, im Magnettonverfahren oder ähnlichem Wege bleiben vorbehalten.