Abstract
The automotive industry is currently facing massive challenges. Shorter product life cycles together with mass customization lead to a high complexity for manual assembly tasks. This induces the need for effective manual assembly assistances which guide the worker faultlessly through different assembly steps while simultaneously decrease their completion time and cognitive load. While in the literature a simulation-based assistance visualizing an augmented digital human was proposed, it lacks the ability to incorporate knowledge about the context of an assembly scenario through arbitrary sensor data. Within this paper, a general framework for the modular acquisition, interpretation and management of context is presented. Furthermore, a novel context-aware assistance application in augmented reality is introduced which enhances the previously proposed simulation-based assistance method by several context-aware features. Finally, a preliminary study (N = 6) is conducted to give a first insight into the effectiveness of context-awareness for the simulation-based assistance with respect to subjective perception criteria. The results suggest that the user experience is improved by context-awareness in general and the developed context-aware features were overall perceived as useful in terms of error, time and cognitive load reduction as well as motivational increase. However, the developed software architecture offers potential for improvement and future research considering performance parameters is mandatory.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Abowd, G.D., Dey, A.K., Brown, P.J., Davies, N., Smith, M., Steggles, P.: Towards a better understanding of context and context-awareness. In: Gellersen, H.-W. (ed.) HUC 1999. LNCS, vol. 1707, pp. 304–307. Springer, Heidelberg (1999). https://doi.org/10.1007/3-540-48157-5_29
Azuma, R.T.: A survey of augmented reality. Presence Teleoperators Virtual Environ. 6(4), 355–385 (1997). https://doi.org/10.1162/pres.1997.6.4.355
Baldauf, M., Dustdar, S., Rosenberg, F.: A survey on context-aware systems. Int. J. Ad Hoc Ubiquit. Comput. 2(4), 263–277 (2007). https://doi.org/10.1504/IJAHUC.2007.014070
Bannat, A., et al.: Towards optimal worker assistance: a framework for adaptive selection and presentation of assembly instructions. In: 2008 1st International Cotesys Workshop, p. 7 (2008)
Bannat, A., Gast, J., Rigoll, G., Wallhoff, F.: Event analysis and interpretation of human activity for augmented reality-based assistant systems. In: 2008 4th International Conference on Intelligent Computer Communication and Processing, pp. 1–8. IEEE, Cluj-Napoca (2008). https://doi.org/10.1109/ICCP.2008.4648347
Blochwitz, T., et al.: Functional mockup interface 2.0: the standard for tool independent exchange of simulation models. In: Proceedings of the 9th International MODELICA Conference, pp. 173–184. The Modelica Association (2012)
Bubb, H., Müller, H., Schubö, A., Rigoll, G., Wallhoff, F., Zäh, M.F.: CoTeSys progress report 2008: ACIPE - adaptive cognitive interaction in production environments (2008)
Chen, H.: An intelligent broker architecture for pervasive context-aware systems. Ph.D. thesis, University of Maryland, Baltimore County (2004)
Chen, X., et al.: ImmerTai: immersive motion learning in VR environments. J. Vis. Commun. Image Represent. 58, 416–427 (2019). https://doi.org/10.1016/j.jvcir.2018.11.039
Doerr, K., Arreola-Risa, A.: A worker-based approach for modeling variability in task completion times. IIE Trans. 32, 625–636 (2000). https://doi.org/10.1023/A:1007659032655
ElMaraghy, W., ElMaraghy, H., Tomiyama, T., Monostori, L.: Complexity in engineering design and manufacturing. CIRP Ann. 61(2), 793–814 (2012). https://doi.org/10.1016/j.cirp.2012.05.001
Field, A., Hole, G.: How to Design and Report Experiments, reprint edn. Sage, Los Angeles (2013)
Funk, M., Kosch, T., Kettner, R., Korn, O., Schmidt, A.: motionEAP: an overview of 4 years of combining industrial assembly with augmented reality for industry 4.0. In: Proceedings of the 16th International Conference on Knowledge Technologies and Data-Driven Business, pp. 1–4 (2016)
Gaisbauer, F., Lampen, E., Agethen, P., Rukzio, E.: Combining heterogeneous digital human simulations: presenting a novel co-simulation approach for incorporating different character animation technologies. Vis. Comput. (2020). https://doi.org/10.1007/s00371-020-01792-x
Grubert, J., Langlotz, T., Zollmann, S., Regenbrecht, H.: Towards pervasive augmented reality: context-awareness in augmented reality. IEEE Trans. Vis. Comput. Graph. 23(6), 1706–1724 (2017). https://doi.org/10.1109/TVCG.2016.2543720
Gámez-Romero, J., Serrano, M.A., García, J., Molina, J.M., Rogova, G.: Context-based multi-level information fusion for harbor surveillance. Inf. Fusion 21, 173–186 (2015). https://doi.org/10.1016/j.inffus.2014.01.011
Gündoğran, C., Kietzmann, P., Lenders, M., Petersen, H., Schmidt, T.C., Wählisch, M.: NDN, CoAP, and MQTT: a comparative measurement study in the IoT. In: Proceedings of the 5th ACM Conference on Information-Centric Networking, ICN 2018, pp. 159–171. ACM Press, Boston (2018). https://doi.org/10.1145/3267955.3267967
Hall, E.T.: The Hidden Dimension: Man’s Use of Space in Public and Private. Bodley Head, London (1969)
Han, P.H., Chen, K.W., Hsieh, C.H., Huang, Y.J., Hung, Y.P.: AR-Arm: augmented visualization for guiding arm movement in the first-person perspective. In: Proceedings of the 7th Augmented Human International Conference 2016, AH 2016, pp. 1–4. ACM Press, Geneva (2016). https://doi.org/10.1145/2875194.2875237
Hinrichsen, S., Riediger, D., Unrau, A.: Assistance systems in manual assembly. In: Production Engineering and Management, Lemgo (2016)
Hong, D., Schmidtke, H.R., Woo, W.: Linking context modelling and contextual reasoning. In: 4th International Workshop on Modeling and Reasoning in Context, pp. 37–48 (2007)
Korn, O., Schmidt, A., Hörz, T.: The potentials of in-situ-projection for augmented workplaces in production: a study with impaired persons. In: Proceedings of the Conference on Human Factors in Computing Systems, CHI 2013, p. 6 (2013)
Korn, O., Schmidt, A., Hörz, T., Kaupp, D.: Assistive system experiment designer ASED: a toolkit for the quantitative evaluation of enhanced assistive systems for impaired persons in production. In: Proceedings of the 14th International ACM SIGACCESS Conference on Computers and Accessibility, ASSETS 2012, p. 259. ACM Press, Boulder (2012). https://doi.org/10.1145/2384916.2384982
Lampen, E., Teuber, J., Gaisbauer, F., Bär, T., Pfeiffer, T., Wachsmuth, S.: Combining simulation and augmented reality methods for enhanced worker assistance in manual assembly. Procedia CIRP 81, 588–593 (2019). https://doi.org/10.1016/j.procir.2019.03.160
Miller, M.R., Jun, H., Herrera, F., Villa, J.Y., Welch, G., Bailenson, J.N.: Social interaction in augmented reality. PLoS ONE 14(5), e0216290 (2019). https://doi.org/10.1371/journal.pone.0216290
Mura, M.D., Dini, G., Failli, F.: An integrated environment based on augmented reality and sensing device for manual assembly workstations. Procedia CIRP 41, 340–345 (2016). https://doi.org/10.1016/j.procir.2015.12.128
Perera, C., Zaslavsky, A., Christen, P., Georgakopoulos, D.: Context aware computing for the Internet of Things: a survey. IEEE Commun. Surv. Tutor. 16(1), 414–454 (2014). https://doi.org/10.1109/SURV.2013.042313.00197. arXiv: 1305.0982
Renner, P., Pfeiffer, T.: Evaluation of attention guiding techniques for augmented reality-based assistance in picking and assembly tasks. In: Proceedings of the 22nd International Conference on Intelligent User Interfaces Companion, IUI 2017 Companion, pp. 89–92. ACM Press, Limassol (2017). https://doi.org/10.1145/3030024.3040987
Rodriguez, L., Quint, F., Gorecky, D., Romero, D., Siller, H.R.: Developing a mixed reality assistance system based on projection mapping technology for manual operations at assembly workstations. Procedia Comput. Sci. 75, 327–333 (2015). https://doi.org/10.1016/j.procs.2015.12.254
Schepers, M., Giuberti, M., Bellusci, G.: Xsens MVN: consistent tracking of human motion using inertial sensing (2018). Unpublished. https://doi.org/10.13140/rg.2.2.22099.07205
Schrepp, M., Hinderks, A., Thomaschewski, J.: Design and evaluation of a short version of the user experience questionnaire (UEQ-S). Int. J. Interact. Multimed. Artif. Intell. 4(6), 103 (2017). https://doi.org/10.9781/ijimai.2017.09.001
Snidaro, L., García, J., Llinas, J.: Context-based information fusion: a survey and discussion. Inf. Fusion 25, 16–31 (2015). https://doi.org/10.1016/j.inffus.2015.01.002
Strang, T., Linnhoff-Popien, C.: A context modeling survey. In: Workshop Proceedings, Nottingham, UK, pp. 34–41 (2004)
Sweller, J., van Merrienboer, J.J.G., Paas, F.G.W.C.: Cognitive architecture and instructional design. Educ. Psychol. Rev. 10(3), 251–296 (1998). https://doi.org/10.1023/A:1022193728205
Syberfeldt, A., Danielsson, O., Holm, M., Wang, L.: Visual assembling guidance using augmented reality. Procedia Manuf. 1, 98–109 (2015). https://doi.org/10.1016/j.promfg.2015.09.068
Westerfield, G., Mitrovic, A., Billinghurst, M.: Intelligent augmented reality training for motherboard assembly. Int. J. Artif. Intell. Educ. 25(1), 157–172 (2014). https://doi.org/10.1007/s40593-014-0032-x
Acknowledgments
The authors acknowledge the financial support by the Federal Ministry of Education and Research of Germany (MOSIM project, grant no. 01IS18060A-H).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Lampen, E., Lehwald, J., Pfeiffer, T. (2020). A Context-Aware Assistance Framework for Implicit Interaction with an Augmented Human. In: Chen, J.Y.C., Fragomeni, G. (eds) Virtual, Augmented and Mixed Reality. Industrial and Everyday Life Applications. HCII 2020. Lecture Notes in Computer Science(), vol 12191. Springer, Cham. https://doi.org/10.1007/978-3-030-49698-2_7
Download citation
DOI: https://doi.org/10.1007/978-3-030-49698-2_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-49697-5
Online ISBN: 978-3-030-49698-2
eBook Packages: Computer ScienceComputer Science (R0)