Skip to main content

Interactive Mixed Reality Cooking Assistant for Unskilled Operating Scenario

  • Conference paper
  • First Online:
Virtual, Augmented and Mixed Reality. Industrial and Everyday Life Applications (HCII 2020)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12191))

Included in the following conference series:

Abstract

As the further development of virtual reality technology, mixed reality (MR) promotes the innovation of human-computer interaction. It can integrate virtual information (objects, pictures, videos, etc.) into the real environment, and directly interact with people. It can greatly improve the efficiency of information reception, reduce the cost of understanding and learning, and improve the fluency and accuracy of operational tasks. In the kitchen scene, when the novices cook according to the recipe, they usually do not perform well in memory and learning, which causes many problems in the cooking process. Therefore, we propose an interactive intelligent cooking system design, which focuses on the five kinds of information that novices need most help in the cooking process, and subverts the traditional recipe with MR presentation. The experiment also shows that the intelligent cooking system can make up for the guidance to novice which is easy to be ignored by traditional recipes, and can effectively improve the user experience of novices.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Tran, Q.T., Calcaterra, G., Mynatt, E.D.: COOK’S COLLAGE. In: Sloane, A. (ed.) Home-Oriented Informatics and Telematics. IIFIP, vol. 178, pp. 15–32. Springer, Boston (2005). https://doi.org/10.1007/11402985_2

    Chapter  Google Scholar 

  2. Hamada, R., Okabe, J., Ide, I.: Cooking navi: assistant for daily cooking in kitchen. In: Proceedings of 13th ACM International Multimedia Conference, pp. 371–374 (2005)

    Google Scholar 

  3. Takano, T., Ueshima, S.: Cooking studio: cooking simulation from web recipes. In: Proceedings of 2nd International Conference on Creating, Connecting and Collaborating Through Computing, p. 191 (2004)

    Google Scholar 

  4. Fukuda, T., Nakauchi, Y., Noguchi, K., Matsubara, T.: Human behavior recognition for cooking support robot. In: Proceedings of IEEE International Workshop on Robot and Human Communication, pp. 359–364 (2005)

    Google Scholar 

  5. Mori, T., Kuroiwa, T., Morishita, H., Sato, T.: Assistance with human actions and individuality adaptation by robotic kitchen counter. Proceedings of ASER, pp. 13–20 (2004)

    Google Scholar 

  6. Orsini, A., et al.: Augmented reality enhanced cooking with Microsoft HoloLens, Rutgers State University of New Jersey (2017)

    Google Scholar 

  7. Fadil, Y., Mega, S., Horie, A., et al.: Mixed reality cooking support system using content-free recipe selection. In: Eighth IEEE International Symposium on Multimedia. IEEE (2006)

    Google Scholar 

  8. Funk, M., Kosch, T., Schmidt, A.: Interactive worker assistance: comparing the effects of in-situ projection, head-mounted displays, tablet, and paper instructions. In: Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing, pp. 934–939. ACM (2016)

    Google Scholar 

  9. Blattgerste, J., Strenge, B., Renner, P., et al.: Comparing conventional and augmented reality instructions for manual assembly tasks. In: Proceedings of the 10th International Conference on Pervasive Technologies Related to Assistive Environments, pp. 75–82 (2017)

    Google Scholar 

  10. Hasada, H., Zhang, J., Yamamoto, K., Ryskeldiev, B., Ochiai, Y.: AR Cooking: comparing display methods for the instructions of cookwares on AR Goggles. In: Yamamoto, S., Mori, H. (eds.) HCII 2019. LNCS, vol. 11570, pp. 127–140. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-22649-7_11

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ke-yu Zhai .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Zhai, Ky., Cao, Ym., Hou, Wj., Li, Xm. (2020). Interactive Mixed Reality Cooking Assistant for Unskilled Operating Scenario. In: Chen, J.Y.C., Fragomeni, G. (eds) Virtual, Augmented and Mixed Reality. Industrial and Everyday Life Applications. HCII 2020. Lecture Notes in Computer Science(), vol 12191. Springer, Cham. https://doi.org/10.1007/978-3-030-49698-2_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-49698-2_13

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-49697-5

  • Online ISBN: 978-3-030-49698-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics