Yupeng Zhang
Nobuyuki Umetani
Yang Liu
ABSTRACT
BodyAvatar is a Kinect-based interactive system that allows users without professional skills to create freeform 3D avatars using body gestures. Unlike existing gesture-based 3D modeling tools, BodyAvatar centers around a first-person "you're the avatar" metaphor, where the user treats their own body as a physical proxy of the virtual avatar. Based on an intuitive body-centric mapping, the user performs gestures to their own body as if wanting to modify it, which in turn results in corresponding modifications to the avatar. BodyAvatar provides an intuitive, immersive, and playful creation experience for the user. We present a formative study that leads to the design of BodyAvatar, the system's interactions and underlying algorithms, and results from initial user trials.
Supplemental Material
- Bae, S-H, Balakrishnan, R., Singh, K. (2008). ILoveSketch: as-natural-as-possible sketching system for creating 3D curve models. UIST. p. 151--160. Google Scholar
Digital Library
- Baran, I., Popovic, J. (2007). Automatic rigging and animation of 3D characters. SIGGRAPH. Google ScholarDigital Library
- Bloomenthal, J. (1988). Polygonization of implicit surfaces. Computer Aided Geometric Design, 5(4), p.341--355. Google ScholarDigital Library
- Chen, J., Izadi, S., Fitzgibbon, A. (2012). KinÊtre: animating the world with the human body. UIST, p. 435--444. Google ScholarDigital Library
- Follmer, S., Ishii, H. (2012). KidCAD: digitally remixing toys through tangible tools. CHI. p. 2401--2410. Google ScholarDigital Library
- Holz, C., Wilson, A.D. (2011). Data miming: inferring spatial object descriptions from human gesture. CHI, p. 811--820. Google ScholarDigital Library
- Igarashi, T., Matsuoka, S., Tanaka, H. (1999). Teddy: a sketching interface for 3D freeform design. SIGGRAPH, p.409--416. Google ScholarDigital Library
- Kelley, J. F. (1984). An iterative design methodology for user-friendly natural language office information applications. Transactions on Office Information Systems, 2(1), p. 26--4 Google ScholarDigital Library
- Keskin, C., Kirac, F., Kara, Y.E., Akarun, L. (2012). Hand pose estimation and hand shape classification using multi-layered randomized decision forests. ECCV. p. 852--863. Google ScholarDigital Library
- Lewis, J. P., Cordner, M., Fong, N. (2000). Pose space deformations: a unified approach to shape interpolation and skeleton-driven deformation. SIGGRAPH. p. 165--172. Google ScholarDigital Library
- McDonnell, K., Qin, H., & Wlodarczyk, R. (2001). Virtual clay: A real-time sculpting system with haptic toolkits. I3D. p. 179--190. Google ScholarDigital Library
- Nishimura, H., Hirai, M., Kawai, T., Kawata, T., Shirakawa, I., Omura, K. (1985). Object modeling by distribution function and a method of image generation. Electronics Communications Conference, p. 718--725.Google Scholar
- Nishino, H., Utsumiya, K., & Korida, K. (1998). 3D object modeling using spatial and pictographic gestures. VRST. p. 51--58. Google ScholarDigital Library
- Rossignac, J., et al. (2003). Finger sculpting with digital clay: 3D shape input and output through a computer-controlled real surface. Shape Modeling International. p. 229--234. Google ScholarDigital Library
- Schkolne, S., Pruett, M., & Schroeder, P. (2001). Surface drawing: creating organic 3D shapes with the hand and tangible tools. CHI. p. 261--268. Google ScholarDigital Library
- Schmidt, R., Wyvill, B., Sousa, M. C., Jorge, J.A. (2005). ShapeShop: sketch-based solid modeling with blobTrees. Eurographics Workshop on Sketch-Based Interfaces and Modeling. p. 53--62.Google Scholar
- Sheng, J., Balakrishnan, R., Singh, K. (2006). An interface for 3D sculpting via physical proxy. GRAPHITE. p. 213--220. Google ScholarDigital Library
- Shin, H.J., Lee, J., Shin, S.Y., Gleicher, M. (2001). Computer puppetry: an importance-based approach. Trans. on Graphics. 20(2), p. 67--94. Google ScholarDigital Library
- Song, P., Goh, W.B., Hutama, W., Fu, C., Liu, X. (2012). A handle bar metaphor for virtual object manipulation with mid-air interaction. CHI. p. 1297--1306. Google ScholarDigital Library
- Zeleznik, R.C., Herndon, K., & Hughes, J. (1996). SKETCH: an interface for sketching 3D scenes. SIGGRAPH. p. 163--170. Google ScholarDigital Library
Index Terms
- BodyAvatar: creating freeform 3D avatars using first-person body gestures
Recommendations
On generating realistic avatars: dress in your own style
The use of 3D avatars is becoming more frequent with the development of computer technology and the internet. To meet users' requirements, some software or programs have allowed users to customize the avatar. However, users are only able to customize ...
Streaming VR Games to the Broad Audience: A Comparison of the First-Person and Third-Person Perspectives
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing SystemsThe spectatorship experience for virtual reality (VR) games differs strongly from its non-VR precursor. When watching non-VR games on platforms such as Twitch, spectators just see what the player sees, as the physical interaction is mostly unimportant ...
Anticipatory Gaze Shifts during Navigation in a Naturalistic Virtual Environment
CHI PLAY '15: Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in PlayIn the real world, coupled eye and head movements are used by humans and other animals to orient their gaze toward objects or scenes of interest. In virtual environments a mouse is often used as a proxy for head movements, orienting the camera towards a ...
Comments