Chunyuan Liao
François Guimbretière
Ken Hinckley
ABSTRACT
Knowledge workers use paper extensively for document reviewing and note-taking due to its versatility and simplicity of use. As users annotate printed documents and gather notes, they create a rich web of annotations and cross references. Unfortunately, as paper is a static media, this web often gets trapped in the physical world. While several digital solutions such as XLibris [15] and Digital Desk [18] have been proposed, they suffer from a small display size or onerous hardware requirements.To address these limitations, we propose PapierCraft, a gesture-based interface that allows users to manipulate digital documents directly using their printouts as proxies. Using a digital pen, users can annotate a printout or draw command gestures to indicate operations such as copying a document area, pasting an area previously copied, or creating a link. Upon pen synchronization, our infrastructure executes these commands and presents the result in a customized viewer. In this paper we describe the design and implementation of the PapierCraft command system, and report on early user feedback.
- Alvarado, C. and R. Davis. SketchREAD: a multi-domain sketch recognition engine. Proceedings of UIST'04, pp. 23 -- 32. Google Scholar
Digital Library
- Anoto, http://www.anoto.com.Google Scholar
- Cohen, P.R. and D.R. McGee, Tangible multimodal interfaces for safety-critical applications. Communications of the ACM, 2004. 47(1): p. 41 -- 46. Google ScholarDigital Library
- Guimbretiere, F. Paper Augmented Digital Documents. Proceedings of UIST'03, pp. 51 -- 60. Google ScholarDigital Library
- Heiner, J.M., S.E. Hudson, and K. Tanaka. Linking and messaging from real paper in the Paper PDA. Proceedings of UIST'99, pp. 179 -- 186. Google ScholarDigital Library
- Hinckley, K., G. Ramos, F. Guimbretiere, P. Baudisch, and M. Smith. Stitching: Pen Gestures that Span Multiple Displays. Proceedings of AVI'04, pp. 23 -- 31. Google ScholarDigital Library
- Hinckley, K., P. Baudisch, G. Ramos, and F. Guimbretiere. Design and Analysis of Delimiters for Selection-Action Pen Gesture Phrases in Scriboli. Proceedings of CHI'05, pp. 451 -- 460. Google ScholarDigital Library
- Johnson, W., H. Jellinek, J. Leigh Klotz, R. Rao, and S.K. Card. Bridging the paper and electronic worlds: the paper user interface. Proceedings of CHI'93, pp. 507 -- 512. Google ScholarDigital Library
- Kurtenbach, G., The design and Evaluation of Marking Menus, PhD thesis, University of Toronto. 1993 Google ScholarDigital Library
- Mackay, W.E., G. Pothier, C. Letondal, K. Boegh, and H.E. Sorensen. The missing link: augmenting biology laboratory notebooks. Proceedings of UIST'02, pp. 41 -- 50. Google ScholarDigital Library
- OneNote, http://office.microsoft.com.Google Scholar
- Price, M.N., G. Golovchinsky, and B.N. Schilit. Linking by inking: trailblazing in a paper-like hypertext. Proceedings of Conference on Hypertext and Hypermedia, pp. 30 -- 39. Google ScholarDigital Library
- Rekimoto, J. Pick-and-drop: a direct manipulation technique for multiple computer environments. Proceedings of UIST'97, pp. 31 -- 39. Google ScholarDigital Library
- Saund, E. and E. Lank. Stylus input and editing without prior selection of mode. Proceedings of UIST'03, pp. 213 -- 216. Google ScholarDigital Library
- Schilit, B.N., G. Golovchinsky, and M.N. Price. Beyond paper: supporting active reading with free form digital ink annotations. Proceedings of CHI'98, pp. 249 -- 256. Google ScholarDigital Library
- Sellen, A.J. and R.H.R. Harper, The Myth of the Paperless Office. 1st ed. 2001: MIT press. Google ScholarDigital Library
- Sensiva, http://www.sensiva.com/.Google Scholar
- Wellner, P., Interacting with paper on the DigitalDesk. Communications of the ACM, 1993. 36(7): p. 87 -- 96. Google ScholarDigital Library
- Zeleznik, R., T. Miller, Fluid Inking: Modeless Integration of Gestures with Inking. Technical report CS-05-10, Brown University, 2005,Google Scholar
- Zhao, S. and R. Balakrishnan. Simple vs. compound mark hierarchical marking menus. Proceedings of UIST'04, pp. 33 -- 42. Google ScholarDigital Library
Index Terms
- PapierCraft: a command system for interactive paper
Recommendations
Papiercraft: A gesture-based command system for interactive paper
Paper persists as an integral component of active reading and other knowledge-worker tasks because it provides ease of use unmatched by digital alternatives. Paper documents are light to carry, easy to annotate, rapid to navigate, flexible to manipulate,...
Comparing cursor orientations for mouse, pointer, and pen interaction
CHI '05: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsMost graphical user interfaces provide visual cursors to facilitate interaction with input devices such as mice, pointers, and pens. These cursors often include directional cues that could influence the stimulus-response compatibility of user input. We ...
Physics on display: tangible graphics on hexagonal bezel-less screens
TEI '10: Proceedings of the fourth international conference on Tangible, embedded, and embodied interactionIn this paper, we present a tiled display system made out of hexagonal cardboard screens with no visible bezel. Use of a bezel-less hexagonal form factor allows users to build larger multiform displays out of smaller tiles. Individual display tiles can ...
Comments