skip to main content
research-article

XICE windowing toolkit: Seamless display annexation

Published:08 August 2011Publication History
Skip Abstract Section

Abstract

Users are increasingly nomadic, carrying computing power with them. To gain rich input and output, users could annex displays and input devices when available, but annexing via VGA cable is insufficient. This article introduces XICE, which uses wireless networks to connect portable devices to display servers. Network connections eliminate cables, allow multiple people to share a display, and ease input annexation. XICE mitigates potentially malicious input, and facilitates comfortable viewing on a variety of displays via view-independent coordinates. The XICE-distributed graphics model greatly reduces portable device CPU usage and extends portable device battery life.

References

  1. Adobe Systems. 1996. Adobe Flash. http://get.adobe.com/flashplayer/(accessed 6/11).Google ScholarGoogle Scholar
  2. ANSI. 1984. GKS. ANSIX3.124-1985.Google ScholarGoogle Scholar
  3. Apple Computer. 2010a. iPhone. http://www.apple.com/iphone/(accessed 6/10).Google ScholarGoogle Scholar
  4. Apple Computer. 2010b. Bonjour. http://www.apple.com/support/bonjour/(accessed 6/10).Google ScholarGoogle Scholar
  5. Apple Computer. 2010c. Cocoa. http://developer.apple.com/technologies/mac/cocoa.htmh (accessed 7/10).Google ScholarGoogle Scholar
  6. Argue, R. 2007. Advanced multi-display configuration and connectivity. MS dissertation. Dalhousie Univ.Google ScholarGoogle Scholar
  7. Bartels Media GMBH. 2011. MaxiVista. http://www.maxivista.com/(accessed 1/11).Google ScholarGoogle Scholar
  8. Baudisch, P., Cutrell, E., Hinckley, K., and Gruen, R. 2004. Mouse ether: Accelerating the acquisition of targets across multi-monitor displays. In Proceedings of Extended Abstracts on Human Factors in Computing Systems (CHI'04). ACM press, 1379--1382. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Bederson, B. B., Grosjean, J., and Meyer, J. 2004. Toolkit design for interactive structured graphics. IEEE Softw. Engin. 535--546. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Berger, S., Kjeldsen, R., Narayanaswami, C., Pinhanez, C., Podlaseck, M., and Raghunath, M. 2005. Using symbiotic displays to view sensitive information in public. In Proceedings of the 3rd IEEE International Conference on Pervasive Computing and Communications (PerCom'05). IEEE Computer Society, 139--148. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Bharat, K. and Cardelli, L. 1997. Migratory applications. In Lecture Notes in Computer Science. Springer Berlin, 131--148. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Biehl, J. T., Baker, W. T., Bailey, B. P., Tan, D. S., Inkpen, K. M., and Czerwinski, M. 2008. Impromptu: A new interaction framework for supporting collaboration in multiple display environments and its field evaluation for co-located software development. In Proceeding of the 26th Annual SIGCHI Conference on Human Factors in Computing Systems (CHI'08). ACM, New York, 939--948. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Canonical, Ltd., 2011. Ubuntu 10.10, http://www.ubuntu.com/. (accessed 1/11).Google ScholarGoogle Scholar
  14. Chapuis, O. and Roussel, N. 2005. Metisse is not a 3D desktop! In Proceedings of the User Interface Software and Conference Technology (UIST'05). ACM, 13--22. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Cisco Systems Inc. 1997. WebEx, http://www.webex.com/. (accessed 1/11).Google ScholarGoogle Scholar
  16. Citrix Systems, Inc. 1997. Citrix Online, http://www.citrixonline.com/. (accessed 1/11).Google ScholarGoogle Scholar
  17. Edwards, W. K., Newman, M. W., Sedivy, J., Smith, T., and Izadi, S. 2002. Challenge: Recombinant computing and the speakeasy approach. In Proceedings of the 8th Annual international Conference on Mobile Computing and Networking (MobiCom'02). ACM, New York, 279--286. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Equalizer Graphics. 2008. http://www.equalizergraphics.com/(accessed 1/11).Google ScholarGoogle Scholar
  19. Flanagan, D. 2006. JavaScript: The Definitive Guide. O'Reilly Media, Inc. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Google, Inc. 2011. Android, http://www.android.com/. (accessed 8/11).Google ScholarGoogle Scholar
  21. Gosling, J., Joy, B., Steele, G., and Bracha, G. 2011. Java Language Specification, 2nd Ed. The Java Series. Addison-Wesley Longman Publishing Co., Inc.Google ScholarGoogle Scholar
  22. Gosling, J., Rosenthal, D., and Arden, M. 1989. The NeWS Book: An Introduction to the Networked Extensible Window System, Sun Microsystems. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Howard, M. and LeBlanc, D. 2003. Writing Secure Code, 2nd Ed. Microsoft Press. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Hutterer, P., and Thomas, B. H. 2007. 'Groupware support in the windowing system. In Proceedings of the 8th Australasian Conference on User Interface (AUIC'07). Australian Computer Society, Inc., 39--46. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. International Business Machines Corp., 2011. NMON performance: Nigel's Monitor. http://www.ibm.com/developerworks/aix/library/au-analyze_aix/. (accessed 1/11).Google ScholarGoogle Scholar
  26. Izadi, S., Brignull, H., Rodden, T., Rogers, Y., and Underwood, M. 2003. Dynamo: A public interactive surface supporting the cooperative sharing and exchange of media. In Proceedings of the User Interface Software and Technology Conference (UIST'03). ACM, 159--168. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Jiang, H., Wigdor, D., Forlines, C., Borkin, M., Kauffmann, J., and Shen, C. 2008. LivOlay: Interactive ad-hoc registration and overlapping of applications for collaborative visual exploration. In Proceeding of the 26th Annual SIGCHI Conference on Human Factors in Computing Systems (CHI'08). ACM, 1357--1360. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Johanson, B., Fox, A., and Winograd, T. 2002. The interactive workspaces project: Experiences with ubiquitous computing rooms. IEEE Pervasive Comput. 1, 2, 67--74. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Liu, Z. 2007. Lacome: A cross-platform multi-user collaboration system for a shared large display. Computer Science, University of British Columbia. http://hdl.handle.net/2429/378.Google ScholarGoogle Scholar
  30. Microsoft Corporation. 2011a. Kinect, http://www.xbox.com/en-US/kinect. (accessed 1/11).Google ScholarGoogle Scholar
  31. Microsoft Corporation. 2011b. logman, http://technet.microsoft.com/en-us/library/bb490956.aspx. (accessed 1/11).Google ScholarGoogle Scholar
  32. Microsoft Corporation. 2011c. NET Framework http://www.microsoft.com/net/. (accessed 6/11).Google ScholarGoogle Scholar
  33. Microsoft Corporation. 2011d. Network Projectors. Microsoft Corporation. http://msdn.microsoft.com/en-us/library/aa934598.aspx. (accessed 6/11).Google ScholarGoogle Scholar
  34. Microsoft Corporation. 2011e. Silverlight, http://www.microsoft.com/silverlight/. (accessed 6/11).Google ScholarGoogle Scholar
  35. Microsoft Corporation. 2011f. Windows Phone 7 Series, http://www.windowsphone7.com/. (accessed 6/11).Google ScholarGoogle Scholar
  36. Microsoft Corporation. 2011g. Visual C#, http://msdn.microsoft.com/en-us/vcsharp/default.aspx, 2000.Google ScholarGoogle Scholar
  37. Myers, B. A. 2001. Using handhelds and PCs together. Comm. ACM 44, 11, 34--41. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Naef, M., Lamboray, E., Staadt, O., and Gross, M. 2003. The blue-c distributed scene graph. In Proceedings of the Workshop on Virtual Environments (EGVE'03). ACM, 125--133. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Nichols, J., Myers, B. A., and Rothrock, B. 2006. UNIFORM: Automatically generating consistent remote control user interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'06). ACM, 611--620. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Nintendo Co., Ltd. 2011. Wii, http://www.wii.com/. (accessed 1/11).Google ScholarGoogle Scholar
  41. Olsen, D. R. 1999. Interacting in chaos. Interactions, 42--54. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Olsen, D. R., Clement, J., and Pace, A. 2007. Spilling: Expanding hand held interaction to touch table displays. In Proceedings of TABLETOP '07. IEEE Computer Society. 163--170.Google ScholarGoogle Scholar
  43. Olsen, D. R., Hudson, S. E., Verratti, T., Heiner, J. M., and Phelps, M. 1999. Implementing interface attachments based on surface representations. In Proceedings of the Symposium on Human Factors in Computing Systems (CHI'99). ACM, 191--198. Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Olsen, D. R., Nielsen, S. T., and Parslow, D. 2001. Join and capture: A model for nomadic interaction. In Proceedings of the User Interface Software and Technology Conference (UIST'01). ACM, 131--140. Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Oprea, A., Balfanz, D., Durfee, G., and Smetters, D. K. 2004. “Securing a remote terminal application with a mobile trusted device. In Proceedings of the 20th Annual Computer Security Applications Conference. 438--447. Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Oracle Corporation. 2011a. Java documents on DataOutputStream, Oracle Corporation, http://download.oracle.com/javase/6/docs/api/java/io/DataOutputStream.html. (accessed 1/11).Google ScholarGoogle Scholar
  47. Oracle Corporation. 2011b. Java media framework, Oracle Corporation, http://java.sun.com/javase/technologies/desktop/media/jmf/. (accessed 1/11).Google ScholarGoogle Scholar
  48. Oracle Corporation. 2011c. OpenJDK, Oracle Corporation, http://openjdk.java.net/. (accessed 1/11).Google ScholarGoogle Scholar
  49. Paek, T., Agrawala, M., Basu, S., Drucker, S., Kristjansson, T., Logan, R., Toyama, K., and Wilson, A. 2004. Toward universal mobile interaction for shared displays. In Proceedings of the Computer Supported Cooperative Work Conference (CSCW'04), ACM, 266--269. Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. Perlin, K. and Fox, D. 1993. Pad: An alternative approach to the computer interface. In Proceedings of the 20th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'93). ACM, 57--64. Google ScholarGoogle ScholarDigital LibraryDigital Library
  51. Petzold, C. 2006. Applications = Code + Markup: A Guide to the Microsoft Windows Presentation Foundation, Microsoft Press. Google ScholarGoogle ScholarDigital LibraryDigital Library
  52. Pierce, J. S. and Mahaney, H. E. 2004. Opportunistic annexing for handheld devices: Opportunities and challenges. In Proceedings of HCIC (HCIC'04).Google ScholarGoogle Scholar
  53. RealVNC Ltd. 2011. RealVNC, http://realvnc.com/. (accessed 1/11).Google ScholarGoogle Scholar
  54. Richardson, T., Stafford-Fraser, Q., Wood, K. R., and Hopper, A. 1998. Virtual Network Computing. IEEE Internet Comput. 2, 1. Google ScholarGoogle ScholarDigital LibraryDigital Library
  55. Scheifler, R. W. and Gettys, J. 1986. The X window system. ACM Trans. Graph. 5, 2, 79--109. Google ScholarGoogle ScholarDigital LibraryDigital Library
  56. Sharp, R., Madhavapeddy, A., Want, R., and Pering, T. 2008. Enhancing web browsing security on public terminals using mobile composition. In Proceeding of the 6th International Conference on Mobile Systems, Applications, and Services (MobiSys'08). ACM, 94--105. Google ScholarGoogle ScholarDigital LibraryDigital Library
  57. Sharp, R., Scott, J., and Beresford, A. R. 2006. Secure mobile computing via public terminals. In Proceedings of the International Conference on Pervasive Computing (PerCom'06). IEEE Computer Society, 238--253. Google ScholarGoogle ScholarDigital LibraryDigital Library
  58. Shen, C., Vernier, F. D., Forlines, C., and Ringel, R. 2004. DiamondSpin: An extensible toolkit for around-the-table interaction. In Proceedings of the Symposium on Human Factors in Computing Systems (CHI'04). ACM, 167--174. Google ScholarGoogle ScholarDigital LibraryDigital Library
  59. Schilit, B. N. and Sengupta, U. 2004. Device ensembles. Computer 37, 12, 56--64. Google ScholarGoogle ScholarDigital LibraryDigital Library
  60. Shuey, D., Bailey, D., and Morrissey, T. P. 1986. PHIGS: A standard, dynamic, interactive graphics interface. Comput. Graph. Appl. 6, 8, 50--57. Google ScholarGoogle ScholarDigital LibraryDigital Library
  61. Synergy. 2011. http://synergy-foss.org/. (accessed 1/11).Google ScholarGoogle Scholar
  62. Tarasewich, P., Gong, J., and Conlan, R. 2006. Protecting private data in public. In Proceedings of CHI'06 Extended Abstracts on Human Factors in Computing Systems. ACM, 1409--1414. Google ScholarGoogle ScholarDigital LibraryDigital Library
  63. Tan, D. S., Meyers, B., and Czerwinski, M. 2004. WinCuts: Manipulating arbitrary window regions for more effective use of screen space. In Proceedings of CHI'04 Extended Abstracts on Human Factors in Computing Systems. ACM, 1525--1528. Google ScholarGoogle ScholarDigital LibraryDigital Library
  64. TightVNC Group. 2011. TightVNC, http://tightvnc.com/. (accessed 1/11).Google ScholarGoogle Scholar
  65. Thota, C. 2005. Programming MapPoint in .NET, O'Reilly Media, Inc. Google ScholarGoogle ScholarDigital LibraryDigital Library
  66. Tritsch, B. 2003. Microsoft Windows Server 2003 Terminal Services, Microsoft Press. Google ScholarGoogle ScholarDigital LibraryDigital Library
  67. Want, R., Perins, T., Danneels, G., Kumar, M., Sundar, M., and Light, J. 2002. The personal server: Changing the way we think about ubiquitous computing. In Proceedings of the Ubiquitous Computing Conference (UbiComp'02). Google ScholarGoogle ScholarDigital LibraryDigital Library
  68. Yuan, F. 2000. Windows Graphics Programming: Win32 GDI and DirectDraw. Prentice-Hall.Google ScholarGoogle Scholar
  69. Yue, C. and Wang, H. 2009. SessionMagnifier: A simple approach to secure and convenient kiosk browsing. In Proceedings of the 11th International Conference on Ubiquitous Computing (Ubicomp '09). ACM, 125--134. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. XICE windowing toolkit: Seamless display annexation

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    • Published in

      cover image ACM Transactions on Computer-Human Interaction
      ACM Transactions on Computer-Human Interaction  Volume 18, Issue 3
      July 2011
      208 pages
      ISSN:1073-0516
      EISSN:1557-7325
      DOI:10.1145/1993060
      Issue’s Table of Contents

      Copyright © 2011 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 8 August 2011
      • Accepted: 1 March 2011
      • Revised: 1 February 2011
      • Received: 1 August 2010
      Published in tochi Volume 18, Issue 3

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader