Skip to main content
SpringerLink
Log in

Hand and Object Recognition on Liquid Crystal Displays

  • Chapter
  • First Online:
Tabletops - Horizontal Interactive Displays

Part of the book series: Human-Computer Interaction Series ((HCIS))

  • 927 Accesses

Abstract

Most traditional tabletop systems use video projectors to display large images on the tabletop. However, the projectors require long distance to project large images. What is worse, the images are often dark and it is not comfortable to be used in bright environment. On the other hand, Liquid Crystal Displays (LCDs) provide much brighter images, and they are getting larger, thinner, lighter, brighter, and less expensive. We have been using LCDs in our experiments as a horizontal tabletop, and there are some interesting characteristics of the LCD tabletop systems when it is used with some optical films. In this chapter, we describe a vision-based approach for hand and object recognition on an LCD tabletop system.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Microsoft (2006) Microsoft surface. http://surface.microsoft.com, accessed 02.05.2009

  2. Wilson A (2006) Robust computer vision-based detection of pinching for one and two-handed gesture input. In: UIST ’06: Proceedings of the 19th annual ACM symposium on user interface software and technology, ACM Press, New York, pp 255–258

    Google Scholar 

  3. Dietz P, Leigh D (2001) DiamondTouch: A multi-user touch technology. In: UIST ’01: Proceedings of the 14th annual ACM symposium on user interface software and technology, ACM Press, New York, pp 219–226

    Google Scholar 

  4. Rekimoto J (2002) SmartSkin: An infrastructure for freehand manipulation on interactive surfaces. In: CHI ’02: Proceedings of the SIGCHI conference on human factors in computing systems, ACM Press, New York, pp 113–120

    Google Scholar 

  5. Hodges S, Izadi S, Butler A, Rrustemi A, Buxton B (2007) ThinSight: Versatile multi-touch sensing for thin form-factor displays. In: UIST ’07: Proceedings of the ACM symposium on user interface software and technology, ACM Press, New York, pp 259–268

    Google Scholar 

  6. Sato T, Fukuchi K, Koike H (2006) Implementation and evaluations of vision-based finger flicking gesture recognition for tabletops. In: TABLETOP 2008: Proceedings of IEEE international workshop on horizontal interactive human computer system, IEEE, Amsterdam, The Netherlands, pp 137–144

    Google Scholar 

  7. Matsushita N, Rekimoto J (1997) HoloWall: Designing a finger, hand, body, and object sensitive wall. In: UIST ’97: Proceedings of the 10th annual ACM symposium on user interface software and technology, ACM Press, New York, pp 209–210

    Google Scholar 

  8. Han JY (2005) Low-cost multi-touch sensing through frustrated total internal reflection. In: UIST’05: Proceedings of the 18th annual ACM symposium on user interface software and technology, ACM Press, New York, pp 115–118

    Google Scholar 

  9. Koike H, Sato Y, Kobayashi Y, Tobita H, Kobayashi M (2000) Interactive textbook and interactive venn diagram: Natural and intuitive interface on augmented desk system. In: Proceedings of human factors in computing systems (CHI’2000), ACM Press, New York, pp 121–128

    Google Scholar 

  10. Rekimoto J, Nagao K (1995) The world through the computer: Computer augmented interaction with real world environments. In: UIST ’95: Proceedings of the 8th annual ACM symposium on user interface and software technology, ACM Press, New York, pp 29–36

    Google Scholar 

  11. Rekimoto J, Saito M (1999) Augmented surfaces: A spatially continuous work space for hybrid computing environments. In: Proceedings of the ACM conference on human factors in computing system (CHI’99), ACM Press, New York, pp 378–385

    Google Scholar 

  12. Kato H, Billinghurst M (1999) Marker tracking and HMD calibration for a video-based augmented reality conferencing system. In: Proceedings of the 2nd international workshop on augmented reality (IWAR ’99), San Francisco, CA, pp 85–94

    Google Scholar 

  13. Kaltenbrunner M, Bencina R (2007) reacTIVision: A computer-vision framework for table-based tangible interaction. In: TEI ’07: Proceedings of the 1st international conference on Tangible and embedded interaction, ACM Press, New York, pp 69–74

    Google Scholar 

  14. Denso Corp QR Code. http://http://en.wikipedia.org/wiki/QR Code, accessed 12.03.2010

  15. Kakehi Y, Hosomi T, Iida M, Naemura T, Matsushita M (2006) Transparent tabletop interface for multiple users on lumisight table. In: Proceedings of 1st international workshop on horizontal interactive human-computer systems (TABLETOP 2006), IEEE Computer Society, Washington, DC, pp 141–148

    Google Scholar 

  16. Shirai Y, Matsushita M, Ohguro T (2003) HIEI projector: Augmenting a real environment with invisible information. In: Proceedings of the 11th workshop on interactive systems and software (WISS2003), Ishikawa, Japan, pp 115–122

    Google Scholar 

  17. Park H, Park JI (2004) Invisible marker tracking for AR. In: Proceedings of 3rd IEEE and ACM international symposium on mixed and augmented reality (ISMAR 2004), IEEE/CS, IEEE Computer Society, Washington, DC

    Google Scholar 

  18. Nishi T, Sato Y, Koike H (2001) SnapLink: Interactive object registration and recognition for augmented desk interface. In: Proceedings of IFIP international conference on human–computer interaction (INTERACT’01), IOS Press, Amsterdam, pp 240–246

    Google Scholar 

  19. Open Source Computer Vision Library http://www.intel.com/technology/computing/opencv/

  20. SDL: Simple Directmedia Layer http://www.libsdl.org/, accessed 12.03.2010

  21. Oka K, Sato Y, Koike H (2002) Real-time tracking of multiple fingertips and gesture recognition for augmented desk interface system. IEEE Computer Graphics and Its Applications 22(6):64–71

    Article  Google Scholar 

  22. Sato T, Mamiya H, Koike H, Fukuchi K (2008) An augmented tabletop video game with pinching gesture recognition. ACM SIGGRAPH Asia Emerging Technologies (also at http://pac-pac.org)

  23. Koike H, Nishikawa W, Kentaro F (2009) Transparent 2-D markers on an LCD tabletop system. In: Proceedings of human factors in computing systems (CHI’2009), ACM, New York, pp 163–172

    Google Scholar 

  24. Bier EA, Stone MC, Pier K, Buxton W, DeRose TD (1993) Toolglass and magic lenses: The see-through interface. In: SIGGRAPH ’93: Proceedings of the 20th annual conference on computer graphics and interactive techniques, ACM, New York, pp 73–80

    Google Scholar 

  25. Billinghurst M, Grasset R, Looser J (2005) Designning augmented reality interfaces. ACM SIGGRAPH Computer Graphics 39(1):17–22

    Article  Google Scholar 

  26. Looser J, Grasset R, Billinghurst M (2007) A 3D flexible and tangible magic lens in augmented reality. In: ISMAR 2007: Proceedings of the 6th IEEE and ACM international symposium on mixed and augmented reality, IEEE, Washington, DC, pp 51–54

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of Electro-Communications, Chofu, Tokyo, 182-8585, Japan

    Kentaro Fukuchi

Authors
  1. Hideki Koike
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Toshiki Sato
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Wataru Nishikawa
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Kentaro Fukuchi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Hideki Koike .

Editor information

Editors and Affiliations

  1. Mosman St. 2/6A, Mosman, 2088, Australia

    Christian Müller-Tomfelde

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag London

About this chapter

Cite this chapter

Koike, H., Sato, T., Nishikawa, W., Fukuchi, K. (2010). Hand and Object Recognition on Liquid Crystal Displays. In: Müller-Tomfelde, C. (eds) Tabletops - Horizontal Interactive Displays. Human-Computer Interaction Series. Springer, London. https://doi.org/10.1007/978-1-84996-113-4_6

Download citation

  • DOI: https://doi.org/10.1007/978-1-84996-113-4_6

  • Published:

  • Publisher Name: Springer, London

  • Print ISBN: 978-1-84996-112-7

  • Online ISBN: 978-1-84996-113-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation