Skip to main content

Augmenting Interactive Tabletops with Translucent Tangible Controls

  • Chapter
  • First Online:
Tabletops - Horizontal Interactive Displays

Part of the book series: Human-Computer Interaction Series ((HCIS))

Abstract

Multi-touch surfaces enable multi-hand and multi-person direct manipulation interfaces. However, they lack haptic feedback. Tangible interfaces (TUIs) are a promising approach to this issue but most are special-purpose with fixed physical and visual appearance. This chapter provides an overview of recent work to add haptic feedback to interactive surfaces, including haptic and tactile displays, tangibles on tabletops, general-purpose controls, and typing on multi-touch tables. The focus of the chapter is Silicone Illuminated Active Peripherals (SLAP). SLAP Widgets are physical translucent general-purpose controls, such as buttons, knob, sliders, and keyboards, that can be used to manipulate virtual objects on interactive tabletop surfaces. They combine benefits of physical and virtual controls, providing the strong affordances and haptic feedback of physical controls and enabling the dynamically changeable appearance possibilities of virtual controls. SLAP Widgets are particularly promising for tasks in which eyes-free manipulation is advantageous and their plasticity encourages development of context sensitive controls and exploration of alternative interface forms.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://www.anoto.com/

  2. 2.

    http://www.artlebedev.com/everything/optimus/

  3. 3.

    http://www.iskin.com

References

  1. Hutchins EL, Hollan JD, Norman DA (1985) Direct manipulation interfaces. Human-Computer Interaction 1(4):311–338

    Article  Google Scholar 

  2. Hutchins EL, Hollan JD, Norman DA (1986) Direct manipulation interfaces. In: User centered system design: New perspectives on human-computer interaction, Lawrence Erlbaum Associates, Hillsdale, NJ and London, pp 87–124

    Google Scholar 

  3. Weiser M (1991) The computer for the 21st century. Scientific American 265(3):94–104

    Article  Google Scholar 

  4. Fiebrink R, Morris D, Morris MR (2009) Dynamic mapping of physical controls for tabletop groupware. In: CHI ’09: Proceedings of the 27th international conference on human factors in computing systems, ACM Press, New York, pp 471–480

    Google Scholar 

  5. Ishii H, Ullmer B (1997) Tangible bits: Towards seamless interfaces between people, bits and atoms. In: CHI ’97: Proceedings of the SIGCHI conference on human factors in computing systems, ACM Press, New York. pp 234–241

    Google Scholar 

  6. Poupyrev I, Nashida T, Okabe M (2007) Actuation and tangible user interfaces: The Vaucanson Duck, Robots, and shape displays. In: TEI ’07: Proceedings of the 1st international conference on tangible and embedded interaction, ACM Press, New York, pp 205–212

    Google Scholar 

  7. Benali-Khoudja M, Hafez M, Alex J, Kheddar A (2004) Tactile interfaces: A state-of-the-art survey. In: Proceedings of the international symposium on robotics, Paris, France,pp 721–726

    Google Scholar 

  8. Craig IS, Chanter CM, Southall AL, Brady AC (2001) Results from a tactile array on the fingertip. In: Eurohaptics, Birmingham, UK, pp 26–28

    Google Scholar 

  9. Yang GH, Kyung KU, Srinivasan MA, Kwon DS (2006) Quantitative tactile display device with pin-array type tactile feedback and thermal feedback. In: Proceedings of the IEEE international conference on robotics and automation, Orlando, Florida, USA, pp 3917–3922

    Google Scholar 

  10. Oelho M, Maes P (2009) Shutters: A permeable surface for environmental control and communication. In: TEI’ 09: Proceedings of the 3rd international conference on tangible and embedded interaction, ACM Press, New York, pp 13–18

    Google Scholar 

  11. Harrison C, Hudson SE (2009) Providing dynamically changeable physical buttons on a visual display. In: CHI ’09: Proceedings of the 27th international conference on human factors in computing systems, ACM Press, New York, pp 299–308

    Google Scholar 

  12. Hoggan E, Brewster SA, Johnston J (2008) Investigating the effectiveness of tactile feedback for mobile touchscreens. In: CHI ’08: Proceeding of the twenty-sixth annual SIGCHI conference on human factors in computing systems, ACM Press, New York, pp 1573–1582

    Google Scholar 

  13. Fitzmaurice GW, Ishii H, Buxton WAS (1995) Bricks: Laying the foundations for graspable user interfaces. In CHI ’95: Proceedings of the SIGCHI conference on human factors in computing systems, ACM Press/Addison-Wesley Publishing Co, New York, pp 442–449

    Google Scholar 

  14. Ishii H (2008) The tangible user interface and its evolution. Communications of the ACM 51(6):32–36

    Article  Google Scholar 

  15. Ishii H (2008) Tangible bits: Beyond pixels. In: TEI ’08: Proceedings of the 2nd international conference on tangible and embedded interaction, ACM Press, New York. pp xv–xxv

    Google Scholar 

  16. Underkoffler J, Ishii H (1998) Illuminating light: An optical design tool with a luminous-tangible interface. In: CHI ’98: Proceedings of the SIGCHI conference on human factors in computing systems, ACM/Addison-Wesley Publishing Co., New York, pp 542–549

    Google Scholar 

  17. Underkoffler J, Ishii H (1999) Urp: A luminous-tangible workbench for urban planning and design. In: CHI ’99: Proceedings of the SIGCHI conference on human factors in computing systems, ACM Press, New York, pp 386–393

    Google Scholar 

  18. Jordà S, Geiger G, Alonso M, Kaltenbrunner M (2007) The reacTable: Exploring the synergy between live music performance and tabletop tangible interfaces. In: TEI ’07: Proceedings of the 1st international conference on tangible and embedded interaction, ACM Press, New York, pp 139–146

    Google Scholar 

  19. Horn MS, Solovey ET, Crouser RJ, Jacob RJK (2009) Comparing the use of tangible and graphical programming languages for informal science education. In: CHI ’09: Proceedings of the 27th international conference on human factors in computing systems, ACM Press, New York, pp 975–984

    Google Scholar 

  20. Patten J, Ishii H (2007) Mechanical constraints as computational constraints in tabletop tangible interfaces. In: CHI ’07: Proceedings of the SIGCHI conference on human factors in computing systems, ACM Press, New York, pp 809–818

    Google Scholar 

  21. Rosenfeld D, Zawadzki M, Sudol J, Perlin K (2004) Physical objects as bidirectional user interface elements. Computer Graphics and Applications. IEEE 24(1):pp 44–49

    Article  Google Scholar 

  22. Pangaro G, Maynes-Aminzade D, Ishii H (2002) The actuated workbench: Computer-controlled actuation in tabletop tangible interfaces. In: UIST ’02: Proceedings of the 15th annual ACM symposium on user interface software and technology, ACM Press, New York, pp 181–190

    Google Scholar 

  23. Block F, Haller M, Gellersen H, Gutwin C, Billinghurst M (2008) VoodooSketch: Extending interactive surfaces with adaptable interface palettes. In: TEI ’08: Proceedings of the 2nd international conference on tangible and embedded interaction, ACM Press, New York,pp 55–58

    Google Scholar 

  24. Villar N, Gellersen H (2007) A malleable control structure for softwired user interfaces. In: TEI ’07: Proceedings of the 1st international conference on tangible and embedded interaction, ACM Press, New York, pp 49–56

    Google Scholar 

  25. Block F, Gutwin C, Haller M, Gellersen H, Billinghurst M (2008) Pen and paper techniques for physical customisation of tabletop interfaces. In: Horizontal interactive human computer systems, 2008. TABLETOP 2008: Proceedings of the 3rd IEEE International Workshop on 2008, Amsterdam, The Netherlands, pp 17–24

    Google Scholar 

  26. Shahrokni A, Jenaro J, Gustafsson T, Vinnberg A, Sandsjö J, Fjeld M (2006) One-dimensional force feedback slider: Going from an analogue to a digital platform. In: NordiCHI ’06: Proceedings of the 4th Nordic conference on human-computer interaction, ACM Press,New York, pp 453–456

    Google Scholar 

  27. Gabriel R, Sandsjö J, Shahrokni A, Fjeld M (2008) BounceSlider: Actuated sliders for music performance and composition. In: TEI ’08: Proceedings of the 2nd international conference on tangible and embedded interaction, ACM Press, New York, pp 127–130

    Google Scholar 

  28. Schmalstieg D, Encarnação LM, Szalavári Z (1999) Using transparent props for interaction with the virtual table. In: I3D ’99: Proceedings of the 1999 symposium on interactive 3d graphics, ACM Press, New York, pp 147–153

    Google Scholar 

  29. Rekimoto J, Ullmer B, Oba H (2001) DataTiles: A modular platform for mixed physical and graphical interactions. In CHI ’01: Proceedings of the SIGCHI conference on human factors in computing systems, ACM, New York. pp 269–276

    Google Scholar 

  30. Waldner M, Hauber J, Zauner J, Haller M, Billinghurst M (2006) Tangible tiles: Design and evaluation of a tangible user interface in a collaborative tabletop setup. In: OZCHI ’06: Proceedings of the 18th Australia conference on computer-human interaction, ACM Press, New York, pp 151–158

    Google Scholar 

  31. Hinrichs U, Hancock M, Collins C, Carpendale S (2007) Examination of text-entry methods for tabletop displays. In: Horizontal interactive human-computer systems, 2007. TABLETOP ’07: Proceedings of the 2nd annual IEEE international workshop on 2007, Newport, Rhode Island, pp 105–112

    Google Scholar 

  32. Hirche J, Bomark P, Bauer M, Solyga P (2008) Adaptive interface for text input on large-scale interactive surfaces. In: Horizontal interactive human-computer systems, 2008. TABLETOP ’08: Proceedings of the 3rd annual IEEE international workshop on 2008, Amsterdam, Netherlands, pp 153–156

    Google Scholar 

  33. Weiss M, Wagner J, Jansen Y, Jennings R, Khoshabeh R, Hollan JD, Borchers J (2009) SLAP Widgets: Bridging the gap between virtual and physical controls on tabletops. In: CHI ’09: Proceedings of the 27th international conference on human factors in computing systems, ACM Press, New York, pp 481–490

    Google Scholar 

  34. Han JY (2005) Low-cost multi-touch sensing through frustrated total internal reflection. In: UIST ’05: Proceedings of the 18th annual ACM symposium on user interface software and technology, ACM Press, New York, pp 115–118

    Google Scholar 

  35. Matsushita N, Rekimoto J (1997) HoloWall: Designing a finger, hand, body, and object sensitive wall. In: UIST ’97: Proceedings of the 10th annual ACM symposium on user interface software and technology, ACM Press, New York, pp 209–210

    Google Scholar 

  36. Mayrhofer R, Gellersen H (2007) Shake well before use: Authentication based on accelerometer data. In: Pervasive Computing, Springer, Heidelberg, pp 144–161

    Chapter  Google Scholar 

  37. Co E, Pashenkov N (2008) Emerging display technologies for organic user interfaces. Communication of the ACM 51(6):45–47

    Article  Google Scholar 

  38. Holman D, Vertegaal R (2008) Organic user interfaces: Designing computers in any way, shape, or form. In Communication of the ACM 51(6):48–55

    Google Scholar 

  39. Izadi S, Hodges S, Taylor S, Rosenfeld D, Villar N, Butler A, et al. (2008) Going beyond the display: A surface technology with an electronically switchable diffuser. In: UIST ’08: Proceedings of the 21st annual ACM symposium on user interface software and technology, ACM Press, New York, pp 269–278

    Google Scholar 

  40. Koike H, Nishikawa W, Fukuchi K (2009) Transparent 2-D markers on an LCD tabletop system. In: CHI ’09: Proceedings of the 27th international conference on human factors in computing systems, ACM Press, New York, pp 163–172

    Google Scholar 

  41. Kakehi Y, Hosomi T, Iida M, Naemura T, Matsushita M (2006) Transparent tabletop interface for multiple users on lumisight table. In: TABLETOP ’06: Proceedings of the 1st IEEE international workshop on horizontal interactive human-computer systems, IEEE Computer Society, Washington, DC, pp 143–150

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Malte Weiss .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag London

About this chapter

Cite this chapter

Weiss, M., Hollan, J.D., Borchers, J. (2010). Augmenting Interactive Tabletops with Translucent Tangible Controls. In: Müller-Tomfelde, C. (eds) Tabletops - Horizontal Interactive Displays. Human-Computer Interaction Series. Springer, London. https://doi.org/10.1007/978-1-84996-113-4_7

Download citation

  • DOI: https://doi.org/10.1007/978-1-84996-113-4_7

  • Published:

  • Publisher Name: Springer, London

  • Print ISBN: 978-1-84996-112-7

  • Online ISBN: 978-1-84996-113-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics