Toolkit for Expressive Interaction with a Surface through Fiduciary-Tagged Gloves
This is a completed project.
Description
The hand has incredible potential as an expressive input device. Yet most touch technologies imprecisely recognize limited hand parts (if at all), usually by inferring the hand part from the touch shapes. Our fiduciary-tagged glove is a reliable and very expressive way to gather input about: (a) many parts of a hand (fingertips, knuckles, palms, sides, backs of the hand), and (b) to discriminate between one person’s or multiple peoples’ hands.
The project primarily supplies a toolkit / API to calibrate, identify, and track touch, postures and gestures by such gloves. We also explore interaction possibilities introduced by such capabilities.
Images and Videos
Publications
- Nicolai Marquardt, Johannes Kiemer, David Ledo, Sebastian Boring, and Saul Greenberg (2011) Designing User-, Hand-, and Handpart-Aware Tabletop Interactions with the TOUCHID Toolkit. In ACM International Conference on Interactive Tabletops and Surfaces-ITS’2011. (Kobe, Japan), ACM Press, 10 pages, November 13-16. Include video figure, duration 3:42 minutes.(click here for the Video File)
- Johannes Kiemer, The Fiduciary Glove Toolkit, Master’s Thesis, Dept Institut fur Informatik, Ludwig-Maximilians-Universitat Munchen, Munich, Germany, 2011. Supervisors: Nicolai Marquardt and Saul Greenberg, Professor in charge: Andreas Butz.
- Nicolai Marquardt, Johannes Kiemer, Saul Greenberg, What Caused That Touch? Expressive Interaction with a Surface through Fiduciary-Tagged Gloves. Proceedings of ACM Conference on Interactive Tabletops and Surfaces 2010, Saarbruecken, Germany, ACM Press, 2010.
- Nicolai Marquardt, Johannes Kiemer, Saul Greenberg, What Caused That Touch? The Video, Research Report 2010-965-14, Department of Computer Science, University of Calgary, Calgary, Alberta, Canada, 2010.
Demos & Software Components
Partners
NSERC – iCORE – SMART Technologies
Themes
- 1.1.3: Expanding the Interaction Design Palette
- 1.2.1: Input and Interaction with a Surface
- 3.2.1: Identifying Basic Services
- 3.2.2: Multi-User Gestures
- 3.4.2: Interface Toolkits for Surface Applications
- 3.4.4: Multi-User UI Components
Researchers
- Saul Greenberg (Supervisor)
- Nic Marquardt (PhD Student)
- Joe Kiemer (Research Intern)