On Building Flexible and Robust Multimodal Interfaces

Speaker: Phil Cohen , Oregon Health and Science Universit

Date: Friday, February 21, 2003

Time: 2:30 PM to 3:30 PM

Public: Yes


Event Type:

Room Description:

Host: ,

Contact: jcma@csail.mit.edu

Relevant URL:

Speaker URL: None

Speaker Photo:

Reminders to:

Reminder Subject: TALK: On Building Flexible and Robust Multimodal Interfaces

Multimodal interfaces are all about flexibility and robustness. They allow users to employ the most appropriate communication modalities for the immediate circumstances, and the most appropriate form-factor for the activity being performed. Because of this flexibility, such system will be confronted with more adverse conditions than graphical user interfaces (GUIs) operating in standard office-based environments, or unimodal interfaces that have been developed and tested under benign conditions. The natural result is that without an architecture that is designed for error correction and the resolution of uncertainty, the processing of the users' inputs is more susceptible to failure. This talk will discuss and illustrate how the QuickSet multimodal interface architecture supports flexibility and robustness through its symbolic and statistical multimodal fusion algorithms. I will also discuss how we have extended the algorithms that were designed for 2D environments to 3D interaction in 3D worlds, resulting in a system that can simultaneously correct individual interpretations from three modalities/information sources in order to arrive at a sensible overall interpretation.

This inherent flexibility of multimodal systems extends to environments where computers and their GUIs have been rejected. Indeed, a number of studies have shown that professionals in life-and-death occupations (such as medical, military, and air traffic control) would rather use paper. We will remark upon why this occurs, and then discuss and demonstrate how, by accepting this natural reluctance to change work style, a new class of tangible multimodal interfaces can offer advantages of the physical, digital, and linguistic worlds.

Research Areas:

Impact Areas:

See other events that are part of the HCI Seminar Series Spring 2003.

Created by Linda L. Julien Email at Wednesday, June 19, 2013 at 6:21 AM.