Implicit User-Adaptive System Engagement in Speech, Pen and Multimodal Systems
Speaker: Dr Sharon Oviatt, atural Interaction Systems, Seattle, WA
When: 2008-03-04 14:00:00
Venue: 78-420
Host: Prof Penelope Sanderson
Abstract:As emphasis is placed on developing mobile, educational, and other
applications that minimize cognitive load on users, it is becoming
more essential to base interface design on implicit engagement
techniques so users can remain focused on their tasks. In this
research, data were collected with 12 pairs of students who solved
complex math problems using a tutorial system that they engaged over
100 times per session entirely implicitly via speech amplitude or
pen pressure cues. Results revealed that users spontaneously,
reliably, and substantially adapted these forms of communicative
energy to designate and repair an intended interlocutor in a
computer-mediated group setting. This behavior was harnessed to
achieve system engagement accuracies of 75-86%, with accuracies
highest using speech amplitude. However, students had limited
awareness of their own adaptations. Finally, while continually using
these implicit engagement techniques, students maintained their
perfor! mance level at solving complex mathematics problems
throughout a one-hour session.
Biography:Sharon Oviatt is a Distinguished Scientist at Natural Interaction
Systems in Seattle, and has been a Professor and Co-Director of the
Center for Human-Computer Communication in the Dept. of Computer
Science at Oregon Health & Science University (OHSU) for the past
decade. Her research focuses on lifespan human-centered interface
design (children through the elderly), especially modeling of users'
natural behavior and communication patterns, and designing systems
that process spoken language, pen-based, and multimodal input. Her
work also has focused on communication models and technologies, and
mobile/ubiquitous interfaces. Examples of recent work involve the
development of novel design concepts for math and science education,
adaptive conversational interfaces with animated software
characters, adaptive audio-visual interfaces for collaborative
teamwork, and robust interfaces for real-world mobile and field
environments. She has published over 110 scientific articles in a
wide range of venues, including work featured in recent special
issues of Communications of the ACM, Human Computer Interaction,
Transactions on Human Computer Interaction, IEEE Multimedia,
Proceedings of IEEE, and IEEE Transactions on Neural Networks. She
was General Chair of the International Conference on Multimodal
Interfaces (ICMI) in 2003, and is Founding Chair of ICMI's Advisory
Board. She has been the recipient of an NSF Special Extension for
Creativity Award.
Type: ITEE Seminar
Contact:Prof Penelope Sanderson, seminar host (psanderson@itee.uq.edu.au)
or Guido Governatori (ITEE seminar co-ordinator)
(guido@itee.uq.edu.au)