What are Faces and Hands Good for Anyway?

Justine Cassell

MIT Media Lab

 Abstract:

 We hear alot these days about smart rooms, ubiquitous intelligence, invisible computers. But, as Harry Potter says, "never trust anything that can think for itself, if you can't see where it keeps its brain". In this talk I'll argue that unless users can *find* the computer, they can't interact seamlessly with it. What does this have to do with faces and hands? I believe we want to design interface systems that can see where users keep their brains, by having access to what users are doing with their hands and their faces AND I believe we want to design interfaces that allow users to see where the computer keeps its "brain" by giving the computer a face and hands. I'll describe the work my students and I have been doing on "shared reality" -- a paradigm in which both human and computer share a real physical space within which to make hand gestures, facial displays, body movements. I'll show some new work within this paradigm, and argue that unless we locate the body of both user and computer, and unless we understand the "affordances" of the body, for face-to-face conversation, for situating intelligence, for establishing trust and other kinds of interactional glue, then face and gesture recognition won't live up to their interface promise.