Accession Number : ADA290549

Title :   Modeling the Interaction between Speech and Gesture.

Descriptive Note : Technical rept.,

Corporate Author : MOORE SCHOOL OF ELECTRICAL ENGINEERING PHILADELPHIA PA DEPT OF COMPUTER AND I NFORMATION SCIENCES

Personal Author(s) : Cassell, Justine ; Stone, Matthew ; Douville, Brett ; Prevost, Scott ; Achorn, Brett

PDF Url : ADA290549

Report Date : MAY 1994

Pagination or Media Count : 15

Abstract : This paper describes an implemented system that generates spoken dialogue, including speech, intonation, and gesture, using two copies of an identical program that differ only in knowledge of the world and which must cooperate to accomplish a goal. The output of the dialogue generation is used to drive a three-dimensional interactive animated model - two graphic figures on a computer screen who speak and gesture according to the rules of the system. The system is based upon a formal, predictive and explanatory theory of the gesture-speech relationship. A felicitous outcome is a working system to realize autonomous animated conversational agents for virtual reality and other purposes, and a tool for investigating the relationship between speech and gesture.

Descriptors :   *INTERACTIONS, *COMPUTER GRAPHICS, *HUMAN BODY, *SPEECH, *FACE(ANATOMY), THREE DIMENSIONAL, SCREENS(DISPLAYS).

Subject Categories : Psychology
      Computer Programming and Software
      Voice Communications

Distribution Statement : APPROVED FOR PUBLIC RELEASE