Real-Time Facial Interaction

Pandzic, I.S. and Kalra, P. and Magnenat-Thalmann, N. and Thalmann, D.

Abstract: Human interface for computer graphics systems is taking an evolutionary turn where it would involve multimodal approach. It is now moving from typical keyboard operation to more natural modes of interaction using visual, audio and gestural means. This paper discusses real time interaction using visual input from a human face. It describes the underlying approach for recognizing and analyzing the facial movements of a real performance. The output in the form of parameters describing the facial expressions can then be used to drive one or more applications running on the same or on a remote computer. This enables the user to control the graphics system by means of facial expressions. This is being used primarily as a part of a real-time facial animation system, where the synthetic actor reproduces the animator’s expression. This offers interesting possibilities for teleconferencing as the requirements on the network bandwidth are low (about 7 Kbit/s). Experiments are also done using facial movements as means of controlling a walkthrough or performing simple object manipulation.

  journal = {Displays},
  author = {Pandzic, I.S. and Kalra, P. and Magnenat-Thalmann, N. and Thalmann, D.},
  title = {Real-Time Facial Interaction},
  publisher = {Elsevier},
  volume = {Vol. 15},
  number = {No. 3},
  pages = {157-163},
  month = jul,
  year = {1994},
  topic = {Facial Animation}