July 30 to August 1, 1992
Edited by
Paul Ekman
Thomas S. Huang
Terrence J. Sejnowski
Joseph C. Hager
Note: Edited for Web browser presentation 7/97 & 4/00 by J.H.; printed edition 3/93 can be requested from Human Interaction Lab, LPPI Box 0984, University of California, San Francisco, CA 94143.
This workshop was supported by the Interactive Systems Program, the Robotics and Machine Intelligence Program, the Social Psychology Program, and the Division of Behavioral and Cognitive Sciences, all entities of the National Science Foundation. The views expressed in this report represent the views of the participants, not of the National Science Foundation.
Contents
I. EXECUTIVE SUMMARY by P. Ekman and T. J. Sejnowski
I-A. Introduction
I-B. Background About the Importance of Facial Expression
I-C. Progress and Obstacles in Measuring Facial Expression
I-D. The Opportunity
I-E. Recommendations
I-F. Organization of the Report
II. OVERVIEW OF THE WORKSHOP by P. Ekman
II-A. Organization of the Workshop
II-B. Scope of the Workshop
II-C. Goals achieved
II-D. Workshop Schedule
II-E. Participants
Invited Participants:
Other Workshop Participants:
Post-Workshop Contributor:
III. TUTORIAL SUMMARIES
III-A. The Psychology and Neuroanatomy of Facial Expression by J. Cacioppo, J. C. Hager, and P. Ekman
Facial Signal Systems
Techniques for Measuring the Rapid Facial Signals
Evidence About Which Facial Actions Signal Which Emotions
The Neuroanatomy of Facial Movement
Facial Data Base
III-B. Computer Vision and Face Processing by T. S. Huang, P. Burt, and K. Mase
Introduction
Representation
Reconstruction
Object Recognition
Motion Analysis and Face Processing
Optic Flow Approach to Face Processing
III-C. Neural Networks and Eigenfaces for Finding and Analyzing Faces by A. Pentland and T. Sejnowski
Introduction
Important Subproblems
Major Approaches
Biological Foundation of Face Processing
Face Detection
Face Recognition
Tracking Faces
Lip reading
Neural Networks
Backpropagation of Errors
Sex Recognition
Expression Recognition
III-D. Special Hardware For Face Processing by D. Psaltis
Analog VLSI
Optics
IV. REPORTS FROM THE PLANNING BREAKOUT GROUPS
IV-A. Breakout Group on Basic Science
Basic Science for Understanding Facial Expression by R. Davidson, J. Allman, J. Cacioppo, P. Ekman, W. Friesen, J. C. Hager, and M. Phillips
Recommendations on Basic Research Needs
Infrastructure Recommendations
Next Steps towards Automating Facial Measurement
Automating Other Relevant Data Sources:
IV-B. Breakout Group on Sensing and Processing
Sensing and Processing by A. Yuille, A. Pentland, P. Burt, G. Cottrell, O. Garcia, H. Lee, K. Mase, and T. Vetter
Introduction and Overview
Sensing and Environments.
Detection of Faces
Feature Extraction from Static Images
Feature Extraction from Image Sequences
Lip Reading
Expression Recognition
IV-C. Breakout group on Modeling and Databases
Computer-Based Facial Expression Models and Image Databases by F. Parke, D. Terzopoulos, T. Sejnowski, P. Stucki, L. Williams, D. Ballard, L. Sadler, and J. C. Hager
Introduction
State of the Art in 3D Modeling
Facial Databases
Research Directions and Goals
V. RECOMMENDATIONS by J. C. Hager
Basic Research on the Face that Answers These Crucial Questions:
Infrastructure Resources that Include the Following:
Tools for Processing and Analyzing Faces and Related Data:
Training and Education for Experienced and Beginning Investigators:
VI. BENEFITS by B. Golomb and T. J. Sejnowski
Commercial Applications
Computer Sciences
Basic Science Research
Medicine
Unforeseen Benefits
VII. REFERENCES.