File(s) not publicly available

Facial expression recognition experiments with data from television broadcasts and the World Wide Web

journal contribution
posted on 14.02.2018, 00:00 by Ligang Zhang, D Tjondronegoro, V Chandran
Facial expression recognition (FER) systems must ultimately work on real data in uncontrolled environments although most research studies have been conducted on lab-based data with posed or evoked facial expressions obtained in pre-set laboratory environments. It is very difficult to obtain data in real-world situations because privacy laws prevent unauthorized capture and use of video from events such as funerals, birthday parties, marriages etc. It is a challenge to acquire such data on a scale large enough for benchmarking algorithms. Although video obtained from TV or movies or postings on the World Wide Web may also contain ‘acted’ emotions and facial expressions, they may be more ‘realistic’ than lab-based data currently used by most researchers. Or is it? One way of testing this is to compare feature distributions and FER performance. This paper describes a database that has been collected from television broadcasts and the World Wide Web containing a range of environmental and facial variations expected in real conditions and uses it to answer this question. A fully automatic system that uses a fusion based approach for FER on such data is introduced for performance evaluation. Performance improvements arising from the fusion of point-based texture and geometry features, and the robustness to image scale variations are experimentally evaluated on this image and video dataset. Differences in FER performance between lab-based and realistic data, between different feature sets, and between different train-test data splits are investigated.

Funding

Other

History

Volume

32

Issue

2

Start Page

107

End Page

119

Number of Pages

13

ISSN

0262-8856

Publisher

Elsevier, Netherlands

Peer Reviewed

Yes

Open Access

No

Acceptance Date

13/12/2013

External Author Affiliations

Queensland University of Technology

Era Eligible

Yes

Journal

Image and Vision Computing

Exports

CQUniversity

Exports