8th Annual Conference of the International Speech Communication Association

Antwerp, Belgium
August 27-31, 2007

Detecting Deception Using Critical Segments

Frank Enos (1), Elizabeth Shriberg (2), Martin Graciarena (2), Julia Hirschberg (1), Andreas Stolcke (2)

(1) Columbia University, USA
(2) SRI International, USA

We present an investigation of segments that map to global lies, that is, the intent to deceive with respect to salient topics of the discourse. We propose that identifying the truth or falsity of these

critical segments may be important in determining a speaker's veracity over the larger topic of discourse. Further, answers to key questions, which can be identified a priori, may represent emotional and cognitive

hot spots, analogous to those observed by psychologists who study gestural and facial cues to deception. We present results of experiments that use two different definitions of critical segments and employ machine learning techniques that compensate for imbalances in the dataset. Using this approach, we achieve a performance gain of 23.8% relative to chance, in contrast with human performance on a similar task, which averages substantially below chance. We discuss the features used by the models, and consider how these findings can influence future research.

Full Paper

Bibliographic reference.  Enos, Frank / Shriberg, Elizabeth / Graciarena, Martin / Hirschberg, Julia / Stolcke, Andreas (2007): "Detecting deception using critical segments", In INTERSPEECH-2007, 2281-2284.