9th Annual Conference of the International Speech Communication Association

Brisbane, Australia
September 22-26, 2008

Detection of Security Related Affect and Behaviour in Passenger Transport

Björn Schuller (1), Matthias Wimmer (2), Dejan Arsic (1), Tobias Moosmayr (3), Gerhard Rigoll (1)

(1) Technische Universität München, Germany; (2) Waseda University, Japan; (3) BMW Group, Munich, Germany

Surveillance of drivers, pilots or passengers possesses significant potential for increased security within passenger transport. In an automotive setting the interaction can e.g. be improved by social awareness of an MMI. As further example security marshals can be efficiently positioned guided by according systems. Within this scope the detection of security relevant behavior patterns as aggressiveness or stress is discussed. The focus lies on real-life usage respecting online processing, subject independency, and noise robustness. The approach introduced employs multivariate time-series analysis for the synchronization and data reduction of audio and video by brute-force feature generation. By combined optimization of the large audiovisual space accuracy is boosted. Extensive results are reported on aviation behavior, as well as in particular for the audio channel on numerous standard corpora. The influence of noise will be discussed by representative car-noise overlay.

Full Paper

Bibliographic reference.  Schuller, Björn / Wimmer, Matthias / Arsic, Dejan / Moosmayr, Tobias / Rigoll, Gerhard (2008): "Detection of security related affect and behaviour in passenger transport", In INTERSPEECH-2008, 265-268.