14thAnnual Conference of the International Speech Communication Association

Lyon, France
August 25-29, 2013

Demographic Recommendation by Means of Group Profile Elicitation Using Speaker Age and Gender Recognition

Sven Ewan Shepstone (1), Zheng-Hua Tan (2), Søren Holdt Jensen (2)

(1) Bang and Olufsen A/S, Denmark
(2) Aalborg University, Denmark

In this paper we show a new method of using automatic age and gender recognition to recommend a sequence of multimedia items to a home TV audience comprising multiple viewers. Instead of relying on explicitly provided demographic data for each user, we define an audio-based demographic group profile that captures the age and gender for all members of the audience. A 7-class age and gender classifier employing a fusion of acoustic and prosodic features determines the probability of each speaker belonging to each class. The information for all speakers is then combined to form the group profile, which itself is the input to a recommender system. The recommender system finds the content items whose demographics best match the group profile. We tested the effectiveness of the system for several typical home audience configurations. In a survey, users were given a configuration and asked to rate a set of advertisements on how well each advertisement matched the configuration. Unbeknown to the subjects, half of the adverts were recommended using the derived audio demographics and the other half were randomly chosen. The recommended adverts received a significantly higher median rating of 7.75, as opposed to 4.25 for the randomly selected adverts.

Full Paper

Bibliographic reference.  Shepstone, Sven Ewan / Tan, Zheng-Hua / Jensen, Søren Holdt (2013): "Demographic recommendation by means of group profile elicitation using speaker age and gender recognition", In INTERSPEECH-2013, 2827-2831.