Third Workshop on Child, Computer and Interaction (WOCCI 2012)

Portland, OR, USA
September 14, 2012

Investigating the Influence of Virtual Peers as Dialect Models on Students' Prosodic Inventory

Samantha Finkelstein (1), Stefan Scherer (2), Amy Ogan (1), Louis-Philippe Morency (2), Justine Cassell (1)

(1) Human-Computer Interaction Institute, Carnegie Mellon University, Pittsburgh, PA, USA
(2) Institute for Creative Technologies, University of Southern California, Playa Vista, CA, USA

Children who speak non-standard dialects of English show reduced performance not just in language-oriented topics in school but also in math and science. Technological solutions have been rare exactly because of the nonmainstream nature of their talk, and hence the difficulty in automatically recognizing their speech and responding to it with, for example, computer tutors. In order to work towards overcoming this achievement gap, in this work we investigate African American students' prosodic inventories in different contexts as a first-step towards building a system that will be able to automatically recognize, and respond to, the dialect in which a child is speaking. We presented children with recordings of a peer (confederate) speaking in either African American English (AAE) or Mainstream American English (MAE) during both a social task and a science task. We found that children showed decreased prosodic variation and peak slopes during speech segments which did not contain AAE features, resulting in more monotone and breathy utterances than when they are speaking in AAE. We also found that children who were speaking with a “peer” who uses AAE have increased articulation rates, energy, and pitch variation. We discuss potential interpretations of these results that are important to the design of a system to support linguistic diversity and decrease the achievement gap.

Index Terms: Virtual peers, dialect model, prosodic inventory

Full Paper

Bibliographic reference.  Finkelstein, Samantha / Scherer, Stefan / Ogan, Amy / Morency, Louis-Philippe / Cassell, Justine (2012): "Investigating the influence of virtual peers as dialect models on students' prosodic inventory", In WOCCI-2012, 60-67.