ISCA Archive SMM 2022
ISCA Archive SMM 2022

Exploring the correspondence between singers' gestures and melody with deep learning

Dr. Preeti Rao

Physical gestures, such as hand movements produced spontaneously by a speaker, are considered an integral part of speech communication. It is believed that, apart from conveying meaning, the visual movement representations help to organize and package the information in the sequential stream of spoken language. Even less is understood about the role of bodily gestures that accompany singing, a phenomenon that is amply demonstrated in Indian classical vocal performances. We discuss the potential of extracting the co-occurring melodic and gesture features from video recordings of raga performances to explore the correspondence using deep learning models.


Cite as: Rao, D.P. (2022) Exploring the correspondence between singers' gestures and melody with deep learning. Proc. Workshop on Speech, Music and Mind

@inproceedings{rao22_smm,
  author={Dr. Preeti Rao},
  title={{Exploring the correspondence between singers' gestures and melody with deep learning}},
  year=2022,
  booktitle={Proc. Workshop on Speech, Music and Mind},
  pages={}
}