Multimodal Dialog with the MALACH Audiovisual Archive

Adam Chýlek, Luboš Šmídl, Jan Švec


In this paper, we present a multimodal dialog system capable of information retrieval from the large audiovisual archive MALACH of Holocaust testimonies. The users can use spoken natural language queries to search the archive. A graphical user interface allows the users to quickly view footage with the answers and explore their context. The dialog was deployed in two languages — English and Czech. The system uses automatic speech recognition and natural language processing for knowledge base construction and for processing of the user’s input.


Cite as: Chýlek, A., Šmídl, L., Švec, J. (2019) Multimodal Dialog with the MALACH Audiovisual Archive. Proc. Interspeech 2019, 3663-3664.


@inproceedings{Chýlek2019,
  author={Adam Chýlek and Luboš Šmídl and Jan Švec},
  title={{Multimodal Dialog with the MALACH Audiovisual Archive}},
  year=2019,
  booktitle={Proc. Interspeech 2019},
  pages={3663--3664}
}