ISCA Archive IberSPEECH 2022
ISCA Archive IberSPEECH 2022

On the detection of acoustic events for public security: the challenges of the counter-terrorism domain

Anna Pompili, Tiago Luís, Nuno Monteiro, João Miranda, Carlo Mendes, Sérgio Paulo

Massive amounts of audio-visual contents are shared in public platforms everyday. These contents are created with many purposes, from entertaining or teaching, to extremist propaganda. Civil security actors need to monitor these platforms to detect and neutralize security threats. Generating actionable knowledge from multimedia contents requires the extraction of multiple information, from linguistic data to sounds and background noises. Information extraction demands audio-visual annotations, a costly, time-consuming task when performed manually, which hinders the analysis of such an overwhelming amount of data. This work, performed in the context of the EU Horizon 2020 Project AIDA, addresses the challenge of building a robust sound detector focused on events relevant to the counterterrorism domain. Our classification framework combines PLP features with a convolutional architecture to train a scalable model on a large number of events that is later fine-tuned on the subset of interest. The fusion of different corpora was also investigated, showing the difficulties posed by this task. With our framework, results attained an average F1-score of 0.53% on the target set of events. Of relevance, during the fine-tune phase a general-purpose class was introduced, which allowed the model to generalize on ’unseen’ events, highlighting the importance of a robust fine-tune.


doi: 10.21437/IberSPEECH.2022-40

Cite as: Pompili, A., Luís, T., Monteiro, N., Miranda, J., Mendes, C., Paulo, S. (2022) On the detection of acoustic events for public security: the challenges of the counter-terrorism domain . Proc. IberSPEECH 2022, 196-200, doi: 10.21437/IberSPEECH.2022-40

@inproceedings{pompili22_iberspeech,
  author={Anna Pompili and Tiago Luís and Nuno Monteiro and João Miranda and Carlo Mendes and Sérgio Paulo},
  title={{On the detection of acoustic events for public security: the challenges of the counter-terrorism domain }},
  year=2022,
  booktitle={Proc. IberSPEECH 2022},
  pages={196--200},
  doi={10.21437/IberSPEECH.2022-40}
}