Building a global dictionary for semantic technologies

Iklódi Eszter, Gábor Recski, Gábor Borbély, Maria Jose Castro-Bleda

Computer-driven natural language processing plays an increasingly important role in our everyday life. In the current digital world, using natural language for human-machine communication has become a basic requirement. In order to meet this requirement, it is inevitable to analyze human languages semantically. Nowadays, state-of-the-art systems represent word meaning with high dimensional vectors, known as word embeddings. Within the field of computational semantics a new research direction focuses on finding mappings between embeddings of different languages. This paper proposes a novel method for finding linear mappings among word vectors for various languages. Compared to previous approaches, this method does not learn translation matrices between two specific languages, but between a given language and a shared, universal space. The system was trained in two different modes, first between two languages, and after that applying three languages at the same time. In the first case two different training data were applied; Dinu's English-Italian benchmark data, and English-Italian translation pairs extracted from the PanLex database. In the second case only the PanLex database was used. The system performs on English-Italian languages with the best setting significantly better than the baseline system of Mikolov et al., and it provides a comparable performance with the more sophisticated systems of Faruqui and Dyer and Dinu et al. Exploiting the richness of the PanLex database, the proposed method makes it possible to learn linear mappings among an arbitrary number languages.

 DOI: 10.21437/IberSPEECH.2018-60

Cite as: Eszter, I., Recski, G., Borbély, G., Castro-Bleda, M.J. (2018) Building a global dictionary for semantic technologies. Proc. IberSPEECH 2018, 286-290, DOI: 10.21437/IberSPEECH.2018-60.

  author={Iklódi Eszter and Gábor Recski and Gábor Borbély and Maria Jose Castro-Bleda},
  title={{Building a global dictionary for semantic technologies}},
  booktitle={Proc. IberSPEECH 2018},