1st Joint SIG-IL/Microsoft Workshop on Speech and Language Technologies for Iberian Languages

Porto Salvo, Portugal
September 3-4, 2009

Bilingual Example Segmentation based on Markers Hypothesis

Alberto Simões, José João Almeida

Departamento de Informática, Universidade do Minho, Braga, Portugal

The Marker Hypothesis was first defined by Thomas Green in 1979. It is a psycho-linguistic hypothesis defining that there is a set of words in every language that marks boundaries of phrases in a sentence. While it remains a hypothesis because nobody has proved it, tests have shows that results are comparable to basic shallow parsers with higher efficiency. The chunking algorithm based on the Marker Hypothesis is simple, fast and almost language independent. It depends on a list of closed-class words, that are already available for most languages. This makes it suitable for bilingual chunking (there is not the requirement for separate language shallow parsers). This paper discusses the use of the Marker Hypothesis combined with Probabilistic Translation Dictionaries for examplebased machine translation resources extraction from parallel corpora.

Index Terms: Marker Hypothesis, Probabilistic Translation Dictionaries, Translation Examples, Machine Translation

Full Paper

Bibliographic reference.  Simões, Alberto / Almeida, José João (2009): "Bilingual example segmentation based on markers hypothesis", In SLTECH-2009, 95-98.