Bayesian Models for Multilingual Word Alignment
2015 (English)Doctoral thesis, monograph (Other academic)
In this thesis I explore Bayesian models for word alignment, how they can be improved through joint annotation transfer, and how they can be extended to parallel texts in more than two languages. In addition to these general methodological developments, I apply the algorithms to problems from sign language research and linguistic typology.
In the first part of the thesis, I show how Bayesian alignment models estimated with Gibbs sampling are more accurate than previous methods for a range of different languages, particularly for languages with few digital resources available—which is unfortunately the state of the vast majority of languages today. Furthermore, I explore how different variations to the models and learning algorithms affect alignment accuracy.
Then, I show how part-of-speech annotation transfer can be performed jointly with word alignment to improve word alignment accuracy. I apply these models to help annotate the Swedish Sign Language Corpus (SSLC) with part-of-speech tags, and to investigate patterns of polysemy across the languages of the world.
Finally, I present a model for multilingual word alignment which learns an intermediate representation of the text. This model is then used with a massively parallel corpus containing translations of the New Testament, to explore word order features in 1001 languages.
Place, publisher, year, edition, pages
Stockholm: Department of Linguistics, Stockholm University , 2015.
word alignment, parallel text, Bayesian models, MCMC, linguistic typology, sign language, annotation transfer, transfer learning
Language Technology (Computational Linguistics)
Research subject Linguistics
IdentifiersURN: urn:nbn:se:su:diva-115541ISBN: 978-91-7649-151-5OAI: oai:DiVA.org:su-115541DiVA: diva2:798117
2015-05-22, hörsal 5, hus B, Universitetsvägen 10 B, Stockholm, 13:00 (English)
Goldwater, Sharon, Reader
Wirén, Mats, Associate ProfessorKnutsson, Ola, Senior LecturerTiedemann, Jörg, Senior Researcher