Cross-Lingual Word Embeddings

Anders Søgaard is a father of three and a published poet, as well as a Full Professor in Computer Science the University of Copenhagen. He is currently funded by the Novo Nordisk Foundation, the Lundbeck Foundation, and the Innovation Fund Denmark; before that, he held an ERC Starting Grant and a Google Focused Research Award. He has won best paper awards at NAACL, EACL, CoNLL, etc. He previously wrote Semi-Supervised Learning and Domain Adaptation in NLP (Morgan & Claypool, 2013) and Cross-Lingual Word Embeddings (Morgan & Claypool, 2019), the latter with co-authors Ivan Vulic, Sebastian Ruder, and Manaal Faruqui.Ivan Vulić is a Senior Research Associate in the Language Technology Lab at the University of Cambridge since 2015. Ivan holds a Ph.D. in Computer Science from KU Leuven, having achieved summa cum laude in 2014 on ""Unsupervised Algorithms for Cross-lingual Text Analysis, Translation Mining, and Information Retrieval."" He is interested in representation learning, humanlanguage understanding, distributional, lexical, and multi-modal semantics inmonolingual and multilingual contexts, and transfer learning for enabling cross-lingual NLP applications. He has co-authored more than 60 peer-reviewed research papers published in top-tier journals and conference proceedings in NLP and IR. He co-lectured a tutorial on monolingual and multilingual topic models and applications at ECIR 2013 and WSDM 2014, a tutorial onword vector space specialisation at EACL 2017 and ESSLLI 2018, a tutorial on cross-lingual word representations at EMNLP 2017, and a tutorial on deep learning for conversational AI at NAACL 2018.Sebastian Ruder is a Research Scientist at DeepMind. He obtained his Ph.D. in Natural Lan-guage Processing at the National University of Ireland, Galway in 2019. He is interested intransfer learning and cross-lingual learning and has published widely read reviews as well asmore than ten peer-reviewed research papers in top-tier conference proceedings in NLP.Manaal Faruqui is a Senior Research Scientist at Google, working on industrial scale NLP and ML problems. He obtained his Ph.D. in the Language Technologies Institute at Carnegie Mellon University while working on representation learning, multilingual learning, and distributional and lexical semantics. He received a best paper award at NAACL 2015 for his work on incorporating semantic knowledge in word vector representations. He serves on the editorial board of the Computational Linguistics journal and has been an area chair for several ACL conferences.

• Preface.- Introduction.- Monolingual Word Embedding Models.- Cross-Lingual Word Embedding Models: Typology.- A Brief History of Cross-Lingual Word Representations.- Word-Level Alignment Models.- Sentence-Level Alignment Methods.- Document-Level Alignment Models.- From Bilingual to Multilingual Training.- Unsupervised Learning of Cross-Lingual Word Embeddings.- Applications and Evaluation.- Useful Data and Software.- General Challenges and Future Directions.- Bibliography.- Authors' Biographies.