Building and Using Comparable Corpora for Multilingual Natural Language Processing

This book provides a comprehensive overview of methods to build comparable corporaand of their applications, including machine translation, cross-lingual transfer, andvarious kinds of multilingual natural language processing. The authors begin witha brief history on the topic followed by a comparison to parallel resources and anexplanation of why comparable corpora have become more widely used. In particular,they provide the basis for the multilingual capabilities of pre-trained models, suchas BERT or GPT. The book then focuses on building comparable corpora, aligningtheir sentences to create a database of suitable translations, and using these sentencetranslations to produce dictionaries and term banks. Then, it is explained howcomparable corpora can be used to build machine translation engines and to developa wide variety of multilingual applications.