Tackling Language Modelling Bias in Support of Linguistic Diversity

Gábor Bella (1, 2) , Paula Helm (3) , Gertraud Koch (4) , Fausto Giunchiglia (5)

1 IMT Atlantique - LUSSI - Département Logique des Usages, Sciences sociales et Sciences de l'Information
2 Lab-STICC_DECIDE - Equipe DECIDE
3 UvA - University of Amsterdam [Amsterdam] = Universiteit van Amsterdam
4 University of Hamburg
5 UNITN - Università degli Studi di Trento = University of Trento

Current AI-based language technologies—language models, machine translation systems, multilingual dictionaries and corpora—are known to focus on the world’s 2-3% most widely spoken languages. Research efforts of the past decade have attempted to expand this coverage to ‛under-resourced languages.’ The goal of our paper is to bring attention to a corollary phenomenon that we call language modelling bias: multilingual language processing systems often exhibit a hardwired, yet usually involuntary and hidden representational preference towards certain languages. We define language modelling bias as uneven per-language performance under similar test conditions. We show that bias stems not only from technology but also from ethically problematic research and development methodologies that disregard the needs of language communities. Moving towards diversity-aware alternatives, we present an initiative that aims at reducing language modelling bias within lexical resources through both technology design and methodology, based on an eye-level collaboration with local communities.

Keywords: language modeling bias; linguistic diversity; low-resource languages; natural language processing; Value-sensitive design

Domains: Artificial Intelligence [cs.AI]; Computation and Language [cs.CL]; Ethics

Gábor Bella, Paula Helm, Gertraud Koch, Fausto Giunchiglia. Tackling Language Modelling Bias in Support of Linguistic Diversity. FAccT 2024, ACM, Jun 2024, Rio de Janeiro, Brazil. ⟨hal-04564896⟩