The IgboAPI Dataset: Empowering Igbo Language Technologies through Multi-dialectal Enrichment
arxiv(2024)
摘要
The Igbo language is facing a risk of becoming endangered, as indicated by a
2025 UNESCO study. This highlights the need to develop language technologies
for Igbo to foster communication, learning and preservation. To create robust,
impactful, and widely adopted language technologies for Igbo, it is essential
to incorporate the multi-dialectal nature of the language. The primary obstacle
in achieving dialectal-aware language technologies is the lack of comprehensive
dialectal datasets. In response, we present the IgboAPI dataset, a
multi-dialectal Igbo-English dictionary dataset, developed with the aim of
enhancing the representation of Igbo dialects. Furthermore, we illustrate the
practicality of the IgboAPI dataset through two distinct studies: one focusing
on Igbo semantic lexicon and the other on machine translation. In the semantic
lexicon project, we successfully establish an initial Igbo semantic lexicon for
the Igbo semantic tagger, while in the machine translation study, we
demonstrate that by finetuning existing machine translation systems using the
IgboAPI dataset, we significantly improve their ability to handle dialectal
variations in sentences.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要