ANGOFA: Leveraging OFA Embedding Initialization and Synthetic Data for Angolan Language Model

arXiv:2404.02534v2 Announce Type: replace-cross Abstract: In recent years, the development of pre-trained language models (PLMs) has gained momentum, showcasing their capacity to transcend linguistic barriers and facilitate knowledge transfer across diverse languages. However, this progress has...