Artificial Intelligence

   

Unified Framework for Efficient Cross-Lingual Transfer Learning Across Low-Resource Languages Using Knowledge-Augmented Multilingual Models

Authors: Ritika Budhiraja, Bhaumik Tyagi, Sagar Kumar Jha

Cross-lingual transfer learning is incredibly promising for facilitating knowledge transfer between languages, particularly for low-resource languages that lack annotated data. However, many current methods are inefficient in terms of adaptation, have poor generalizability, and often fail to incorporate external real-world or linguistic knowledge. This paper introduces a Unified Framework for Efficient CrossLingual Transfer Learning Across Low-Resource Languages using Knowledge-Augmented Multilingual Models. The approach integrates structured and unstructured knowledge sources, such as multilingual knowledge graphs, lexical resources, and cross-lingual embeddings, into pre-trained multilingual language models (like XLM-R and mT5) through adapter-based fine-tuning and prompt-guided alignment. This creates a task-agnostic transfer pipeline that jointly optimizes for semantic alignment, knowledge consistency, and lowresource adaptability across multiple NLP tasks, including machine translation, named entity recognition, and question answering. Experimental results on 25 typologically diverse languages, including some with fewer than 10,000 training examples, demonstrate that the framework achieves state-of the-art performance, significantly surpassing current multilingual baselines in zero-shot and few-shot regimes. Furthermore, ablations reveal the critical contribution of knowledge integration to improving contextual disambiguation and representation fidelity for low-resource languages, providing a foundation for creating scalable, knowledge-driven multilingual systems that help close the digital linguistic divide.

Comments: 9 Pages.

Download: PDF

Submission history

[v1] 2025-09-23 18:01:13

Unique-IP document downloads: 226 times

Vixra.org is a pre-print repository rather than a journal. Articles hosted may not yet have been verified by peer-review and should be treated as preliminary. In particular, anything that appears to include financial or legal advice or proposed medical treatments should be treated with due caution. Vixra.org will not be responsible for any consequences of actions that result from any form of use of any documents on this website.

Add your own feedback and questions here:
You are equally welcome to be positive or negative about any paper but please be polite. If you are being critical you must mention at least one specific error, otherwise your comment will be deleted as unhelpful.

comments powered by Disqus