Cross-lingual Transfer Learning for Javanese Dependency Parsing
Author: Fadli Aulawi Al Ghiffari, Ika Alfina, Kurniawati Azizah
Informations
JournalConference of the Asia-Pacific Chapter of the Association for Computational Linguistics: Student Research Workshop, Proceedings of the 13th International Joint Conference on Natural Language Processing and the 3rd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics: Long Papers, IJCNLP-AACL 2023
PublisherConference of the Asia-Pacific Chapter of the Association for Computational …, 2024, Association for Computational Linguistics (ACL)
Volume & IssueVol. 3,Issue Association for Computational Linguistic
Publication Year2024
ISBN979-889176015-8
Source TypeGoogle Scholar
Citations
Scopus: 2
Google Scholar: 7
PubMed: 2
Abstract
While structure learning achieves remarkable performance in high-resource languages, the situation differs for under-represented languages due to the scarcity of annotated data. This study focuses on assessing the efficacy of transfer learning in enhancing dependency parsing for Javanese—a language spoken by 80 million individuals but characterized by limited representation in natural language processing. We utilized the Universal Dependencies dataset consisting of dependency treebanks from more than 100 languages, including Javanese. We propose two learning strategies to train the model: transfer learning (TL) and hierarchical transfer learning (HTL). While TL only uses a source language to pre-train the model, the HTL method uses a source language and an intermediate language in the learning process. The results show that our best model uses the HTL method, which improves performance with an increase of 10% for both UAS and LAS evaluations compared to the baseline model.
Documents & Links
