Study the XLM-RoBERTa, ByT5, mT5 question and answer methods for Lao language in specific areas of internet network equipment

Lathsamy CHIDTAVONG , Sommith THOUMMALY , Outhigone LABOUNTHANH , Soulith SENGMANOTHUM , Amone CHANTHAPHAVONG

XLM-RoBERTa, ByT5, mT5, SQuAD, Machine Reading comphehension

The purpose of this research is to study Question Answering method using XLM-RoBERTa, ByT5 and mT5 Models for closed domain network device in Lao language, the aim is to develop Question answering system to help answer question more quickly and close to human as much as possible in Lao language. Therefore, the dataset is retrieved and created from www.huawei.com by using web scraping technique, and then translated to Lao language. The dataset is in SQuAD format that consists of 921 articles (samples), where 330 articles is translated to Lao language remaining 591 articles keep in english, dataset has question 989 samples in Lao language, answer has 989 samples (393 Lao samples). The result of the research shows that training time of the XLM-RoBERTa model takes 58.3 minutes, the evaluation result by exact match is 51.51% and F1 Score is 78.38%. For the ByT5 model, training time is 120.76 minutes, evaluation result by exact match is 29.29% and F1 Score is 62.42%. The final model, the mT5 takes 82.28 minutes for training time, the exact match is 3.03% and F1 Score is 38.01%

Published Paper   E-Certificate

"Study the XLM-RoBERTa, ByT5, mT5 question and answer methods for Lao language in specific areas of internet network equipment", IJSDR - International Journal of Scientific Development and Research (www.IJSDR.org), ISSN:2455-2631, Vol.8, Issue 7, page no.29 - 35, July-2023, Available :https://ijsdr.org/papers/IJSDR2307006.pdf

Volume 8 Issue 7, July-2023

Pages : 29 - 35

Paper Reg. ID: IJSDR_207547

Published Paper Id: IJSDR2307006

Downloads: 000347256

Research Area: Computer Science & Technology 

Country: Department of CoXaythanee, Vientiane Capital, Lao , Vientiane Capita, Lao People's Democratic Republic

Published Paper PDF: https://ijsdr.org/papers/IJSDR2307006

Published Paper URL: https://ijsdr.org/viewpaperforall?paper=IJSDR2307006

ISSN: 2455-2631 | IMPACT FACTOR: 9.15 Calculated By Google Scholar | ESTD YEAR: 2016

An International Scholarly Open Access Journal, Peer-Reviewed, Refereed Journal Impact Factor 9.15 Calculate by Google Scholar and Semantic Scholar | AI-Powered Research Tool, Multidisciplinary, Monthly, Multilanguage Journal Indexing in All Major Database & Metadata, Citation Generator

Publisher: IJSDR(IJ Publication) Janvi Wave

This work is licensed under a Creative Commons Attribution 4.0 International License and The Open Definition