TY - JOUR
T1 - A BERT-Based Automatic Scoring Model of Korean Language Learners' Essay
AU - Lee, Jung Hee
AU - Park, Ji Su
AU - Shon, Jin Gon
N1 - Publisher Copyright:
© 2022. Journal of Information Processing Systems.All Rights Reserved
PY - 2022/4
Y1 - 2022/4
N2 - This research applies a pre-trained bidirectional encoder representations from transformers (BERT) handwriting recognition model to predict foreign Korean-language learners’ writing scores. A corpus of 586 answers to midterm and final exams written by foreign learners at the Intermediate 1 level was acquired and used for pre-training, resulting in consistent performance, even with small datasets. The test data were pre-processed and fine-tuned, and the results were calculated in the form of a score prediction. The difference between the prediction and actual score was then calculated. An accuracy of 95.8% was demonstrated, indicating that the prediction results were strong overall; hence, the tool is suitable for the automatic scoring of Korean written test answers, including grammatical errors, written by foreigners.
AB - This research applies a pre-trained bidirectional encoder representations from transformers (BERT) handwriting recognition model to predict foreign Korean-language learners’ writing scores. A corpus of 586 answers to midterm and final exams written by foreign learners at the Intermediate 1 level was acquired and used for pre-training, resulting in consistent performance, even with small datasets. The test data were pre-processed and fine-tuned, and the results were calculated in the form of a score prediction. The difference between the prediction and actual score was then calculated. An accuracy of 95.8% was demonstrated, indicating that the prediction results were strong overall; hence, the tool is suitable for the automatic scoring of Korean written test answers, including grammatical errors, written by foreigners.
KW - Automatic writing scoring
KW - Bidirectional encoder representations from transformers
KW - Korean as a foreign language
KW - Natural language processing
UR - http://www.scopus.com/inward/record.url?scp=85129993541&partnerID=8YFLogxK
U2 - 10.3745/JIPS.04.0239
DO - 10.3745/JIPS.04.0239
M3 - Article
AN - SCOPUS:85129993541
VL - 18
SP - 282
EP - 291
JO - Journal of Information Processing Systems
JF - Journal of Information Processing Systems
SN - 1976-913X
IS - 2
ER -