Automatic essay scoring systems are both overstable and oversensitive: explaining why and proposing defenses

Y Kumar, S Parekh, S Singh, JJ Li, RR Shah… - Dialogue & …, 2023 - journals.uic.edu
Abstract Deep-learning based Automatic Essay Scoring (AES) systems are being actively
used in various high-stake applications in education and testing. However, little research …

Computer-assisted assessment of phonetic fluency in a second language: a longitudinal study of Japanese learners of French

S Detey, L Fontan, M Le Coz, S Jmel - Speech Communication, 2020 - Elsevier
Automatic second language (L2) speech fluency assessment has been one of the ultimate
goals of several projects aiming at designing Computer-Assisted Pronunciation Training …

Complementary strengths? Evaluation of a hybrid human-machine scoring approach for a test of oral academic English

L Davis, S Papageorgiou - Assessment in Education: Principles …, 2021 - Taylor & Francis
Human raters and machine scoring systems potentially have complementary strengths in
evaluating language ability; specifically, it has been suggested that automated systems …

Kvantitativa perspektiv på L2-tal på olika färdighetsnivåer

M Kautonen, M Kuronen - Folkmålsstudier, 2021 - journal.fi
The aim of this study is to investigate differences in the amount (the occurrence rate) of
second language (L2) traits at different proficiency levels in spoken L2 Finland-Swedish. In …

A universal ordinal regression for assessing phoneme-level pronunciation

S Mao, F Soong, Y Xia, J Tien - ICASSP 2022-2022 IEEE …, 2022 - ieeexplore.ieee.org
The efficacy and robustness of Ordinal Regression (OR) in assessing speech pronunciation
for language learning at phrase level has been shown before. However, for assessing …

AES systems are both overstable and oversensitive: Explaining why and proposing defenses

YK Singla, S Parekh, S Singh, JJ Li, RR Shah… - arXiv preprint arXiv …, 2021 - arxiv.org
Deep-learning based Automatic Essay Scoring (AES) systems are being actively used by
states and language testing agencies alike to evaluate millions of candidates for life …

Summary and outlook on automated speech scoring

K Zechner - Automated speaking assessment, 2019 - taylorfrancis.com
From an assessment perspective, the main criteria used for evaluating spoken responses in
language tests with human scoring also apply when automated scores are used, ie, score …

Improving pronunciation assessment via ordinal regression with anchored reference samples

B Su, S Mao, F Soong, Y Xia, J Tien… - ICASSP 2021-2021 …, 2021 - ieeexplore.ieee.org
Sentence level pronunciation assessment is important for Computer Assisted Language
Learning (CALL). Traditional speech pronunciation assessment, based on the Goodness of …

[PDF][PDF] Lukiolaisten käsitykset ja heidän antamansa palaute suullisen kielitaidon automaattisesta arvioinnista

A von Zansen, MSJAR HILDÉN, M Sneck - LINGUAPEDA 2021, 2021 - helda.helsinki.fi
This study analyzed L2 Finnish learners' perceptions of automated assessment of oral
language skills. The data consisted of questionnaire responses (n= 58) collected by the …

Machine learning and applied linguistics

S Vajjala - arXiv preprint arXiv:1803.09103, 2018 - arxiv.org
This entry introduces the topic of machine learning and provides an overview of its
relevance for applied linguistics and language learning. The discussion will focus on giving …