[HTML][HTML] Human-Comparable Sensitivity of Large Language Models in Identifying Eligible Studies Through Title and Abstract Screening: 3-Layer Strategy Using GPT …
K Matsui, T Utsumi, Y Aoki, T Maruki… - Journal of Medical …, 2024 - jmir.org
Background The screening process for systematic reviews is resource-intensive. Although
previous machine learning solutions have reported reductions in workload, they risked …
previous machine learning solutions have reported reductions in workload, they risked …
Gpt-4 vs. human translators: A comprehensive evaluation of translation quality across languages, domains, and expertise levels
This study comprehensively evaluates the translation quality of Large Language Models
(LLMs), specifically GPT-4, against human translators of varying expertise levels across …
(LLMs), specifically GPT-4, against human translators of varying expertise levels across …
Pragmatic Competence Evaluation of Large Language Models for Korean
D Park, J Lee, H Jeong, S Park, S Lee - arXiv preprint arXiv:2403.12675, 2024 - arxiv.org
The current evaluation of Large Language Models (LLMs) predominantly relies on
benchmarks focusing on their embedded knowledge by testing through multiple-choice …
benchmarks focusing on their embedded knowledge by testing through multiple-choice …
MultiPragEval: Multilingual Pragmatic Evaluation of Large Language Models
D Park, J Lee, S Park, H Jeong, Y Koo… - arXiv preprint arXiv …, 2024 - arxiv.org
As the capabilities of LLMs expand, it becomes increasingly important to evaluate them
beyond basic knowledge assessment, focusing on higher-level language understanding …
beyond basic knowledge assessment, focusing on higher-level language understanding …
Benchmarking GPT-4 against Human Translators: A Comprehensive Evaluation Across Languages, Domains, and Expertise Levels
This study presents a comprehensive evaluation of GPT-4's translation capabilities
compared to human translators of varying expertise levels. Through systematic human …
compared to human translators of varying expertise levels. Through systematic human …
Enhancing LLM Conversational Acuity Using Pragmatic Measures
A Han, N Koushik, N Bidarkundi… - … on Information and …, 2024 - ieeexplore.ieee.org
AI-driven communication has the potential to transform society with superhuman capabilities
such as real-time multilingual translation, predictive text generation, and personalized …
such as real-time multilingual translation, predictive text generation, and personalized …
Using Large Language Models for Automated Grading of Student Writing about Science
A challenge in teaching large classes for formal or informal learners is assessing writing. As
a result, most large classes, especially in science, use objective assessment tools like …
a result, most large classes, especially in science, use objective assessment tools like …