Leveraging large language models for nlg evaluation: Advances and challenges
In the rapidly evolving domain of Natural Language Generation (NLG) evaluation,
introducing Large Language Models (LLMs) has opened new avenues for assessing …
introducing Large Language Models (LLMs) has opened new avenues for assessing …
Is chatgpt a good nlg evaluator? a preliminary study
Recently, the emergence of ChatGPT has attracted wide attention from the computational
linguistics community. Many prior studies have shown that ChatGPT achieves remarkable …
linguistics community. Many prior studies have shown that ChatGPT achieves remarkable …
Benchmarking foundation models with language-model-as-an-examiner
Numerous benchmarks have been established to assess the performance of foundation
models on open-ended question answering, which serves as a comprehensive test of a …
models on open-ended question answering, which serves as a comprehensive test of a …
Leveraging large language models for nlg evaluation: A survey
In the rapidly evolving domain of Natural Language Generation (NLG) evaluation,
introducing Large Language Models (LLMs) has opened new avenues for assessing …
introducing Large Language Models (LLMs) has opened new avenues for assessing …
What makes a good story and how can we measure it? a comprehensive survey of story evaluation
With the development of artificial intelligence, particularly the success of Large Language
Models (LLMs), the quantity and quality of automatically generated stories have significantly …
Models (LLMs), the quantity and quality of automatically generated stories have significantly …
Learning personalized story evaluation
While large language models (LLMs) have shown impressive results for more objective
tasks such as QA and retrieval, it remains nontrivial to evaluate their performance on open …
tasks such as QA and retrieval, it remains nontrivial to evaluate their performance on open …
Medqa-cs: Benchmarking large language models clinical skills using an ai-sce framework
Artificial intelligence (AI) and large language models (LLMs) in healthcare require advanced
clinical skills (CS), yet current benchmarks fail to evaluate these comprehensively. We …
clinical skills (CS), yet current benchmarks fail to evaluate these comprehensively. We …
Which Prompts Make The Difference? Data Prioritization For Efficient Human LLM Evaluation
Human evaluation is increasingly critical for assessing large language models, capturing
linguistic nuances, and reflecting user preferences more accurately than traditional …
linguistic nuances, and reflecting user preferences more accurately than traditional …
Are NLP Models Good at Tracing Thoughts: An Overview of Narrative Understanding
Narrative understanding involves capturing the author's cognitive processes, providing
insights into their knowledge, intentions, beliefs, and desires. Although large language …
insights into their knowledge, intentions, beliefs, and desires. Although large language …
Corrpus: Code-based structured prompting for neurosymbolic story understanding
Story generation and understanding--as with all NLG/NLU tasks--has seen a surge in
neurosymbolic work. Researchers have recognized that, while large language models …
neurosymbolic work. Researchers have recognized that, while large language models …