Grounding and Evaluation for Large Language Models: Practical Challenges and Lessons Learned (Survey)

K Kenthapadi, M Sameki, A Taly - Proceedings of the 30th ACM SIGKDD …, 2024 - dl.acm.org
With the ongoing rapid adoption of Artificial Intelligence (AI)-based systems in high-stakes
domains, ensuring the trustworthiness, safety, and observability of these systems has …

Are Large Language Models Reliable Argument Quality Annotators?

N Mirzakhmedova, M Gohsen, CH Chang… - Conference on Advances …, 2024 - Springer
Evaluating the quality of arguments is a crucial aspect of any system leveraging argument
mining. However, it is a challenge to obtain reliable and consistent annotations regarding …

My Future with My Chatbot: A Scenario-Driven, User-Centric Approach to Anticipating AI Impacts

K Kieslich, N Helberger, N Diakopoulos - The 2024 ACM Conference on …, 2024 - dl.acm.org
As a general purpose technology without a concrete pre-defined purpose, personal chatbots
can be used for a whole range of objectives, depending on the personal needs, contexts …

A Multi-Aspect Framework for Counter Narrative Evaluation using Large Language Models

J Jones, L Mo, E Fosler-Lussier, H Sun - arXiv preprint arXiv:2402.11676, 2024 - arxiv.org
Counter narratives-informed responses to hate speech contexts designed to refute hateful
claims and de-escalate encounters-have emerged as an effective hate speech intervention …

Measuring GenAI Usage Patterns in a University Campus via Network Traffic Analysis

M Lyu, Y Wang, V Sivaraman - Proceedings of the Asian Internet …, 2024 - dl.acm.org
Generative AI platforms backed by large-language models (LLMs) are taking the world by
storm. Starting with ChatGPT launched a mere 18 months ago that can generate amazingly …

[图书][B] The Rise of AI in Academic Inquiry

J Hutson - 2024 - books.google.com
The rise of artificial intelligence (AI) has revolutionized academic inquiry, offering powerful
tools to enhance research capabilities and improve academic discovery across various …

Towards an Educator-Centered Method for Measuring Bias in Large Language Model-Based Chatbot Tutors

E Harvey, A Koenecke, RF Kizilcec - AI for Education: Bridging …, 2024 - openreview.net
Large language model (LLM)-based education technology (edtech) is increasingly being
developed and deployed with the goal of improving both learning outcomes and teaching …