A Survey on LLM-as-a-Judge

J Gu, X Jiang, Z Shi, H Tan, X Zhai, C Xu, W Li… - arXiv preprint arXiv …, 2024 - arxiv.org
Accurate and consistent evaluation is crucial for decision-making across numerous fields,
yet it remains a challenging task due to inherent subjectivity, variability, and scale. Large …

Calibraeval: Calibrating prediction distribution to mitigate selection bias in llms-as-judges

H Li, J Chen, Q Ai, Z Chu, Y Zhou, Q Dong… - arXiv preprint arXiv …, 2024 - arxiv.org
The use of large language models (LLMs) as automated evaluation tools to assess the
quality of generated natural language, known as LLMs-as-Judges, has demonstrated …

Ethical and Legal Considerations of Large Language Models: A Systematic Review of the Literature

S Alkamli, M Al-Yahya, K Alyahya - 2024 2nd International …, 2024 - ieeexplore.ieee.org
Large Language Models (LLMs) such as OpenAI's GPT-4 and Google's Gemini have rapidly
emerged as influential tools across various sectors, including healthcare, education …

A Survey on Large Language Models for Critical Societal Domains: Finance, Healthcare, and Law

ZZ Chen, J Ma, X Zhang, N Hao, A Yan… - arXiv preprint arXiv …, 2024 - arxiv.org
In the fast-evolving domain of artificial intelligence, large language models (LLMs) such as
GPT-3 and GPT-4 are revolutionizing the landscapes of finance, healthcare, and law …

Evaluating Large Language Models for Tax Law Reasoning

JPC Presa, CG Camilo Junior, SST Oliveira - Brazilian Conference on …, 2024 - Springer
The ability to reason over laws is essential for legal professionals, facilitating interpreting
and applying legal principles to complex real-world situations. Tax laws are crucial for …

[PDF][PDF] Generative AI System to Support Decision-Making on Public Procurement Legislation by Fine-Tuned Large Language Models

D Datcu, C Maathuis - system - dragosdatcu.eu
Public procurement processes are often hindered by the complex nature of implementing
domain-specific directives and laws, leading to human errors in decision-making during …