Legalbench: A collaboratively built benchmark for measuring legal reasoning in large language models
The advent of large language models (LLMs) and their adoption by the legal community has
given rise to the question: what types of legal reasoning can LLMs perform? To enable …
given rise to the question: what types of legal reasoning can LLMs perform? To enable …
Task-aware retrieval with instructions
We study the problem of retrieval with instructions, where users of a retrieval system
explicitly describe their intent along with their queries. We aim to develop a general-purpose …
explicitly describe their intent along with their queries. We aim to develop a general-purpose …
Bringing order into the realm of Transformer-based language models for artificial intelligence and law
CM Greco, A Tagarelli - Artificial Intelligence and Law, 2023 - Springer
Transformer-based language models (TLMs) have widely been recognized to be a cutting-
edge technology for the successful development of deep-learning-based solutions to …
edge technology for the successful development of deep-learning-based solutions to …
Applicability of large language models and generative models for legal case judgement summarization
Automatic summarization of legal case judgements, which are known to be long and
complex, has traditionally been tried via extractive summarization models. In recent years …
complex, has traditionally been tried via extractive summarization models. In recent years …
How to train long-context language models (effectively)
We study continued training and supervised fine-tuning (SFT) of a language model (LM) to
make effective use of long-context information. We first establish a reliable evaluation …
make effective use of long-context information. We first establish a reliable evaluation …
SUMMEDITS: measuring LLM ability at factual reasoning through the lens of summarization
With the recent appearance of LLMs in practical settings, having methods that can effectively
detect factual inconsistencies is crucial to reduce the propagation of misinformation and …
detect factual inconsistencies is crucial to reduce the propagation of misinformation and …
Llms as factual reasoners: Insights from existing benchmarks and beyond
With the recent appearance of LLMs in practical settings, having methods that can effectively
detect factual inconsistencies is crucial to reduce the propagation of misinformation and …
detect factual inconsistencies is crucial to reduce the propagation of misinformation and …
Lextreme: A multi-lingual and multi-task benchmark for the legal domain
Lately, propelled by the phenomenal advances around the transformer architecture, the
legal NLP field has enjoyed spectacular growth. To measure progress, well curated and …
legal NLP field has enjoyed spectacular growth. To measure progress, well curated and …
Natural Language Processing for the Legal Domain: A Survey of Tasks, Datasets, Models, and Challenges
F Ariai, G Demartini - arXiv preprint arXiv:2410.21306, 2024 - arxiv.org
Natural Language Processing is revolutionizing the way legal professionals and laypersons
operate in the legal field. The considerable potential for Natural Language Processing in the …
operate in the legal field. The considerable potential for Natural Language Processing in the …
An exploration of hierarchical attention transformers for efficient long document classification
Non-hierarchical sparse attention Transformer-based models, such as Longformer and Big
Bird, are popular approaches to working with long documents. There are clear benefits to …
Bird, are popular approaches to working with long documents. There are clear benefits to …