Challenges and applications of large language models

J Kaddour, J Harris, M Mozes, H Bradley… - arXiv preprint arXiv …, 2023 - arxiv.org
Large Language Models (LLMs) went from non-existent to ubiquitous in the machine
learning discourse within a few years. Due to the fast pace of the field, it is difficult to identify …

A survey on legal judgment prediction: Datasets, metrics, models and challenges

J Cui, X Shen, S Wen - IEEE Access, 2023 - ieeexplore.ieee.org
Legal judgment prediction (LJP) applies Natural Language Processing (NLP) techniques to
predict judgment results based on fact descriptions automatically. The present work …

Flashattention: Fast and memory-efficient exact attention with io-awareness

T Dao, D Fu, S Ermon, A Rudra… - Advances in Neural …, 2022 - proceedings.neurips.cc
Transformers are slow and memory-hungry on long sequences, since the time and memory
complexity of self-attention are quadratic in sequence length. Approximate attention …

On the opportunities and risks of foundation models

R Bommasani, DA Hudson, E Adeli, R Altman… - arXiv preprint arXiv …, 2021 - arxiv.org
AI is undergoing a paradigm shift with the rise of models (eg, BERT, DALL-E, GPT-3) that are
trained on broad data at scale and are adaptable to a wide range of downstream tasks. We …

Analyzing leakage of personally identifiable information in language models

N Lukas, A Salem, R Sim, S Tople… - … IEEE Symposium on …, 2023 - ieeexplore.ieee.org
Language Models (LMs) have been shown to leak information about training data through
sentence-level membership inference and reconstruction attacks. Understanding the risk of …

Legalbench: A collaboratively built benchmark for measuring legal reasoning in large language models

N Guha, J Nyarko, D Ho, C Ré… - Advances in …, 2024 - proceedings.neurips.cc
The advent of large language models (LLMs) and their adoption by the legal community has
given rise to the question: what types of legal reasoning can LLMs perform? To enable …

LEGAL-BERT: The muppets straight out of law school

I Chalkidis, M Fergadiotis, P Malakasiotis… - arXiv preprint arXiv …, 2020 - arxiv.org
BERT has achieved impressive performance in several NLP tasks. However, there has been
limited investigation on its adaptation guidelines in specialised domains. Here we focus on …

A comparative study of automated legal text classification using random forests and deep learning

H Chen, L Wu, J Chen, W Lu, J Ding - Information Processing & …, 2022 - Elsevier
Automated legal text classification is a prominent research topic in the legal field. It lays the
foundation for building an intelligent legal system. Current literature focuses on international …

How does NLP benefit legal system: A summary of legal artificial intelligence

H Zhong, C Xiao, C Tu, T Zhang, Z Liu… - arXiv preprint arXiv …, 2020 - arxiv.org
Legal Artificial Intelligence (LegalAI) focuses on applying the technology of artificial
intelligence, especially natural language processing, to benefit tasks in the legal domain. In …

[HTML][HTML] Lawformer: A pre-trained language model for chinese legal long documents

C Xiao, X Hu, Z Liu, C Tu, M Sun - AI Open, 2021 - Elsevier
Legal artificial intelligence (LegalAI) aims to benefit legal systems with the technology of
artificial intelligence, especially natural language processing (NLP). Recently, inspired by …