A comprehensive overview of large language models

H Naveed, AU Khan, S Qiu, M Saqib, S Anwar… - arXiv preprint arXiv …, 2023 - arxiv.org
Large Language Models (LLMs) have recently demonstrated remarkable capabilities in
natural language processing tasks and beyond. This success of LLMs has led to a large …

The emerging trends of multi-label learning

W Liu, H Wang, X Shen… - IEEE transactions on …, 2021 - ieeexplore.ieee.org
Exabytes of data are generated daily by humans, leading to the growing needs for new
efforts in dealing with the grand challenges for multi-label learning brought by big data. For …

Legalbench: A collaboratively built benchmark for measuring legal reasoning in large language models

N Guha, J Nyarko, D Ho, C Ré… - Advances in …, 2024 - proceedings.neurips.cc
The advent of large language models (LLMs) and their adoption by the legal community has
given rise to the question: what types of legal reasoning can LLMs perform? To enable …

Ernie 3.0: Large-scale knowledge enhanced pre-training for language understanding and generation

Y Sun, S Wang, S Feng, S Ding, C Pang… - arXiv preprint arXiv …, 2021 - arxiv.org
Pre-trained models have achieved state-of-the-art results in various Natural Language
Processing (NLP) tasks. Recent works such as T5 and GPT-3 have shown that scaling up …

[图书][B] Pretrained transformers for text ranking: Bert and beyond

J Lin, R Nogueira, A Yates - 2022 - books.google.com
The goal of text ranking is to generate an ordered list of texts retrieved from a corpus in
response to a query. Although the most common formulation of text ranking is search …

How does NLP benefit legal system: A summary of legal artificial intelligence

H Zhong, C Xiao, C Tu, T Zhang, Z Liu… - arXiv preprint arXiv …, 2020 - arxiv.org
Legal Artificial Intelligence (LegalAI) focuses on applying the technology of artificial
intelligence, especially natural language processing, to benefit tasks in the legal domain. In …

[HTML][HTML] Lawformer: A pre-trained language model for chinese legal long documents

C Xiao, X Hu, Z Liu, C Tu, M Sun - AI Open, 2021 - Elsevier
Legal artificial intelligence (LegalAI) aims to benefit legal systems with the technology of
artificial intelligence, especially natural language processing (NLP). Recently, inspired by …

Legal judgment prediction via topological learning

H Zhong, Z Guo, C Tu, C Xiao, Z Liu… - Proceedings of the 2018 …, 2018 - aclanthology.org
Abstract Legal Judgment Prediction (LJP) aims to predict the judgment result based on the
facts of a case and becomes a promising application of artificial intelligence techniques in …

Legal judgment prediction via event extraction with constraints

Y Feng, C Li, V Ng - Proceedings of the 60th Annual Meeting of …, 2022 - aclanthology.org
While significant progress has been made on the task of Legal Judgment Prediction (LJP) in
recent years, the incorrect predictions made by SOTA LJP models can be attributed in part to …

Pangu-{\Sigma}: Towards trillion parameter language model with sparse heterogeneous computing

X Ren, P Zhou, X Meng, X Huang, Y Wang… - arXiv preprint arXiv …, 2023 - arxiv.org
The scaling of large language models has greatly improved natural language
understanding, generation, and reasoning. In this work, we develop a system that trained a …