Legalbench: A collaboratively built benchmark for measuring legal reasoning in large language models

N Guha, J Nyarko, D Ho, C Ré… - Advances in …, 2024 - proceedings.neurips.cc
The advent of large language models (LLMs) and their adoption by the legal community has
given rise to the question: what types of legal reasoning can LLMs perform? To enable …

Legal syllogism prompting: Teaching large language models for legal judgment prediction

C Jiang, X Yang - … of the Nineteenth International Conference on …, 2023 - dl.acm.org
Legal syllogism is a form of deductive reasoning commonly used by legal professionals to
analyze cases. In this paper, we propose legal syllogism prompting (LoT), a simple …

LAiW: A Chinese legal large language models benchmark (a technical report)

Y Dai, D Feng, J Huang, H Jia, Q Xie, Y Zhang… - arXiv preprint arXiv …, 2023 - arxiv.org
With the emergence of numerous legal LLMs, there is currently a lack of a comprehensive
benchmark for evaluating their legal abilities. In this paper, we propose the first Chinese …

Precedent-enhanced legal judgment prediction with llm and domain-model collaboration

Y Wu, S Zhou, Y Liu, W Lu, X Liu, Y Zhang… - arXiv preprint arXiv …, 2023 - arxiv.org
Legal Judgment Prediction (LJP) has become an increasingly crucial task in Legal AI, ie,
predicting the judgment of the case in terms of case fact description. Precedents are the …

Syllogistic reasoning for legal judgment analysis

W Deng, J Pei, K Kong, Z Chen, F Wei… - Proceedings of the …, 2023 - aclanthology.org
Legal judgment assistants are developing fast due to impressive progress of large language
models (LLMs). However, people can hardly trust the results generated by a model without …

Scale: Scaling up the complexity for advanced language model evaluation

V Rasiah, R Stern, V Matoshi, M Stürmer… - arXiv preprint arXiv …, 2023 - arxiv.org
Recent strides in Large Language Models (LLMs) have saturated many NLP benchmarks
(even professional domain-specific ones), emphasizing the need for novel, more …

U-creat: Unsupervised case retrieval using events extraction

A Joshi, A Sharma, SK Tanikella, A Modi - arXiv preprint arXiv:2307.05260, 2023 - arxiv.org
The task of Prior Case Retrieval (PCR) in the legal domain is about automatically citing
relevant (based on facts and precedence) prior legal cases in a given query case. To further …

Topology-aware Multi-task Learning Framework for Civil Case Judgment Prediction

Y Le, S Xiao, Z Xiao, K Li - Expert Systems with Applications, 2024 - Elsevier
The civil case judgment prediction (CCJP) task involves automatically determining whether
the plea of a plaintiff should be supported by analyzing the given civil case materials …

Justitia ex machina: The impact of an AI system on legal decision-making and discretionary authority

D Kolkman, F Bex, N Narayan… - Big Data & …, 2024 - journals.sagepub.com
Governments increasingly use algorithms to inform or supplant decision-making. Artificial
Intelligence systems in particular are considered objective, consistent and efficient decision …

FedProK: Trustworthy Federated Class-Incremental Learning via Prototypical Feature Knowledge Transfer

X Gao, X Yang, H Yu, Y Kang… - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
Abstract Federated Class-Incremental Learning (FCIL) focuses on continually transferring
the previous knowledge to learn new classes in dynamic Federated Learning (FL). However …