Modeling Legal Reasoning: LM Annotation at the Edge of Human Agreement

1 code implementation • 27 Oct 2023 • Rosamond Thalken, Edward H. Stiglitz, David Mimno, Matthew Wilkens

Our findings generally sound a note of caution in the use of generative LMs on complex tasks without fine-tuning and point to the continued relevance of human annotation-intensive classification methods.

Jurisprudence Legal Reasoning +1