Search Results for author: Leonard Tang

Found 10 papers, 4 papers with code

Consistent Explanations in the Face of Model Indeterminacy via Ensembling

no code implementations9 Jun 2023 Dan Ley, Leonard Tang, Matthew Nazari, Hongjin Lin, Suraj Srinivas, Himabindu Lakkaraju

This work addresses the challenge of providing consistent explanations for predictive models in the presence of model indeterminacy, which arises due to the existence of multiple (nearly) equally well-performing models for a given dataset and task.

Baselines for Identifying Watermarked Large Language Models

no code implementations29 May 2023 Leonard Tang, Gavin Uberti, Tom Shlomi

We consider the emerging problem of identifying the presence and use of watermarking schemes in widely used, publicly hosted, closed source large language models (LLMs).

Learning the Wrong Lessons: Inserting Trojans During Knowledge Distillation

no code implementations9 Mar 2023 Leonard Tang, Tom Shlomi, Alexander Cai

In recent years, knowledge distillation has become a cornerstone of efficiently deployed machine learning, with labs and industries using knowledge distillation to train models that are inexpensive and resource-optimized.

Knowledge Distillation

MAUD: An Expert-Annotated Legal NLP Dataset for Merger Agreement Understanding

2 code implementations2 Jan 2023 Steven H. Wang, Antoine Scardigli, Leonard Tang, Wei Chen, Dimitry Levkin, Anya Chen, Spencer Ball, Thomas Woodside, Oliver Zhang, Dan Hendrycks

Reading comprehension of legal text can be a particularly challenging task due to the length and complexity of legal clauses and a shortage of expert-annotated datasets.

Reading Comprehension

The Naughtyformer: A Transformer Understands Offensive Humor

no code implementations25 Nov 2022 Leonard Tang, Alexander Cai, Steve Li, Jason Wang

Jokes are intentionally written to be funny, but not all jokes are created the same.

Humor Detection

PixMix: Dreamlike Pictures Comprehensively Improve Safety Measures

2 code implementations CVPR 2022 Dan Hendrycks, Andy Zou, Mantas Mazeika, Leonard Tang, Bo Li, Dawn Song, Jacob Steinhardt

In real-world applications of machine learning, reliable and safe systems must consider measures of performance beyond standard test set accuracy.

Adversarial Robustness Anomaly Detection +1

Solving Probability and Statistics Problems by Program Synthesis

no code implementations16 Nov 2021 Leonard Tang, Elizabeth Ke, Nikhil Singh, Nakul Verma, Iddo Drori

Our work is the first to introduce a new dataset of university-level probability and statistics problems and solve these problems in a scalable fashion using the program synthesis capabilities of large language models.

Program Synthesis Prompt Engineering

Cannot find the paper you are looking for? You can Submit a new open access paper.