Search Results for author:
Found 33 papers, 23 papers with code
Jailbreak Large Vision-Language Models Through Multi-Modal Linkage
With the significant advancement of Large Vision-Language Models (VLMs), concerns about their potential misuse and abuse have grown rapidly.
Style-Compress: An LLM-Based Prompt Compression Framework Considering Task-Specific Styles
In a preliminary study, we discover that when instructing language models to compress prompts, different compression styles (e. g., extractive or abstractive) impact performance of compressed prompts on downstream tasks.
Can LLM Graph Reasoning Generalize beyond Pattern Memorization?
To this end, we propose the NLGift benchmark, an evaluation suite of LLM graph reasoning generalization: whether LLMs could go beyond semantic, numeric, structural, reasoning patterns in the synthetic training data and improve utility on real-world graph-based tasks.
Towards Black-Box Membership Inference Attack for Diffusion Models
Given the rising popularity of AI-generated art and the associated copyright concerns, identifying whether an artwork was used to train a diffusion model is an important research topic.
Learning Syntax Without Planting Trees: Understanding When and Why Transformers Generalize Hierarchically
Transformers trained on natural language data have been shown to learn its hierarchical structure and generalize to sentences with unseen syntactic structures without explicitly encoding any structural bias.
Stumbling Blocks: Stress Testing the Robustness of Machine-Generated Text Detectors Under Attacks
Our experiments reveal that almost none of the existing detectors remain robust under all the attacks, and all detectors exhibit different loopholes.
k-SemStamp: A Clustering-Based Semantic Watermark for Detection of Machine-Generated Text
Recent watermarked generation algorithms inject detectable signatures during language generation to facilitate post-hoc detection.
Learning Time-Invariant Representations for Individual Neurons from Population Dynamics
This suggests that neuronal activity is a combination of its time-invariant identity and the inputs the neuron receives from the rest of the circuit.
KGQuiz: Evaluating the Generalization of Encoded Knowledge in Large Language Models
To gain a better understanding of LLMs' knowledge abilities and their generalization, we evaluate 10 open-source and black-box LLMs on the KGQuiz benchmark across the five knowledge-intensive tasks and knowledge domains.
On the Zero-Shot Generalization of Machine-Generated Text Detectors
The rampant proliferation of large language models, fluent enough to generate text indistinguishable from human-written language, gives unprecedented importance to the detection of machine-generated text.
SemStamp: A Semantic Watermark with Paraphrastic Robustness for Text Generation
Existing watermarking algorithms are vulnerable to paraphrase attacks because of their token-level design.
Knowledge Crosswords: Geometric Knowledge Reasoning with Large Language Models
The novel setting of geometric knowledge reasoning necessitates new LM abilities beyond existing atomic/linear multi-hop QA, such as backtracking, verifying facts and constraints, reasoning with uncertainty, and more.
Resolving Knowledge Conflicts in Large Language Models
To this end, we introduce an evaluation framework for simulating contextual knowledge conflicts and quantitatively evaluating to what extent LLMs achieve these goals.
LatticeGen: A Cooperative Framework which Hides Generated Text in a Lattice for Privacy-Aware Generation on Cloud
In the current user-server interaction paradigm of prompted generation with large language models (LLM) on cloud, the server fully controls the generation process, which leaves zero options for users who want to keep the generated text to themselves.
Can Language Models Solve Graph Problems in Natural Language?
We then propose Build-a-Graph Prompting and Algorithmic Prompting, two instruction-based approaches to enhance LLMs in solving natural language graph problems.
Knowledge Card: Filling LLMs' Knowledge Gaps with Plug-in Specialized Language Models
Ultimately, Knowledge Card framework enables dynamic synthesis and updates of knowledge from diverse domains.
On the Blind Spots of Model-Based Evaluation Metrics for Text Generation
In this work, we explore a useful but often neglected methodology for robustness analysis of text generation evaluation metrics: stress tests with synthetic data.
PCFG-based Natural Language Interface Improves Generalization for Controlled Text Generation
Existing work on controlled text generation (CTG) assumes a control interface of categorical attributes.
Controlling the Focus of Pretrained Language Generation Models
This work aims to develop a control mechanism by which a user can select spans of context as "highlights" for the model to focus on, and generate relevant output.
Revisiting Latent-Space Interpolation via a Quantitative Evaluation Framework
In this work, we show how data labeled with semantically continuous attributes can be utilized to conduct a quantitative evaluation of latent-space interpolation algorithms, for variational autoencoders.
An Empirical Study on Few-shot Knowledge Probing for Pretrained Language Models
Prompt-based knowledge probing for 1-hop relations has been used to measure how much world knowledge is stored in pretrained language models.
Analyzing the Forgetting Problem in Pretrain-Finetuning of Open-domain Dialogue Response Models
We find that mix-review effectively regularizes the finetuning process, and the forgetting problem is alleviated to some extent.
Joint Energy-based Model Training for Better Calibrated Natural Language Understanding Models
In this work, we explore joint energy-based model (EBM) training during the finetuning of pretrained text encoders (e. g., Roberta) for natural language understanding (NLU) tasks.
Quantifying Exposure Bias for Open-ended Language Generation
The exposure bias problem refers to the incrementally distorted generation induced by the training-generation discrepancy, in teacher-forcing training for auto-regressive neural network language models (LM).
A Systematic Characterization of Sampling Algorithms for Open-ended Language Generation
On the other hand, we find that the set of sampling algorithms that satisfies these properties performs on par with the existing sampling algorithms.
AutoKG: Constructing Virtual Knowledge Graphs from Unstructured Documents for Question Answering
Knowledge graphs (KGs) have the advantage of providing fine-grained detail for question-answering systems.
Analyzing the Forgetting Problem in the Pretrain-Finetuning of Dialogue Response Models
We find that mix-review effectively regularizes the finetuning process, and the forgetting problem is alleviated to some extent.
From Data Quality to Model Quality: an Exploratory Study on Deep Learning
Nowadays, people strive to improve the accuracy of deep learning models.
Why gradient clipping accelerates training: A theoretical justification for adaptivity
We provide a theoretical explanation for the effectiveness of gradient clipping in training deep neural networks.
Exposure Bias versus Self-Recovery: Are Distortions Really Incremental for Autoregressive Text Generation?
Exposure bias has been regarded as a central problem for auto-regressive language models (LM).
Negative Training for Neural Dialogue Response Generation
Although deep learning models have brought tremendous advancements to the field of open-domain dialogue response generation, recent research results have revealed that the trained models have undesirable generation behaviors, such as malicious responses and generic (boring) responses.
Detecting egregious responses in neural sequence-to-sequence models
We adopt an empirical methodology, in which we first create lists of egregious output sequences, and then design a discrete optimization algorithm to find input sequences that will cause the model to generate them.
On Training Bi-directional Neural Network Language Model with Noise Contrastive Estimation
We propose to train bi-directional neural network language model(NNLM) with noise contrastive estimation(NCE).
