Search Results for author: Ling Shi

Found 56 papers, 8 papers with code

A Unified Alternating Optimization Framework for Joint Sensor and Actuator Configuration in LQG Systems

no code implementations25 Apr 2025 Nachuan Yang, Yuzhe Li, Ling Shi, Tongwen Chen

This paper fills a gap in the literature by considering a joint sensor and actuator configuration problem under the linear quadratic Gaussian (LQG) performance without assuming a predefined set of candidate components.

Breaking the Loop: Detecting and Mitigating Denial-of-Service Vulnerabilities in Large Language Models

no code implementations1 Mar 2025 Junzhe Yu, Yi Liu, Huijia Sun, Ling Shi, Yuqi Chen

Large Language Models (LLMs) have significantly advanced text understanding and generation, becoming integral to applications across education, software development, healthcare, entertainment, and legal services.

ProBench: Benchmarking Large Language Models in Competitive Programming

no code implementations28 Feb 2025 Lei Yang, Renren Jin, Ling Shi, Jianxiang Peng, Yue Chen, Deyi Xiong

To bridge the gap for high-level code reasoning assessment, we propose ProBench to benchmark LLMs in competitive programming, drawing inspiration from the International Collegiate Programming Contest.

Attribute Benchmarking +1

Detecting LLM Fact-conflicting Hallucinations Enhanced by Temporal-logic-based Reasoning

no code implementations19 Feb 2025 Ningke Li, Yahui Song, Kailong Wang, Yuekang Li, Ling Shi, Yi Liu, Haoyu Wang

Large language models (LLMs) face the challenge of hallucinations -- outputs that seem coherent but are actually incorrect.

Hallucination

Optimal Actuator Attacks on Autonomous Vehicles Using Reinforcement Learning

no code implementations11 Feb 2025 Pengyu Wang, Jialu Li, Ling Shi

With the increasing prevalence of autonomous vehicles (AVs), their vulnerability to various types of attacks has grown, presenting significant security challenges.

Autonomous Vehicles reinforcement-learning +2

Learning-based Detection of GPS Spoofing Attack for Quadrotors

no code implementations10 Jan 2025 Pengyu Wang, Zhaohua Yang, Jialu Li, Ling Shi

Safety-critical cyber-physical systems (CPS), such as quadrotor UAVs, are particularly prone to cyber attacks, which can result in significant consequences if not detected promptly and accurately.

Large Language Model Safety: A Holistic Survey

1 code implementation23 Dec 2024 Dan Shi, Tianhao Shen, Yufei Huang, Zhigen Li, Yongqi Leng, Renren Jin, Chuang Liu, Xinwei Wu, Zishan Guo, Linhao Yu, Ling Shi, Bojian Jiang, Deyi Xiong

The rapid development and deployment of large language models (LLMs) have introduced a new frontier in artificial intelligence, marked by unprecedented capabilities in natural language understanding and generation.

Language Modeling Language Modelling +4

Model-Editing-Based Jailbreak against Safety-aligned Large Language Models

no code implementations11 Dec 2024 Yuxi Li, Zhibo Zhang, Kailong Wang, Ling Shi, Haoyu Wang

Large Language Models (LLMs) have transformed numerous fields by enabling advanced natural language interactions but remain susceptible to critical vulnerabilities, particularly jailbreak attacks.

Model Editing Safety Alignment

A Secure Estimator with Gaussian Bernoulli Mixture Model

no code implementations15 Nov 2024 Xingzhou Chen, Nachuan Yang, Peihu Duan, Shilei Li, Ling Shi

The implementation of cyber-physical systems in real-world applications is challenged by safety requirements in the presence of sensor threats.

Computational Efficiency model

Efficient and Effective Universal Adversarial Attack against Vision-Language Pre-training Models

no code implementations15 Oct 2024 Fan Yang, Yihao Huang, Kailong Wang, Ling Shi, Geguang Pu, Yang Liu, Haoyu Wang

Vision-language pre-training (VLP) models, trained on large-scale image-text pairs, have become widely used across a variety of downstream vision-and-language (V+L) tasks.

Adversarial Attack Data Augmentation

Bias-VarianceTrade-off in Kalman Filter-Based Disturbance Observers

no code implementations7 Oct 2024 Shilei Li, Dawei Shi, Xiaoxu Lyu, Jiawei Tang, Ling Shi

In contrast, the Kalman filter-based disturbance observer (KF-DOB) achieves minimum mean-square error estimation when the disturbance model is fully specified.

Efficient Detection of Toxic Prompts in Large Language Models

no code implementations21 Aug 2024 Yi Liu, Junzhe Yu, Huijia Sun, Ling Shi, Gelei Deng, Yuqi Chen, Yang Liu

ToxicDetector achieves high accuracy, efficiency, and scalability, making it a practical method for toxic prompt detection in LLMs.

Computational Efficiency

On the Effects of Modeling Errors on Distributed Continuous-time Filtering

no code implementations13 Aug 2024 Xiaoxu Lyu, Shilei Li, Dawei Shi, Ling Shi

This paper offers a comprehensive performance analysis of the distributed continuous-time filtering in the presence of modeling errors.

Designing Consensus-Based Distributed Filtering over Directed Graphs

no code implementations13 Aug 2024 Xiaoxu Lyu, Guanghui Wen, Yuezu Lv, Zhisheng Duan, Ling Shi

The transient performance is also analyzed with the fusion step tending to infinity.

Performance Analysis of Distributed Filtering under Mismatched Noise Covariances

no code implementations13 Aug 2024 Xiaoxu Lyu, Guanghui Wen, Ling Shi, Peihu Duan, Zhisheng Duan

Additionally, we prove that the estimation error covariance of the consensus-based distributed filter under mismatched noise covariances can be bounded by the Frobenius norms of the noise covariance deviations and the trace of the nominal performance evaluation index.

FuxiTranyu: A Multilingual Large Language Model Trained with Balanced Data

1 code implementation12 Aug 2024 Haoran Sun, Renren Jin, Shaoyang Xu, Leiyu Pan, Supryadi, Menglong Cui, Jiangcun Du, Yikun Lei, Lei Yang, Ling Shi, Juesi Xiao, Shaolin Zhu, Deyi Xiong

To mitigate this challenge, we present FuxiTranyu, an open-source multilingual LLM, which is designed to satisfy the need of the research community for balanced and high-performing multilingual capabilities.

Language Modeling Language Modelling +1

GlitchProber: Advancing Effective Detection and Mitigation of Glitch Tokens in Large Language Models

1 code implementation9 Aug 2024 Zhibo Zhang, Wuxia Bai, Yuxi Li, Mark Huasong Meng, Kailong Wang, Ling Shi, Li Li, Jun Wang, Haoyu Wang

In this work, we aim to enhance the understanding of glitch tokens and propose techniques for their detection and mitigation.

Federated Cubic Regularized Newton Learning with Sparsification-amplified Differential Privacy

no code implementations8 Aug 2024 Wei Huo, Changxin Liu, Kemi Ding, Karl Henrik Johansson, Ling Shi

This paper investigates the use of the cubic-regularized Newton method within a federated learning framework while addressing two major concerns that commonly arise in federated learning: privacy leakage and communication bottleneck.

Federated Learning

Recent Advances in Data-driven Intelligent Control for Wireless Communication: A Comprehensive Survey

no code implementations6 Aug 2024 Wei Huo, Huiwen Yang, Nachuan Yang, Zhaohua Yang, Jiuzhou Zhang, Fuhai Nan, Xingzhou Chen, Yifan Mao, Suyang Hu, Pengyu Wang, Xuanyu Zheng, Mingming Zhao, Ling Shi

As the volume of data continues to escalate, the integration of data-driven methods has become indispensable for enabling adaptive and intelligent control mechanisms in future wireless communication systems.

Scheduling

NeuSemSlice: Towards Effective DNN Model Maintenance via Neuron-level Semantic Slicing

no code implementations26 Jul 2024 Shide Zhou, Tianlin Li, Yihao Huang, Ling Shi, Kailong Wang, Yang Liu, Haoyu Wang

In this work, we implement NeuSemSlice, a novel framework that introduces the semantic slicing technique to effectively identify critical neuron-level semantic components in DNN models for semantic-aware model maintenance tasks.

Model Compression Semantic Similarity +1

Continuous Embedding Attacks via Clipped Inputs in Jailbreaking Large Language Models

1 code implementation16 Jul 2024 Zihao Xu, Yi Liu, Gelei Deng, Kailong Wang, Yuekang Li, Ling Shi, Stjepan Picek

Security concerns for large language models (LLMs) have recently escalated, focusing on thwarting jailbreaking attempts in discrete prompts.

Self and Cross-Model Distillation for LLMs: Effective Methods for Refusal Pattern Alignment

no code implementations17 Jun 2024 Jie Li, Yi Liu, Chongyang Liu, Xiaoning Ren, Ling Shi, Weisong Sun, Yinxing Xue

Our results show that these methods significantly improve refusal rates and reduce unsafe content, with cross-model distilling achieving refusal rates close to Claude3's 94. 51%.

Text Generation

CRiskEval: A Chinese Multi-Level Risk Evaluation Benchmark Dataset for Large Language Models

no code implementations7 Jun 2024 Ling Shi, Deyi Xiong

Each question is accompanied with 4 answer choices that state opinions or behavioral tendencies corresponding to the question.

Multiple-choice Philosophy +1

Lockpicking LLMs: A Logit-Based Jailbreak Using Token-level Manipulation

1 code implementation20 May 2024 Yuxi Li, Yi Liu, Yuekang Li, Ling Shi, Gelei Deng, Shengquan Chen, Kailong Wang

Large language models (LLMs) have transformed the field of natural language processing, but they remain susceptible to jailbreaking attacks that exploit their capabilities to generate unintended and potentially harmful content.

Compression-based Privacy Preservation for Distributed Nash Equilibrium Seeking in Aggregative Games

no code implementations6 May 2024 Wei Huo, Xiaomeng Chen, Kemi Ding, Subhrakanti Dey, Ling Shi

To jointly address these issues, we propose an algorithm that uses stochastic compression to save communication resources and conceal information through random errors induced by compression.

Quantization

Glitch Tokens in Large Language Models: Categorization Taxonomy and Effective Detection

no code implementations15 Apr 2024 Yuxi Li, Yi Liu, Gelei Deng, Ying Zhang, Wenjia Song, Ling Shi, Kailong Wang, Yuekang Li, Yang Liu, Haoyu Wang

We present categorizations of the identified glitch tokens and symptoms exhibited by LLMs when interacting with glitch tokens.

Differentially Private Dual Gradient Tracking for Distributed Resource Allocation

no code implementations27 Mar 2024 Wei Huo, Xiaomeng Chen, Lingying Huang, Karl Henrik Johansson, Ling Shi

This paper investigates privacy issues in distributed resource allocation over directed networks, where each agent holds a private cost function and optimizes its decision subject to a global coupling constraint through local interaction with other agents.

OpenEval: Benchmarking Chinese LLMs across Capability, Alignment and Safety

no code implementations18 Mar 2024 Chuang Liu, Linhao Yu, Jiaxuan Li, Renren Jin, Yufei Huang, Ling Shi, Junhui Zhang, Xinmeng Ji, Tingting Cui, Tao Liu, Jinwang Song, Hongying Zan, Sun Li, Deyi Xiong

In addition to these benchmarks, we have implemented a phased public evaluation and benchmark update strategy to ensure that OpenEval is in line with the development of Chinese LLMs or even able to provide cutting-edge benchmark datasets to guide the development of Chinese LLMs.

Benchmarking Mathematical Reasoning

FineMath: A Fine-Grained Mathematical Evaluation Benchmark for Chinese Large Language Models

no code implementations12 Mar 2024 Yan Liu, Renren Jin, Ling Shi, Zheng Yao, Deyi Xiong

We conduct extensive experiments on a wide range of LLMs on FineMath and find that there is still considerable room for improvements in terms of mathematical reasoning capability of Chinese LLMs.

Math Mathematical Reasoning

Distributed Average Consensus via Noisy and Non-Coherent Over-the-Air Aggregation

no code implementations11 Mar 2024 Huiwen Yang, Xiaomeng Chen, Lingying Huang, Subhrakanti Dey, Ling Shi

Over-the-air aggregation has attracted widespread attention for its potential advantages in task-oriented applications, such as distributed sensing, learning, and consensus.

Consistent and Asymptotically Statistically-Efficient Solution to Camera Motion Estimation

1 code implementation2 Mar 2024 Guangyang Zeng, Qingcheng Zeng, Xinghan Li, Biqiang Mu, Jiming Chen, Ling Shi, Junfeng Wu

Given 2D point correspondences between an image pair, inferring the camera motion is a fundamental issue in the computer vision community.

Motion Estimation

High-Performance Distributed Control for Large-Scale Linear Systems: A Partitioned Distributed Observer Approach

no code implementations10 Feb 2024 Haotian Xu, Shuai Liu, Ling Shi

In recent years, the distributed-observer-based distributed control law has shown powerful ability to arbitrarily approximate the centralized control performance.

LEMMA

A Cross-Language Investigation into Jailbreak Attacks in Large Language Models

no code implementations30 Jan 2024 Jie Li, Yi Liu, Chongyang Liu, Ling Shi, Xiaoning Ren, Yaowen Zheng, Yang Liu, Yinxing Xue

To address this research gap, we conducted an extensive empirical study on Multilingual Jailbreak attacks.

Text Generation

An Efficient Distributed Nash Equilibrium Seeking with Compressed and Event-triggered Communication

no code implementations23 Nov 2023 Xiaomeng Chen, Wei Huo, Yuchi Wu, Subhrakanti Dey, Ling Shi

We demonstrate that SETC-DNES guarantees linear convergence to the NE while achieving even greater reductions in communication costs compared to ETC-DNES.

Generalized Multi-kernel Maximum Correntropy Kalman Filter for Disturbance Estimation

no code implementations30 Oct 2023 Shilei Li, Dawei Shi, Yunjiang Lou, Wulin Zou, Ling Shi

Disturbance observers have been attracting continuing research efforts and are widely used in many applications.

Over-the-air Federated Policy Gradient

no code implementations25 Oct 2023 Huiwen Yang, Lingying Huang, Subhrakanti Dey, Ling Shi

In recent years, over-the-air aggregation has been widely considered in large-scale distributed learning, optimization, and sensing.

Sensor Selection for Remote State Estimation with QoS Requirement Constraints

no code implementations26 Jun 2023 Huiwen Yang, Lingying Huang, Chao Yang, Yilin Mo, Ling Shi

By utilizing the solution of the relaxed problem, we propose a heuristic sensor selection algorithm which can provide a good suboptimal solution.

On the Effects and Optimal Design of Redundant Sensors in Collaborative State Estimation

no code implementations15 Jun 2023 Yunxiao Ren, Zhisheng Duan, Peihu Duan, Ling Shi

The paper presents two main results: a theoretical analysis of the effects of redundant sensors and an engineering-oriented optimal design of redundant sensors.

Distributed Nash Equilibrium Seeking with Stochastic Event-Triggered Mechanism

no code implementations20 Apr 2023 Wei Huo, Kam Fai Elvis Tsang, Yamin Yan, Karl Henrik Johansson, Ling Shi

In this paper, we study the problem of consensus-based distributed Nash equilibrium (NE) seeking where a network of players, abstracted as a directed graph, aim to minimize their own local cost functions non-cooperatively.

Multi-kernel Correntropy Regression: Robustness, Optimality, and Application on Magnetometer Calibration

no code implementations13 Apr 2023 Shilei Li, Yunjiang Lou, Dawei Shi, Lijing Li, Ling Shi

This paper investigates the robustness and optimality of the multi-kernel correntropy (MKC) on linear regression.

regression

Multi-kernel Correntropy-based Orientation Estimation of IMUs: Gradient Descent Methods

1 code implementation13 Apr 2023 Shilei Li, Lijing Li, Dawei Shi, Yunjiang Lou, Ling Shi

We evaluate the effectiveness of our proposed methods by comparing them with existing algorithms in various situations.

LQG Control Over SWIPT-enabled Wireless Communication Network

no code implementations27 Mar 2023 Huiwen Yang, Lingying Huang, Yuzhe Li, Subhrakanti Dey, Ling Shi

In this paper, we consider using simultaneous wireless information and power transfer (SWIPT) to recharge the sensor in the LQG control, which provides a new approach to prolonging the network lifetime.

Consistent and Asymptotically Efficient Localization from Range-Difference Measurements

no code implementations7 Feb 2023 Guangyang Zeng, Biqiang Mu, Ling Shi, Jiming Chen, Junfeng Wu

Based on the preliminary consistent location estimate, a one-step GN iteration suffices to achieve the same asymptotic property as the ML estimator.

Towards Efficient Dynamic Uplink Scheduling over Multiple Unknown Channels

no code implementations13 Dec 2022 Shuang Wu, Xiaoqiang Ren, Qing-Shan Jia, Karl Henrik Johansson, Ling Shi

To alleviate the challenge, we reformulate the problem as a variant of the restless multi-armed bandit (RMAB) problem and leverage Whittle's index theory to design an index-based scheduling policy algorithm.

Decision Making Scheduling

Harmonic-Copuled Riccati Equations and its Applications in Distributed Filtering

no code implementations21 Nov 2022 Jiachen Qian, Peihu Duan, Zhisheng Duan, Ling Shi

This paper manages to formulate and investigate a new kind of coupled Riccati equations, called harmonic-coupled Riccati equations (HCRE), from the matrix iterative law of the consensus on information-based distributed filtering (CIDF) algortihm proposed in [1], where the solutions of the equations are coupled with harmonic means.

Stochastic Event-triggered Variational Bayesian Filtering

no code implementations14 Jun 2022 Xiaoxu Lv, Peihu Duan, Zhisheng Duan, Guanrong Chen, Ling Shi

This paper proposes an event-triggered variational Bayesian filter for remote state estimation with unknown and time-varying noise covariances.

Sensor Scheduling Design for Complex Networks under a Distributed State Estimation Framework

no code implementations18 Jan 2022 Peihu Duan, Lidong He, Lingying Huang, Guanrong Chen, Ling Shi

The goal of this paper is to seek an optimal sensor scheduling policy minimizing the overall estimation errors.

Scheduling

Consensus-Based Distributed Filtering with Fusion Step Analysis

no code implementations13 Dec 2021 Jiachen Qian, Peihu Duan, Zhisheng Duan, Guanrong Chen, Ling Shi

For consensus on measurement-based distributed filtering (CMDF), through infinite consensus fusion operations during each sampling interval, each node in the sensor network can achieve optimal filtering performance with centralized filtering.

Branch and Bound in Mixed Integer Linear Programming Problems: A Survey of Techniques and Trends

no code implementations5 Nov 2021 Lingying Huang, Xiaomeng Chen, Wei Huo, Jiazheng Wang, Fan Zhang, Bo Bai, Ling Shi

In order to improve the speed of B&B algorithms, learning techniques have been introduced in this algorithm recently.

Variable Selection

A Differential Private Method for Distributed Optimization in Directed Networks via State Decomposition

no code implementations9 Jul 2021 Xiaomeng Chen, Lingying Huang, Lidong He, Subhrakanti Dey, Ling Shi

For privacy preservation, we propose a novel state-decomposition based gradient tracking approach (SD-Push-Pull) for distributed optimzation over directed networks that preserves differential privacy, which is a strong notion that protects agents' privacy against an adversary with arbitrary auxiliary information.

Distributed Optimization

Privacy-Preserving Push-sum Average Consensus via State Decomposition

no code implementations25 Sep 2020 Xiaomeng Chen, Lingying Huang, Kemi Ding, Subhrakanti Dey, Ling Shi

That is to say, only the exchanged substate would be visible to an adversary, preventing the initial state information from leakage.

Privacy Preserving

Cannot find the paper you are looking for? You can Submit a new open access paper.