Search Results for author: Jian Liu

Found 131 papers, 54 papers with code

Event Extraction as Machine Reading Comprehension

no code implementations EMNLP 2020 Jian Liu, Yubo Chen, Kang Liu, Wei Bi, Xiaojiang Liu

ii) Our model is excelled in the data-scarce scenario, for example, obtaining 49. 8{\%} in F1 for event argument extraction with only 1{\%} data, compared with 2. 2{\%} of the previous method.

Event Argument Extraction Event Extraction +5

Machine Reading Comprehension as Data Augmentation: A Case Study on Implicit Event Argument Extraction

no code implementations EMNLP 2021 Jian Liu, Yufeng Chen, Jinan Xu

Implicit event argument extraction (EAE) is a crucial document-level information extraction task that aims to identify event arguments beyond the sentence level.

Data Augmentation Event Argument Extraction +3

Iterative Constrained Back-Translation for Unsupervised Domain Adaptation of Machine Translation

1 code implementation COLING 2022 Hongxiao Zhang, Hui Huang, Jiale Gao, Yufeng Chen, Jinan Xu, Jian Liu

In this paper, we propose an Iterative Constrained Back-Translation (ICBT) method to incorporate in-domain lexical knowledge on the basis of BT for unsupervised domain adaptation of NMT.

Machine Translation NMT +4

Saliency as Evidence: Event Detection with Trigger Saliency Attribution

1 code implementation ACL 2022 Jian Liu, Yufeng Chen, Jinan Xu

Event detection (ED) is a critical subtask of event extraction that seeks to identify event triggers of certain types in texts. Despite significant advances in ED, existing methods typically follow a “one model fits all types” approach, which sees no differences between event types and often results in a quite skewed performance. Finding the causes of skewed performance is crucial for the robustness of an ED model, but to date there has been little exploration of this problem. This research examines the issue in depth and presents a new concept termed trigger salience attribution, which can explicitly quantify the underlying patterns of events.

Event Detection Event Extraction

基于多任务标签一致性机制的中文命名实体识别(Chinese Named Entity Recognition based on Multi-task Label Consistency Mechanism)

no code implementations CCL 2021 Shuning Lv, Jian Liu, Jinan Xu, Yufeng Chen, Yujie Zhang

“实体边界预测对中文命名实体识别至关重要。现有研究为改善边界识别效果提出的多任务学习方法仅考虑与分词任务结合, 缺少多任务标签训练数据, 无法学到任务的标签一致性关系。本文提出一种新的基于多任务标签一致性机制的中文命名实体识别方法:将分词和词性信息融入命名实体识别模型, 使三种任务联合训练;建立基于标签一致性机制的多任务学习模式, 来捕获标签一致性关系及学习多任务表示。全样本和小样本实验表明了方法的有效性。”

Chinese Named Entity Recognition named-entity-recognition +1

Novel Object 6D Pose Estimation with a Single Reference View

1 code implementation7 Mar 2025 Jian Liu, Wei Sun, Kai Zeng, Jin Zheng, Hui Yang, Lin Wang, Hossein Rahmani, Ajmal Mian

Using only a single reference view is more scalable, but challenging due to large pose discrepancies and limited geometric and spatial information.

6D Pose Estimation State Space Models

A Survey on Ordinal Regression: Applications, Advances and Prospects

no code implementations2 Mar 2025 Jinhong Wang, Jintai Chen, Jian Liu, Dongqi Tang, Danny Z. Chen, Jian Wu

To our best knowledge, this is the first systematic survey of ordinal regression, which lays a foundation for future research in this fundamental and generic domain.

Age Estimation regression +1

Towards Collaborative Anti-Money Laundering Among Financial Institutions

1 code implementation27 Feb 2025 Zhihua Tian, Yuan Ding, Xiang Yu, Enchao Gong, Jian Liu, Kui Ren

The experimental results demonstrate that our methods can effectively identify cross-institution money laundering subgroups.

Bridging the Data Gap in AI Reliability Research and Establishing DR-AIR, a Comprehensive Data Repository for AI Reliability

1 code implementation17 Feb 2025 Simin Zheng, Jared M. Clark, Fatemeh Salboukh, Priscila Silva, Karen da Mata, Fenglian Pan, Jie Min, Jiayi Lian, Caleb B. King, Lance Fiondella, Jian Liu, Xinwei Deng, Yili Hong

To address this gap, this paper focuses on conducting a comprehensive review of available AI reliability data and establishing DR-AIR: a data repository for AI reliability.

Compressive Sensing Empirical Wavelet Transform for Frequency-Banded Power Measurement Considering Interharmonics

no code implementations14 Feb 2025 Jian Liu, Wei Zhao, Shisong Li

The empirical wavelet transform (EWT) has been demonstrated to improve measurement accuracy by effectively partitioning transition bands.

Compressive Sensing

Diff9D: Diffusion-Based Domain-Generalized Category-Level 9-DoF Object Pose Estimation

1 code implementation4 Feb 2025 Jian Liu, Wei Sun, Hui Yang, Pengchao Deng, Chongpei Liu, Nicu Sebe, Hossein Rahmani, Ajmal Mian

Our motivation is to leverage the latent generalization ability of the diffusion model to address the domain generalization challenge in object pose estimation.

Denoising Domain Generalization +3

SecPE: Secure Prompt Ensembling for Private and Robust Large Language Models

no code implementations2 Feb 2025 Jiawen Zhang, KeJia Chen, Zunlei Feng, Jian Lou, Mingli Song, Jian Liu, Xiaohu Yang

With the growing popularity of LLMs among the general public users, privacy-preserving and adversarial robustness have become two pressing demands for LLM-based services, which have largely been pursued separately but rarely jointly.

Adversarial Robustness Privacy Preserving

BiDepth Multimodal Neural Network: Bidirectional Depth Deep Learning Architecture for Spatial-Temporal Prediction

no code implementations14 Jan 2025 Sina Ehsani, Fenglian Pan, Qingpei Hu, Jian Liu

Accurate prediction of spatial-temporal (ST) information in dynamic systems, such as urban mobility and weather patterns, is a crucial yet challenging problem.

Precipitation Forecasting Prediction +1

TextSleuth: Towards Explainable Tampered Text Detection

no code implementations19 Dec 2024 Chenfan Qu, Jian Liu, Haoxing Chen, Baihan Yu, Jingjing Liu, Weiqiang Wang, Lianwen Jin

To fill the data gap for this task, we propose a large-scale, comprehensive dataset, ETTD, which contains both pixel-level annotations for tampered text region and natural language annotations describing the anomaly of the tampered text.

Domain Generalization Optical Character Recognition (OCR) +1

PhysAug: A Physical-guided and Frequency-based Data Augmentation for Single-Domain Generalized Object Detection

1 code implementation16 Dec 2024 Xiaoran Xu, Jiangang Yang, Wenhui Shi, Siyuan Ding, Luqing Luo, Jian Liu

Single-Domain Generalized Object Detection~(S-DGOD) aims to train on a single source domain for robust performance across a variety of unseen target domains by taking advantage of an object detector.

Data Augmentation Robust Object Detection

CtrlNeRF: The Generative Neural Radiation Fields for the Controllable Synthesis of High-fidelity 3D-Aware Images

no code implementations1 Dec 2024 Jian Liu, Zhen Yu

In this paper, we introduce a controllable generative model (i. e. \textbf{CtrlNeRF}) that uses a single MLP network to represent multiple scenes with shared weights.

3D geometry Image Generation +1

Attributed Graph Clustering in Collaborative Settings

no code implementations19 Nov 2024 Rui Zhang, Xiaoyang Hou, Zhihua Tian, Yan He, Enchao Gong, Jian Liu, Qingbiao Wu, Kui Ren

Graph clustering is an unsupervised machine learning method that partitions the nodes in a graph into different groups.

Clustering Graph Clustering

Scalable Autoregressive Monocular Depth Estimation

no code implementations18 Nov 2024 Jinhong Wang, Jian Liu, Dongqi Tang, Weiqiang Wang, Wentong Li, Danny Chen, Jintai Chen, Jian Wu

Our idea is simple: We tackle the monocular depth estimation (MDE) task with an autoregressive prediction paradigm, based on two core designs.

Monocular Depth Estimation Zero-shot Generalization

Scaling Mesh Generation via Compressive Tokenization

1 code implementation11 Nov 2024 Haohan Weng, Zibo Zhao, Biwen Lei, Xianghui Yang, Jian Liu, Zeqiang Lai, Zhuo Chen, Yuhong Liu, Jie Jiang, Chunchao Guo, Tong Zhang, Shenghua Gao, C. L. Philip Chen

We propose a compressive yet effective mesh representation, Blocked and Patchified Tokenization (BPT), facilitating the generation of meshes exceeding 8k faces.

8k

Reducing the Cost of Dropout in Flash-Attention by Hiding RNG with GEMM

no code implementations10 Oct 2024 Haiyue Ma, Jian Liu, Ronny Krashinsky

Further, we extend our theoretical model to different RNG implementations and hardware architectures, and discuss the widely applicable benefits for overlapping RNG with GEMM layers.

EAB-FL: Exacerbating Algorithmic Bias through Model Poisoning Attacks in Federated Learning

1 code implementation2 Oct 2024 Syed Irfan Ali Meerza, Jian Liu

In this paper, we propose a new type of model poisoning attack, EAB-FL, with a focus on exacerbating group unfairness while maintaining a good level of model utility.

Fairness Federated Learning +1

PVContext: Hybrid Context Model for Point Cloud Compression

no code implementations19 Sep 2024 Guoqing Zhang, Wenbo Zhao, Jian Liu, Yuanchao Bai, Junjun Jiang, Xianming Liu

Efficient storage of large-scale point cloud data has become increasingly challenging due to advancements in scanning technology.

model

Object Gaussian for Monocular 6D Pose Estimation from Sparse Views

no code implementations4 Sep 2024 Luqing Luo, Shichu Sun, Jiangang Yang, Linfang Zheng, Jinwei Du, Jian Liu

Monocular object pose estimation, as a pivotal task in computer vision and robotics, heavily depends on accurate 2D-3D correspondences, which often demand costly CAD models that may not be readily available.

3DGS 3D Reconstruction +2

Diffusion-Occ: 3D Point Cloud Completion via Occupancy Diffusion

no code implementations27 Aug 2024 Guoqing Zhang, Jian Liu

In this paper, we introduce \textbf{Diffusion-Occ}, a novel framework for Diffusion Point Cloud Completion.

Point Cloud Completion

Mayer-homology learning prediction of protein-ligand binding affinities

no code implementations23 Aug 2024 Hongsong Feng, Li Shen, Jian Liu, Guo-Wei Wei

Our recent work has extended this concept by employing Mayer homology with a generalized differential that satisfies \(d^N = 0\) for \(N \geq 2\), leading to the development of persistent Mayer homology (PMH) theory and richer topological information across various scales.

Descriptive Drug Design +1

WTU-EVAL: A Whether-or-Not Tool Usage Evaluation Benchmark for Large Language Models

no code implementations2 Jul 2024 Kangyun Ning, Yisong Su, Xueqiang Lv, Yuanzhe Zhang, Jian Liu, Kang Liu, Jinan Xu

We then introduce the Whether-or-not tool usage Evaluation benchmark (WTU-Eval) to assess LLMs with eleven datasets, where six of them are tool-usage datasets, and five are general datasets.

TokenPacker: Efficient Visual Projector for Multimodal LLM

2 code implementations2 Jul 2024 Wentong Li, Yuqian Yuan, Jian Liu, Dongqi Tang, Song Wang, Jie Qin, Jianke Zhu, Lei Zhang

However, the visual tokens are redundant and can be considerably increased when dealing with high-resolution images, impairing the efficiency of MLLMs significantly.

Language Modelling Large Language Model +2

Strengthening Layer Interaction via Dynamic Layer Attention

1 code implementation19 Jun 2024 Kaishen Wang, Xun Xia, Jian Liu, Zhang Yi, Tao He

In this paper, we delve into the distinction between layer attention and the general attention mechanism, noting that existing layer attention methods achieve layer interaction on fixed feature maps in a static manner.

object-detection Object Detection

Efficient Multi-View Fusion and Flexible Adaptation to View Missing in Cardiovascular System Signals

1 code implementation13 Jun 2024 Qihan Hu, Daomiao Wang, Hong Wu, Jian Liu, Cuiwei Yang

The progression of deep learning and the widespread adoption of sensors have facilitated automatic multi-view fusion (MVF) about the cardiovascular system (CVS) signals.

Atrial Fibrillation Detection Blood pressure estimation +1

DINO-SD: Champion Solution for ICRA 2024 RoboDepth Challenge

no code implementations27 May 2024 Yifan Mao, Ming Li, Jian Liu, Jiayang Liu, Zihan Qin, Chunxi Chu, Jialei Xu, Wenbo Zhao, Junjun Jiang, Xianming Liu

However, given that most of the data in the autonomous driving dataset is collected in daytime scenarios, this leads to poor depth model performance in the face of out-of-distribution(OoD) data.

3D Reconstruction Autonomous Driving +1

Deep Learning for Protein-Ligand Docking: Are We There Yet?

1 code implementation23 May 2024 Alex Morehead, Nabin Giri, Jian Liu, Pawan Neupane, Jianlin Cheng

The effects of ligand binding on protein structures and their in vivo functions carry numerous implications for modern biomedical research and biotechnology development efforts such as drug discovery.

Deep Learning Drug Discovery +1

Towards Better Question Generation in QA-based Event Extraction

1 code implementation17 May 2024 Zijin Hong, Jian Liu

Event Extraction (EE) is an essential information extraction task that aims to extract event-related information from unstructured texts.

Event Extraction Question Answering +2

Deep Learning-Based Object Pose Estimation: A Comprehensive Survey

1 code implementation13 May 2024 Jian Liu, Wei Sun, Hui Yang, Zhiwen Zeng, Chongpei Liu, Jin Zheng, Xingyu Liu, Hossein Rahmani, Nicu Sebe, Ajmal Mian

Object pose estimation is a fundamental computer vision problem with broad applications in augmented reality and robotics.

Deep Learning Object +2

Non-Uniform Exposure Imaging via Neuromorphic Shutter Control

no code implementations22 Apr 2024 Mingyuan Lin, Jian Liu, Chi Zhang, Zibo Zhao, Chu He, Lei Yu

To address this challenge, we propose a novel Neuromorphic Shutter Control (NSC) system to avoid motion blurs and alleviate instant noises, where the extremely low latency of events is leveraged to monitor the real-time motion and facilitate the scene-adaptive exposure.

Image Denoising Self-Supervised Learning

Amplitude-Phase Fusion for Enhanced Electrocardiogram Morphological Analysis

1 code implementation15 Apr 2024 Shuaicong Hu, Yanan Wang, Jian Liu, Jingyu Lin, Shengmei Qin, Zhenning Nie, Zhifeng Yao, Wenjie Cai, Cuiwei Yang

Considering the variability of amplitude and phase patterns in electrocardiogram (ECG) signals due to cardiac activity and individual differences, existing entropy-based studies have not fully utilized these two patterns and lack integration.

Morphological Analysis

Scalable second-order consensus of hierarchical groups

no code implementations31 Mar 2024 Jiamin Wang, Jian Liu, Feng Xiao, Ning Xi, Yuanshi Zheng

Motivated by widespread dominance hierarchy, growth of group sizes, and feedback mechanisms in social species, we are devoted to exploring the scalable second-order consensus of hierarchical groups.

Stealing Stable Diffusion Prior for Robust Monocular Depth Estimation

1 code implementation8 Mar 2024 Yifan Mao, Jian Liu, Xianming Liu

This paper introduces a novel approach named Stealing Stable Diffusion (SSD) prior for robust monocular depth estimation.

Monocular Depth Estimation Scene Understanding

REPS: Reconstruction-based Point Cloud Sampling

1 code implementation8 Mar 2024 Guoqing Zhang, Wenbo Zhao, Jian Liu, Xianming Liu

Our method outperforms previous approaches in preserving the structural features of the sampled point clouds.

OccTransformer: Improving BEVFormer for 3D camera-only occupancy prediction

no code implementations28 Feb 2024 Jian Liu, Sipeng Zhang, Chuixin Kong, Wenyuan Zhang, Yuhang Wu, Yikang Ding, Borun Xu, Ruibo Ming, Donglai Wei, Xianming Liu

This technical report presents our solution, "occTransformer" for the 3D occupancy prediction track in the autonomous driving challenge at CVPR 2023.

Autonomous Driving Data Augmentation +1

A Comprehensive Survey on 3D Content Generation

1 code implementation2 Feb 2024 Jian Liu, Xiaoshui Huang, Tianyu Huang, Lu Chen, Yuenan Hou, Shixiang Tang, Ziwei Liu, Wanli Ouyang, WangMeng Zuo, Junjun Jiang, Xianming Liu

Recent years have witnessed remarkable advances in artificial intelligence generated content(AIGC), with diverse input modalities, e. g., text, image, video, audio and 3D.

Survey

GLOCALFAIR: Jointly Improving Global and Local Group Fairness in Federated Learning

no code implementations7 Jan 2024 Syed Irfan Ali Meerza, Luyang Liu, Jiaxin Zhang, Jian Liu

Specifically, we utilize constrained optimization to enforce local fairness on the client side and adopt a fairness-aware clustering-based aggregation on the server to further ensure the global model fairness across different sensitive groups while maintaining high utility.

Fairness Federated Learning

SyCoCa: Symmetrizing Contrastive Captioners with Attentive Masking for Multimodal Alignment

1 code implementation4 Jan 2024 Ziping Ma, Furong Xu, Jian Liu, Ming Yang, Qingpei Guo

To achieve multimodal alignment from both global and local perspectives, this paper proposes Symmetrizing Contrastive Captioners (SyCoCa), which introduces bidirectional interactions on images and texts across the global and local representation levels.

Image Captioning Image Classification +8

Query-Based Knowledge Sharing for Open-Vocabulary Multi-Label Classification

no code implementations2 Jan 2024 Xuelin Zhu, Jian Liu, Dongqi Tang, Jiawei Ge, Weijia Liu, Bo Liu, Jiuxin Cao

Identifying labels that did not appear during training, known as multi-label zero-shot learning, is a non-trivial task in computer vision.

Knowledge Distillation Multi-Label Classification +2

Osprey: Pixel Understanding with Visual Instruction Tuning

3 code implementations CVPR 2024 Yuqian Yuan, Wentong Li, Jian Liu, Dongqi Tang, Xinjie Luo, Chi Qin, Lei Zhang, Jianke Zhu

In this paper, we propose Osprey, a mask-text instruction tuning approach, to extend MLLMs by incorporating fine-grained mask regions into language instruction, aiming at achieving pixel-wise visual understanding.

Language Modelling

Planning Reliability Assurance Tests for Autonomous Vehicles

no code implementations30 Nov 2023 Simin Zheng, Lu Lu, Yili Hong, Jian Liu

This paper aims to fill in this gap by developing statistical methods for planning AV reliability assurance tests based on recurrent events data.

Autonomous Vehicles

A Quality-based Syntactic Template Retriever for Syntactically-controlled Paraphrase Generation

1 code implementation20 Oct 2023 Xue Zhang, Songming Zhang, Yunlong Liang, Yufeng Chen, Jian Liu, Wenjuan Han, Jinan Xu

Furthermore, for situations requiring multiple paraphrases for each source sentence, we design a Diverse Templates Search (DTS) algorithm, which can enhance the diversity between paraphrases without sacrificing quality.

Data Augmentation Diversity +3

Label-efficient Segmentation via Affinity Propagation

1 code implementation NeurIPS 2023 Wentong Li, Yuqian Yuan, Song Wang, Wenyu Liu, Dongqi Tang, Jian Liu, Jianke Zhu, Lei Zhang

In this work, we formulate the affinity modeling as an affinity propagation process, and propose a local and a global pairwise affinity terms to generate accurate soft pseudo labels.

Box-supervised Instance Segmentation Segmentation +2

GLoRE: Evaluating Logical Reasoning of Large Language Models

1 code implementation13 Oct 2023 Hanmeng Liu, Zhiyang Teng, Ruoxi Ning, Jian Liu, Qiji Zhou, Yue Zhang

Recently, large language models (LLMs), including notable models such as GPT-4 and burgeoning community models, have showcased significant general language understanding abilities.

Logical Reasoning Natural Language Understanding

Equirectangular image construction method for standard CNNs for Semantic Segmentation

no code implementations13 Oct 2023 Haoqian Chen, Jian Liu, Minghe Li, Kaiwen Jiang, Ziheng Xu, Rencheng Sun, Yi Sui

In addition, there are few publicly dataset of equirectangular images with labels, which presents a challenge for standard CNNs models to process equirectangular images effectively.

Data Augmentation Semantic Segmentation

ChatGPT for Computational Topology

1 code implementation11 Oct 2023 Jian Liu, Li Shen, Guo-Wei Wei

This work serves as an initial step towards effectively transforming pure mathematical theories into practical computational tools, with the ultimate goal of enabling real applications across diverse fields.

Topological Data Analysis

AffordPose: A Large-scale Dataset of Hand-Object Interactions with Affordance-driven Hand Pose

1 code implementation ICCV 2023 Juntao Jian, Xiuping Liu, Manyi Li, Ruizhen Hu, Jian Liu

We collect a total of 26. 7K hand-object interactions, each including the 3D object shape, the part-level affordance label, and the manually adjusted hand poses.

Diversity Object

Point2Mask: Point-supervised Panoptic Segmentation via Optimal Transport

1 code implementation ICCV 2023 Wentong Li, Yuqian Yuan, Song Wang, Jianke Zhu, Jianshu Li, Jian Liu, Lei Zhang

Weakly-supervised image segmentation has recently attracted increasing research attentions, aiming to avoid the expensive pixel-wise labeling.

Image Segmentation Panoptic Segmentation

Towards Understanding and Improving Knowledge Distillation for Neural Machine Translation

1 code implementation14 May 2023 Songming Zhang, Yunlong Liang, Shuaibo Wang, Wenjuan Han, Jian Liu, Jinan Xu, Yufeng Chen

In this work, we first unravel this mystery from an empirical perspective and show that the knowledge comes from the top-1 predictions of teachers, which also helps us build a potential connection between word- and sequence-level KD.

Knowledge Distillation Machine Translation +2

Full Scaling Automation for Sustainable Development of Green Data Centers

1 code implementation1 May 2023 Shiyu Wang, Yinbo Sun, Xiaoming Shi, Shiyi Zhu, Lin-Tao Ma, James Zhang, Yifei Zheng, Jian Liu

The rapid rise in cloud computing has resulted in an alarming increase in data centers' carbon emissions, which now accounts for >3% of global greenhouse gas emissions, necessitating immediate steps to combat their mounting strain on the global climate.

Cloud Computing Representation Learning

Exploring the Mutual Influence between Self-Supervised Single-Frame and Multi-Frame Depth Estimation

1 code implementation25 Apr 2023 Jie Xiang, Yun Wang, Lifeng An, Haiyang Liu, Jian Liu

Although both self-supervised single-frame and multi-frame depth estimation methods only require unlabeled monocular videos for training, the information they leverage varies because single-frame methods mainly rely on appearance-based features while multi-frame methods focus on geometric cues.

Depth Estimation

False Claims against Model Ownership Resolution

1 code implementation13 Apr 2023 Jian Liu, Rui Zhang, Sebastian Szyller, Kui Ren, N. Asokan

Our core idea is that a malicious accuser can deviate (without detection) from the specified MOR process by finding (transferable) adversarial examples that successfully serve as evidence against independent suspect models.

model

RecUP-FL: Reconciling Utility and Privacy in Federated Learning via User-configurable Privacy Defense

no code implementations11 Apr 2023 Yue Cui, Syed Irfan Ali Meerza, Zhuohang Li, Luyang Liu, Jiaxin Zhang, Jian Liu

In this paper, we seek to reconcile utility and privacy in FL by proposing a user-configurable privacy defense, RecUP-FL, that can better focus on the user-specified sensitive attributes while obtaining significant improvements in utility over traditional defenses.

Adversarial Attack Attribute +4

Multi-Sample Consensus Driven Unsupervised Normal Estimation for 3D Point Clouds

no code implementations10 Apr 2023 Jie Zhang, Minghui Nie, Junjie Cao, Jian Liu, Ligang Liu

Comprehensive experiments demonstrate that the two proposed unsupervised methods are noticeably superior to some supervised deep normal estimators on the most common synthetic dataset.

Evaluating the Logical Reasoning Ability of ChatGPT and GPT-4

1 code implementation7 Apr 2023 Hanmeng Liu, Ruoxi Ning, Zhiyang Teng, Jian Liu, Qiji Zhou, Yue Zhang

With the release of Generative Pretrained Transformer 4 (GPT-4), highlighted as "advanced" at reasoning tasks, we are eager to learn the GPT-4 performance on various logical reasoning tasks.

Logical Reasoning Natural Language Inference +2

Speech Privacy Leakage from Shared Gradients in Distributed Learning

no code implementations21 Feb 2023 Zhuohang Li, Jiaxin Zhang, Jian Liu

Distributed machine learning paradigms, such as federated learning, have been recently adopted in many privacy-critical applications for speech analysis.

Federated Learning Keyword Spotting

Diffusion Models in Bioinformatics: A New Wave of Deep Learning Revolution in Action

no code implementations13 Feb 2023 Zhiye Guo, Jian Liu, Yanli Wang, Mengrui Chen, Duolin Wang, Dong Xu, Jianlin Cheng

This review aims to provide a rather thorough overview of the applications of diffusion models in bioinformatics to aid their further development in bioinformatics and computational biology.

Denoising Protein Design

Protocol selection for second-order consensus against disturbance

no code implementations10 Dec 2022 Jiamin Wang, Liqi Zhou, Dong Zhang, Jian Liu, Yuanshi Zheng

Noticing that both the absolute and relative velocity protocols can solve the second-order consensus of multi-agent systems, this paper aims to investigate which of the above two protocols has better anti-disturbance capability, in which the anti-disturbance capability is measured by the L2 gain from the disturbance to the consensus error.

On the Robustness of Dataset Inference

no code implementations24 Oct 2022 Sebastian Szyller, Rui Zhang, Jian Liu, N. Asokan

However, in a subspace of the same setting, we prove that DI suffers from high false positives (FPs) -- it can incorrectly identify an independent model trained with non-overlapping data from the same distribution as stolen.

OST: Efficient One-stream Network for 3D Single Object Tracking in Point Clouds

no code implementations16 Oct 2022 Xiantong Zhao, Yinan Han, Shengjing Tian, Jian Liu, Xiuping Liu

Although recent Siamese network-based trackers have achieved impressive perceptual accuracy for single object tracking in LiDAR point clouds, they usually utilized heavy correlation operations to capture category-level characteristics only, and overlook the inherent merit of arbitrariness in contrast to multiple object tracking.

3D Single Object Tracking Multiple Object Tracking

Multi-parametric Analysis for Mixed Integer Linear Programming: An Application to Transmission Planning and Congestion Control

no code implementations19 Jul 2022 Jian Liu, Rui Bo, Siyuan Wang

Finally, the amount of capacity upgrade will be chosen by balancing the cost-reduction rate of the objective function on parameters and the cost of the line upgrade.

Decision Making

Watermark Vaccine: Adversarial Attacks to Prevent Watermark Removal

1 code implementation17 Jul 2022 Xinwei Liu, Jian Liu, Yang Bai, Jindong Gu, Tao Chen, Xiaojun Jia, Xiaochun Cao

Inspired by the vulnerability of DNNs on adversarial perturbations, we propose a novel defence mechanism by adversarial machine learning for good.

DProQ: A Gated-Graph Transformer for Protein Complex Structure Assessment

1 code implementation21 May 2022 Xiao Chen, Alex Morehead, Jian Liu, Jianlin Cheng

We challenge this significant task with DProQ, which introduces a gated neighborhood-modulating Graph Transformer (GGT) designed to predict the quality of 3D protein complex structures.

Drug Discovery

Visual Attention-based Self-supervised Absolute Depth Estimation using Geometric Priors in Autonomous Driving

2 code implementations18 May 2022 Jie Xiang, Yun Wang, Lifeng An, Haiyang Liu, Zijun Wang, Jian Liu

Although existing monocular depth estimation methods have made great progress, predicting an accurate absolute depth map from a single image is still challenging due to the limited modeling capacity of networks and the scale ambiguity issue.

Autonomous Driving Monocular Depth Estimation

VPNets: Volume-preserving neural networks for learning source-free dynamics

1 code implementation29 Apr 2022 Aiqing Zhu, Beibei Zhu, Jiawei Zhang, Yifa Tang, Jian Liu

We propose volume-preserving networks (VPNets) for learning unknown source-free dynamical systems using trajectory data.

Auditing Privacy Defenses in Federated Learning via Generative Gradient Leakage

2 code implementations CVPR 2022 Zhuohang Li, Jiaxin Zhang, Luyang Liu, Jian Liu

Federated Learning (FL) framework brings privacy benefits to distributed learning systems by allowing multiple clients to participate in a learning task under the coordination of a central server without exchanging their private data.

Bayesian Optimization Federated Learning

Conditional Bilingual Mutual Information Based Adaptive Training for Neural Machine Translation

1 code implementation ACL 2022 Songming Zhang, Yijin Liu, Fandong Meng, Yufeng Chen, Jinan Xu, Jian Liu, Jie zhou

Token-level adaptive training approaches can alleviate the token imbalance problem and thus improve neural machine translation, through re-weighting the losses of different target tokens based on specific statistical metrics (e. g., token frequency or mutual information).

Language Modelling Machine Translation +2

Label Relation Graphs Enhanced Hierarchical Residual Network for Hierarchical Multi-Granularity Classification

1 code implementation CVPR 2022 Jingzhou Chen, Peng Wang, Jian Liu, Yuntao Qian

Hierarchical multi-granularity classification (HMC) assigns hierarchical multi-granularity labels to each object and focuses on encoding the label hierarchy, e. g., ["Albatross", "Laysan Albatross"] from coarse-to-fine levels.

Fine-Grained Image Classification Relation

Spatio-temporal-spectral-angular observation model that integrates observations from UAV and mobile mapping vehicle for better urban mapping

no code implementations24 Aug 2021 Zhenfeng Shao, Gui Cheng, Deren Li, Xiao Huang, Zhipeng Lu, Jian Liu

The integrated results combined both the characteristic of UAV and mobile mapping vehicle point cloud, confirming the practicability of the proposed joint data acquisition platform and the effectiveness of spatio-temporal-spectral-angular observation model.

"Adversarial Examples" for Proof-of-Learning

1 code implementation21 Aug 2021 Rui Zhang, Jian Liu, Yuan Ding, Zhibo Wu, Qingbiao Wang, Kui Ren

Jia et al. claimed that an adversary merely knowing the final model and training dataset cannot efficiently find a set of intermediate models with correct data points.

valid

The Effect of Dust and Sand on the 5G Terrestrial Links

no code implementations20 Aug 2021 Esmail M M Abuhdima, Gurcan Comert, Pierluigi Pisu, Chin-Tser Huang, Ahmed El Qaouaq, Chunheng Zhao, Shakendra Alston, Kirk Ambrose, Jian Liu

A recent study investigates the effect of rain and snow on the 5G communication channel to reduce the challenge of using high millimeter-wave frequencies.

Sand

Byzantine-robust Federated Learning through Spatial-temporal Analysis of Local Model Updates

no code implementations3 Jul 2021 Zhuohang Li, Luyang Liu, Jiaxin Zhang, Jian Liu

Federated Learning (FL) enables multiple distributed clients (e. g., mobile devices) to collaboratively train a centralized model while keeping the training data locally on the client.

Federated Learning

Template-Based Named Entity Recognition Using BART

1 code implementation Findings (ACL) 2021 Leyang Cui, Yu Wu, Jian Liu, Sen yang, Yue Zhang

To address the issue, we propose a template-based method for NER, treating NER as a language model ranking problem in a sequence-to-sequence framework, where original sentences and statement templates filled by candidate named entity span are regarded as the source sequence and the target sequence, respectively.

Few-shot NER Language Modeling +3

OFEI: A Semi-black-box Android Adversarial Sample Attack Framework Against DLaaS

no code implementations25 May 2021 Guangquan Xu, GuoHua Xin, Litao Jiao, Jian Liu, Shaoying Liu, Meiqi Feng, Xi Zheng

With the growing popularity of Android devices, Android malware is seriously threatening the safety of users.

Unsupervised Sentiment Analysis by Transferring Multi-source Knowledge

no code implementations9 May 2021 Yong Dai, Jian Liu, Jian Zhang, Hongguang Fu, Zenglin Xu

The first mechanism is a selective domain adaptation (SDA) method, which transfers knowledge from the closest source domain.

Domain Adaptation Sentiment Analysis

A hybrid deep-learning approach for complex biochemical named entity recognition

no code implementations20 Dec 2020 Jian Liu, Lei Gao, Sujie Guo, Rui Ding, Xin Huang, Long Ye, Qinghua Meng, Asef Nazari, Dhananjay Thiruvady

In this approach, the MHATT mechanism aims to improve the recognition accuracy of abbreviations to efficiently deal with the problem of inconsistency in full-text labels.

Attribute Attribute Extraction +4

Graph-Based Knowledge Integration for Question Answering over Dialogue

no code implementations COLING 2020 Jian Liu, Dianbo Sui, Kang Liu, Jun Zhao

Despite many advances, existing approaches for this task did not consider dialogue structure and background knowledge (e. g., relationships between speakers).

Machine Reading Comprehension Question Answering +1

Natural Language Inference in Context -- Investigating Contextual Reasoning over Long Texts

1 code implementation10 Nov 2020 Hanmeng Liu, Leyang Cui, Jian Liu, Yue Zhang

Natural language inference (NLI) is a fundamental NLP task, investigating the entailment relationship between two texts.

Logical Reasoning Natural Language Inference +1

Singular equivalences induced by bimodules and quadratic monomial algebras

no code implementations20 Sep 2020 Xiao-Wu Chen, Jian Liu, Ren Wang

We investigate the problem when the tensor functor by a bimodule yields a singular equivalence.

Representation Theory Rings and Algebras 18G80, 16E45, 16D20, 16G20

LogiQA: A Challenge Dataset for Machine Reading Comprehension with Logical Reasoning

2 code implementations16 Jul 2020 Jian Liu, Leyang Cui, Hanmeng Liu, Dandan Huang, Yile Wang, Yue Zhang

Machine reading is a fundamental task for testing the capability of natural language understanding, which is closely related to human cognition in many aspects.

Logical Reasoning Machine Reading Comprehension +1

Adversarial Training Based Multi-Source Unsupervised Domain Adaptation for Sentiment Analysis

no code implementations10 Jun 2020 Yong Dai, Jian Liu, Xiancong Ren, Zenglin Xu

Existing algorithms of MS-UDA either only exploit the shared features, i. e., the domain-invariant information, or based on some weak assumption in NLP, e. g., smoothness assumption.

Multi-Source Unsupervised Domain Adaptation Sentiment Analysis +2

Enabling Fast and Universal Audio Adversarial Attack Using Generative Model

no code implementations26 Apr 2020 Yi Xie, Zhuohang Li, Cong Shi, Jian Liu, Yingying Chen, Bo Yuan

These idealized assumptions, however, makes the existing audio adversarial attacks mostly impossible to be launched in a timely fashion in practice (e. g., playing unnoticeable adversarial perturbations along with user's streaming input).

Adversarial Attack

Learn to Forget: Machine Unlearning via Neuron Masking

no code implementations24 Mar 2020 Yang Liu, Zhuo Ma, Ximeng Liu, Jian Liu, Zhongyuan Jiang, Jianfeng Ma, Philip Yu, Kui Ren

To this end, machine unlearning becomes a popular research topic, which allows users to eliminate memorization of their private data from a trained machine learning model. In this paper, we propose the first uniform metric called for-getting rate to measure the effectiveness of a machine unlearning method.

BIG-bench Machine Learning Federated Learning +2

Real-time, Universal, and Robust Adversarial Attacks Against Speaker Recognition Systems

no code implementations4 Mar 2020 Yi Xie, Cong Shi, Zhuohang Li, Jian Liu, Yingying Chen, Bo Yuan

As the popularity of voice user interface (VUI) exploded in recent years, speaker recognition system has emerged as an important medium of identifying a speaker in many security-required applications and services.

Adversarial Attack Room Impulse Response (RIR) +1

Review and Examination of Input Feature Preparation Methods and Machine Learning Models for Turbulence Modeling

1 code implementation15 Jan 2020 Shirui Luo, Jiahuan Cui, Madhu Vellakal, Jian Liu, Enyi Jiang, Seid Koric, Volodymyr Kindratenko

Model extrapolation to unseen flow is one of the biggest challenges facing data-driven turbulence modeling, especially for models with high dimensional inputs that involve many flow features.

Fluid Dynamics Computational Physics

Free-riders in Federated Learning: Attacks and Defenses

1 code implementation28 Nov 2019 Jierui Lin, Min Du, Jian Liu

Although the incentive model for federated learning has not been fully developed, it is supposed that participants are able to get rewards or the privilege to use the final global model, as a compensation for taking efforts to train the model.

Anomaly Detection Federated Learning

Adversarial Attack on Skeleton-based Human Action Recognition

no code implementations14 Sep 2019 Jian Liu, Naveed Akhtar, Ajmal Mian

We also explore the possibility of semantically imperceptible localized attacks with CIASA, and succeed in fooling the state-of-the-art skeleton action recognition models with high confidence.

Action Recognition Adversarial Attack +2

Spearphone: A Speech Privacy Exploit via Accelerometer-Sensed Reverberations from Smartphone Loudspeakers

1 code implementation12 Jul 2019 S Abhishek Anand, Chen Wang, Jian Liu, Nitesh Saxena, Yingying Chen

In this paper, we build a speech privacy attack that exploits speech reverberations generated from a smartphone's inbuilt loudspeaker captured via a zero-permission motion sensor (accelerometer).

Cryptography and Security

Temporally Coherent Full 3D Mesh Human Pose Recovery from Monocular Video

no code implementations1 Jun 2019 Jian Liu, Naveed Akhtar, Ajmal Mian

A major challenge in this regard is the lack of appropriately annotated video data for learning the desired deep models.

Deep Cross Networks with Aesthetic Preference for Cross-domain Recommendation

no code implementations29 May 2019 Jian Liu, Pengpeng Zhao, Yanchi Liu, Victor S. Sheng, Fuzheng Zhuang, Jiajie Xu, Xiaofang Zhou, Hui Xiong

Then, we integrate the aesthetic features into a cross-domain network to transfer users' domain independent aesthetic preferences.

Transfer Learning

Biophysics at the coffee shop: lessons learned working with George Oster

no code implementations20 Feb 2019 Oleg Igoshin, Jing Chen, Jianhua Xing, Jian Liu, Timothy C. Elston, Michael Grabe, Kenneth S. Kim, Jasmine Nirody, Padmini Rangamani, Sean Sun, Hongyun Wang, Charles Wolgemuth

Over the past 50 years, the use of mathematical models, derived from physical reasoning, to describe molecular and cellular systems has evolved from an art of the few to a cornerstone of biological inquiry.

Descriptive Physical Intuition

Latent Dirichlet Allocation in Generative Adversarial Networks

no code implementations17 Dec 2018 Lili Pan, Shen Cheng, Jian Liu, Yazhou Ren, Zenglin Xu

We study the problem of multimodal generative modelling of images based on generative adversarial networks (GANs).

Image Generation multimodal generation +1

Faster super-resolution imaging with auto-correlation two-step deconvolution

2 code implementations19 Sep 2018 Weisong Zhao, Jian Liu, Chenqi Kong, Yixuan Zhao, Changliang Guo, Chen-Guang Liu, Xiangyan Ding, Xumin Ding, Jiubin Tan, Haoyu Li

Despite super-resolution fluorescence blinking microscopes break the diffraction limit, the intense phototoxic illumination and long-term image sequences thus far still pose to major challenges in visualizing live-organisms.

Optics

Event Detection via Gated Multilingual Attention Mechanism

no code implementations AAAI-18 2018 Jian Liu, Yubo Chen, Kang Liu, Jun Zhao

In specific, to alleviate data scarcity problem, we exploit the consistent information in multilingual data via context attention mechanism.

Event Detection

Understanding Android Obfuscation Techniques: A Large-Scale Investigation in the Wild

no code implementations5 Jan 2018 Shuaike Dong, Menghao Li, Wenrui Diao, Xiangyu Liu, Jian Liu, Zhou Li, Fenghao Xu, Kai Chen, Xiao-Feng Wang, Kehuan Zhang

In this paper, we seek to better understand Android obfuscation and depict a holistic view of the usage of obfuscation through a large-scale investigation in the wild.

Cryptography and Security

Defense against Universal Adversarial Perturbations

no code implementations CVPR 2018 Naveed Akhtar, Jian Liu, Ajmal Mian

A rigorous evaluation shows that our framework can defend the network classifiers against unseen adversarial perturbations in the real-world scenarios with up to 97. 5% success rate.

Skepxels: Spatio-temporal Image Representation of Human Skeleton Joints for Action Recognition

no code implementations16 Nov 2017 Jian Liu, Naveed Akhtar, Ajmal Mian

The proposed action recognition exploits the representation in a hierarchical manner by first capturing the micro-temporal relations between the skeleton joints with the Skepxels and then exploiting their macro-temporal relations by computing the Fourier Temporal Pyramids over the CNN features of the skeletal images.

Action Analysis Action Recognition +1

Viewpoint Invariant Action Recognition using RGB-D Videos

no code implementations15 Sep 2017 Jian Liu, Naveed Akhtar, Ajmal Mian

The proposed technique capitalizes on the spatio-temporal information available in the two data streams to the extract action features that are largely insensitive to the viewpoint variations.

Action Recognition Temporal Action Localization +1

Learning Human Pose Models from Synthesized Data for Robust RGB-D Action Recognition

no code implementations4 Jul 2017 Jian Liu, Naveed Akhtar, Ajmal Mian

We propose Human Pose Models that represent RGB and depth images of human poses independent of clothing textures, backgrounds, lighting conditions, body shapes and camera viewpoints.

Action Recognition Skeleton Based Action Recognition +1

Improvement of training set structure in fusion data cleaning using Time-Domain Global Similarity method

no code implementations30 Jun 2017 Jian Liu, Ting Lan, Hong Qin

Traditional data cleaning identifies dirty data by classifying original data sequences, which is a class$-$imbalanced problem since the proportion of incorrect data is much less than the proportion of correct ones for most diagnostic systems in Magnetic Confinement Fusion (MCF) devices.

Classification Diagnostic +1

Preference-based performance measures for Time-Domain Global Similarity method

no code implementations30 Jun 2017 Ting Lan, Jian Liu, Hong Qin

To obtain the general expressions of performance measures based on the preferences of tasks, the mapping relations between performance of TDGS method about physical similarity and correctness of data sequences are investigated by probability theory in this paper.

Binary Classification General Classification

Context-aware System Service Call-oriented Symbolic Execution of Android Framework with Application to Exploit Generation

no code implementations2 Nov 2016 Lannan Luo, Qiang Zeng, Chen Cao, Kai Chen, Jian Liu, Limin Liu, Neng Gao, Min Yang, Xinyu Xing, Peng Liu

We present novel ideas and techniques to resolve the challenges, and have built the first system for symbolic execution of Android Framework.

Cryptography and Security Software Engineering

Cannot find the paper you are looking for? You can Submit a new open access paper.