Search Results for author: Tao Jiang

Found 73 papers, 18 papers with code

Intra-class Feature Variation Distillation for Semantic Segmentation

1 code implementation ECCV 2020 Yukang Wang, Wei Zhou, Tao Jiang, Xiang Bai, Yongchao Xu

In this paper, different from previous methods performing knowledge distillation for densely pairwise relations, we propose a novel intra-class feature variation distillation (IFVD) to transfer the intra-class feature variation (IFV) of the cumbersome model (teacher) to the compact model (student).

Knowledge Distillation Segmentation +1

Localization of Dummy Data Injection Attacks in Power Systems Considering Incomplete Topological Information: A Spatio-Temporal Graph Wavelet Convolutional Neural Network Approach

no code implementations27 Jan 2024 Zhaoyang Qu, Yunchang Dong, Yang Li, Siqi Song, Tao Jiang, Min Li, Qiming Wang, Lei Wang, Xiaoyong Bo, Jiye Zang, Qi Xu

Unfortunately, this approach tends to overlook the inherent topological correlations within the non-Euclidean spatial attributes of power grid data, consequently leading to diminished accuracy in attack localization.

SCNet: Sparse Compression Network for Music Source Separation

no code implementations24 Jan 2024 Weinan Tong, Jiaxu Zhu, Jun Chen, Shiyin Kang, Tao Jiang, Yang Li, Zhiyong Wu, Helen Meng

We use a higher compression ratio on subbands with less information to improve the information density and focus on modeling subbands with more information.

Music Source Separation

Synthetic Data in AI: Challenges, Applications, and Ethical Implications

no code implementations3 Jan 2024 Shuang Hao, Wenfeng Han, Tao Jiang, Yiping Li, Haonan Wu, Chunlin Zhong, Zhangjun Zhou, He Tang

In the rapidly evolving field of artificial intelligence, the creation and utilization of synthetic datasets have become increasingly significant.

Fairness Synthetic Data Generation

RTMO: Towards High-Performance One-Stage Real-Time Multi-Person Pose Estimation

1 code implementation12 Dec 2023 Peng Lu, Tao Jiang, Yining Li, Xiangtai Li, Kai Chen, Wenming Yang

Real-time multi-person pose estimation presents significant challenges in balancing speed and precision.

 Ranked #1 on Multi-Person Pose Estimation on CrowdPose (using extra training data)

Multi-Person Pose Estimation

FreeKD: Knowledge Distillation via Semantic Frequency Prompt

no code implementations20 Nov 2023 Yuan Zhang, Tao Huang, Jiaming Liu, Tao Jiang, Kuan Cheng, Shanghang Zhang

(2) During the distillation period, a pixel-wise frequency mask is generated via Frequency Prompt, to localize those pixel of interests (PoIs) in various frequency bands.

Knowledge Distillation

Practical Membership Inference Attacks against Fine-tuned Large Language Models via Self-prompt Calibration

no code implementations10 Nov 2023 Wenjie Fu, Huandong Wang, Chen Gao, Guanghua Liu, Yong Li, Tao Jiang

Prior attempts have quantified the privacy risks of language models (LMs) via MIAs, but there is still no consensus on whether existing MIA algorithms can cause remarkable privacy leakage on practical Large Language Models (LLMs).

Inference Attack Membership Inference Attack +1

How to Extend 3D GBSM to Integrated Sensing and Communication Channel with Sharing Feature?

no code implementations25 Oct 2023 Yameng Liu, Jianhua Zhang, Yuxiang Zhang, Huiwen Gong, Tao Jiang, Guangyi Liu

The proposed approach can be summarized as follows: Firstly, an ISAC channel model is proposed, where shared and non-shared components are superimposed for both communication and sensing.

Active Sensing for Localization with Reconfigurable Intelligent Surface

no code implementations19 Oct 2023 Zhongze Zhang, Tao Jiang, Wei Yu

After all the measurements have been received, a final DNN can be used to map the LSTM cell state to the estimated user equipment (UE) position.

A Probabilistic Fluctuation based Membership Inference Attack for Diffusion Models

no code implementations23 Aug 2023 Wenjie Fu, Huandong Wang, Chen Gao, Guanghua Liu, Yong Li, Tao Jiang

Membership Inference Attack (MIA) identifies whether a record exists in a machine learning model's training set by querying the model.

Inference Attack Membership Inference Attack +1

Triple Correlations-Guided Label Supplementation for Unbiased Video Scene Graph Generation

no code implementations30 Jul 2023 Wenqing Wang, Kaifeng Gao, Yawei Luo, Tao Jiang, Fei Gao, Jian Shao, Jianwen Sun, Jun Xiao

Video-based scene graph generation (VidSGG) is an approach that aims to represent video content in a dynamic graph by identifying visual entities and their relationships.

Graph Generation Missing Labels +2

CalibNet: Dual-branch Cross-modal Calibration for RGB-D Salient Instance Segmentation

1 code implementation16 Jul 2023 Jialun Pei, Tao Jiang, He Tang, Nian Liu, Yueming Jin, Deng-Ping Fan, Pheng-Ann Heng

We propose a novel approach for RGB-D salient instance segmentation using a dual-branch cross-modal feature calibration architecture called CalibNet.

Instance Segmentation Semantic Segmentation

Carbon emissions and sustainability of launching 5G mobile networks in China

no code implementations14 Jun 2023 Tong Li, Li Yu, Yibo Ma, Tong Duan, Wenzhen Huang, Yan Zhou, Depeng Jin, Yong Li, Tao Jiang

We show that the decline in carbon efficiency leads to a carbon efficiency trap, estimated to cause additional carbon emissions of 23. 82 +- 1. 07 megatons in China.

Robust Multi-agent Communication via Multi-view Message Certification

no code implementations7 May 2023 Lei Yuan, Tao Jiang, Lihe Li, Feng Chen, Zongzhang Zhang, Yang Yu

Many multi-agent scenarios require message sharing among agents to promote coordination, hastening the robustness of multi-agent communication when policies are deployed in a message perturbation environment.

Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Driving

1 code implementation NeurIPS 2023 Xiaoyu Tian, Tao Jiang, Longfei Yun, Yucheng Mao, Huitong Yang, Yue Wang, Yilun Wang, Hang Zhao

3D occupancy prediction, which estimates the detailed occupancy states and semantics of a scene, is an emerging task to overcome these limitations.

Autonomous Driving

RTMPose: Real-Time Multi-Person Pose Estimation based on MMPose

1 code implementation13 Mar 2023 Tao Jiang, Peng Lu, Li Zhang, Ningsheng Ma, Rui Han, Chengqi Lyu, Yining Li, Kai Chen

Recent studies on 2D pose estimation have achieved excellent performance on public benchmarks, yet its application in the industrial community still suffers from heavy model parameters and high latency.

Ranked #3 on Pose Estimation on OCHuman (using extra training data)

2D Human Pose Estimation 2D Pose Estimation +1

Re-embedding data to strengthen recovery guarantees of clustering

no code implementations26 Jan 2023 Tao Jiang, Samuel Tan, Stephen Vavasis

We propose a clustering method that involves chaining four known techniques into a pipeline yielding an algorithm with stronger recovery guarantees than any of the four components separately.

Clustering

Towards A Unified Conformer Structure: from ASR to ASV Task

1 code implementation14 Nov 2022 Dexin Liao, Tao Jiang, Feng Wang, Lin Li, Qingyang Hong

Transformer has achieved extraordinary performance in Natural Language Processing and Computer Vision tasks thanks to its powerful self-attention mechanism, and its variant Conformer has become a state-of-the-art architecture in the field of Automatic Speech Recognition (ASR).

Automatic Speech Recognition Automatic Speech Recognition (ASR) +3

S3E: A Large-scale Multimodal Dataset for Collaborative SLAM

1 code implementation25 Oct 2022 Dapeng Feng, Yuhua Qi, Shipeng Zhong, Zhiqiang Chen, Yudu Jiao, Qiming Chen, Tao Jiang, Hongbo Chen

With the advanced request to employ a team of robots to perform a task collaboratively, the research community has become increasingly interested in collaborative simultaneous localization and mapping.

Simultaneous Localization and Mapping

Stochastic Variational Methods in Generalized Hidden Semi-Markov Models to Characterize Functionality in Random Heteropolymers

no code implementations5 Jul 2022 Yun Zhou, Boying Gong, Tao Jiang, Ting Xu, Haiyan Huang

Recent years have seen substantial advances in the development of biofunctional materials using synthetic polymers.

Learning Based User Scheduling in Reconfigurable Intelligent Surface Assisted Multiuser Downlink

no code implementations12 May 2022 Zhongze Zhang, Tao Jiang, Wei Yu

Reconfigurable intelligent surface (RIS) is capable of intelligently manipulating the phases of the incident electromagnetic wave to improve the wireless propagation environment between the base-station (BS) and the users.

Fairness Scheduling

Acceleration of Federated Learning with Alleviated Forgetting in Local Training

1 code implementation ICLR 2022 Chencheng Xu, Zhiwei Hong, Minlie Huang, Tao Jiang

Here, we propose FedReg, an algorithm to accelerate FL with alleviated knowledge forgetting in the local training stage by regularizing locally trained parameters with the loss on generated pseudo data, which encode the knowledge of previous training data learned by the global model.

Distributed Optimization Federated Learning

A Comprehensive Survey with Quantitative Comparison of Image Analysis Methods for Microorganism Biovolume Measurements

no code implementations18 Feb 2022 Jiawei Zhang, Chen Li, Md Mamunur Rahaman, YuDong Yao, Pingli Ma, Jinghua Zhang, Xin Zhao, Tao Jiang, Marcin Grzegorzek

This study has high research significance and application value, which can be referred to microbial researchers to have a comprehensive understanding of microorganism biovolume measurements using digital image analysis methods and potential applications.

Image Segmentation Semantic Segmentation

A Survey of Semen Quality Evaluation in Microscopic Videos Using Computer Assisted Sperm Analysis

no code implementations16 Feb 2022 Wenwei Zhao, Pingli Ma, Chen Li, Xiaoning Bu, Shuojia Zou, Tao Jiang, Marcin Grzegorzek

The various works related to Computer Assisted Sperm Analysis methods in the last 30 years (since 1988) are comprehensively introduced and analysed in this survey.

object-detection Object Detection

A State-of-the-art Survey of U-Net in Microscopic Image Analysis: from Simple Usage to Structure Mortification

no code implementations14 Feb 2022 Jian Wu, Wanli Liu, Chen Li, Tao Jiang, Islam Mohammad Shariful, Hongzan Sun, Xiaoqi Li, Xintong Li, Xinyu Huang, Marcin Grzegorzek

Image analysis technology is used to solve the inadvertences of artificial traditional methods in disease, wastewater treatment, environmental change monitoring analysis and convolutional neural networks (CNN) play an important role in microscopic image analysis.

Image Segmentation Segmentation +1

Forgery Attack Detection in Surveillance Video Streams Using Wi-Fi Channel State Information

no code implementations24 Jan 2022 Yong Huang, Xiang Li, Wei Wang, Tao Jiang, Qian Zhang

The cybersecurity breaches expose surveillance video streams to forgery attacks, under which authentic streams are falsified to hide unauthorized activities.

Time Series Time Series Analysis +1

Active Sensing for Communications by Learning

1 code implementation8 Dec 2021 Foad Sohrabi, Tao Jiang, Wei Cui, Wei Yu

This paper proposes a deep learning approach to a class of active sensing problems in wireless communications in which an agent sequentially interacts with an environment over a predetermined number of time frames to gather information in order to perform a sensing or actuation task for maximizing some utility function.

Active Learning

EMDS-7: Environmental Microorganism Image Dataset Seventh Version for Multiple Object Detection Evaluation

no code implementations11 Oct 2021 Hechen Yang, Chen Li, Xin Zhao, Bencheng Cai, Jiawei Zhang, Pingli Ma, Peng Zhao, Ao Chen, Hongzan Sun, Yueyang Teng, Shouliang Qi, Tao Jiang, Marcin Grzegorzek

The Environmental Microorganism Image Dataset Seventh Version (EMDS-7) is a microscopic image data set, including the original Environmental Microorganism images (EMs) and the corresponding object labeling files in ". XML" format file.

Object object-detection +1

Looking for the Signs: Identifying Isolated Sign Instances in Continuous Video Footage

no code implementations21 Jul 2021 Tao Jiang, Necati Cihan Camgoz, Richard Bowden

In this paper, we focus on the task of one-shot sign spotting, i. e. given an example of an isolated sign (query), we want to identify whether/where this sign appears in a continuous, co-articulated sign language video (target).

A Comparison for Patch-level Classification of Deep Learning Methods on Transparent Environmental Microorganism Images: from Convolutional Neural Networks to Visual Transformers

no code implementations22 Jun 2021 Hechen Yang, Chen Li, Jinghua Zhang, Peng Zhao, Ao Chen, Xin Zhao, Tao Jiang, Marcin Grzegorzek

We conclude that ViT performs the worst in classifying 8 * 8 pixel patches, but it outperforms most convolutional neural networks in classifying 224 * 224 pixel patches.

Skeletor: Skeletal Transformers for Robust Body-Pose Estimation

no code implementations23 Apr 2021 Tao Jiang, Necati Cihan Camgoz, Richard Bowden

Skeletor can achieve this as it implicitly learns the spatio-temporal context of human motion via a transformer based neural network.

3D Human Pose Estimation Sign Language Translation +1

A New Pairwise Deep Learning Feature For Environmental Microorganism Image Analysis

no code implementations24 Feb 2021 Frank Kulwa, Chen Li, Jinghua Zhang, Kimiaki Shirahama, Sergey Kosov, Xin Zhao, Hongzan Sun, Tao Jiang, Marcin Grzegorzek

In order to fasten, low the cost, increase consistency and accuracy of identification, we propose the novel pairwise deep learning features to analyze microorganisms.

Specificity

Policy-Aware Mobility Model Explains the Growth of COVID-19 in Cities

no code implementations21 Feb 2021 Zhenyu Han, Fengli Xu, Yong Li, Tao Jiang, Depeng Jin, Jianhua Lu, James A. Evans

With the continued spread of coronavirus, the task of forecasting distinctive COVID-19 growth curves in different cities, which remain inadequately explained by standard epidemiological models, is critical for medical supply and treatment.

Towards Cross-Modal Forgery Detection and Localization on Live Surveillance Videos

no code implementations4 Jan 2021 Yong Huang, Xiang Li, Wei Wang, Tao Jiang, Qian Zhang

Traditional video forensics approaches can detect and localize forgery traces in each video frame using computationally-expensive spatial-temporal analysis, while falling short in real-time verification of live video feeds.

Time Series Analysis Video Forensics Cryptography and Security

Sparse Coding-inspired GAN for Weakly Supervised Hyperspectral Anomaly Detection

no code implementations1 Jan 2021 Tao Jiang, Weiying Xie, Jie Lei, Yunsong Li, Zan Li

For solving these problems, this paper proposes a sparse coding-inspired generative adversarial network (GAN) for weakly supervised HAD, named sparseHAD.

Anomaly Detection Generative Adversarial Network +1

Peer-to-Peer Localization for Single-Antenna Devices

no code implementations10 Dec 2020 Xianan Zhang, Wei Wang, Xuedou Xiao, Hang Yang, Xinyu Zhang, Tao Jiang

In this paper, we present P2PLocate, a peer-to-peer localization system that enables a single-antenna device co-located with a batteryless backscatter tag to localize another single-antenna device with decimeter-level accuracy.

Indoor Localization TAG

Reinforced Molecular Optimization with Neighborhood-Controlled Grammars

1 code implementation NeurIPS 2020 Chencheng Xu, Qiao Liu, Minlie Huang, Tao Jiang

A major challenge in the pharmaceutical industry is to design novel molecules with specific desired properties, especially when the property evaluation is costly.

 Ranked #1 on Molecular Graph Generation on ZINC (QED Top-3 metric)

Graph Generation Molecular Graph Generation

Learning to Reflect and to Beamform for Intelligent Reflecting Surface with Implicit Channel Estimation

1 code implementation30 Sep 2020 Tao Jiang, Hei Victor Cheng, Wei Yu

Intelligent reflecting surface (IRS), which consists of a large number of tunable reflective elements, is capable of enhancing the wireless propagation environment in a cellular network by intelligently reflecting the electromagnetic waves from the base-station (BS) toward the users.

Multi-Agent Deep Reinforcement Learning for HVAC Control in Commercial Buildings

no code implementations25 Jun 2020 Liang Yu, Yi Sun, Zhanbo Xu, Chao Shen, Dong Yue, Tao Jiang, Xiaohong Guan

In this paper, we intend to minimize the energy cost of an HVAC system in a multi-zone commercial building under dynamic pricing with the consideration of random zone occupancy, thermal comfort, and indoor air quality comfort.

reinforcement-learning Reinforcement Learning (RL)

Certifying clusters from sum-of-norms clustering

no code implementations19 Jun 2020 Tao Jiang, Stephen Vavasis

Multiple algorithms have been proposed to solve the optimization problem: subgradient descent by Hocking et al., ADMM and ADA by Chi and Lange, stochastic incremental algorithm by Panahi et al. and semismooth Newton-CG augmented Lagrangian method by Sun et al. All algorithms yield approximate solutions, even though an exact solution is demanded to determine the correct cluster assignment.

Clustering

Robot-assisted Backscatter Localization for IoT Applications

no code implementations21 May 2020 Shengkai Zhang, Wei Wang, Sheyang Tang, Shi Jin, Tao Jiang

Recent years have witnessed the rapid proliferation of backscatter technologies that realize the ubiquitous and long-term connectivity to empower smart cities and smart homes.

Indoor Localization

Edge Intelligence: Architectures, Challenges, and Applications

no code implementations26 Mar 2020 Dianlei Xu, Tong Li, Yong Li, Xiang Su, Sasu Tarkoma, Tao Jiang, Jon Crowcroft, Pan Hui

Edge intelligence refers to a set of connected systems and devices for data collection, caching, processing, and analysis in locations close to where data is captured based on artificial intelligence.

A Multi-scale CNN-CRF Framework for Environmental Microorganism Image Segmentation

no code implementations8 Mar 2020 Jinghua Zhang, Chen Li, Frank Kulwa, Xin Zhao, Changhao Sun, Zihan Li, Tao Jiang, Hong Li

In order to assist researchers to identify Environmental Microorganisms (EMs) effectively, a Multi-scale CNN-CRF (MSCC) framework for the EM image segmentation is proposed in this paper.

Image Segmentation Segmentation +1

Gastric histopathology image segmentation using a hierarchical conditional random field

no code implementations3 Mar 2020 Changhao Sun, Chen Li, Jinghua Zhang, Muhammad Rahaman, Shiliang Ai, Hao Chen, Frank Kulwa, Yixin Li, Xiaoyan Li, Tao Jiang

This HCRF model is built up with higher order potentials, including pixel-level and patch-level potentials, and graph-based post-processing is applied to further improve its segmentation performance.

Image Segmentation Segmentation +2

Communication-Efficient Edge AI: Algorithms and Systems

no code implementations22 Feb 2020 Yuanming Shi, Kai Yang, Tao Jiang, Jun Zhang, Khaled B. Letaief

By pushing inference and training processes of AI models to edge nodes, edge AI has emerged as a promising alternative.

Drug Discovery Image Classification

Sensor-Augmented Neural Adaptive Bitrate Video Streaming on UAVs

no code implementations23 Sep 2019 Xuedou Xiao, Wei Wang, Taobin Chen, Yang Cao, Tao Jiang, Qian Zhang

In this paper, we present SA-ABR, a new sensor-augmented system that generates ABR video streaming algorithms with the assistance of various kinds of inherent sensor data that are used to pilot UAVs.

Automated Steel Bar Counting and Center Localization with Convolutional Neural Networks

1 code implementation3 Jun 2019 Zhun Fan, Jiewei Lu, Benzhang Qiu, Tao Jiang, Kang An, Alex Noel Josephraj, Chuliang Wei

The proposed CNN-DC can achieve 99. 26% accuracy for steel bar counting and 4. 1% center offset for center localization on the established steel bar dataset, which demonstrates that the proposed CNN-DC can perform well on automated steel bar counting and center localization.

Clustering

Recovery of a mixture of Gaussians by sum-of-norms clustering

no code implementations19 Feb 2019 Tao Jiang, Stephen Vavasis, Chen Wen Zhai

Sum-of-norms clustering is a method for assigning $n$ points in $\mathbb{R}^d$ to $K$ clusters, $1\le K\le n$, using convex optimization.

Clustering

Federated Learning via Over-the-Air Computation

no code implementations31 Dec 2018 Kai Yang, Tao Jiang, Yuanming Shi, Zhi Ding

Instead, edge machine learning becomes increasingly attractive for performing training and inference directly at network edges without sending data to a centralized data center.

BIG-bench Machine Learning Cloud Computing +1

Double Neural Counterfactual Regret Minimization

no code implementations ICLR 2020 Hui Li, Kailiang Hu, Zhibang Ge, Tao Jiang, Yuan Qi, Le Song

Counterfactual Regret Minimization (CRF) is a fundamental and effective technique for solving Imperfect Information Games (IIG).

counterfactual

Cross-Technology Communications for Heterogeneous IoT Devices Through Artificial Doppler Shifts

no code implementations27 Nov 2018 Wei Wang, Shiyue He, Liang Sun, Tao Jiang, Qian Zhang

To this end, we propose DopplerFi, a communication framework that enables a two-way communication channel between BLE and Wi-Fi by injecting artificial Doppler shifts, which can be decoded by sensing the patterns in the Gaussian frequency shift keying (GFSK) demodulator and Channel State Information (CSI).

Networking and Internet Architecture

Cannot find the paper you are looking for? You can Submit a new open access paper.