Search Results for author: Yi Liu

Found 186 papers, 68 papers with code

CLIO: Role-interactive Multi-event Head Attention Network for Document-level Event Extraction

no code implementations COLING 2022 Yubing Ren, Yanan Cao, Fang Fang, Ping Guo, Zheng Lin, Wei Ma, Yi Liu

Transforming the large amounts of unstructured text on the Internet into structured event knowledge is a critical, yet unsolved goal of NLP, especially when addressing document-level text.

Document-level Event Extraction Event Extraction

Task Oriented In-Domain Data Augmentation

no code implementations24 Jun 2024 Xiao Liang, Xinyu Hu, Simiao Zuo, Yeyun Gong, Qiang Lou, Yi Liu, Shao-Lun Huang, Jian Jiao

On average, TRAIT improves LLM performance by 8% in the advertisement domain and 7. 5% in the math domain.

Data Augmentation Math

Repairing Catastrophic-Neglect in Text-to-Image Diffusion Models via Attention-Guided Feature Enhancement

no code implementations24 Jun 2024 Zhiyuan Chang, Mingyang Li, Junjie Wang, Yi Liu, Qing Wang, Yang Liu

The most prominent issue among these semantic inconsistencies is catastrophic-neglect, where the images generated by T2I DMs miss key objects mentioned in the prompt.

Image Generation

BadSampler: Harnessing the Power of Catastrophic Forgetting to Poison Byzantine-robust Federated Learning

no code implementations18 Jun 2024 Yi Liu, Cong Wang, Xingliang Yuan

To fill this gap, we first formally define generalization error and establish its connection to catastrophic forgetting, paving the way for the development of a clean-label data poisoning attack named BadSampler.

Data Poisoning Federated Learning

Self and Cross-Model Distillation for LLMs: Effective Methods for Refusal Pattern Alignment

no code implementations17 Jun 2024 Jie Li, Yi Liu, Chongyang Liu, Xiaoning Ren, Ling Shi, Weisong Sun, Yinxing Xue

Our results show that these methods significantly improve refusal rates and reduce unsafe content, with cross-model distilling achieving refusal rates close to Claude3's 94. 51%.

Text Generation

Multi-Aspect Controllable Text Generation with Disentangled Counterfactual Augmentation

1 code implementation30 May 2024 Yi Liu, Xiangyu Liu, Xiangrong Zhu, Wei Hu

We alleviate the issue of imbalanced attribute correlations during training using counterfactual feature vectors in the attribute latent space by disentanglement.

Attribute counterfactual +2

LOGO: Video Text Spotting with Language Collaboration and Glyph Perception Model

no code implementations29 May 2024 Hongen Liu, Di Sun, Jiahao Wang, Yi Liu, Gang Pan

In this paper, we propose a Language Collaboration and Glyph Perception Model, termed LOGO, an innovative framework designed to enhance the performance of conventional text spotters.

Position Text Spotting

LIRE: listwise reward enhancement for preference alignment

no code implementations22 May 2024 Mingye Zhu, Yi Liu, Lei Zhang, Junbo Guo, Zhendong Mao

Recently, tremendous strides have been made to align the generation of Large Language Models (LLMs) with human values to mitigate toxic or unhelpful content.

Lockpicking LLMs: A Logit-Based Jailbreak Using Token-level Manipulation

1 code implementation20 May 2024 Yuxi Li, Yi Liu, Yuekang Li, Ling Shi, Gelei Deng, Shengquan Chen, Kailong Wang

Large language models (LLMs) have transformed the field of natural language processing, but they remain susceptible to jailbreaking attacks that exploit their capabilities to generate unintended and potentially harmful content.

Multi-Source Conformal Inference Under Distribution Shift

1 code implementation15 May 2024 Yi Liu, Alexander W. Levis, Sharon-Lise Normand, Larry Han

Recent years have experienced increasing utilization of complex machine learning models across multiple sources of data to inform more generalizable decision-making.

Decision Making Length-of-Stay prediction +3

Tactile-Augmented Radiance Fields

1 code implementation CVPR 2024 Yiming Dou, Fengyu Yang, Yi Liu, Antonio Loquercio, Andrew Owens

Our approach makes use of two insights: (i) common vision-based touch sensors are built on ordinary cameras and thus can be registered to images using methods from multi-view geometry, and (ii) visually and structurally similar regions of a scene share the same tactile features.

Tensor Factorisation for Polypharmacy Side Effect Prediction

no code implementations17 Apr 2024 Oliver Lloyd, Yi Liu, Tom R. Gaunt

We find, in contrast to previous reports, that for this task tensor factorisation models are competitive with state-of-the-art graph neural network models and we recommend that future work in this field considers cheaper methods with linear complexity before running costly deep learning processes.

Graph Neural Network

The Ninth NTIRE 2024 Efficient Super-Resolution Challenge Report

3 code implementations16 Apr 2024 Bin Ren, Nancy Mehta, Radu Timofte, Hongyuan Yu, Cheng Wan, Yuxin Hong, Bingnan Han, Zhuoyuan Wu, Yajun Zou, Yuqing Liu, Jizhe Li, Keji He, Chao Fan, Heng Zhang, Xiaolin Zhang, Xuanwu Yin, Kunlong Zuo, Bohao Liao, Peizhe Xia, Long Peng, Zhibo Du, Xin Di, Wangkai Li, Yang Wang, Wei Zhai, Renjing Pei, Jiaming Guo, Songcen Xu, Yang Cao, ZhengJun Zha, Yan Wang, Yi Liu, Qing Wang, Gang Zhang, Liou Zhang, Shijie Zhao, Long Sun, Jinshan Pan, Jiangxin Dong, Jinhui Tang, Xin Liu, Min Yan, Menghan Zhou, Yiqiang Yan, Yixuan Liu, Wensong Chan, Dehua Tang, Dong Zhou, Li Wang, Lu Tian, Barsoum Emad, Bohan Jia, Junbo Qiao, Yunshuai Zhou, Yun Zhang, Wei Li, Shaohui Lin, Shenglong Zhou, Binbin Chen, Jincheng Liao, Suiyi Zhao, Zhao Zhang, Bo wang, Yan Luo, Yanyan Wei, Feng Li, Mingshen Wang, Yawei Li, Jinhan Guan, Dehua Hu, Jiawei Yu, Qisheng Xu, Tao Sun, Long Lan, Kele Xu, Xin Lin, Jingtong Yue, Lehan Yang, Shiyi Du, Lu Qi, Chao Ren, Zeyu Han, YuHan Wang, Chaolin Chen, Haobo Li, Mingjun Zheng, Zhongbao Yang, Lianhong Song, Xingzhuo Yan, Minghan Fu, Jingyi Zhang, Baiang Li, Qi Zhu, Xiaogang Xu, Dan Guo, Chunle Guo, Jiadi Chen, Huanhuan Long, Chunjiang Duanmu, Xiaoyan Lei, Jie Liu, Weilin Jia, Weifeng Cao, Wenlong Zhang, Yanyu Mao, Ruilong Guo, Nihao Zhang, Qian Wang, Manoj Pandey, Maksym Chernozhukov, Giang Le, Shuli Cheng, Hongyuan Wang, Ziyan Wei, Qingting Tang, Liejun Wang, Yongming Li, Yanhui Guo, Hao Xu, Akram Khatami-Rizi, Ahmad Mahmoudi-Aznaveh, Chih-Chung Hsu, Chia-Ming Lee, Yi-Shiuan Chou, Amogh Joshi, Nikhil Akalwadi, Sampada Malagi, Palani Yashaswini, Chaitra Desai, Ramesh Ashok Tabib, Ujwala Patil, Uma Mudenagudi

In sub-track 1, the practical runtime performance of the submissions was evaluated, and the corresponding score was used to determine the ranking.

Image Super-Resolution

Revealing the structure-property relationships of copper alloys with FAGC

no code implementations15 Apr 2024 Yuexing Han, Guanxin Wan, Tao Han, Bing Wang, Yi Liu

These outcomes underscore the potential of FAGC to address the challenge of limited image data in materials science, providing a powerful tool for establishing detailed and quantitative relationships between complex microstructures and material properties.

Glitch Tokens in Large Language Models: Categorization Taxonomy and Effective Detection

no code implementations15 Apr 2024 Yuxi Li, Yi Liu, Gelei Deng, Ying Zhang, Wenjia Song, Ling Shi, Kailong Wang, Yuekang Li, Yang Liu, Haoyu Wang

We present categorizations of the identified glitch tokens and symptoms exhibited by LLMs when interacting with glitch tokens.

H2RSVLM: Towards Helpful and Honest Remote Sensing Large Vision Language Model

1 code implementation29 Mar 2024 Chao Pang, Jiang Wu, Jiayu Li, Yi Liu, Jiaxing Sun, Weijia Li, Xingxing Weng, Shuai Wang, Litong Feng, Gui-Song Xia, Conghui He

The generic large Vision-Language Models (VLMs) is rapidly developing, but still perform poorly in Remote Sensing (RS) domain, which is due to the unique and specialized nature of RS imagery and the comparatively limited spatial perception of current VLMs.

Hallucination Language Modelling +2

Evaluating Text-to-Image Generative Models: An Empirical Study on Human Image Synthesis

no code implementations8 Mar 2024 Muxi Chen, Yi Liu, Jian Yi, Changran Xu, Qiuxia Lai, Hongliang Wang, Tsung-Yi Ho, Qiang Xu

In this paper, we present an empirical study introducing a nuanced evaluation framework for text-to-image (T2I) generative models, applied to human image synthesis.

Defect Detection Fairness +1

Neural Field Classifiers via Target Encoding and Classification Loss

no code implementations2 Mar 2024 Xindi Yang, Zeke Xie, Xiong Zhou, Boyu Liu, Buhua Liu, Yi Liu, Haoran Wang, Yunfeng Cai, Mingming Sun

We successfully propose a novel Neural Field Classifier (NFC) framework which formulates existing neural field methods as classification tasks rather than regression tasks.

Classification Multi-Label Classification +2

TempCompass: Do Video LLMs Really Understand Videos?

1 code implementation1 Mar 2024 Yuanxin Liu, Shicheng Li, Yi Liu, Yuxiang Wang, Shuhuai Ren, Lei LI, Sishuo Chen, Xu sun, Lu Hou

Motivated by these two problems, we propose the \textbf{TempCompass} benchmark, which introduces a diversity of temporal aspects and task formats.

Diversity

CAMixerSR: Only Details Need More "Attention"

1 code implementation CVPR 2024 Yan Wang, Yi Liu, Shijie Zhao, Junlin Li, Li Zhang

To satisfy the rapidly increasing demands on the large image (2K-8K) super-resolution (SR), prevailing methods follow two independent tracks: 1) accelerate existing networks by content-aware routing, and 2) design better super-resolution networks via token mixer refining.

2k 8k +1

Gradual Residuals Alignment: A Dual-Stream Framework for GAN Inversion and Image Attribute Editing

no code implementations22 Feb 2024 Hao Li, Mengqi Huang, Lei Zhang, Bo Hu, Yi Liu, Zhendong Mao

GAN-based image attribute editing firstly leverages GAN Inversion to project real images into the latent space of GAN and then manipulates corresponding latent codes.

Attribute

A Comprehensive Study of Jailbreak Attack versus Defense for Large Language Models

1 code implementation21 Feb 2024 Zihao Xu, Yi Liu, Gelei Deng, Yuekang Li, Stjepan Picek

Large Language Models (LLMS) have increasingly become central to generating content with potential societal impacts.

Play Guessing Game with LLM: Indirect Jailbreak Attack with Implicit Clues

no code implementations14 Feb 2024 Zhiyuan Chang, Mingyang Li, Yi Liu, Junjie Wang, Qing Wang, Yang Liu

With the development of LLMs, the security threats of LLMs are getting more and more attention.

Generative AI to Generate Test Data Generators

1 code implementation31 Jan 2024 Benoit Baudry, Khashayar Etemadi, Sen Fang, Yogya Gamage, Yi Liu, Yuxin Liu, Martin Monperrus, Javier Ron, André Silva, Deepika Tiwari

The results show that LLMs can successfully generate realistic test data generators in a wide range of domains at all three levels of integrability.

A Cross-Language Investigation into Jailbreak Attacks in Large Language Models

no code implementations30 Jan 2024 Jie Li, Yi Liu, Chongyang Liu, Ling Shi, Xiaoning Ren, Yaowen Zheng, Yang Liu, Yinxing Xue

To address this research gap, we conducted an extensive empirical study on Multilingual Jailbreak attacks.

Text Generation

Digger: Detecting Copyright Content Mis-usage in Large Language Model Training

no code implementations1 Jan 2024 Haodong Li, Gelei Deng, Yi Liu, Kailong Wang, Yuekang Li, Tianwei Zhang, Yang Liu, Guoai Xu, Guosheng Xu, Haoyu Wang

In this paper, we introduce a detailed framework designed to detect and assess the presence of content from potentially copyrighted books within the training datasets of LLMs.

Language Modelling Large Language Model +1

Towards Efficient and Effective Text-to-Video Retrieval with Coarse-to-Fine Visual Representation Learning

no code implementations1 Jan 2024 Kaibin Tian, Yanhua Cheng, Yi Liu, Xinglin Hou, Quan Chen, Han Li

To address this issue, we adopt multi-granularity visual feature learning, ensuring the model's comprehensiveness in capturing visual content features spanning from abstract to detailed levels during the training phase.

Representation Learning Retrieval +3

Benchmarking Large Language Models on Controllable Generation under Diversified Instructions

1 code implementation1 Jan 2024 Yihan Chen, Benfeng Xu, Quan Wang, Yi Liu, Zhendong Mao

While large language models (LLMs) have exhibited impressive instruction-following capabilities, it is still unclear whether and to what extent they can respond to explicit constraints that might be entailed in various instructions.

Benchmarking Instruction Following +1

MoVQA: A Benchmark of Versatile Question-Answering for Long-Form Movie Understanding

no code implementations8 Dec 2023 Hongjie Zhang, Yi Liu, Lu Dong, Yifei HUANG, Zhen-Hua Ling, Yali Wang, LiMin Wang, Yu Qiao

While several long-form VideoQA datasets have been introduced, the length of both videos used to curate questions and sub-clips of clues leveraged to answer those questions have not yet reached the criteria for genuine long-form video understanding.

Question Answering Video Question Answering +1

MVBench: A Comprehensive Multi-modal Video Understanding Benchmark

3 code implementations CVPR 2024 Kunchang Li, Yali Wang, Yinan He, Yizhuo Li, Yi Wang, Yi Liu, Zun Wang, Jilan Xu, Guo Chen, Ping Luo, LiMin Wang, Yu Qiao

With the rapid development of Multi-modal Large Language Models (MLLMs), a number of diagnostic benchmarks have recently emerged to evaluate the comprehension capabilities of these models.

Fairness Multiple-choice +9

RECALL: A Benchmark for LLMs Robustness against External Counterfactual Knowledge

no code implementations14 Nov 2023 Yi Liu, Lianzhe Huang, Shicheng Li, Sishuo Chen, Hao Zhou, Fandong Meng, Jie zhou, Xu sun

Therefore, to evaluate the ability of LLMs to discern the reliability of external knowledge, we create a benchmark from existing knowledge bases.

counterfactual Knowledge Graphs +2

Gaussian Differential Privacy on Riemannian Manifolds

1 code implementation NeurIPS 2023 Yangdi Jiang, Xiaotian Chang, Yi Liu, Lei Ding, Linglong Kong, Bei Jiang

We develop an advanced approach for extending Gaussian Differential Privacy (GDP) to general Riemannian manifolds.

Random Entity Quantization for Parameter-Efficient Compositional Knowledge Graph Representation

1 code implementation24 Oct 2023 Jiaang Li, Quan Wang, Yi Liu, Licheng Zhang, Zhendong Mao

We analyze this phenomenon and reveal that entity codes, the quantization outcomes for expressing entities, have higher entropy at the code level and Jaccard distance at the codeword level under random entity quantization.

Knowledge Graphs Quantization +1

MUSCLE: Multi-task Self-supervised Continual Learning to Pre-train Deep Models for X-ray Images of Multiple Body Parts

no code implementations3 Oct 2023 Weibin Liao, Haoyi Xiong, Qingzhong Wang, Yan Mo, Xuhong LI, Yi Liu, Zeyu Chen, Siyu Huang, Dejing Dou

In this work, we study a novel self-supervised pre-training pipeline, namely Multi-task Self-super-vised Continual Learning (MUSCLE), for multiple medical imaging tasks, such as classification and segmentation, using X-ray images collected from multiple body parts, including heads, lungs, and bones.

Continual Learning Representation Learning +1

Distribution-Aware Continual Test-Time Adaptation for Semantic Segmentation

no code implementations24 Sep 2023 Jiayi Ni, Senqiao Yang, ran Xu, Jiaming Liu, Xiaoqi Li, Wenyu Jiao, Zehui Chen, Yi Liu, Shanghang Zhang

In this paper, we propose a distribution-aware tuning (DAT) method to make the semantic segmentation CTTA efficient and practical in real-world applications.

Autonomous Driving Semantic Segmentation +1

Optimize Weight Rounding via Signed Gradient Descent for the Quantization of LLMs

2 code implementations11 Sep 2023 Wenhua Cheng, Weiwei Zhang, Haihao Shen, Yiyang Cai, Xin He, Kaokao Lv, Yi Liu

Large Language Models (LLMs) have demonstrated exceptional proficiency in language-related tasks, but their deployment poses significant challenges due to substantial memory and storage requirements.

Quantization

Incorporating Pre-trained Model Prompting in Multimodal Stock Volume Movement Prediction

1 code implementation11 Sep 2023 Ruibo Chen, Zhiyuan Zhang, Yi Liu, Ruihan Bao, Keiko Harimoto, Xu sun

Existing multimodal works that train models from scratch face the problem of lacking universal knowledge when modeling financial news.

Time Series

A Small and Fast BERT for Chinese Medical Punctuation Restoration

1 code implementation24 Aug 2023 Tongtao Ling, Yutao Lai, Lei Chen, Shilei Huang, Yi Liu

In clinical dictation, utterances after automatic speech recognition (ASR) without explicit punctuation marks may lead to the misunderstanding of dictated reports.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +3

Self-Supervised Dynamic Hypergraph Recommendation based on Hyper-Relational Knowledge Graph

no code implementations15 Aug 2023 Yi Liu, Hongrui Xuan, Bohan Li, Meng Wang, Tong Chen, Hongzhi Yin

However, the long-tail distribution of entities leads to sparsity in supervision signals, which weakens the quality of item representation when utilizing KG enhancement.

Collaborative Filtering Knowledge-Aware Recommendation +2

SLSSNN: High energy efficiency spike-train level spiking neural networks with spatio-temporal conversion

no code implementations14 Jul 2023 Changqing Xu, Yi Liu, YinTang Yang

Brain-inspired spiking neuron networks (SNNs) have attracted widespread research interest due to their low power features, high biological plausibility, and strong spatiotemporal information processing capability.

Semi-Offline Reinforcement Learning for Optimized Text Generation

1 code implementation16 Jun 2023 Changyu Chen, Xiting Wang, Yiqiao Jin, Victor Ye Dong, Li Dong, Jie Cao, Yi Liu, Rui Yan

In reinforcement learning (RL), there are two major settings for interacting with the environment: online and offline.

Offline RL reinforcement-learning +2

Efficient Approximations of Complete Interatomic Potentials for Crystal Property Prediction

1 code implementation12 Jun 2023 Yuchao Lin, Keqiang Yan, Youzhi Luo, Yi Liu, Xiaoning Qian, Shuiwang Ji

This is enabled by our approximations of infinite potential summations, where we extend the Ewald summation for several potential series approximations with provable error bounds.

Band Gap Formation Energy +2

Prompt Injection attack against LLM-integrated Applications

no code implementations8 Jun 2023 Yi Liu, Gelei Deng, Yuekang Li, Kailong Wang, ZiHao Wang, XiaoFeng Wang, Tianwei Zhang, Yepang Liu, Haoyu Wang, Yan Zheng, Yang Liu

We deploy HouYi on 36 actual LLM-integrated applications and discern 31 applications susceptible to prompt injection.

Towards Better Entity Linking with Multi-View Enhanced Distillation

1 code implementation27 May 2023 Yi Liu, Yuan Tian, Jianxun Lian, Xinlong Wang, Yanan Cao, Fang Fang, Wen Zhang, Haizhen Huang, Denvy Deng, Qi Zhang

Aiming at learning entity representations that can match divergent mentions, this paper proposes a Multi-View Enhanced Distillation (MVD) framework, which can effectively transfer knowledge of multiple fine-grained and mention-relevant parts within entities from cross-encoders to dual-encoders.

Entity Linking Knowledge Distillation +1

DeepGate2: Functionality-Aware Circuit Representation Learning

1 code implementation25 May 2023 Zhengyuan Shi, Hongyang Pan, Sadaf Khan, Min Li, Yi Liu, Junhua Huang, Hui-Ling Zhen, Mingxuan Yuan, Zhufei Chu, Qiang Xu

Circuit representation learning aims to obtain neural representations of circuit elements and has emerged as a promising research direction that can be applied to various EDA and logic reasoning tasks.

Graph Neural Network Representation Learning

Jailbreaking ChatGPT via Prompt Engineering: An Empirical Study

1 code implementation23 May 2023 Yi Liu, Gelei Deng, Zhengzi Xu, Yuekang Li, Yaowen Zheng, Ying Zhang, Lida Zhao, Tianwei Zhang, Kailong Wang, Yang Liu

Our study investigates three key research questions: (1) the number of different prompt types that can jailbreak LLMs, (2) the effectiveness of jailbreak prompts in circumventing LLM constraints, and (3) the resilience of ChatGPT against these jailbreak prompts.

Prompt Engineering

Automatic Code Summarization via ChatGPT: How Far Are We?

no code implementations22 May 2023 Weisong Sun, Chunrong Fang, Yudu You, Yun Miao, Yi Liu, Yuekang Li, Gelei Deng, Shenghan Huang, Yuchen Chen, Quanjun Zhang, Hanwei Qian, Yang Liu, Zhenyu Chen

To support software developers in understanding and maintaining programs, various automatic code summarization techniques have been proposed to generate a concise natural language comment for a given code snippet.

Code Summarization

Communication Efficient Federated Learning for Multilingual Neural Machine Translation with Adapter

1 code implementation21 May 2023 Yi Liu, Xiaohan Bi, Lei LI, Sishuo Chen, Wenkai Yang, Xu sun

However, as pre-trained language models (PLMs) continue to increase in size, the communication cost for transmitting parameters during synchronization has become a training speed bottleneck.

Clustering Federated Learning +2

SFP: Spurious Feature-targeted Pruning for Out-of-Distribution Generalization

no code implementations19 May 2023 Yingchun Wang, Jingcai Guo, Yi Liu, Song Guo, Weizhan Zhang, Xiangyong Cao, Qinghua Zheng

Based on the idea that in-distribution (ID) data with spurious features may have a lower experience risk, in this paper, we propose a novel Spurious Feature-targeted model Pruning framework, dubbed SFP, to automatically explore invariant substructures without referring to the above drawbacks.

Out-of-Distribution Generalization

SegGPT Meets Co-Saliency Scene

no code implementations8 May 2023 Yi Liu, Shoukun Xu, Dingwen Zhang, Jungong Han

Co-salient object detection targets at detecting co-existed salient objects among a group of images.

Co-Salient Object Detection Object +2

AsConvSR: Fast and Lightweight Super-Resolution Network with Assembled Convolutions

no code implementations5 May 2023 Jiaming Guo, Xueyi Zou, Yuyi Chen, Yi Liu, Jia Hao, Jianzhuang Liu, Youliang Yan

In recent years, videos and images in 720p (HD), 1080p (FHD) and 4K (UHD) resolution have become more popular for display devices such as TVs, mobile phones and VR.

4k Super-Resolution

DETRs Beat YOLOs on Real-time Object Detection

4 code implementations CVPR 2024 Yian Zhao, Wenyu Lv, Shangliang Xu, Jinman Wei, Guanzhong Wang, Qingqing Dang, Yi Liu, Jie Chen

Our RT-DETR-R50 / R101 achieves 53. 1% / 54. 3% AP on COCO and 108 / 74 FPS on T4 GPU, outperforming previously advanced YOLOs in both speed and accuracy.

Decoder Object +2

PP-MobileSeg: Explore the Fast and Accurate Semantic Segmentation Model on Mobile Devices

1 code implementation11 Apr 2023 Shiyu Tang, Ting Sun, Juncai Peng, Guowei Chen, Yuying Hao, Manhui Lin, Zhihong Xiao, Jiangbin You, Yi Liu

To address this issue, we propose PP-MobileSeg, a semantic segmentation model that achieves state-of-the-art performance on mobile devices.

Semantic Segmentation valid

Object-Aware Distillation Pyramid for Open-Vocabulary Object Detection

1 code implementation CVPR 2023 Luting Wang, Yi Liu, Penghui Du, Zihan Ding, Yue Liao, Qiaosong Qi, Biaolong Chen, Si Liu

When extracting object knowledge from PVLMs, the former adaptively transforms object proposals and adopts object-aware mask attention to obtain precise and complete knowledge of objects.

Object Open Vocabulary Object Detection

Angel-PTM: A Scalable and Economical Large-scale Pre-training System in Tencent

no code implementations6 Mar 2023 Xiaonan Nie, Yi Liu, Fangcheng Fu, Jinbao Xue, Dian Jiao, Xupeng Miao, Yangyu Tao, Bin Cui

Recent years have witnessed the unprecedented achievements of large-scale pre-trained models, especially the Transformer models.

Management Scheduling

Video4MRI: An Empirical Study on Brain Magnetic Resonance Image Analytics with CNN-based Video Classification Frameworks

no code implementations24 Feb 2023 Yuxuan Zhang, Qingzhong Wang, Jiang Bian, Yi Liu, Yanwu Xu, Dejing Dou, Haoyi Xiong

Due to the high similarity between MRI data and videos, we conduct extensive empirical studies on video recognition techniques for MRI classification to answer the questions: (1) can we directly use video recognition models for MRI classification, (2) which model is more appropriate for MRI, (3) are the common tricks like data augmentation in video recognition still useful for MRI classification?

Classification Data Augmentation +3

Knowledge Enhancement for Contrastive Multi-Behavior Recommendation

no code implementations13 Jan 2023 Hongrui Xuan, Yi Liu, Bohan Li, Hongzhi Yin

In particular, we design the multi-behavior learning module to extract users' personalized behavior information for user-embedding enhancement, and utilize knowledge graph in the knowledge enhancement module to derive more robust knowledge-aware representations for items.

Contrastive Learning Recommendation Systems +1

Efficient Preference-Based Reinforcement Learning Using Learned Dynamics Models

no code implementations11 Jan 2023 Yi Liu, Gaurav Datta, Ellen Novoseller, Daniel S. Brown

In particular, we provide evidence that a learned dynamics model offers the following benefits when performing PbRL: (1) preference elicitation and policy optimization require significantly fewer environment interactions than model-free PbRL, (2) diverse preference queries can be synthesized safely and efficiently as a byproduct of standard model-based RL, and (3) reward pre-training based on suboptimal demonstrations can be performed without any environmental interaction.

reinforcement-learning Reinforcement Learning (RL)

SIRL: Similarity-based Implicit Representation Learning

no code implementations2 Jan 2023 Andreea Bobu, Yi Liu, Rohin Shah, Daniel S. Brown, Anca D. Dragan

This, in turn, is what enables the robot to disambiguate between what needs to go into the representation versus what is spurious, as well as what aspects of behavior can be compressed together versus not.

Contrastive Learning Data Augmentation +1

Lightweight Image Super-Resolution with Superpixel Token Interaction

1 code implementation ICCV 2023 Aiping Zhang, Wenqi Ren, Yi Liu, Xiaochun Cao

Our method employs superpixels to cluster local similar pixels to form the explicable local regions and utilizes intra-superpixel attention to enable local information interaction.

Image Super-Resolution Superpixels

Efficient Stein Variational Inference for Reliable Distribution-lossless Network Pruning

no code implementations7 Dec 2022 Yingchun Wang, Song Guo, Jingcai Guo, Weizhan Zhang, Yida Xu, Jie Zhang, Yi Liu

Extensive experiments based on small Cifar-10 and large-scaled ImageNet demonstrate that our method can obtain sparser networks with great generalization performance while providing quantified reliability for the pruned model.

Network Pruning Variational Inference

InternVideo: General Video Foundation Models via Generative and Discriminative Learning

2 code implementations6 Dec 2022 Yi Wang, Kunchang Li, Yizhuo Li, Yinan He, Bingkun Huang, Zhiyu Zhao, Hongjie Zhang, Jilan Xu, Yi Liu, Zun Wang, Sen Xing, Guo Chen, Junting Pan, Jiashuo Yu, Yali Wang, LiMin Wang, Yu Qiao

Specifically, InternVideo efficiently explores masked video modeling and video-language contrastive learning as the pretraining objectives, and selectively coordinates video representations of these two complementary frameworks in a learnable manner to boost various video applications.

 Ranked #1 on Action Recognition on Something-Something V1 (using extra training data)

Action Classification Contrastive Learning +8

CaDM: Codec-aware Diffusion Modeling for Neural-enhanced Video Streaming

no code implementations15 Nov 2022 Qihua Zhou, Ruibin Li, Song Guo, Peiran Dong, Yi Liu, Jingcai Guo, Zhenda Xu

Recent years have witnessed the dramatic growth of Internet video traffic, where the video bitstreams are often compressed and delivered in low quality to fit the streamer's uplink bandwidth.

Decoder Denoising +1

Feature Correlation-guided Knowledge Transfer for Federated Self-supervised Learning

no code implementations14 Nov 2022 Yi Liu, Song Guo, Jie Zhang, Qihua Zhou, Yingchun Wang, Xiaohan Zhao

We prove that FedFoA is a model-agnostic training framework and can be easily compatible with state-of-the-art unsupervised FL methods.

Feature Correlation Federated Learning +4

PP-YOLOE-R: An Efficient Anchor-Free Rotated Object Detector

2 code implementations4 Nov 2022 Xinxin Wang, Guanzhong Wang, Qingqing Dang, Yi Liu, Xiaoguang Hu, dianhai yu

With multi-scale training and testing, PP-YOLOE-R-l and PP-YOLOE-R-x further improve the detection precision to 80. 02 and 80. 73 mAP.

Object object-detection +3

MCSCSet: A Specialist-annotated Dataset for Medical-domain Chinese Spelling Correction

1 code implementation21 Oct 2022 Wangjie Jiang, Zhihao Ye, Zijing Ou, Ruihui Zhao, Jianguang Zheng, Yi Liu, Siheng Li, Bang Liu, Yujiu Yang, Yefeng Zheng

In this work, we define the task of Medical-domain Chinese Spelling Correction and propose MCSCSet, a large scale specialist-annotated dataset that contains about 200k samples.

Optical Character Recognition Optical Character Recognition (OCR) +1

VideoPipe 2022 Challenge: Real-World Video Understanding for Urban Pipe Inspection

no code implementations20 Oct 2022 Yi Liu, Xuan Zhang, Ying Li, Guixin Liang, Yabing Jiang, Lixia Qiu, Haiping Tang, Fei Xie, Wei Yao, Yi Dai, Yu Qiao, Yali Wang

For this reason, we propose to advance research areas of video understanding, with a shift from traditional action recognition to industrial anomaly analysis.

Temporal Defect Localization Video Defect Classification

EISeg: An Efficient Interactive Segmentation Tool based on PaddlePaddle

1 code implementation17 Oct 2022 Yuying Hao, Yi Liu, Yizhou Chen, Lin Han, Juncai Peng, Shiyu Tang, Guowei Chen, Zewu Wu, Zeyu Chen, Baohua Lai

In recent years, the rapid development of deep learning has brought great advancements to image and video segmentation methods based on neural networks.

Image Segmentation Interactive Segmentation +4

Boosting the Transferability of Adversarial Attacks with Reverse Adversarial Perturbation

3 code implementations12 Oct 2022 Zeyu Qin, Yanbo Fan, Yi Liu, Li Shen, Yong Zhang, Jue Wang, Baoyuan Wu

Furthermore, RAP can be naturally combined with many existing black-box attack techniques, to further boost the transferability.

Adversarial Attack

PP-StructureV2: A Stronger Document Analysis System

1 code implementation11 Oct 2022 Chenxia Li, Ruoyu Guo, Jun Zhou, Mengtao An, Yuning Du, Lingfeng Zhu, Yi Liu, Xiaoguang Hu, dianhai yu

For Table Recognition model, we utilize PP-LCNet, CSP-PAN and SLAHead to optimize the backbone module, feature fusion module and decoding module, respectively, which improved the table structure accuracy by 6\% with comparable inference speed.

 Ranked #1 on Network Pruning on CIFAR-100 (Inference Time (ms) metric)

Key Information Extraction Knowledge Distillation +3

FAST: Improving Controllability for Text Generation with Feedback Aware Self-Training

no code implementations6 Oct 2022 Junyi Chai, Reid Pryzant, Victor Ye Dong, Konstantin Golobokov, Chenguang Zhu, Yi Liu

Controllable text generation systems often leverage control codes to direct various properties of the output like style and length.

Attribute Causal Inference +2

Periodic Graph Transformers for Crystal Material Property Prediction

2 code implementations23 Sep 2022 Keqiang Yan, Yi Liu, Yuchao Lin, Shuiwang Ji

Our Matformer is designed to be invariant to periodicity and can capture repeating patterns explicitly.

Band Gap Formation Energy +2

A Nonparametric Contextual Bandit with Arm-level Eligibility Control for Customer Service Routing

no code implementations8 Sep 2022 Ruofeng Wen, Wenjun Zeng, Yi Liu

Routing contacts to eligible SMEs turns out to be a non-trivial problem because SMEs' domain eligibility is subject to training quality and can change over time.

Thompson Sampling

SATformer: Transformer-Based UNSAT Core Learning

no code implementations2 Sep 2022 Zhengyuan Shi, Min Li, Yi Liu, Sadaf Khan, Junhua Huang, Hui-Ling Zhen, Mingxuan Yuan, Qiang Xu

This paper introduces SATformer, a novel Transformer-based approach for the Boolean Satisfiability (SAT) problem.

Graph Neural Network Multi-Task Learning

DeepGen: Diverse Search Ad Generation and Real-Time Customization

no code implementations6 Aug 2022 Konstantin Golobokov, Junyi Chai, Victor Ye Dong, Mandy Gu, Bingyu Chi, Jie Cao, Yulan Yan, Yi Liu

In addition, our system creates a customized ad in real-time in response to the user's search query, therefore highlighting different aspects of the same product based on what the user is looking for.

Diversity Text Generation

Ultra-low Latency Adaptive Local Binary Spiking Neural Network with Accuracy Loss Estimator

no code implementations31 Jul 2022 Changqing Xu, Yijian Pei, Zili Wu, Yi Liu, YinTang Yang

Spiking neural network (SNN) is a brain-inspired model which has more spatio-temporal information processing capacity and computational energy efficiency.

Quantization

Learning Hierarchical Protein Representations via Complete 3D Graph Networks

1 code implementation26 Jul 2022 Limei Wang, Haoran Liu, Yi Liu, Jerry Kurtin, Shuiwang Ji

In this work, we propose to develop a novel hierarchical graph network, known as ProNet, to capture the relations.

Representation Learning

An Ultra-low Power TinyML System for Real-time Visual Processing at Edge

1 code implementation11 Jul 2022 Kunran Xu, Huawei Zhang, Yishi Li, Yuhao Zhang, Rui Lai, Yi Liu

Tiny machine learning (TinyML), executing AI workloads on resource and power strictly restricted systems, is an important and challenging topic.

object-detection Object Detection

Distilling Ensemble of Explanations for Weakly-Supervised Pre-Training of Image Segmentation Models

2 code implementations4 Jul 2022 Xuhong LI, Haoyi Xiong, Yi Liu, Dingfu Zhou, Zeyu Chen, Yaqing Wang, Dejing Dou

Though image classification datasets could provide the backbone networks with rich visual features and discriminative ability, they are incapable of fully pre-training the target model (i. e., backbone+segmentation modules) in an end-to-end manner.

Classification Image Classification +3

Assessing the Effects of Hyperparameters on Knowledge Graph Embedding Quality

1 code implementation1 Jul 2022 Oliver Lloyd, Yi Liu, Tom Gaunt

We regressed the embedding quality on those hyperparameter configurations, using this model to generate Sobol sensitivity indices for each of the hyperparameters.

Knowledge Graph Embedding Knowledge Graphs +2

Tell Me the Evidence? Dual Visual-Linguistic Interaction for Answer Grounding

no code implementations21 Jun 2022 Junwen Pan, Guanlin Chen, Yi Liu, Jiexiang Wang, Cheng Bian, Pengfei Zhu, Zhicheng Zhang

Answer grounding aims to reveal the visual evidence for visual question answering (VQA), which entails highlighting relevant positions in the image when answering questions about images.

Decoder Question Answering +2

ComENet: Towards Complete and Efficient Message Passing for 3D Molecular Graphs

1 code implementation17 Jun 2022 Limei Wang, Yi Liu, Yuchao Lin, Haoran Liu, Shuiwang Ji

To incorporate 3D information completely and efficiently, we propose a novel message passing scheme that operates within 1-hop neighborhood.

Drug Discovery Graph Neural Network

Multiple Domain Cyberspace Attack and Defense Game Based on Reward Randomization Reinforcement Learning

no code implementations23 May 2022 Lei Zhang, Yu Pan, Yi Liu, Qibin Zheng, Zhisong Pan

In order to improve the defense ability of defender, a game model based on reward randomization reinforcement learning is proposed.

reinforcement-learning Reinforcement Learning (RL)

Improved-Flow Warp Module for Remote Sensing Semantic Segmentation

no code implementations9 May 2022 Yinjie Zhang, Yi Liu, Wei Guo

Second, the offsets help with the low-resolution deep feature up-sampling process to improve the feature accordance, which boosts the accuracy of semantic segmentation.

Segmentation Semantic Segmentation

Rotated Object Detection via Scale-invariant Mahalanobis Distance in Aerial Images

no code implementations2 Apr 2022 Siyang Wen, Wei Guo, Yi Liu, Ruijie Wu

The eight-parameter (coordinates of box vectors) methods in rotated object detection usually use ln-norm losses (L1 loss, L2 loss, and smooth L1 loss) as loss functions.

Object object-detection +1

Ultra-low Latency Spiking Neural Networks with Spatio-Temporal Compression and Synaptic Convolutional Block

no code implementations18 Mar 2022 Changqing Xu, Yi Liu, YinTang Yang

We evaluate the proposed method for event streams classification tasks on neuromorphic N-MNIST, CIFAR10-DVS, DVS128 gesture datasets.

Classification

The Right to be Forgotten in Federated Learning: An Efficient Realization with Rapid Retraining

no code implementations14 Mar 2022 Yi Liu, Lei Xu, Xingliang Yuan, Cong Wang, Bo Li

Existing machine unlearning techniques focus on centralized training, where access to all holders' training data is a must for the server to conduct the unlearning process.

Federated Learning Machine Unlearning

Aggregation Service for Federated Learning: An Efficient, Secure, and More Resilient Realization

no code implementations4 Feb 2022 Yifeng Zheng, Shangqi Lai, Yi Liu, Xingliang Yuan, Xun Yi, Cong Wang

In this paper, we present a system design which offers efficient protection of individual model updates throughout the learning procedure, allowing clients to only provide obscured model updates while a cloud server can still perform the aggregation.

Federated Learning

Evolutionary Action Selection for Gradient-based Policy Learning

no code implementations12 Jan 2022 Yan Ma, Tianxing Liu, Bingsheng Wei, Yi Liu, Kang Xu, Wei Li

Evolutionary Algorithms (EAs) and Deep Reinforcement Learning (DRL) have recently been integrated to take the advantage of the both methods for better exploration and exploitation. The evolutionary part in these hybrid methods maintains a population of policy networks. However, existing methods focus on optimizing the parameters of policy network, which is usually high-dimensional and tricky for EA. In this paper, we shift the target of evolution from high-dimensional parameter space to low-dimensional action space. We propose Evolutionary Action Selection-Twin Delayed Deep Deterministic Policy Gradient (EAS-TD3), a novel hybrid method of EA and DRL. In EAS, we focus on optimizing the action chosen by the policy network and attempt to obtain high-quality actions to promote policy learning through an evolutionary algorithm.

Continuous Control Evolutionary Algorithms

FamilySeer: Towards Optimized Tensor Codes by Exploiting Computation Subgraph Similarity

no code implementations1 Jan 2022 Shanjun Zhang, Mingzhen Li, Hailong Yang, Yi Liu, Zhongzhi Luan, Depei Qian

Currently, the DL compilers partition the input DL models into several subgraphs and leverage the auto-tuning to find the optimal tensor codes of these subgraphs.

PP-HumanSeg: Connectivity-Aware Portrait Segmentation with a Large-Scale Teleconferencing Video Dataset

1 code implementation14 Dec 2021 Lutao Chu, Yi Liu, Zewu Wu, Shiyu Tang, Guowei Chen, Yuying Hao, Juncai Peng, Zhiliang Yu, Zeyu Chen, Baohua Lai, Haoyi Xiong

This work is the first to construct a large-scale video portrait dataset that contains 291 videos from 23 conference scenes with 14K fine-labeled frames and extensions to multi-camera teleconferencing.

Portrait Segmentation Segmentation +1

Direct Training via Backpropagation for Ultra-low Latency Spiking Neural Networks with Multi-threshold

no code implementations25 Nov 2021 Changqing Xu, Yi Liu, YinTang Yang

In our proposed training method, we proposed three approximated derivative for spike activity to solve the problem of the non-differentiable issue which cause difficulties for direct training SNNs based on BP.

Damped Anderson Mixing for Deep Reinforcement Learning: Acceleration, Convergence, and Stabilization

no code implementations NeurIPS 2021 Ke Sun, Yafei Wang, Yi Liu, Yingnan Zhao, Bo Pan, Shangling Jui, Bei Jiang, Linglong Kong

Anderson mixing has been heuristically applied to reinforcement learning (RL) algorithms for accelerating convergence and improving the sampling efficiency of deep RL.

reinforcement-learning Reinforcement Learning (RL)

Locally Adaptive Structure and Texture Similarity for Image Quality Assessment

no code implementations16 Oct 2021 Keyan Ding, Yi Liu, Xueyi Zou, Shiqi Wang, Kede Ma

The latest advances in full-reference image quality assessment (IQA) involve unifying structure and texture similarity based on deep representations.

Image Quality Assessment Image Super-Resolution +1

Resource-constrained Federated Edge Learning with Heterogeneous Data: Formulation and Analysis

no code implementations14 Oct 2021 Yi Liu, Yuanshao Zhu, James J. Q. Yu

Similarly, due to the heterogeneity of the connected remote devices, FEEL faces the challenge of heterogeneous data and non-IID (Independent and Identically Distributed) data.

Binary Classification Ensemble Learning +1

Dyn-Backdoor: Backdoor Attack on Dynamic Link Prediction

no code implementations8 Oct 2021 Jinyin Chen, Haiyang Xiong, Haibin Zheng, Jian Zhang, Guodong Jiang, Yi Liu

Backdoor attacks induce the DLP methods to make wrong prediction by the malicious training data, i. e., generating a subgraph sequence as the trigger and embedding it to the training data.

Backdoor Attack Dynamic Link Prediction +1

Gaussian Differential Privacy Transformation: from identification to application

no code implementations29 Sep 2021 Yi Liu, Ke Sun, Bei Jiang, Linglong Kong

Gaussian differential privacy (GDP) is a single-parameter family of privacy notions that provides coherent guarantees to avoid the exposure of individuals from machine learning models.

Towards Understanding Distributional Reinforcement Learning: Regularization, Optimization, Acceleration and Sinkhorn Algorithm

no code implementations29 Sep 2021 Ke Sun, Yingnan Zhao, Yi Liu, Enze Shi, Yafei Wang, Aref Sadeghi, Xiaodong Yan, Bei Jiang, Linglong Kong

Distributional reinforcement learning~(RL) is a class of state-of-the-art algorithms that estimate the whole distribution of the total return rather than only its expectation.

Atari Games Distributional Reinforcement Learning +2

Exploring the Robustness of Distributional Reinforcement Learning against Noisy State Observations

no code implementations29 Sep 2021 Ke Sun, Yi Liu, Yingnan Zhao, Hengshuai Yao, Shangling Jui, Linglong Kong

In real scenarios, state observations that an agent observes may contain measurement errors or adversarial noises, misleading the agent to take suboptimal actions or even collapse while training.

Distributional Reinforcement Learning reinforcement-learning +1

BioCopy: A Plug-And-Play Span Copy Mechanism in Seq2Seq Models

no code implementations EMNLP (sustainlp) 2021 Yi Liu, Guoan Zhang, Puning Yu, Jianlin Su, Shengfeng Pan

Copy mechanisms explicitly obtain unchanged tokens from the source (input) sequence to generate the target (output) sequence under the neural seq2seq framework.

TAG

How Does Knowledge Graph Embedding Extrapolate to Unseen Data: A Semantic Evidence View

1 code implementation24 Sep 2021 Ren Li, Yanan Cao, Qiannan Zhu, Guanqun Bi, Fang Fang, Yi Liu, Qian Li

However, most existing KGE works focus on the design of delicate triple modeling function, which mainly tells us how to measure the plausibility of observed triples, but offers limited explanation of why the methods can extrapolate to unseen data, and what are the important factors to help KGE extrapolate.

Graph Neural Network Knowledge Graph Completion +2

BoA-PTA, A Bayesian Optimization Accelerated Error-Free SPICE Solver

no code implementations31 Jul 2021 Wei W. Xing, Xiang Jin, Yi Liu, Dan Niu, Weishen Zhao, Zhou Jin

One of the greatest challenges in IC design is the repeated executions of computationally expensive SPICE simulations, particularly when highly complex chip testing/verification is involved.

Bayesian Optimization Variational Inference

EGC2: Enhanced Graph Classification with Easy Graph Compression

1 code implementation16 Jul 2021 Jinyin Chen, Haiyang Xiong, Haibin Zhenga, Dunjie Zhang, Jian Zhang, Mingwei Jia, Yi Liu

To achieve lower-complexity defense applied to graph classification models, EGC2 utilizes a centrality-based edge-importance index to compress the graphs, filtering out trivial structures and adversarial perturbations in the input graphs, thus improving the model's robustness.

Graph Classification

A Map of Bandits for E-commerce

no code implementations1 Jul 2021 Yi Liu, Lihong Li

The rich body of Bandit literature not only offers a diverse toolbox of algorithms, but also makes it hard for a practitioner to find the right solution to solve the problem at hand.

Navigate

Mask-Embedded Discriminator With Region-Based Semantic Regularization for Semi-Supervised Class-Conditional Image Synthesis

no code implementations CVPR 2021 Yi Liu, Xiaoyang Huo, Tianyi Chen, Xiangping Zeng, Si Wu, Zhiwen Yu, Hau-San Wong

Semi-supervised generative learning (SSGL) makes use of unlabeled data to achieve a trade-off between the data collection/annotation effort and generation performance, when adequate labeled data are not available.

Generative Adversarial Network Image Generation

Optical Mouse: 3D Mouse Pose From Single-View Video

no code implementations17 Jun 2021 Bo Hu, Bryan Seybold, Shan Yang, David Ross, Avneesh Sud, Graham Ruby, Yi Liu

We present a method to infer the 3D pose of mice, including the limbs and feet, from monocular videos.

Machine Learning Regression based Single Event Transient Modeling Method for Circuit-Level Simulation

no code implementations22 May 2021 Changqing Xu, Yi Liu, XinFang Liao, JiaLiang Cheng, YinTang Yang

A multilayer feedfordward neural network is used to build the SET pulse current model by learning the data from TCAD simulation.

BIG-bench Machine Learning regression

Efficiently Solving High-Order and Nonlinear ODEs with Rational Fraction Polynomial: the Ratio Net

no code implementations18 May 2021 Chenxin Qin, Ruhao Liu, Maocai Li, Shengyuan Li, Yi Liu, ChiChun Zhou

The ratio net holds promise for advancing the efficiency and effectiveness of solving differential equations.

DIG: A Turnkey Library for Diving into Graph Deep Learning Research

1 code implementation23 Mar 2021 Meng Liu, Youzhi Luo, Limei Wang, Yaochen Xie, Hao Yuan, Shurui Gui, Haiyang Yu, Zhao Xu, Jingtun Zhang, Yi Liu, Keqiang Yan, Haoran Liu, Cong Fu, Bora Oztekin, Xuan Zhang, Shuiwang Ji

Although there exist several libraries for deep learning on graphs, they are aiming at implementing basic operations for graph deep learning.

Benchmarking Graph Generation +1

The ADENUIM Telescope- A new beam telescope for the DESY II Test Beam Facility

no code implementations22 Feb 2021 Yi Liu, Yao Teng, Chenfei Yang, Changqing Feng, Ingrid-Maria Gregor, Lennart Huth, Marcel Stanitzki

The coincident signal of all scintillators is used as trigger and then used as a trigger and distributed to the entire system, including all the telescope planes and any devices under test from test beam users.

Instrumentation and Detectors Instrumentation and Methods for Astrophysics High Energy Physics - Experiment

Spherical Message Passing for 3D Graph Networks

1 code implementation ICLR 2022 Yi Liu, Limei Wang, Meng Liu, Xuan Zhang, Bora Oztekin, Shuiwang Ji

Based on such observations, we propose the spherical message passing (SMP) as a novel and powerful scheme for 3D molecular learning.

Drug Discovery Representation Learning

PaddleSeg: A High-Efficient Development Toolkit for Image Segmentation

1 code implementation15 Jan 2021 Yi Liu, Lutao Chu, Guowei Chen, Zewu Wu, Zeyu Chen, Baohua Lai, Yuying Hao

The toolkit aims to help both developers and researchers in the whole process of designing segmentation models, training models, optimizing performance and inference speed, and deploying models.

Autonomous Driving Human Part Segmentation +5

A Multi-Stage Attentive Transfer Learning Framework for Improving COVID-19 Diagnosis

no code implementations14 Jan 2021 Yi Liu, Shuiwang Ji

The method is then integrated to the last stage of the proposed transfer learning framework to reuse the complex patterns learned from the same CT images.

Computed Tomography (CT) COVID-19 Diagnosis +3

CleftNet: Augmented Deep Learning for Synaptic Cleft Detection from Brain Electron Microscopy

no code implementations12 Jan 2021 Yi Liu, Shuiwang Ji

The effectiveness of our methods is evaluated on both online and offline tasks.

Social Media, Content Moderation, and Technology

no code implementations12 Jan 2021 Yi Liu, Pinar Yildirim, Z. John Zhang

This means that platforms under different revenue models can have different incentives to improve their content moderation technology.

Marketing

Semi-Supervised Single-Stage Controllable GANs for Conditional Fine-Grained Image Generation

no code implementations ICCV 2021 Tianyi Chen, Yi Liu, Yunfei Zhang, Si Wu, Yong Xu, Feng Liangbing, Hau San Wong

To ensure disentanglement among the variables, we maximize mutual information between the class-independent variable and synthesized images, map real images to the latent space of a generator to perform consistency regularization of cross-class attributes, and incorporate class semantic-based regularization into a discriminator's feature space.

Disentanglement Image Generation

Poisoning Semi-supervised Federated Learning via Unlabeled Data: Attacks and Defenses

no code implementations8 Dec 2020 Yi Liu, Xingliang Yuan, Ruihui Zhao, Cong Wang, Dusit Niyato, Yefeng Zheng

Extensive case studies have shown that our attacks are effective on different datasets and common semi-supervised learning methods.

Federated Learning Quantization

Towards Communication-efficient and Attack-Resistant Federated Edge Learning for Industrial Internet of Things

no code implementations8 Dec 2020 Yi Liu, Ruihui Zhao, Jiawen Kang, Abdulsalam Yassine, Dusit Niyato, Jialiang Peng

Second, we propose an asynchronous local differential privacy mechanism, which improves communication efficiency and mitigates gradient leakage attacks by adding well-designed noise to the gradients of edge nodes.

Edge-computing

A Systematic Literature Review on Federated Learning: From A Model Quality Perspective

no code implementations1 Dec 2020 Yi Liu, Li Zhang, Ning Ge, Guanghao Li

In this process, the server uses an incentive mechanism to encourage clients to contribute high-quality and large-volume data to improve the global model.

Federated Learning

Topology-Aware Graph Pooling Networks

no code implementations19 Oct 2020 Hongyang Gao, Yi Liu, Shuiwang Ji

In addition, graph topology is incorporated in global voting to compute the importance score of each node globally in the entire graph.

Graph Classification

Large-Scale Analysis of Iliopsoas Muscle Volumes in the UK Biobank

1 code implementation12 Aug 2020 Julie Fitzpatrick, Nicolas Basty, Madeleine Cule, Yi Liu, Jimmy D. Bell, E. Louise Thomas, Brandon Whitcher

We also found that iliopsoas volume was significantly related to height, BMI and age, and that there was an acceleration in muscle volume decrease in men with age.

Scalable and Communication-efficient Decentralized Federated Edge Learning with Multi-blockchain Framework

no code implementations10 Aug 2020 Jiawen Kang, Zehui Xiong, Chunxiao Jiang, Yi Liu, Song Guo, Yang Zhang, Dusit Niyato, Cyril Leung, Chunyan Miao

This framework can achieve scalable and flexible decentralized FEL by individually manage local model updates or model sharing records for performance isolation.

Cryptography and Security

PR-NN: RNN-based Detection for Coded Partial-Response Channels

2 code implementations30 Jul 2020 Simeng Zheng, Yi Liu, Paul H. Siegel

In this paper, we investigate the use of recurrent neural network (RNN)-based detection of magnetic recording channels with inter-symbol interference (ISI).

Federated Learning in the Sky: Aerial-Ground Air Quality Sensing Framework with UAV Swarms

no code implementations23 Jul 2020 Yi Liu, Jiangtian Nie, Xuandi Li, Syed Hassan Ahmed, Wei Yang Bryan Lim, Chunyan Miao

To this end, this paper proposes a new federated learning-based aerial-ground air quality sensing framework for fine-grained 3D air quality monitoring and forecasting.

Federated Learning

Deep Anomaly Detection for Time-series Data in Industrial IoT: A Communication-Efficient On-device Federated Learning Approach

no code implementations19 Jul 2020 Yi Liu, Sahil Garg, Jiangtian Nie, Yang Zhang, Zehui Xiong, Jiawen Kang, M. Shamim Hossain

Third, to adapt the proposed framework to the timeliness of industrial anomaly detection, we propose a gradient compression mechanism based on Top-\textit{k} selection to improve communication efficiency.

Anomaly Detection Federated Learning +2

Deep Learning of High-Order Interactions for Protein Interface Prediction

no code implementations18 Jul 2020 Yi Liu, Hao Yuan, Lei Cai, Shuiwang Ji

However, these methods do not incorporate the important sequential information from amino acid chains and the high-order pairwise interactions.

Protein Interface Prediction Vocal Bursts Intensity Prediction

Image Processing and Quality Control for Abdominal Magnetic Resonance Imaging in the UK Biobank

2 code implementations2 Jul 2020 Nicolas Basty, Yi Liu, Madeleine Cule, E. Louise Thomas, Jimmy D. Bell, Brandon Whitcher

An end-to-end image analysis pipeline is presented for the abdominal MRI protocol used in the UK Biobank on the first 38, 971 participants.