Search Results for author: Chenghao Li

Found 21 papers, 7 papers with code

A SAM-guided Two-stream Lightweight Model for Anomaly Detection

1 code implementation29 Feb 2024 Chenghao Li, Lei Qi, Xin Geng

In this paper, considering these two critical factors, we propose a SAM-guided Two-stream Lightweight Model for unsupervised anomaly detection (STLM) that not only aligns with the two practical application requirements but also harnesses the robust generalization capabilities of SAM.

Unsupervised Anomaly Detection

LKCA: Large Kernel Convolutional Attention

1 code implementation11 Jan 2024 Chenghao Li, Boheng Zeng, Yi Lu, Pengbo Shi, Qingzi Chen, Jirui Liu, Lingyun Zhu

We revisit the relationship between attention mechanisms and large kernel ConvNets in visual transformers and propose a new spatial attention named Large Kernel Convolutional Attention (LKCA).

Large Scale Training of Graph Neural Networks for Optimal Markov-Chain Partitioning Using the Kemeny Constant

no code implementations22 Dec 2023 Sam Alexander Martino, João Morado, Chenghao Li, Zhenghao Lu, Edina Rosta

In this work, we propose several GNN-based architectures to tackle the graph partitioning problem for Markov Chains described as kinetic networks.

Clustering graph partitioning

Mitigate Replication and Copying in Diffusion Models with Generalized Caption and Dual Fusion Enhancement

1 code implementation13 Sep 2023 Chenghao Li, Dake Chen, Yuke Zhang, Peter A. Beerel

While diffusion models demonstrate a remarkable capability for generating high-quality images, their tendency to `replicate' training data raises privacy concerns.

Language Modelling Large Language Model

Toward a Deeper Understanding: RetNet Viewed through Convolution

1 code implementation11 Sep 2023 Chenghao Li, Chaoning Zhang

A straightforward way to locally adapt the self-attention matrix can be realized by an element-wise learnable weight mask (ELM), for which our preliminary results show promising results.

Language Modelling

Never Explore Repeatedly in Multi-Agent Reinforcement Learning

no code implementations19 Aug 2023 Chenghao Li, Tonghan Wang, Chongjie Zhang, Qianchuan Zhao

In the realm of multi-agent reinforcement learning, intrinsic motivations have emerged as a pivotal tool for exploration.

Multi-agent Reinforcement Learning reinforcement-learning +2

Learning Diverse Risk Preferences in Population-based Self-play

1 code implementation19 May 2023 Yuhua Jiang, Qihan Liu, Xiaoteng Ma, Chenghao Li, Yiqin Yang, Jun Yang, Bin Liang, Qianchuan Zhao

In this paper, we aim to introduce diversity from the perspective that agents could have diverse risk preferences in the face of uncertainty.

reinforcement-learning Reinforcement Learning (RL)

Generative AI meets 3D: A Survey on Text-to-3D in AIGC Era

no code implementations10 May 2023 Chenghao Li, Chaoning Zhang, Atish Waghwase, Lik-Hang Lee, Francois Rameau, Yang Yang, Sung-Ho Bae, Choong Seon Hong

AI generated content) has made remarkable progress in the past few years, among which text-guided content generation is the most practical one since it enables the interaction between human instruction and AIGC.

Scene Generation Text to 3D +1

When ChatGPT for Computer Vision Will Come? From 2D to 3D

no code implementations10 May 2023 Chenghao Li, Chaoning Zhang

On top of that, this work presents an outlook on the development of AIGC in 3D from the data perspective.

SAL-ViT: Towards Latency Efficient Private Inference on ViT using Selective Attention Search with a Learnable Softmax Approximation

no code implementations ICCV 2023 Yuke Zhang, Dake Chen, Souvik Kundu, Chenghao Li, Peter A. Beerel

Then, given our observation that external attention (EA) presents lower PI latency than widely-adopted self-attention (SA) at the cost of accuracy, we present a selective attention search (SAS) method to integrate the strength of EA and SA.

Modeling the Interaction between Agents in Cooperative Multi-Agent Reinforcement Learning

no code implementations10 Feb 2021 Xiaoteng Ma, Yiqin Yang, Chenghao Li, Yiwen Lu, Qianchuan Zhao, Yang Jun

Value-based methods of multi-agent reinforcement learning (MARL), especially the value decomposition methods, have been demonstrated on a range of challenging cooperative tasks.

Continuous Control Multi-agent Reinforcement Learning +2

A Multitask Deep Learning Approach for User Depression Detection on Sina Weibo

no code implementations26 Aug 2020 Yiding Wang, Zhenyi Wang, Chenghao Li, Yilin Zhang, Haizhou Wang

In recent years, due to the mental burden of depression, the number of people who endanger their lives has been increasing rapidly.

Classification Depression Detection +2

SOAC: The Soft Option Actor-Critic Architecture

no code implementations25 Jun 2020 Chenghao Li, Xiaoteng Ma, Chongjie Zhang, Jun Yang, Li Xia, Qianchuan Zhao

In these tasks, our approach learns a diverse set of options, each of whose state-action space has strong coherence.

Transfer Learning

Cannot find the paper you are looking for? You can Submit a new open access paper.