Search Results for author: Wei Wang

Found 536 papers, 173 papers with code

PALM: Pre-training an Autoencoding\&Autoregressive Language Model for Context-conditioned Generation

no code implementations EMNLP 2020 Bin Bi, Chenliang Li, Chen Wu, Ming Yan, Wei Wang, Songfang Huang, Fei Huang, Luo Si

An extensive set of experiments show that PALM achieves new state-of-the-art results on a variety of language generation benchmarks covering generative question answering (Rank 1 on the official MARCO leaderboard), abstractive summarization on CNN/DailyMail as well as Gigaword, question generation on SQuAD, and conversational response generation on Cornell Movie Dialogues.

Abstractive Text Summarization Conversational Response Generation +8

A Bayesian Topic Model for Human-Evaluated Interpretability

no code implementations LREC 2022 Justin Wood, Corey Arnold, Wei Wang

Given a nonparametric topic model, we can include weakly-supervised input using novel modifications to the nonparametric generative model.

Topic Models

High-content stimulated Raman histology of human breast cancer

no code implementations20 Sep 2023 Hongli Ni, Chinmayee Prabhu Dessai, Haonan Lin, Wei Wang, Shaoxiong Chen, Yuhao Yuan, Xiaowei Ge, Jianpeng Ao, Nolan Vild, Ji-Xin Cheng

Here, we present a high-content stimulated Raman histology (HC-SRH) platform that provides both morphological and chemical information for cancer diagnosis based on un-stained breast tissues.

Neural Image Compression Using Masked Sparse Visual Representation

no code implementations20 Sep 2023 Wei Jiang, Wei Wang, Yue Chen

A set of semantic-class-dependent basis codebooks are learned, which are weighted combined to generate a rich latent feature for high-quality reconstruction.

Image Compression

Unveiling Invariances via Neural Network Pruning

no code implementations15 Sep 2023 Derek Xu, Yizhou Sun, Wei Wang

Invariance describes transformations that do not alter data's underlying semantics.

Network Pruning

A DRL-based Reflection Enhancement Method for RIS-assisted Multi-receiver Communications

no code implementations11 Sep 2023 Wei Wang, Peizheng Li, Angela Doufexi, Mark A Beach

In reconfigurable intelligent surface (RIS)-assisted wireless communication systems, the pointing accuracy and intensity of reflections depend crucially on the 'profile,' representing the amplitude/phase state information of all elements in a RIS array.

Mean Field Game-based Waveform Precoding Design for Mobile Crowd Integrated Sensing, Communication, and Computation Systems

no code implementations6 Sep 2023 Dezhi Wang, Chongwen Huang, Jiguang He, Xiaoming Chen, Wei Wang, Zhaoyang Zhang, Zhu Han, Mérouane Debbah

In this paper, we consider the environment sensing problem in the large-scale mobile crowd ISCC systems and propose an efficient waveform precoding design algorithm based on the mean field game~(MFG).

MathAttack: Attacking Large Language Models Towards Math Solving Ability

no code implementations4 Sep 2023 ZiHao Zhou, Qiufeng Wang, Mingyu Jin, Jie Yao, Jianan Ye, Wei Liu, Wei Wang, Xiaowei Huang, Kaizhu Huang

Instead of attacking prompts in the use of LLMs, we propose a MathAttack model to attack MWP samples which are closer to the essence of security in solving math problems.

Adversarial Attack GSM8K

DALNet: A Rail Detection Network Based on Dynamic Anchor Line

1 code implementation22 Aug 2023 Zichen Yu, Quanli Liu, Wei Wang, Liyong Zhang, Xiaoguang Zhao

In the paper, motivated by the anchor line-based lane detection methods, we propose a rail detection network called DALNet based on dynamic anchor line.

Lane Detection

Multi-scale Target-Aware Framework for Constrained Image Splicing Detection and Localization

no code implementations18 Aug 2023 Yuxuan Tan, Yuanman Li, Limin Zeng, Jiaxiong Ye, Wei Wang, Xia Li

Additionally, in order to handle scale transformations, we introduce a multi-scale projection method, which can be readily integrated into our target-aware framework that enables the attention process to be conducted between tokens containing information of varying scales.

Artificial Intelligence for Web 3.0: A Comprehensive Survey

no code implementations17 Aug 2023 Meng Shen, Zhehui Tan, Dusit Niyato, Yuzhi Liu, Jiawen Kang, Zehui Xiong, Liehuang Zhu, Wei Wang, Xuemin, Shen

Then, we thoroughly analyze the current state of AI technology applications in the four layers of Web 3. 0 and offer some insights into its potential future development direction.


D-IF: Uncertainty-aware Human Digitization via Implicit Distribution Field

1 code implementation ICCV 2023 Xueting Yang, Yihao Luo, Yuliang Xiu, Wei Wang, Hao Xu, Zhaoxin Fan

In this paper, we propose replacing the implicit value with an adaptive uncertainty distribution, to differentiate between points based on their distance to the surface.

KnowledGPT: Enhancing Large Language Models with Retrieval and Storage Access on Knowledge Bases

no code implementations17 Aug 2023 Xintao Wang, Qianwen Yang, Yongting Qiu, Jiaqing Liang, Qianyu He, Zhouhong Gu, Yanghua Xiao, Wei Wang

Large language models (LLMs) have demonstrated impressive impact in the field of natural language processing, but they still struggle with several issues regarding, such as completeness, timeliness, faithfulness and adaptability.


Learning A Coarse-to-Fine Diffusion Transformer for Image Restoration

1 code implementation17 Aug 2023 Liyan Wang, Qinyu Yang, Cong Wang, Wei Wang, Jinshan Pan, Zhixun Su

Specifically, our C2F-DFT contains diffusion self-attention (DFSA) and diffusion feed-forward network (DFN) within a new coarse-to-fine training scheme.

Deblurring Denoising +3

Routing Recovery for UAV Networks with Deliberate Attacks: A Reinforcement Learning based Approach

no code implementations14 Aug 2023 Sijie He, Ziye Jia, Chao Dong, Wei Wang, Yilu Cao, Yang Yang, Qihui Wu

The unmanned aerial vehicle (UAV) network is popular these years due to its various applications.

From Generation to Suppression: Towards Effective Irregular Glow Removal for Nighttime Visibility Enhancement

no code implementations31 Jul 2023 Wanyu Wu, Wei Wang, Zheng Wang, Kui Jiang, Xin Xu

Most existing Low-Light Image Enhancement (LLIE) methods are primarily designed to improve brightness in dark regions, which suffer from severe degradation in nighttime images.

Low-Light Image Enhancement Zero-Shot Learning

Unsupervised Decomposition Networks for Bias Field Correction in MR Image

1 code implementation30 Jul 2023 Dong Liang, Xingyu Qiu, Kuanquan Wang, Gongning Luo, Wei Wang, Yashu Liu

Many retrospective algorithms were developed to facilitate the bias correction, to which the deep learning-based methods outperformed.

Image Segmentation Semantic Segmentation

BotHawk: An Approach for Bots Detection in Open Source Software Projects

1 code implementation25 Jul 2023 Fenglin Bi, Zhiwei Zhu, Wei Wang, Xiaoya Xia, Hassan Ali Khan, Peng Pu

Identifying bot accounts and behavior is a challenging task in the OSS project.

Refining the Optimization Target for Automatic Univariate Time Series Anomaly Detection in Monitoring Services

no code implementations20 Jul 2023 Manqing Dong, Zhanxiang Zhao, Yitong Geng, Wentao Li, Wei Wang, Huai Jiang

Time series anomaly detection is crucial for industrial monitoring services that handle a large volume of data, aiming to ensure reliability and optimize system performance.

Anomaly Detection Time Series +1

Householder Projector for Unsupervised Latent Semantics Discovery

1 code implementation ICCV 2023 Yue Song, Jichao Zhang, Nicu Sebe, Wei Wang

Generative Adversarial Networks (GANs), especially the recent style-based generators (StyleGANs), have versatile semantics in the structured latent space.

Generalizing Graph ODE for Learning Complex System Dynamics across Environments

no code implementations10 Jul 2023 Zijie Huang, Yizhou Sun, Wei Wang

In practice, however, we might observe multiple systems that are generated across different environments, which differ in latent exogenous factors such as temperature and gravity.

Contrastive Learning Physical Simulations

Coordinating Multiple Resources for Optimal Postdisaster Operation of Interdependent Electric Power and Natural Gas Distribution Systems

no code implementations28 Jun 2023 Wei Wang, Kaigui Xie, Hongbin Wang, Xingzhe Hou, Tao Chen, Hongzhou Chen, Yufei He

Specifically, 1) on the supply side, the fuel supply issue of different types of generators for emergency use is considered and the fuel delivery process among different fuel facilities is mathematically formulated; 2) on the demand side, a zonewise method is proposed for integrated dispatch of power and gas demand responses; and 3) in the repair process, a varying efficiency related to the repair units at work is introduced to accurately model repairs.

AOG-LSTM: An adaptive attention neural network for visual storytelling

no code implementations Neurocomputing 2023 Hanqing Liu, Jiacheng Yang, Chia-Hao Chang, Wei Wang, Hai-Tao Zheng, Yong Jiang, Hui Wang, Rui Xie, and Wei Wu

Moreover, the existing method of alleviating error accumulation based on replacing reference words does not take into account the different effects of each word.

Visual Storytelling

Leveraging Brain Modularity Prior for Interpretable Representation Learning of fMRI

no code implementations24 Jun 2023 Qianqian Wang, Wei Wang, Yuqi Fang, P. -T. Yap, Hongtu Zhu, Hong-Jun Li, Lishan Qiao, Mingxia Liu

Resting-state functional magnetic resonance imaging (rs-fMRI) can reflect spontaneous neural activities in brain and is widely used for brain disorder analysis. Previous studies propose to extract fMRI representations through diverse machine/deep learning methods for subsequent analysis.

graph construction Graph Learning +1

Learning by Analogy: Diverse Questions Generation in Math Word Problem

1 code implementation15 Jun 2023 ZiHao Zhou, Maizhen Ning, Qiufeng Wang, Jie Yao, Wei Wang, Xiaowei Huang, Kaizhu Huang

We then feed them to a question generator together with the scenario to obtain the corresponding diverse questions, forming a new MWP with a variety of questions and equations.

Shuffled Autoregression For Motion Interpolation

no code implementations10 Jun 2023 Shuo Huang, Jia Jia, Zongxin Yang, Wei Wang, Haozhe Wu, Yi Yang, Junliang Xing

However, motion interpolation is a more complex problem that takes isolated poses (e. g., only one start pose and one end pose) as input.

Motion Interpolation

Gotta: Generative Few-shot Question Answering by Prompt-based Cloze Data Augmentation

1 code implementation7 Jun 2023 Xiusi Chen, Yu Zhang, Jinliang Deng, Jyun-Yu Jiang, Wei Wang

Few-shot question answering (QA) aims at precisely discovering answers to a set of questions from context passages while only a few training samples are available.

Data Augmentation Question Answering

Professional Basketball Player Behavior Synthesis via Planning with Diffusion

no code implementations7 Jun 2023 Xiusi Chen, Wei-Yao Wang, Ziniu Hu, Curtis Chou, Lam Hoang, Kun Jin, Mingyan Liu, P. Jeffrey Brantingham, Wei Wang

To accomplish reward-guided trajectory generation, conditional sampling is introduced to condition the diffusion model on the value function and conduct classifier-guided sampling.

Decision Making

Can Directed Graph Neural Networks be Adversarially Robust?

no code implementations3 Jun 2023 Zhichao Hou, Xitong Zhang, Wei Wang, Charu C. Aggarwal, Xiaorui Liu

This work presents the first investigation into the robustness of GNNs in the context of directed graphs, aiming to harness the profound trust implications offered by directed graphs to bolster the robustness and resilience of GNNs.

CAROM Air -- Vehicle Localization and Traffic Scene Reconstruction from Aerial Videos

no code implementations31 May 2023 Duo Lu, Eric Eaton, Matt Weg, Wei Wang, Steven Como, Jeffrey Wishart, Hongbin Yu, Yezhou Yang

Road traffic scene reconstruction from videos has been desirable by road safety regulators, city planners, researchers, and autonomous driving technology developers.

Autonomous Driving

Universality and Limitations of Prompt Tuning

no code implementations30 May 2023 Yihan Wang, Jatin Chauhan, Wei Wang, Cho-Jui Hsieh

The limitations of prompt tuning for limited-depth transformers are first proved by constructing a set of datasets, that cannot be memorized by a prompt of any length for a given single encoder layer.

Language Modelling

TLNets: Transformation Learning Networks for long-range time-series prediction

1 code implementation25 May 2023 Wei Wang, Yang Liu, Hao Sun

Note that the FT and SVD blocks are capable of learning global information, while the Conv blocks focus on learning local information.

Time Series Time Series Forecasting +1

Exploiting Correlations Between Contexts and Definitions with Multiple Definition Modeling

no code implementations24 May 2023 Linhan Zhang, Qian Chen, Wen Wang, Yuxin Jiang, Bing Li, Wei Wang, Xin Cao

In this paper, we carefully design a new task called Multiple Definition Modeling (MDM) that pool together all contexts and definition of target words.

STAR: Boosting Low-Resource Event Extraction by Structure-to-Text Data Generation with Large Language Models

no code implementations24 May 2023 Mingyu Derek Ma, Xiaoxuan Wang, Po-Nien Kung, P. Jeffrey Brantingham, Nanyun Peng, Wei Wang

Structure prediction tasks such as event extraction require an in-depth understanding of the output structure and sub-task dependencies, thus they still heavily rely on task-specific training data to obtain reasonable performance.

Event Extraction

Lion: Adversarial Distillation of Closed-Source Large Language Model

1 code implementation22 May 2023 Yuxin Jiang, Chunkit Chan, Mingyang Chen, Wei Wang

The practice of transferring knowledge from a sophisticated, closed-source large language model (LLM) to a compact, open-source LLM has garnered considerable attention.

Instruction Following Knowledge Distillation +3

Whisper-KDQ: A Lightweight Whisper via Guided Knowledge Distillation and Quantization for Efficient ASR

no code implementations18 May 2023 Hang Shao, Wei Wang, Bei Liu, Xun Gong, Haoyu Wang, Yanmin Qian

Due to the rapid development of computing hardware resources and the dramatic growth of data, pre-trained models in speech recognition, such as Whisper, have significantly improved the performance of speech recognition tasks.

Knowledge Distillation Quantization +2

Self-Supervised Learning for Point Clouds Data: A Survey

no code implementations9 May 2023 Changyu Zeng, Wei Wang, Anh Nguyen, Yutao Yue

We first present an innovative taxonomy, categorizing the existing SSL methods into four broad categories based on the pretexts' characteristics.

Pedestrian Detection Self-Supervised Learning

Sparsity-Aware Optimal Transport for Unsupervised Restoration Learning

no code implementations29 Apr 2023 Fei Wen, Wei Wang, Wenxian Yu

Recent studies show that, without any prior model, the unsupervised restoration learning problem can be optimally formulated as an optimal transport (OT) problem, which has shown promising performance on denoising tasks to approach the performance of supervised methods.

Denoising Rain Removal +1

Binary stochasticity enabled highly efficient neuromorphic deep learning achieves better-than-software accuracy

no code implementations25 Apr 2023 Yang Li, Wei Wang, Ming Wang, Chunmeng Dou, Zhengyu Ma, Huihui Zhou, Peng Zhang, Nicola Lepri, Xumeng Zhang, Qing Luo, Xiaoxin Xu, Guanhua Yang, Feng Zhang, Ling Li, Daniele Ielmini, Ming Liu

We propose a binary stochastic learning algorithm that modifies all elementary neural network operations, by introducing (i) stochastic binarization of both the forwarding signals and the activation function derivatives, (ii) signed binarization of the backpropagating errors, and (iii) step-wised weight updates.


Bi-Level Attention Graph Neural Networks

1 code implementation23 Apr 2023 Roshni G. Iyer, Wei Wang, Yizhou Sun

Recent graph neural networks (GNNs) with the attention mechanism have historically been limited to small-scale homogeneous graphs (HoGs).

Graph Attention

Dehazing-NeRF: Neural Radiance Fields from Hazy Images

no code implementations22 Apr 2023 Tian Li, Lu Li, Wei Wang, Zhangchi Feng

Our method simulates the physical imaging process of hazy images using an atmospheric scattering model, and jointly learns the atmospheric scattering model and a clean NeRF model for both image dehazing and novel view synthesis.

3D Scene Reconstruction Image Dehazing +3

Collaborative Feature Learning for Fine-grained Facial Forgery Detection and Segmentation

no code implementations17 Apr 2023 Weinan Guan, Wei Wang, Jing Dong, Bo Peng, Tieniu Tan

An important topic in manipulation detection is the localization of the fake regions.

ChatPLUG: Open-Domain Generative Dialogue System with Internet-Augmented Instruction Tuning for Digital Human

1 code implementation16 Apr 2023 Junfeng Tian, Hehong Chen, Guohai Xu, Ming Yan, Xing Gao, Jianhai Zhang, Chenliang Li, Jiayi Liu, Wenshen Xu, Haiyang Xu, Qi Qian, Wei Wang, Qinghao Ye, Jiejing Zhang, Ji Zhang, Fei Huang, Jingren Zhou

In this paper, we present ChatPLUG, a Chinese open-domain dialogue system for digital human applications that instruction finetunes on a wide range of dialogue tasks in a unified internet-augmented format.

RRHF: Rank Responses to Align Language Models with Human Feedback without tears

1 code implementation11 Apr 2023 Zheng Yuan, Hongyi Yuan, Chuanqi Tan, Wei Wang, Songfang Huang, Fei Huang

Reinforcement Learning from Human Feedback (RLHF) facilitates the alignment of large language models with human preferences, significantly enhancing the quality of interactions between humans and these models.

Language Modelling

InfluencerRank: Discovering Effective Influencers via Graph Convolutional Attentive Recurrent Neural Networks

no code implementations4 Apr 2023 Seungbae Kim, Jyun-Yu Jiang, Jinyoung Han, Wei Wang

In this paper, we propose InfluencerRank that ranks influencers by their effectiveness based on their posting behaviors and social relations over time.


PPG-based Heart Rate Estimation with Efficient Sensor Sampling and Learning Models

no code implementations23 Mar 2023 Yuntong Zhang, Jingye Xu, Mimi Xie, Wei Wang, Keying Ye, Jing Wang, Dakai Zhu

Moreover, our analysis showed that DT models with 10 to 20 input features usually have good accuracy, while are several magnitude smaller in model sizes and faster in inference time.

Heart rate estimation

W2KPE: Keyphrase Extraction with Word-Word Relation

no code implementations22 Mar 2023 Wen Cheng, Shichen Dong, Wei Wang

This paper describes our submission to ICASSP 2023 MUG Challenge Track 4, Keyphrase Extraction, which aims to extract keyphrases most relevant to the conference theme from conference materials.

Keyphrase Extraction named-entity-recognition +1

NLUT: Neural-based 3D Lookup Tables for Video Photorealistic Style Transfer

1 code implementation16 Mar 2023 Yaosen Chen, Han Yang, Yuexin Yang, Yuegen Liu, Wei Wang, Xuming Wen, Chaoping Xie

However, existing methods obtain stylized video sequences by performing frame-by-frame photorealistic style transfer, which is inefficient and does not ensure the temporal consistency of the stylized video.

Style Transfer

How well do Large Language Models perform in Arithmetic tasks?

1 code implementation16 Mar 2023 Zheng Yuan, Hongyi Yuan, Chuanqi Tan, Wei Wang, Songfang Huang

Large language models have emerged abilities including chain-of-thought to answer math word problems step by step.

Enhancing Text Generation with Cooperative Training

1 code implementation16 Mar 2023 Tong Wu, Hao Wang, Zhongshen Zeng, Wei Wang, Hai-Tao Zheng, Jiaxing Zhang

Recently, there has been a surge in the use of generated data to enhance the performance of downstream models, largely due to the advancements in pre-trained language models.


RiDDLE: Reversible and Diversified De-identification with Latent Encryptor

1 code implementation CVPR 2023 Dongze Li, Wei Wang, Kang Zhao, Jing Dong, Tieniu Tan

This work presents RiDDLE, short for Reversible and Diversified De-identification with Latent Encryptor, to protect the identity information of people from being misused.


Toward Polar Sea-Ice Classification using Color-based Segmentation and Auto-labeling of Sentinel-2 Imagery to Train an Efficient Deep Learning Model

no code implementations8 Mar 2023 Jurdana Masuma Iqrah, Younghyun Koo, Wei Wang, Hongjie Xie, Sushil Prasad

Global warming is an urgent issue that is generating catastrophic environmental changes, such as the melting of sea ice and glaciers, particularly in the polar regions.

Weighted Sampling for Masked Language Modeling

no code implementations28 Feb 2023 Linhan Zhang, Qian Chen, Wen Wang, Chong Deng, Xin Cao, Kongzhang Hao, Yuxin Jiang, Wei Wang

Experiments on the Semantic Textual Similarity benchmark (STS) show that WSBERT significantly improves sentence embeddings over BERT.

Language Modelling Masked Language Modeling +4

LSR: A Light-Weight Super-Resolution Method

no code implementations27 Feb 2023 Wei Wang, Xuejing Lei, Yueru Chen, Ming-Sui Lee, C. -C. Jay Kuo

A light-weight super-resolution (LSR) method from a single image targeting mobile applications is proposed in this work.

SSIM Super-Resolution

DeAR: Accelerating Distributed Deep Learning with Fine-Grained All-Reduce Pipelining

1 code implementation24 Feb 2023 Lin Zhang, Shaohuai Shi, Xiaowen Chu, Wei Wang, Bo Li, Chengjian Liu

Communication scheduling has been shown to be effective in accelerating distributed training, which enables all-reduce communications to be overlapped with backpropagation computations.


Theoretical Evaluation of the Capacity-Achieving Distribution for IM-DD Fiber-Optic Channels

no code implementations23 Feb 2023 Dongdong Zou, Wei Wang, Sui Qi, Fan Li, Zhaohui Li

For the IM-DD system under peak power constraint (PPC), a dynamic-assignment BA algorithm is applied to find the capacity-achieving distribution with minimum cardinality.

Designing a 3D-Aware StyleNeRF Encoder for Face Editing

no code implementations19 Feb 2023 Songlin Yang, Wei Wang, Bo Peng, Jing Dong

For more flexible face manipulation, we then design a dual-branch StyleFlow module to transfer the StyleNeRF codes with disentangled geometry and texture flows.

Face Model Video Editing

Linear-scaling kernels for protein sequences and small molecules outperform deep learning while providing uncertainty quantitation and improved interpretability

2 code implementations7 Feb 2023 Jonathan Parkinson, Wei Wang

We compare the performance of xGPR with the reported performance of various deep learning models on 20 benchmarks, including small molecule, protein sequence and tabular data.

Data Visualization Drug Discovery +2

Molecular Geometry-aware Transformer for accurate 3D Atomic System modeling

no code implementations2 Feb 2023 Zheng Yuan, Yaoyun Zhang, Chuanqi Tan, Wei Wang, Fei Huang, Songfang Huang

To alleviate this limitation, we propose Moleformer, a novel Transformer architecture that takes nodes (atoms) and edges (bonds and nonbonding atom pairs) as inputs and models the interactions among them using rotational and translational invariant geometry-aware spatial encoding.

Initial Structure to Relaxed Energy (IS2RE), Direct

mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video

4 code implementations1 Feb 2023 Haiyang Xu, Qinghao Ye, Ming Yan, Yaya Shi, Jiabo Ye, Yuanhong Xu, Chenliang Li, Bin Bi, Qi Qian, Wei Wang, Guohai Xu, Ji Zhang, Songfang Huang, Fei Huang, Jingren Zhou

In contrast to predominant paradigms of solely relying on sequence-to-sequence generation or encoder-based instance discrimination, mPLUG-2 introduces a multi-module composition network by sharing common universal modules for modality collaboration and disentangling different modality modules to deal with modality entanglement.

Action Classification Image Classification +7

Foresee What You Will Learn: Data Augmentation for Domain Generalization in Non-stationary Environment

1 code implementation19 Jan 2023 Qiuhao Zeng, Wei Wang, Fan Zhou, Charles Ling, Boyu Wang

In this paper, we formulate such problems as Evolving Domain Generalization, where a model aims to generalize well on a target domain by discovering and leveraging the evolving pattern of the environment.

Data Augmentation Evolving Domain Generalization +1

VQNet 2.0: A New Generation Machine Learning Framework that Unifies Classical and Quantum

no code implementations9 Jan 2023 Huanyu Bian, Zhilong Jia, Menghan Dou, Yuan Fang, Lei LI, Yiming Zhao, Hanchao Wang, Zhaohui Zhou, Wei Wang, Wenyu Zhu, Ye Li, Yang Yang, Weiming Zhang, Nenghai Yu, Zhaoyun Chen, Guoping Guo

Therefore, based on VQNet 1. 0, we further propose VQNet 2. 0, a new generation of unified classical and quantum machine learning framework that supports hybrid optimization.

Quantum Machine Learning Unity

Bidirectional Alignment for Domain Adaptive Detection with Transformers

no code implementations ICCV 2023 Liqiang He, Wei Wang, Albert Chen, Min Sun, Cheng-Hao Kuo, Sinisa Todorovic

We propose a Bidirectional Alignment for domain adaptive Detection with Transformers (BiADT) to improve cross domain object detection performance.

object-detection Object Detection

Joint Beamforming Design for Dual-Functional MIMO Radar and Communication Systems Guaranteeing Physical Layer Security

no code implementations1 Jan 2023 Fuwang Dong, Wei Wang, Xin Li, Fan Liu, Sheng Chen, Lajos Hanzo

The dual-functional radar and communication (DFRC) technique constitutes a promising next-generation wireless solution, due to its benefits in terms of power consumption, physical hardware, and spectrum exploitation.

Boosting Accuracy and Robustness of Student Models via Adaptive Adversarial Distillation

1 code implementation CVPR 2023 Bo Huang, Mingyang Chen, Yi Wang, Junda Lu, Minhao Cheng, Wei Wang

Thus, recent studies concern about adversarial distillation (AD) that aims to inherit not only prediction accuracy but also adversarial robustness of a robust teacher model under the paradigm of robust optimization.

Adversarial Robustness Knowledge Distillation

Biomedical image analysis competitions: The state of current participation practice

no code implementations16 Dec 2022 Matthias Eisenmann, Annika Reinke, Vivienn Weru, Minu Dietlinde Tizabi, Fabian Isensee, Tim J. Adler, Patrick Godau, Veronika Cheplygina, Michal Kozubek, Sharib Ali, Anubha Gupta, Jan Kybic, Alison Noble, Carlos Ortiz de Solórzano, Samiksha Pachade, Caroline Petitjean, Daniel Sage, Donglai Wei, Elizabeth Wilden, Deepak Alapatt, Vincent Andrearczyk, Ujjwal Baid, Spyridon Bakas, Niranjan Balu, Sophia Bano, Vivek Singh Bawa, Jorge Bernal, Sebastian Bodenstedt, Alessandro Casella, Jinwook Choi, Olivier Commowick, Marie Daum, Adrien Depeursinge, Reuben Dorent, Jan Egger, Hannah Eichhorn, Sandy Engelhardt, Melanie Ganz, Gabriel Girard, Lasse Hansen, Mattias Heinrich, Nicholas Heller, Alessa Hering, Arnaud Huaulmé, Hyunjeong Kim, Bennett Landman, Hongwei Bran Li, Jianning Li, Jun Ma, Anne Martel, Carlos Martín-Isla, Bjoern Menze, Chinedu Innocent Nwoye, Valentin Oreiller, Nicolas Padoy, Sarthak Pati, Kelly Payette, Carole Sudre, Kimberlin Van Wijnen, Armine Vardazaryan, Tom Vercauteren, Martin Wagner, Chuanbo Wang, Moi Hoon Yap, Zeyun Yu, Chun Yuan, Maximilian Zenk, Aneeq Zia, David Zimmerer, Rina Bao, Chanyeol Choi, Andrew Cohen, Oleh Dzyubachyk, Adrian Galdran, Tianyuan Gan, Tianqi Guo, Pradyumna Gupta, Mahmood Haithami, Edward Ho, Ikbeom Jang, Zhili Li, Zhengbo Luo, Filip Lux, Sokratis Makrogiannis, Dominik Müller, Young-tack Oh, Subeen Pang, Constantin Pape, Gorkem Polat, Charlotte Rosalie Reed, Kanghyun Ryu, Tim Scherr, Vajira Thambawita, Haoyu Wang, Xinliang Wang, Kele Xu, Hung Yeh, Doyeob Yeo, Yixuan Yuan, Yan Zeng, Xin Zhao, Julian Abbing, Jannes Adam, Nagesh Adluru, Niklas Agethen, Salman Ahmed, Yasmina Al Khalil, Mireia Alenyà, Esa Alhoniemi, Chengyang An, Talha Anwar, Tewodros Weldebirhan Arega, Netanell Avisdris, Dogu Baran Aydogan, Yingbin Bai, Maria Baldeon Calisto, Berke Doga Basaran, Marcel Beetz, Cheng Bian, Hao Bian, Kevin Blansit, Louise Bloch, Robert Bohnsack, Sara Bosticardo, Jack Breen, Mikael Brudfors, Raphael Brüngel, Mariano Cabezas, Alberto Cacciola, Zhiwei Chen, Yucong Chen, Daniel Tianming Chen, Minjeong Cho, Min-Kook Choi, Chuantao Xie Chuantao Xie, Dana Cobzas, Julien Cohen-Adad, Jorge Corral Acero, Sujit Kumar Das, Marcela de Oliveira, Hanqiu Deng, Guiming Dong, Lars Doorenbos, Cory Efird, Sergio Escalera, Di Fan, Mehdi Fatan Serj, Alexandre Fenneteau, Lucas Fidon, Patryk Filipiak, René Finzel, Nuno R. Freitas, Christoph M. Friedrich, Mitchell Fulton, Finn Gaida, Francesco Galati, Christoforos Galazis, Chang Hee Gan, Zheyao Gao, Shengbo Gao, Matej Gazda, Beerend Gerats, Neil Getty, Adam Gibicar, Ryan Gifford, Sajan Gohil, Maria Grammatikopoulou, Daniel Grzech, Orhun Güley, Timo Günnemann, Chunxu Guo, Sylvain Guy, Heonjin Ha, Luyi Han, Il Song Han, Ali Hatamizadeh, Tian He, Jimin Heo, Sebastian Hitziger, SeulGi Hong, Seungbum Hong, Rian Huang, Ziyan Huang, Markus Huellebrand, Stephan Huschauer, Mustaffa Hussain, Tomoo Inubushi, Ece Isik Polat, Mojtaba Jafaritadi, SeongHun Jeong, Bailiang Jian, Yuanhong Jiang, Zhifan Jiang, Yueming Jin, Smriti Joshi, Abdolrahim Kadkhodamohammadi, Reda Abdellah Kamraoui, Inha Kang, Junghwa Kang, Davood Karimi, April Khademi, Muhammad Irfan Khan, Suleiman A. Khan, Rishab Khantwal, Kwang-Ju Kim, Timothy Kline, Satoshi Kondo, Elina Kontio, Adrian Krenzer, Artem Kroviakov, Hugo Kuijf, Satyadwyoom Kumar, Francesco La Rosa, Abhi Lad, Doohee Lee, Minho Lee, Chiara Lena, Hao Li, Ling Li, Xingyu Li, Fuyuan Liao, Kuanlun Liao, Arlindo Limede Oliveira, Chaonan Lin, Shan Lin, Akis Linardos, Marius George Linguraru, Han Liu, Tao Liu, Di Liu, Yanling Liu, João Lourenço-Silva, Jingpei Lu, Jiangshan Lu, Imanol Luengo, Christina B. Lund, Huan Minh Luu, Yi Lv, Uzay Macar, Leon Maechler, Sina Mansour L., Kenji Marshall, Moona Mazher, Richard McKinley, Alfonso Medela, Felix Meissen, Mingyuan Meng, Dylan Miller, Seyed Hossein Mirjahanmardi, Arnab Mishra, Samir Mitha, Hassan Mohy-ud-Din, Tony Chi Wing Mok, Gowtham Krishnan Murugesan, Enamundram Naga Karthik, Sahil Nalawade, Jakub Nalepa, Mohamed Naser, Ramin Nateghi, Hammad Naveed, Quang-Minh Nguyen, Cuong Nguyen Quoc, Brennan Nichyporuk, Bruno Oliveira, David Owen, Jimut Bahan Pal, Junwen Pan, Wentao Pan, Winnie Pang, Bogyu Park, Vivek Pawar, Kamlesh Pawar, Michael Peven, Lena Philipp, Tomasz Pieciak, Szymon Plotka, Marcel Plutat, Fattaneh Pourakpour, Domen Preložnik, Kumaradevan Punithakumar, Abdul Qayyum, Sandro Queirós, Arman Rahmim, Salar Razavi, Jintao Ren, Mina Rezaei, Jonathan Adam Rico, ZunHyan Rieu, Markus Rink, Johannes Roth, Yusely Ruiz-Gonzalez, Numan Saeed, Anindo Saha, Mostafa Salem, Ricardo Sanchez-Matilla, Kurt Schilling, Wei Shao, Zhiqiang Shen, Ruize Shi, Pengcheng Shi, Daniel Sobotka, Théodore Soulier, Bella Specktor Fadida, Danail Stoyanov, Timothy Sum Hon Mun, Xiaowu Sun, Rong Tao, Franz Thaler, Antoine Théberge, Felix Thielke, Helena Torres, Kareem A. Wahid, Jiacheng Wang, Yifei Wang, Wei Wang, Xiong Wang, Jianhui Wen, Ning Wen, Marek Wodzinski, Ye Wu, Fangfang Xia, Tianqi Xiang, Chen Xiaofei, Lizhan Xu, Tingting Xue, Yuxuan Yang, Lin Yang, Kai Yao, Huifeng Yao, Amirsaeed Yazdani, Michael Yip, Hwanseung Yoo, Fereshteh Yousefirizi, Shunkai Yu, Lei Yu, Jonathan Zamora, Ramy Ashraf Zeineldin, Dewen Zeng, Jianpeng Zhang, Bokai Zhang, Jiapeng Zhang, Fan Zhang, Huahong Zhang, Zhongchen Zhao, Zixuan Zhao, Jiachen Zhao, Can Zhao, Qingshuo Zheng, Yuheng Zhi, Ziqi Zhou, Baosheng Zou, Klaus Maier-Hein, Paul F. Jäger, Annette Kopp-Schneider, Lena Maier-Hein

Of these, 84% were based on standard architectures.


Pixel is All You Need: Adversarial Trajectory-Ensemble Active Learning for Salient Object Detection

no code implementations13 Dec 2022 Zhenyu Wu, Lin Wang, Wei Wang, Qing Xia, Chenglizhao Chen, Aimin Hao, Shuo Li

This paper attempts to answer this unexplored question by proving a hypothesis: there is a point-labeled dataset where saliency models trained on it can achieve equivalent performance when trained on the densely annotated dataset.

Active Learning Adversarial Attack +3

AdvCat: Domain-Agnostic Robustness Assessment for Cybersecurity-Critical Applications with Categorical Inputs

no code implementations13 Dec 2022 Helene Orsini, Hongyan Bao, Yujun Zhou, Xiangrui Xu, Yufei Han, Longyang Yi, Wei Wang, Xin Gao, Xiangliang Zhang

Machine Learning-as-a-Service systems (MLaaS) have been largely developed for cybersecurity-critical applications, such as detecting network intrusions and fake news campaigns.

Adversarial Robustness Fake News Detection +1

Orthogonal SVD Covariance Conditioning and Latent Disentanglement

1 code implementation11 Dec 2022 Yue Song, Nicu Sebe, Wei Wang

Extensive experiments on visual recognition demonstrate that our methods can simultaneously improve covariance conditioning and generalization.


A Generative Approach for Script Event Prediction via Contrastive Fine-tuning

1 code implementation7 Dec 2022 Fangqi Zhu, Jun Gao, Changlong Yu, Wei Wang, Chen Xu, Xin Mu, Min Yang, Ruifeng Xu

First, the pretrained language models adopted by current works ignore event-level knowledge, resulting in an inability to capture the correlations between events well.

Language Modelling

AGO: Boosting Mobile AI Inference Performance by Removing Constraints on Graph Optimization

no code implementations2 Dec 2022 Zhiying Xu, Hongding Peng, Wei Wang

Traditional deep learning compilers rely on heuristics for subgraph generation, which impose extra constraints on graph optimization, e. g., each subgraph can only contain at most one complex operator.

graph partitioning

Global and Local Hierarchy-aware Contrastive Framework for Implicit Discourse Relation Recognition

1 code implementation25 Nov 2022 Yuxin Jiang, Linhan Zhang, Wei Wang

Due to the absence of explicit connectives, implicit discourse relation recognition (IDRR) remains a challenging task in discourse analysis.

Contrastive Learning Multi-Task Learning

Learning from Long-Tailed Noisy Data with Sample Selection and Balanced Loss

no code implementations20 Nov 2022 Lefan Zhang, Zhang-Hao Tian, Wujun Zhou, Wei Wang

Specifically, we separate the noisy training data into clean labeled set and unlabeled set with sample selection, and train the deep neural network in a semi-supervised manner with a balanced loss based on model bias.

Improving Speech Emotion Recognition with Unsupervised Speaking Style Transfer

no code implementations16 Nov 2022 Leyuan Qu, Wei Wang, Cornelius Weber, Pengcheng Yue, Taihao Li, Stefan Wermter

Once training is completed, EmoAug enriches expressions of emotional speech with different prosodic attributes, such as stress, rhythm and intensity, by feeding different styles into the paralinguistic encoder.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +4

Long bet will lose: demystifying seemingly fair gambling via two-armed Futurity bandit

no code implementations12 Nov 2022 Zengjing Chen, Huaijin Liang, Wei Wang, Xiaodong Yan

No matter how much some gamblers occasionally win, as long as they continue to gamble, sooner or later they will lose more to the casino, which is the so-called long bet will lose.

Fairness Marketing

Does Deep Learning REALLY Outperform Non-deep Machine Learning for Clinical Prediction on Physiological Time Series?

no code implementations11 Nov 2022 Ke Liao, Wei Wang, Armagan Elibol, Lingzhong Meng, Xu Zhao, Nak Young Chong

In this paper, we systematically examine the performance of machine learning models for the clinical prediction task based on the EHR, especially physiological time series.

Time Series Time Series Analysis

Deep Factorization Model for Robust Recommendation

no code implementations5 Nov 2022 Li Wang, Qiang Zhao, Wei Wang

Recently, malevolent user hacking has become a huge problem for real-world companies.

Recommendation Systems

Deep Latent Mixture Model for Recommendation

no code implementations27 Oct 2022 Jun Zhang, Ping Li, Wei Wang

Recent advances in neural networks have been successfully applied to many tasks in online recommendation applications.

Pronunciation Generation for Foreign Language Words in Intra-Sentential Code-Switching Speech Recognition

no code implementations26 Oct 2022 Wei Wang, Chao Zhang, Xiaopei Wu

In this paper, we make use of limited code-switching data as driving materials and explore a shortcut to quickly develop intra-sentential code-switching recognition skill on the commissioned native language acoustic model, where we propose a data-driven method to make the seed lexicon which is used to train grapheme-to-phoneme model to predict mapping pronunciations for foreign language word in code-switching sentences.

speech-recognition Speech Recognition

Synthetic Data Supervised Salient Object Detection

1 code implementation25 Oct 2022 Zhenyu Wu, Lin Wang, Wei Wang, Tengfei Shi, Chenglizhao Chen, Aimin Hao, Shuo Li

In this paper, we propose a novel yet effective method for SOD, coined SODGAN, which can generate infinite high-quality image-mask pairs requiring only a few labeled data, and these synthesized pairs can replace the human-labeled DUTS-TR to train any off-the-shelf SOD model.

Code Generation object-detection +2

Robust Ellipse Fitting Based on Maximum Correntropy Criterion With Variable Center

no code implementations24 Oct 2022 Wei Wang, Gang Wang, Chenlong Hu, K. C. Ho

For single ellipse fitting, we formulate a non-convex optimization problem to estimate the kernel bandwidth and center and divide it into two subproblems, each estimating one parameter.

Survey of Deep Learning for Autonomous Surface Vehicles in the Marine Environment

no code implementations16 Oct 2022 Yuanyuan Qiao, Jiaxin Yin, Wei Wang, Fábio Duarte, Jie Yang, Carlo Ratti

Within the next several years, there will be a high level of autonomous technology that will be available for widespread use, which will reduce labor costs, increase safety, save energy, enable difficult unmanned tasks in harsh environments, and eliminate human error.

Autonomous Vehicles Self-Learning

Code Recommendation for Open Source Software Developers

1 code implementation15 Oct 2022 Yiqiao Jin, Yunsheng Bai, Yanqiao Zhu, Yizhou Sun, Wei Wang

In this paper, we formulate the novel problem of code recommendation, whose purpose is to predict the future contribution behaviors of developers given their interaction history, the semantic features of source code, and the hierarchical file structures of projects.

Graph Mining Recommendation Systems +1

Exploiting Mixed Unlabeled Data for Detecting Samples of Seen and Unseen Out-of-Distribution Classes

no code implementations13 Oct 2022 Yi-Xuan Sun, Wei Wang

We propose the Adaptive In-Out-aware Learning (AIOL) method, in which we employ the appropriate temperature to adaptively select potential ID and OOD samples from the mixed unlabeled data and consider the entropy over them for OOD detection.

Data Augmentation Out of Distribution (OOD) Detection

Feature Reconstruction Attacks and Countermeasures of DNN training in Vertical Federated Learning

no code implementations13 Oct 2022 Peng Ye, Zhifeng Jiang, Wei Wang, Bo Li, Baochun Li

To address this problem, we develop a novel feature protection scheme against the reconstruction attack that effectively misleads the search to some pre-specified random values.

Federated Learning Reconstruction Attack

GENHOP: An Image Generation Method Based on Successive Subspace Learning

no code implementations7 Oct 2022 Xuejing Lei, Wei Wang, C. -C. Jay Kuo

In the first module, it builds a sequence of high-to-low dimensional subspaces through a sequence of whitening processes, each of which contains samples of joint-spatial-spectral representation.

Dimensionality Reduction Image Generation

CryptoGCN: Fast and Scalable Homomorphically Encrypted Graph Convolutional Network Inference

2 code implementations24 Sep 2022 Ran Ran, Nuo Xu, Wei Wang, Gang Quan, Jieming Yin, Wujie Wen

To this end, we develop an approach that can effectively take advantage of the sparsity of matrix operations in GCN inference to significantly reduce the computational overhead.

Multi-level Adversarial Spatio-temporal Learning for Footstep Pressure based FoG Detection

no code implementations22 Sep 2022 Kun Hu, Shaohui Mei, Wei Wang, Kaylena A. Ehgoetz Martens, Liang Wang, Simon J. G. Lewis, David D. Feng, Zhiyong Wang

The proposed scheme also sheds light on improving subject-level clinical studies from other scenarios as it can be integrated with many existing deep architectures.

Dual-Geometric Space Embedding Model for Two-View Knowledge Graphs

1 code implementation19 Sep 2022 Roshni G. Iyer, Yunsheng Bai, Wei Wang, Yizhou Sun

For works that seek to put both views of the KG together, the instance and ontology views are assumed to belong to the same geometric space, such as all nodes embedded in the same Euclidean space or non-Euclidean product space, an assumption no longer reasonable for two-view KGs where different portions of the graph exhibit different structures.

Knowledge Graphs Vocal Bursts Valence Prediction

RankFeat: Rank-1 Feature Removal for Out-of-distribution Detection

1 code implementation18 Sep 2022 Yue Song, Nicu Sebe, Wei Wang

The task of out-of-distribution (OOD) detection is crucial for deploying machine learning models in real-world settings.

Out-of-Distribution Detection

Multimodal Graph Learning for Deepfake Detection

no code implementations12 Sep 2022 Zhiyuan Yan, Peng Sun, Yubo Lang, Shuo Du, Shanzhuo Zhang, Wei Wang, Lei Liu

We evaluate the effectiveness of our method through extensive experiments on widely-used benchmarks and demonstrate that our method outperforms the state-of-the-art detectors in terms of generalization ability and robustness against unknown disturbances.

DeepFake Detection Face Swapping +2

Training and Tuning Generative Neural Radiance Fields for Attribute-Conditional 3D-Aware Face Generation

1 code implementation26 Aug 2022 Jichao Zhang, Aliaksandr Siarohin, Yahui Liu, Hao Tang, Nicu Sebe, Wei Wang

To this end, we introduce a conditional GNeRF model that uses specific attribute labels as input in order to improve the controllabilities and disentangling abilities of 3D-aware generative models.

Disentanglement Face Generation

Neural network facilitated ab initio derivation of linear formula: A case study on formulating the relationship between DNA motifs and gene expression

1 code implementation19 Aug 2022 Chengyu Liu, Wei Wang

We showed that this linear model could predict gene expression levels using promoter sequences with a performance comparable to deep neural network models.

UPST-NeRF: Universal Photorealistic Style Transfer of Neural Radiance Fields for 3D Scene

1 code implementation15 Aug 2022 Yaosen Chen, Qi Yuan, Zhiqiang Li, Yuegen Liu, Wei Wang, Chaoping Xie, Xuming Wen, Qien Yu

Finally, we jointly optimize a hyper network to realize the scene photorealistic style transfer of arbitrary style images.

Style Transfer

Learning Feature Decomposition for Domain Adaptive Monocular Depth Estimation

no code implementations30 Jul 2022 Shao-Yuan Lo, Wei Wang, Jim Thomas, Jingjing Zheng, Vishal M. Patel, Cheng-Hao Kuo

In this paper, we propose a novel UDA method for MDE, referred to as Learning Feature Decomposition for Adaptation (LFDA), which learns to decompose the feature space into content and style components.

Monocular Depth Estimation Unsupervised Domain Adaptation

Detecting Small Query Graphs in A Large Graph via Neural Subgraph Search

no code implementations21 Jul 2022 Yunsheng Bai, Derek Xu, Yizhou Sun, Wei Wang

In this paper, we propose NSUBS with two innovations to tackle the challenges: (1) A novel encoder-decoder neural network architecture to dynamically compute the matching information between the query and the target graphs at each search state; (2) A novel look-ahead loss function for training the policy network.

reinforcement-learning Reinforcement Learning (RL)

STT: Soft Template Tuning for Few-Shot Adaptation

no code implementations18 Jul 2022 Ping Yu, Wei Wang, Chunyuan Li, Ruiyi Zhang, Zhanpeng Jin, Changyou Chen

Significantly, it can even outperform the time- and resource-consuming fine-tuning method on sentiment classification tasks.

Few-Shot Learning Language Modelling +3

Cross-Domain Cross-Set Few-Shot Learning via Learning Compact and Aligned Representations

1 code implementation16 Jul 2022 Wentao Chen, Zhang Zhang, Wei Wang, Liang Wang, Zilei Wang, Tieniu Tan

Different from previous cross-domain FSL work (CD-FSL) that considers the domain shift between base and novel classes, the new problem, termed cross-domain cross-set FSL (CDSC-FSL), requires few-shot learners not only to adapt to the new domain, but also to be consistent between different domains within each novel class.

Few-Shot Learning

Batch-efficient EigenDecomposition for Small and Medium Matrices

1 code implementation9 Jul 2022 Yue Song, Nicu Sebe, Wei Wang

EigenDecomposition (ED) is at the heart of many computer vision algorithms and applications.

Image Generation

PI-Trans: Parallel-ConvMLP and Implicit-Transformation Based GAN for Cross-View Image Translation

1 code implementation9 Jul 2022 Bin Ren, Hao Tang, Yiming Wang, Xia Li, Wei Wang, Nicu Sebe

For semantic-guided cross-view image translation, it is crucial to learn where to sample pixels from the source view image and where to reallocate them guided by the target view semantic map, especially when there is little overlap or drastic view difference between the source and target images.

FAIVConf: Face enhancement for AI-based Video Conference with Low Bit-rate

no code implementations8 Jul 2022 Zhengang Li, Sheng Lin, Shan Liu, Songnan Li, Xue Lin, Wei Wang, Wei Jiang

Recently, high-quality video conferencing with fewer transmission bits has become a very hot and challenging problem.

Face Generation Face Swapping +1

Improving Covariance Conditioning of the SVD Meta-layer by Orthogonality

1 code implementation5 Jul 2022 Yue Song, Nicu Sebe, Wei Wang

Inserting an SVD meta-layer into neural networks is prone to make the covariance ill-conditioned, which could harm the model in the training stability and generalization abilities.

Unsupervised High-Resolution Portrait Gaze Correction and Animation

1 code implementation1 Jul 2022 Jichao Zhang, Jingjing Chen, Hao Tang, Enver Sangineto, Peng Wu, Yan Yan, Nicu Sebe, Wei Wang

Solving this problem using an unsupervised method remains an open problem, especially for high-resolution face images in the wild, which are not easy to annotate with gaze and head pose labels.

Image Inpainting Vocal Bursts Intensity Prediction

Scalable K-FAC Training for Deep Neural Networks with Distributed Preconditioning

1 code implementation30 Jun 2022 Lin Zhang, Shaohuai Shi, Wei Wang, Bo Li

The second-order optimization methods, notably the D-KFAC (Distributed Kronecker Factored Approximate Curvature) algorithms, have gained traction on accelerating deep neural network (DNN) training on GPU clusters.

Position-prior Clustering-based Self-attention Module for Knee Cartilage Segmentation

1 code implementation21 Jun 2022 Dong Liang, Jun Liu, Kuanquan Wang, Gongning Luo, Wei Wang, Shuo Li

The morphological changes in knee cartilage (especially femoral and tibial cartilages) are closely related to the progression of knee osteoarthritis, which is expressed by magnetic resonance (MR) images and assessed on the cartilage segmentation results.


Pisces: Efficient Federated Learning via Guided Asynchronous Training

no code implementations18 Jun 2022 Zhifeng Jiang, Wei Wang, Baochun Li, Bo Li

Current FL systems employ a participant selection strategy to select fast clients with quality data in each iteration.

Federated Learning Navigate

Region-enhanced Deep Graph Convolutional Networks for Rumor Detection

no code implementations15 Jun 2022 Ge Wang, Li Tan, Tianbao Song, Wei Wang, Ziliang Shang

Specifically, a novel region-enhanced deep graph convolutional network (RDGCN) that enhances the propagation features of rumors by learning regionalized propagation patterns and trains to learn the propagation patterns by unsupervised learning is proposed.

Improving Contrastive Learning of Sentence Embeddings with Case-Augmented Positives and Retrieved Negatives

1 code implementation6 Jun 2022 Wei Wang, Liangzhu Ge, Jingqiao Zhang, Cheng Yang

Following SimCSE, contrastive learning based methods have achieved the state-of-the-art (SOTA) performance in learning sentence embeddings.

Contrastive Learning Language Modelling +3

Abnormal Signal Recognition with Time-Frequency Spectrogram: A Deep Learning Approach

no code implementations30 May 2022 Tingyan Kuang, Huichao Chen, Lu Han, Rong He, Wei Wang, Guoru Ding

With the increasingly complex and changeable electromagnetic environment, wireless communication systems are facing jamming and abnormal signal injection, which significantly affects the normal operation of a communication system.

Image Classification

Exposing Fine-Grained Adversarial Vulnerability of Face Anti-Spoofing Models

no code implementations30 May 2022 Songlin Yang, Wei Wang, Chenye Xu, Ziwen He, Bo Peng, Jing Dong

These fine-grained adversarial examples can be used for selecting robust backbone networks and auxiliary features.

Adversarial Attack Adversarial Robustness +1

Masked Jigsaw Puzzle: A Versatile Position Embedding for Vision Transformers

1 code implementation CVPR 2023 Bin Ren, Yahui Liu, Yue Song, Wei Bi, Rita Cucchiara, Nicu Sebe, Wei Wang

In particular, MJP first shuffles the selected patches via our block-wise random jigsaw puzzle shuffle algorithm, and their corresponding PEs are occluded.

Federated Learning

mPLUG: Effective and Efficient Vision-Language Learning by Cross-modal Skip-connections

2 code implementations24 May 2022 Chenliang Li, Haiyang Xu, Junfeng Tian, Wei Wang, Ming Yan, Bin Bi, Jiabo Ye, Hehong Chen, Guohai Xu, Zheng Cao, Ji Zhang, Songfang Huang, Fei Huang, Jingren Zhou, Luo Si

Large-scale pretrained foundation models have been an emerging paradigm for building artificial intelligence (AI) systems, which can be quickly adapted to a wide range of downstream tasks.

Image Captioning Question Answering +5

Deep-learning-based prediction of nanoparticle phase transitions during in situ transmission electron microscopy

no code implementations23 May 2022 Wenkai Fu, Steven R. Spurgeon, Chongmin Wang, Yuyan Shao, Wei Wang, Amra Peles

We develop the machine learning capability to predict a time sequence of in-situ transmission electron microscopy (TEM) video frames based on the combined long-short-term-memory (LSTM) algorithm and the features de-entanglement method.

A Coupling Enhancement Algorithm for ZrO2 Ceramic Bearing Ball Surface Defect Detection Based on Cartoon-texture Decomposition Model and Multi-Scale Filtering Method

no code implementations23 May 2022 Wei Wang, Xin Zhang, Jiaqi Yi, Xianqi Liao, Wenjie Li, Zhenhong Li

The experimental results show that the image denoising method of ZrO2 ceramic bearing ball surface defect based on cartoon-texture decomposition model can denoise while retaining the image details.

Defect Detection Image Denoising +1

HelixADMET: a robust and endpoint extensible ADMET system incorporating self-supervised knowledge transfer

no code implementations17 May 2022 Shanzhuo Zhang, Zhiyuan Yan, Yueyang Huang, Lihang Liu, Donglong He, Wei Wang, Xiaomin Fang, Xiaonan Zhang, Fan Wang, Hua Wu, Haifeng Wang

Additionally, the pre-trained model provided by H-ADMET can be fine-tuned to generate new and customised ADMET endpoints, meeting various demands of drug research and development requirements.

Drug Discovery Self-Supervised Learning +1

Intelligent Reflecting Surface Configurations for Smart Radio Using Deep Reinforcement Learning

1 code implementation11 May 2022 Wei Wang, Wei zhang

Intelligent reflecting surface (IRS) is envisioned to change the paradigm of wireless communications from "adapting to wireless channels" to "changing wireless channels".

reinforcement-learning Reinforcement Learning (RL)

COSPLAY: Concept Set Guided Personalized Dialogue Generation Across Both Party Personas

1 code implementation2 May 2022 Chen Xu, Piji Li, Wei Wang, Haoran Yang, Siyun Wang, Chuangbai Xiao

In this work, we propose COSPLAY(COncept Set guided PersonaLized dialogue generation Across both partY personas) that considers both parties as a "team": expressing self-persona while keeping curiosity toward the partner, leading responses around mutual personas, and finding the common ground.

Dialogue Generation

On the Equity of Nuclear Norm Maximization in Unsupervised Domain Adaptation

no code implementations12 Apr 2022 Wenju Zhang, Xiang Zhang, Qing Liao, Long Lan, Mengzhu Wang, Wei Wang, Baoyun Peng, Zhengming Ding

Nuclear norm maximization has shown the power to enhance the transferability of unsupervised domain adaptation model (UDA) in an empirical scheme.

Image Classification Unsupervised Domain Adaptation

Explicit and Implicit Pattern Relation Analysis for Discovering Actionable Negative Sequences

no code implementations4 Apr 2022 Wei Wang, Longbing Cao

A DPP-based NSP representation and actionable NSP discovery method EINSP introduces novel and significant contributions for NSA and sequence analysis: (1) it represents NSPs by a determinantal point process (DPP) based graph; (2) it quantifies actionable NSPs in terms of their statistical significance, diversity, and strength of explicit/implicit element/pattern relations; and (3) it models and measures both explicit and implicit element/pattern relations in the DPP-based NSP graph to represent direct and indirect couplings between NSP items, elements and patterns.

Decision Making

DNN-Driven Compressive Offloading for Edge-Assisted Semantic Video Segmentation

no code implementations28 Mar 2022 Xuedou Xiao, Juecheng Zhang, Wei Wang, Jianhua He, Qian Zhang

Existing compression algorithms are not fit for semantic segmentation, as the lack of obvious and concentrated regions of interest (RoIs) forces the adoption of uniform compression strategies, leading to low compression ratios or accuracy.

Optical Flow Estimation Semantic Segmentation +2

Multilingual Knowledge Graph Completion with Self-Supervised Adaptive Graph Alignment

1 code implementation ACL 2022 Zijie Huang, Zheng Li, Haoming Jiang, Tianyu Cao, Hanqing Lu, Bing Yin, Karthik Subbian, Yizhou Sun, Wei Wang

In this paper, we explore multilingual KG completion, which leverages limited seed alignment as a bridge, to embrace the collective knowledge from multiple languages.

Knowledge Graph Completion

Physical Layer Security Assisted Computation Offloading in Intelligently Connected Vehicle Networks

no code implementations25 Mar 2022 Yiliang Liu, Wei Wang, Hsiao-Hwa Chen, Feng Lyu, Liangmin Wang, Weixiao Meng, Xuemin, Shen

In this paper, we propose a secure computation offloading scheme (SCOS) in intelligently connected vehicle (ICV) networks, aiming to minimize overall latency of computing via offloading part of computational tasks to nearby servers in small cell base stations (SBSs), while securing the information delivered during offloading and feedback phases via physical layer security.

Efficient Training of the Memristive Deep Belief Net Immune to Non-Idealities of the Synaptic Devices

no code implementations15 Mar 2022 Wei Wang, Barak Hoffer, Tzofnat Greenberg-Toledo, Yang Li, Minhui Zou, Eric Herbelin, Ronny Ronen, Xiaoxin Xu, Yulin Zhao, Jianguo Yang, Shahar Kvatinsky

Nevertheless, the implementation of the VMM needs complex peripheral circuits and the complexity further increases since non-idealities of memristive devices prevent precise conductance tuning (especially for the online training) and largely degrade the performance of the deep neural networks (DNNs).