Search Results for author: Chao Wang

Found 227 papers, 47 papers with code

Discriminative Partial Domain Adversarial Network

no code implementations ECCV 2020 Jian Hu, Hongya Tuo, Chao Wang, Lingfeng Qiao, Haowen Zhong, Junchi Yan, Zhongliang Jing, Henry Leung

Previous methods typically match the whole source domain to target domain, which causes negative transfer due to the source-negative classes in source domain that does not exist in target domain.

Partial Domain Adaptation Transfer Learning

Knowledge-aware Evolutionary Graph Neural Architecture Search

1 code implementation26 Nov 2024 Chao Wang, Jiaxuan Zhao, Lingling Li, Licheng Jiao, Fang Liu, Xu Liu, Shuyuan Yang

According to the predicted metrics, non-dominated candidate transfer architectures are selected to warm-start the multi-objective evolutionary algorithm for optimizing the #Acc and #Params on a new dataset.

Graph Neural Network Neural Architecture Search

Autoencoder Enhanced Realised GARCH on Volatility Forecasting

no code implementations26 Nov 2024 Qianli Zhao, Chao Wang, Richard Gerlach, Giuseppe Storti, Lingxiang Zhang

In this thesis, aiming to synthesise the impact of various realised volatility measures on volatility forecasting, we propose an extension of the Realised GARCH model that incorporates an autoencoder-generated synthetic realised measure, combining the information from multiple realised measures in a nonlinear manner.

Dimensionality Reduction

Superpixel-informed Implicit Neural Representation for Multi-Dimensional Data

no code implementations18 Nov 2024 Jiayi Li, XiLe Zhao, Jianli Wang, Chao Wang, Min Wang

Recently, implicit neural representations (INRs) have attracted increasing attention for multi-dimensional data recovery.

Superpixels

TokenSelect: Efficient Long-Context Inference and Length Extrapolation for LLMs via Dynamic Token-Level KV Cache Selection

no code implementations5 Nov 2024 Wei Wu, Zhuoshi Pan, Chao Wang, Liyi Chen, Yunchu Bai, Kun fu, Zheng Wang, Hui Xiong

With the development of large language models (LLMs), the ability to handle longer contexts has become a key capability for Web applications such as cross-document understanding and LLM-powered search systems.

document understanding

OwMatch: Conditional Self-Labeling with Consistency for Open-World Semi-Supervised Learning

1 code implementation4 Nov 2024 Shengjie Niu, Lifan Lin, Jian Huang, Chao Wang

However, the emergence of open-world SSL (OwSSL) introduces a more practical challenge, wherein unlabeled data may encompass samples from unseen classes.

Open-World Semi-Supervised Learning

Graph Signal Processing for Global Stock Market Volatility Forecasting

1 code implementation30 Oct 2024 Zhengyang Chi, Junbin Gao, Chao Wang

The interconnectedness of global financial markets has brought increasing attention to modeling volatility spillover effects.

MMDocBench: Benchmarking Large Vision-Language Models for Fine-Grained Visual Document Understanding

no code implementations25 Oct 2024 Fengbin Zhu, Ziyang Liu, Xiang Yao Ng, Haohui Wu, Wenjie Wang, Fuli Feng, Chao Wang, Huanbo Luan, Tat Seng Chua

Large Vision-Language Models (LVLMs) have achieved remarkable performance in many vision-language tasks, yet their capabilities in fine-grained visual understanding remain insufficiently evaluated.

Benchmarking document understanding +1

PiLocNet: Physics-informed neural network on 3D localization with rotating point spread function

no code implementations17 Oct 2024 Mingda Lu, Zitian Ao, Chao Wang, Sudhakar Prasad, Raymond H. Chan

Our PiLocNet combines the unique strengths of both approaches by incorporating forward-model-based information into the network via a data-fitting loss term that constrains the neural network to yield results that are physically sensible.

A Variational Bayesian Inference Theory of Elasticity and Its Mixed Probabilistic Finite Element Method for Inverse Deformation Solutions in Any Dimension

no code implementations10 Oct 2024 Chao Wang, Shaofan Li

In this work, we have developed a variational Bayesian inference theory of elasticity, which is accomplished by using a mixed Variational Bayesian inference Finite Element Method (VBI-FEM) that can be used to solve the inverse deformation problems of continua.

Bayesian Inference

A Lightweight Target-Driven Network of Stereo Matching for Inland Waterways

no code implementations10 Oct 2024 Jing Su, Yiqing Zhou, Yu Zhang, Chao Wang, Yi Wei

Stereo matching for inland waterways is one of the key technologies for the autonomous navigation of Unmanned Surface Vehicles (USVs), which involves dividing the stereo images into reference images and target images for pixel-level matching.

Autonomous Navigation Knowledge Distillation +1

SPikE-SSM: A Sparse, Precise, and Efficient Spiking State Space Model for Long Sequences Learning

no code implementations7 Oct 2024 Yan Zhong, Ruoyu Zhao, Chao Wang, Qinghai Guo, JianGuo Zhang, Zhichao Lu, Luziwei Leng

However, applying the highly capable SSMs to SNNs for long sequences learning poses three major challenges: (1) The membrane potential is determined by the past spiking history of the neuron, leading to reduced efficiency for sequence modeling in parallel computing scenarios.

Computational Efficiency State Space Models

Structure-Enhanced Protein Instruction Tuning: Towards General-Purpose Protein Understanding

no code implementations4 Oct 2024 Wei Wu, Chao Wang, Liyi Chen, Mingze Yin, Yiheng Zhu, Kun fu, Jieping Ye, Hui Xiong, Zheng Wang

Recent development of protein language models (pLMs) with supervised fine tuning provides a promising solution to this problem.

GraphGI:A GNN Explanation Method using Game Interaction

no code implementations24 Sep 2024 Xingping Xian, Jianlu Liu, Tao Wu, Lin Yuan, Chao Wang, Baiyun Chen

In this work, we propose a novel explanatory method GraphGI, which identifies the coalition with the highest interaction strength and presents it as an explanatory subgraph.

Computational Efficiency

Global Stock Market Volatility Forecasting Incorporating Dynamic Graphs and All Trading Days

1 code implementation6 Sep 2024 Zhengyang Chi, Junbin Gao, Chao Wang

By calculating the volatility spillover index to depict the volatility network as graphs, the model effectively mirrors the volatility dynamics for the chosen stock market indices.

Decision Making Graph Neural Network

RLPF: Reinforcement Learning from Prediction Feedback for User Summarization with LLMs

no code implementations6 Sep 2024 Jiaxing Wu, Lin Ning, Luyang Liu, Harrison Lee, Neo Wu, Chao Wang, Sushant Prakash, Shawn O'Banion, Bradley Green, Jun Xie

Existing pretrained LLMs may generate summaries that are concise but lack the necessary context for downstream tasks, hindering their utility in personalization systems.

FairQuant: Certifying and Quantifying Fairness of Deep Neural Networks

no code implementations5 Sep 2024 Brian Hyeongseok Kim, Jingbo Wang, Chao Wang

We propose a method for formally certifying and quantifying individual fairness of deep neural networks (DNN).

Attribute Fairness

UserSumBench: A Benchmark Framework for Evaluating User Summarization Approaches

no code implementations30 Aug 2024 Chao Wang, Neo Wu, Lin Ning, Jiaxing Wu, Luyang Liu, Jun Xie, Shawn O'Banion, Bradley Green

Large language models (LLMs) have shown remarkable capabilities in generating user summaries from a long list of raw user activity data.

Hallucination Recommendation Systems

Multi-modal Adversarial Training for Zero-Shot Voice Cloning

no code implementations28 Aug 2024 John Janiczek, Dading Chong, Dongyang Dai, Arlo Faria, Chao Wang, Tao Wang, Yuzong Liu

The discriminator is used in a training pipeline that improves both the acoustic and prosodic features of a TTS model.

Decoder Text to Speech +1

First Activations Matter: Training-Free Methods for Dynamic Activation in Large Language Models

no code implementations21 Aug 2024 Chi Ma, Mincong Huang, Ying Zhang, Chao Wang, Yujie Wang, Lei Yu, Chuan Liu, Wei Lin

Dynamic activation (DA) techniques, such as DejaVu and MoEfication, have demonstrated their potential to significantly enhance the inference efficiency of large language models (LLMs).

MambaEVT: Event Stream based Visual Object Tracking using State Space Model

1 code implementation20 Aug 2024 Xiao Wang, Chao Wang, Shiao Wang, Xixi Wang, Zhicheng Zhao, Lin Zhu, Bo Jiang

More importantly, we consider introducing a dynamic template update strategy into the tracking framework using the Memory Mamba network.

Mamba Object Localization +2

An Outline of Prognostics and Health Management Large Model: Concepts, Paradigms, and Challenges

no code implementations1 Jul 2024 Laifa Tao, Shangyu Li, Haifei Liu, Qixuan Huang, Liang Ma, Guoao Ning, YiLing Chen, Yunlong Wu, Bin Li, Weiwei Zhang, Zhengduo Zhao, Wenchao Zhan, Wenyan Cao, Chao Wang, Hongmei Liu, Jian Ma, Mingliang Suo, Yujie Cheng, Yu Ding, Dengwei Song, Chen Lu

To this end, based on a systematic analysis of the current challenges and bottlenecks in PHM, as well as the research status and advantages of Large Model, we propose a novel concept and three progressive paradigms of Prognosis and Health Management Large Model (PHM-LM) through the integration of the Large Model with PHM.

Management

Explainable AI Security: Exploring Robustness of Graph Neural Networks to Adversarial Attacks

no code implementations20 Jun 2024 Tao Wu, Canyixing Cui, Xingping Xian, Shaojie Qiao, Chao Wang, Lin Yuan, Shui Yu

Graph neural networks (GNNs) have achieved tremendous success, but recent studies have shown that GNNs are vulnerable to adversarial attacks, which significantly hinders their use in safety-critical scenarios.

Adversarial Robustness

Evolutionary Spiking Neural Networks: A Survey

no code implementations18 Jun 2024 Shuaijie Shen, Rui Zhang, Chao Wang, Renzhuo Huang, Aiersi Tuerhong, Qinghai Guo, Zhichao Lu, JianGuo Zhang, Luziwei Leng

Spiking neural networks (SNNs) are gaining increasing attention as potential computationally efficient alternatives to traditional artificial neural networks(ANNs).

Survey

MOYU: A Theoretical Study on Massive Over-activation Yielded Uplifts in LLMs

no code implementations18 Jun 2024 Chi Ma, Mincong Huang, Chao Wang, Yujie Wang, Lei Yu

Massive Over-activation Yielded Uplifts(MOYU) is an inherent property of large language models, and dynamic activation(DA) based on the MOYU property is a clever yet under-explored strategy designed to accelerate inference in these models.

Job-SDF: A Multi-Granularity Dataset for Job Skill Demand Forecasting and Benchmarking

1 code implementation17 Jun 2024 Xi Chen, Chuan Qin, Chuyu Fang, Chao Wang, Chen Zhu, Fuzhen Zhuang, HengShu Zhu, Hui Xiong

We benchmark a range of models on this dataset, evaluating their performance in standard scenarios, in predictions focused on lower value ranges, and in the presence of structural breaks, providing new insights for further research.

Benchmarking Demand Forecasting +1

Cinematic Gaussians: Real-Time HDR Radiance Fields with Depth of Field

no code implementations11 Jun 2024 Chao Wang, Krzysztof Wolski, Bernhard Kerbl, Ana Serrano, Mojtaba Bemana, Hans-Peter Seidel, Karol Myszkowski, Thomas Leimkühler

Addressing these limitations, we present a lightweight method based on 3D Gaussian Splatting that utilizes multi-view LDR images of a scene with varying exposure times, apertures, and focus distances as input to reconstruct a high-dynamic-range (HDR) radiance field.

Novel View Synthesis

Statistics-Informed Parameterized Quantum Circuit via Maximum Entropy Principle for Data Science and Finance

no code implementations3 Jun 2024 Xi-Ning Zhuang, Zhao-Yun Chen, Cheng Xue, Xiao-Fan Xu, Chao Wang, Huan-Yu Liu, Tai-Ping Sun, Yun-Jie Wang, Yu-Chun Wu, Guo-Ping Guo

Quantum machine learning has demonstrated significant potential in solving practical problems, particularly in statistics-focused areas such as data science and finance.

Quantum Machine Learning

Information Theoretic Text-to-Image Alignment

no code implementations31 May 2024 Chao Wang, Giulio Franzese, Alessandro Finamore, Massimo Gallo, Pietro Michiardi

In a nutshell, our method uses self-supervised fine-tuning and relies on point-wise mutual information between prompts and images to define a synthetic training set to induce model alignment.

Denoising Image Generation

Automatic Graph Topology-Aware Transformer

1 code implementation30 May 2024 Chao Wang, Jiaxuan Zhao, Lingling Li, Licheng Jiao, Fang Liu, Shuyuan Yang

Existing efforts are dedicated to designing many topologies and graph-aware strategies for the graph Transformer, which greatly improve the model's representation capabilities.

Yuan 2.0-M32: Mixture of Experts with Attention Router

1 code implementation28 May 2024 Shaohua Wu, Jiangang Luo, Xi Chen, Lingjun Li, Xudong Zhao, Tong Yu, Chao Wang, Yue Wang, Fei Wang, Weixu Qiao, Houbo He, Zeru Zhang, Zeyu Sun, Junxiong Mao, Chong Shen

Yuan 2. 0-M32, with a similar base architecture as Yuan-2. 0 2B, uses a mixture-of-experts architecture with 32 experts of which 2 experts are active.

ARC Math

Hyperspectral and multispectral image fusion with arbitrary resolution through self-supervised representations

no code implementations28 May 2024 Ting Wang, Zipei Yan, Jizhou Li, XiLe Zhao, Chao Wang, Michael Ng

This approach enables us to harness both the low rankness from the matrix factorization and the continuity from neural representation in a self-supervised manner. Theoretically, we prove the low-rank property and Lipschitz continuity in the proposed continuous low-rank factorization.

Super-Resolution

Dynamic Activation Pitfalls in LLaMA Models: An Empirical Study

no code implementations15 May 2024 Chi Ma, Mincong Huang, Chao Wang, Yujie Wang, Lei Yu

In this work, we systematically investigate the efficacy of dynamic activation mechanisms within the LLaMA family of language models.

Attribute

Shifting the ISAC Trade-Off with Fluid Antenna Systems

no code implementations9 May 2024 Jiaqi Zou, Hao Xu, Chao Wang, Lvxin Xu, Songlin Sun, Kaitao Meng, Christos Masouros, Kai-Kit Wong

As an emerging antenna technology, a fluid antenna system (FAS) enhances spatial diversity to improve both sensing and communication performance by shifting the active antennas among available ports.

Diversity

Tele-FLM Technical Report

no code implementations25 Apr 2024 Xiang Li, Yiqun Yao, Xin Jiang, Xuezhi Fang, Chao Wang, Xinzhang Liu, Zihan Wang, Yu Zhao, Xin Wang, Yuyao Huang, Shuangyong Song, Yongxiang Li, Zheng Zhang, Bo Zhao, Aixin Sun, Yequan Wang, Zhongjiang He, Zhongyuan Wang, Xuelong Li, Tiejun Huang

Large language models (LLMs) have showcased profound capabilities in language understanding and generation, facilitating a wide array of applications.

Language Modelling Large Language Model

Climate Downscaling: A Deep-Learning Based Super-resolution Model of Precipitation Data with Attention Block and Skip Connections

no code implementations26 Mar 2024 Chia-Hao Chiang, Zheng-Han Huang, Liwen Liu, Hsin-Chien Liang, Yi-Chi Wang, Wan-Ling Tseng, Chao Wang, Che-Ta Chen, Ko-Chih Wang

In Taiwan, although the average annual precipitation is up to 2, 500 millimeter (mm), the water allocation for each person is lower than the global average due to drastically geographical elevation changes and uneven distribution through the year.

SSIM Super-Resolution

AFDGCF: Adaptive Feature De-correlation Graph Collaborative Filtering for Recommendations

1 code implementation26 Mar 2024 Wei Wu, Chao Wang, Dazhong Shen, Chuan Qin, Liyi Chen, Hui Xiong

Collaborative filtering methods based on graph neural networks (GNNs) have witnessed significant success in recommender systems (RS), capitalizing on their ability to capture collaborative signals within intricate user-item relationships via message-passing mechanisms.

Collaborative Filtering Recommendation Systems

X-Portrait: Expressive Portrait Animation with Hierarchical Motion Attention

no code implementations23 Mar 2024 You Xie, Hongyi Xu, Guoxian Song, Chao Wang, Yichun Shi, Linjie Luo

We propose X-Portrait, an innovative conditional diffusion model tailored for generating expressive and temporally coherent portrait animation.

Disentanglement Portrait Animation

To Help or Not to Help: LLM-based Attentive Support for Human-Robot Group Interactions

no code implementations19 Mar 2024 Daniel Tanneberg, Felix Ocker, Stephan Hasler, Joerg Deigmoeller, Anna Belardinelli, Chao Wang, Heiko Wersing, Bernhard Sendhoff, Michael Gienger

In addition to following user instructions, Attentive Support is capable of deciding when and how to support the humans, and when to remain silent to not disturb the group.

Common Sense Reasoning

Towards Robustness and Diversity: Continual Learning in Dialog Generation with Text-Mixup and Batch Nuclear-Norm Maximization

no code implementations16 Mar 2024 Zihan Wang, Jiayu Xiao, Mengxiang Li, Zhongjiang He, Yongxiang Li, Chao Wang, Shuangyong Song

In our dynamic world where data arrives in a continuous stream, continual learning enables us to incrementally add new tasks/domains without the need to retrain from scratch.

Continual Learning Data Augmentation +2

DGR: A General Graph Desmoothing Framework for Recommendation via Global and Local Perspectives

no code implementations7 Mar 2024 Leilei Ding, Dazhong Shen, Chao Wang, Tianfu Wang, Le Zhang, Yanyong Zhang

Graph Convolutional Networks (GCNs) have become pivotal in recommendation systems for learning user and item embeddings by leveraging the user-item interaction graph's node information and topology.

Recommendation Systems

Hierarchical Invariance for Robust and Interpretable Vision Tasks at Larger Scales

1 code implementation23 Feb 2024 Shuren Qi, Yushu Zhang, Chao Wang, Zhihua Xia, Xiaochun Cao, Jian Weng

Developing robust and interpretable vision systems is a crucial step towards trustworthy artificial intelligence.

Neural Architecture Search

ProtChatGPT: Towards Understanding Proteins with Large Language Models

no code implementations15 Feb 2024 Chao Wang, Hehe Fan, Ruijie Quan, Yi Yang

The protein first undergoes protein encoders and PLP-former to produce protein embeddings, which are then projected by the adapter to conform with the LLM.

Semi-parametric financial risk forecasting incorporating multiple realized measures

no code implementations15 Feb 2024 Rangika Peiris, Chao Wang, Richard Gerlach, Minh-Ngoc Tran

A semi-parametric joint Value-at-Risk (VaR) and Expected Shortfall (ES) forecasting framework employing multiple realized measures is developed.

Bayesian Inference

Power Transformer Fault Prediction Based on Knowledge Graphs

no code implementations11 Feb 2024 Chao Wang, Zhuo Chen, Ziyan Zhang, Chiyi Li, Kai Song

In this paper, we address the challenge of learning with limited fault data for power transformers.

Knowledge Graphs

GeoDecoder: Empowering Multimodal Map Understanding

no code implementations26 Jan 2024 Feng Qi, Mian Dai, Zixian Zheng, Chao Wang

This paper presents GeoDecoder, a dedicated multimodal model designed for processing geospatial information in maps.

Feature Engineering

TAT-LLM: A Specialized Language Model for Discrete Reasoning over Tabular and Textual Data

no code implementations24 Jan 2024 Fengbin Zhu, Ziyang Liu, Fuli Feng, Chao Wang, Moxin Li, Tat-Seng Chua

In this work, we address question answering (QA) over a hybrid of tabular and textual data that are very common content on the Web (e. g. SEC filings), where discrete reasoning capabilities are often required.

Language Modelling Question Answering

Data Augmentation for Traffic Classification

no code implementations19 Jan 2024 Chao Wang, Alessandro Finamore, Pietro Michiardi, Massimo Gallo, Dario Rossi

Data Augmentation (DA) -- enriching training data by adding synthetic samples -- is a technique widely adopted in Computer Vision (CV) and Natural Language Processing (NLP) tasks to improve models performance.

Benchmarking Classification +3

Re-evaluating the Memory-balanced Pipeline Parallelism: BPipe

no code implementations4 Jan 2024 Mincong Huang, Chao Wang, Chi Ma, Yineng Zhang, Peng Zhang, Lei Yu

Pipeline parallelism is an essential technique in the training of large-scale Transformer models.

Reducing Hallucinations: Enhancing VQA for Flood Disaster Damage Assessment with Visual Contexts

no code implementations21 Dec 2023 Yimin Sun, Chao Wang, Yan Peng

Experimental results show that our method exceeds the performance of state-of-the-art zero-shot VQA models for flood disaster scenarios in total.

Hallucination Question Answering +1

GIT-Net: Generalized Integral Transform for Operator Learning

1 code implementation5 Dec 2023 Chao Wang, Alexandre Hoang Thiery

This article introduces GIT-Net, a deep neural network architecture for approximating Partial Differential Equation (PDE) operators, inspired by integral transform operators.

Operator learning

Unleashing the Potential of Large Language Model: Zero-shot VQA for Flood Disaster Scenario

no code implementations4 Dec 2023 Yimin Sun, Chao Wang, Yan Peng

Most importantly, our model uses well-designed chain of thought (CoT) demonstrations to unlock the potential of the large language model, allowing zero-shot VQA to show better performance in disaster scenarios.

Language Modelling Large Language Model +3

YUAN 2.0: A Large Language Model with Localized Filtering-based Attention

2 code implementations27 Nov 2023 Shaohua Wu, Xudong Zhao, Shenling Wang, Jiangang Luo, Lingjun Li, Xi Chen, Bing Zhao, Wei Wang, Tong Yu, Rongguo Zhang, Jiahua Zhang, Chao Wang

In this work, we develop and release Yuan 2. 0, a series of large language models with parameters ranging from 2. 1 billion to 102. 6 billion.

Code Generation Language Modelling +2

Novel Preprocessing Technique for Data Embedding in Engineering Code Generation Using Large Language Model

no code implementations27 Nov 2023 Yu-Chen Lin, Akhilesh Kumar, Norman Chang, Wenliang Zhang, Muhammad Zakir, Rucha Apte, Haiyang He, Chao Wang, Jyh-Shing Roger Jang

We present four main contributions to enhance the performance of Large Language Models (LLMs) in generating domain-specific code: (i) utilizing LLM-based data splitting and data renovation techniques to improve the semantic representation of embeddings' space; (ii) introducing the Chain of Density for Renovation Credibility (CoDRC), driven by LLMs, and the Adaptive Text Renovation (ATR) algorithm for assessing data renovation reliability; (iii) developing the Implicit Knowledge Expansion and Contemplation (IKEC) Prompt technique; and (iv) effectively refactoring existing scripts to generate new and high-quality scripts with LLMs.

Code Generation Language Modelling +2

Graph Signal Diffusion Model for Collaborative Filtering

1 code implementation15 Nov 2023 Yunqin Zhu, Chao Wang, Qi Zhang, Hui Xiong

In this paper, we adapt standard diffusion model and propose a novel Graph Signal Diffusion Model for Collaborative Filtering (named GiffCF).

Collaborative Filtering Denoising +1

Toward Generative Data Augmentation for Traffic Classification

no code implementations21 Oct 2023 Chao Wang, Alessandro Finamore, Pietro Michiardi, Massimo Gallo, Dario Rossi

Data Augmentation (DA)-augmenting training data with synthetic samples-is wildly adopted in Computer Vision (CV) to improve models performance.

Classification Data Augmentation +1

Minimax Optimal Transfer Learning for Kernel-based Nonparametric Regression

no code implementations21 Oct 2023 Chao Wang, Caixing Wang, Xin He, Xingdong Feng

This paper focuses on investigating the transfer learning problem within the context of nonparametric regression over a reproducing kernel Hilbert space.

regression Transfer Learning

NeuroQuantify -- An Image Analysis Software for Detection and Quantification of Neurons and Neurites using Deep Learning

1 code implementation16 Oct 2023 Ka My Dang, Yi Jia Zhang, Tianchen Zhang, Chao Wang, Anton Sinner, Piero Coronica, Joyce K. S. Poon

The segmentation of cells and neurites in microscopy images of neuronal networks provides valuable quantitative information about neuron growth and neuronal differentiation, including the number of cells, neurites, neurite length and neurite orientation.

Image Segmentation Segmentation +1

Hyperspectral Image Fusion via Logarithmic Low-rank Tensor Ring Decomposition

no code implementations16 Oct 2023 Jun Zhang, Lipeng Zhu, Chao Wang, Shutao Li

On the other hand, the tensor nuclear norm (TNN)-based approaches have recently demonstrated to be more efficient on keeping high-dimensional low-rank structures in tensor recovery.

valid

Towards a Unified Analysis of Kernel-based Methods Under Covariate Shift

1 code implementation NeurIPS 2023 Xingdong Feng, Xin He, Caixing Wang, Chao Wang, Jingnan Zhang

Two types of covariate shift problems are the focus of this paper and the sharp convergence rates are established for a general loss function to provide a unified theoretical analysis, which concurs with the optimal results in literature where the squared loss is used.

quantile regression

CoPAL: Corrective Planning of Robot Actions with Large Language Models

no code implementations11 Oct 2023 Frank Joublin, Antonello Ceravola, Pavel Smirnov, Felix Ocker, Joerg Deigmoeller, Anna Belardinelli, Chao Wang, Stephan Hasler, Daniel Tanneberg, Michael Gienger

In the pursuit of fully autonomous robotic systems capable of taking over tasks traditionally performed by humans, the complexity of open-world environments poses a considerable challenge.

Motion Generation Motion Planning +1

Spatiotemporal Image Reconstruction to Enable High-Frame Rate Dynamic Photoacoustic Tomography with Rotating-Gantry Volumetric Imagers

no code implementations1 Oct 2023 Refik M. Cam, Chao Wang, Weylan Thompson, Sergey A. Ermilov, Mark A. Anastasio, Umberto Villa

Aim: The aim of this study is to develop a spatiotemporal image reconstruction (STIR) method for dynamic PACT that can be applied to commercially available volumetric PACT imagers that employ a sequential scanning strategy.

4D reconstruction Image Reconstruction

Data Scaling Effect of Deep Learning in Financial Time Series Forecasting

1 code implementation5 Sep 2023 Chen Liu, Minh-Ngoc Tran, Chao Wang, Richard Gerlach, Robert Kohn

For years, researchers investigated the applications of deep learning in forecasting financial time series.

Deep Learning Econometrics +4

Robust retrieval of material chemical states in X-ray microspectroscopy

no code implementations8 Aug 2023 Ting Wang, Xiaotong Wu, Jizhou Li, Chao Wang

X-ray microspectroscopic techniques are essential for studying morphological and chemical changes in materials, providing high-resolution structural and spectroscopic information.

Retrieval

Certifying the Fairness of KNN in the Presence of Dataset Bias

no code implementations17 Jul 2023 Yannan Li, Jingbo Wang, Chao Wang

We propose a method for certifying the fairness of the classification result of a widely used supervised learning algorithm, the k-nearest neighbors (KNN), under the assumption that the training data may have historical bias caused by systematic mislabeling of samples from a protected minority group.

Fairness

Bayesian inference for data-efficient, explainable, and safe robotic motion planning: A review

no code implementations16 Jul 2023 Chengmin Zhou, Chao Wang, Haseeb Hassan, Himat Shah, Bingding Huang, Pasi Fränti

Fifth, we systematically present the hybridization of Bayesian inference and RL which is a promising direction to improve the convergence of RL for better motion planning.

Bayesian Inference Knowledge Graphs +2

DRM-IR: Task-Adaptive Deep Unfolding Network for All-In-One Image Restoration

no code implementations15 Jul 2023 Yuanshuo Cheng, Mingwen Shao, Yecong Wan, Chao Wang

With the two cascaded subtasks, DRM-IR first dynamically models the task-specific degradation based on a reference image pair and further restores the image with the collected degradation statistics.

Image Restoration

The Staged Knowledge Distillation in Video Classification: Harmonizing Student Progress by a Complementary Weakly Supervised Framework

no code implementations11 Jul 2023 Chao Wang, Zheng Tang

Our proposed substage-based distillation approach has the potential to inform future research on label-efficient learning for video data.

Knowledge Distillation Pseudo Label +2

Practice with Graph-based ANN Algorithms on Sparse Data: Chi-square Two-tower model, HNSW, Sign Cauchy Projections

no code implementations13 Jun 2023 Ping Li, Weijie Zhao, Chao Wang, Qi Xia, Alice Wu, Lijun Peng

In this paper, we report our exploration of efficient search in sparse data with graph-based ANN algorithms (e. g., HNSW, or SONG which is the GPU version of HNSW), which are popular in industrial practice, e. g., search and ads (advertising).

Many or Few Samples? Comparing Transfer, Contrastive and Meta-Learning in Encrypted Traffic Classification

no code implementations21 May 2023 Idio Guarino, Chao Wang, Alessandro Finamore, Antonio Pescape, Dario Rossi

The popularity of Deep Learning (DL), coupled with network traffic visibility reduction due to the increased adoption of HTTPS, QUIC and DNS-SEC, re-ignited interest towards Traffic Classification (TC).

Contrastive Learning Meta-Learning +3

Speech-Text Dialog Pre-training for Spoken Dialog Understanding with Explicit Cross-Modal Alignment

1 code implementation19 May 2023 Tianshu Yu, Haoyu Gao, Ting-En Lin, Min Yang, Yuchuan Wu, Wentao Ma, Chao Wang, Fei Huang, Yongbin Li

In this paper, we propose Speech-text dialog Pre-training for spoken dialog understanding with ExpliCiT cRoss-Modal Alignment (SPECTRA), which is the first-ever speech-text dialog pre-training model.

Ranked #2 on Multimodal Sentiment Analysis on CMU-MOSI (Acc-2 metric, using extra training data)

cross-modal alignment Emotion Recognition in Conversation +2

Preference or Intent? Double Disentangled Collaborative Filtering

no code implementations18 May 2023 Chao Wang, HengShu Zhu, Dazhong Shen, Wei Wu, Hui Xiong

In this way, the low-rating items will be treated as positive samples for modeling intents while the negative samples for modeling preferences.

Collaborative Filtering Disentanglement +1

Spatial-Frequency Discriminability for Revealing Adversarial Perturbations

1 code implementation18 May 2023 Chao Wang, Shuren Qi, Zhiqiu Huang, Yushu Zhang, Rushi Lan, Xiaochun Cao, Feng-Lei Fan

The vulnerability of deep neural networks to adversarial perturbations has been widely perceived in the computer vision community.

Adversarial Attack Blocking +1

Causal Document-Grounded Dialogue Pre-training

1 code implementation18 May 2023 Yingxiu Zhao, Bowen Yu, Haiyang Yu, Bowen Li, Jinyang Li, Chao Wang, Fei Huang, Yongbin Li, Nevin L. Zhang

To tackle this issue, we are the first to present a causally-complete dataset construction strategy for building million-level DocGD pre-training corpora.

Doc2SoarGraph: Discrete Reasoning over Visually-Rich Table-Text Documents via Semantic-Oriented Hierarchical Graphs

1 code implementation3 May 2023 Fengbin Zhu, Chao Wang, Fuli Feng, Zifeng Ren, Moxin Li, Tat-Seng Chua

Discrete reasoning over table-text documents (e. g., financial reports) gains increasing attention in recent two years.

A Diffusion-based Method for Multi-turn Compositional Image Generation

no code implementations5 Apr 2023 Chao Wang

We introduce a conditioning scheme to generate the target image based on the fusion results.

Denoising Image Generation +2

Deep Learning Enhanced Realized GARCH

1 code implementation16 Feb 2023 Chen Liu, Chao Wang, Minh-Ngoc Tran, Robert Kohn

We propose a new approach to volatility modeling by combining deep learning (LSTM) and realized volatility measures.

Bayesian Inference Deep Learning +1

Bi-level Multi-objective Evolutionary Learning: A Case Study on Multi-task Graph Neural Topology Search

no code implementations6 Feb 2023 Chao Wang, Licheng Jiao, Jiaxuan Zhao, Lingling Li, Xu Liu, Fang Liu, Shuyuan Yang

It is computationally expensive to determine which LL Pareto weight in the LL Pareto weight set is the most appropriate for each UL solution.

Decision Making Graph Classification +3

Representing Noisy Image Without Denoising

1 code implementation18 Jan 2023 Shuren Qi, Yushu Zhang, Chao Wang, Tao Xiang, Xiaochun Cao, Yong Xiang

In this paper, we explore a non-learning paradigm that aims to derive robust representation directly from noisy images, without the denoising as pre-processing.

Data Augmentation Image Denoising

Image Cropping With Spatial-Aware Feature and Rank Consistency

no code implementations CVPR 2023 Chao Wang, Li Niu, Bo Zhang, Liqing Zhang

To address the first issue, we propose spatial-aware feature to encode the spatial relationship between candidate crops and aesthetic elements, by feeding the concatenation of crop mask and selectively aggregated feature maps to a light-weighted encoder.

Image Cropping

Context-Aware Pretraining for Efficient Blind Image Decomposition

1 code implementation CVPR 2023 Chao Wang, Zhedong Zheng, Ruijie Quan, Yifan Sun, Yi Yang

(2) The conventional paradigm usually focuses on mining the abnormal pattern of a superimposed image to separate the noise, which de facto conflicts with the primary image restoration task.

Attribute Image Reconstruction +1

Generative Graph Neural Networks for Link Prediction

1 code implementation31 Dec 2022 Xingping Xian, Tao Wu, Xiaoke Ma, Shaojie Qiao, Yabin Shao, Chao Wang, Lin Yuan, Yu Wu

Instead of sampling positive and negative links and heuristically computing the features of their enclosing subgraphs, GraphLP utilizes the feature learning ability of deep-learning models to automatically extract the structural patterns of graphs for link prediction under the assumption that real-world graphs are not locally isolated.

Link Prediction

State-Aware Proximal Pessimistic Algorithms for Offline Reinforcement Learning

no code implementations28 Nov 2022 Chen Chen, Hongyao Tang, Yi Ma, Chao Wang, Qianli Shen, Dong Li, Jianye Hao

The key idea of SA-PP is leveraging discounted stationary state distribution ratios between the learning policy and the offline dataset to modulate the degree of behavior regularization in a state-wise manner, so that pessimism can be implemented in a more appropriate way.

Offline RL Q-Learning +3

The path integral formula for the stochastic evolutionary game dynamics in the Moran process

no code implementations2 Sep 2022 Chao Wang

In this work, we introduce the formulation of the path integral approach for evolutionary game theory based on the Moran process.

Study of detecting behavioral signatures within DeepFake videos

no code implementations6 Aug 2022 Qiaomu Miao, Sinhwa Kang, Stacy Marsella, Steve DiPaola, Chao Wang, Ari Shapiro

Our results indicate that there could be a behavioral signature that is detectable from a person's movements that is separate from their visual appearance, and that this behavioral signature could be used to distinguish a deep fake from a properly captured video.

Face Swapping

Towards Complex Document Understanding By Discrete Reasoning

no code implementations25 Jul 2022 Fengbin Zhu, Wenqiang Lei, Fuli Feng, Chao Wang, Haozhou Zhang, Tat-Seng Chua

Document Visual Question Answering (VQA) aims to understand visually-rich documents to answer questions in natural language, which is an emerging research topic for both Natural Language Processing and Computer Vision.

document understanding Question Answering +1

Shrinking the Semantic Gap: Spatial Pooling of Local Moment Invariants for Copy-Move Forgery Detection

1 code implementation19 Jul 2022 Chao Wang, Zhiqiu Huang, Shuren Qi, Yaoshen Yu, Guohua Shen, Yushu Zhang

In this paper, we present a very first study of trying to mitigate the semantic gap problem in copy-move forgery detection, with spatial pooling of local moment invariants for midlevel image representation.

A semi-parametric marginalized dynamic conditional correlation framework

no code implementations11 Jul 2022 Giuseppe Storti, Chao Wang

The performance of the proposed model in risk forecasting and portfolio allocation is evaluated by means of a forecasting study on the components of the Dow Jones index for an out-of-sample period from December 2016 to September 2021.

Portfolio Optimization

FL-Tuning: Layer Tuning for Feed-Forward Network in Transformer

1 code implementation30 Jun 2022 Jingping Liu, Yuqiu Song, Kui Xue, Hongli Sun, Chao Wang, Lihan Chen, Haiyun Jiang, Jiaqing Liang, Tong Ruan

Specifically, we focus on layer tuning for feed-forward network in the Transformer, namely FL-tuning.

Model Optimization

Impact of Acoustic Event Tagging on Scene Classification in a Multi-Task Learning Framework

no code implementations27 Jun 2022 Rahil Parikh, Harshavardhan Sundar, Ming Sun, Chao Wang, Spyros Matsoukas

We conclude that this improvement in ASC performance comes from the regularization effect of using AET and not from the network's improved ability to discern between acoustic events.

Acoustic Scene Classification Multi-Task Learning +1

RDU: A Region-based Approach to Form-style Document Understanding

no code implementations14 Jun 2022 Fengbin Zhu, Chao Wang, Wenqiang Lei, Ziyang Liu, Tat Seng Chua

Key Information Extraction (KIE) is aimed at extracting structured information (e. g. key-value pairs) from form-style documents (e. g. invoices), which makes an important step towards intelligent document understanding.

document understanding Key Information Extraction +5

Rethinking Reinforcement Learning based Logic Synthesis

no code implementations16 May 2022 Chao Wang, Chen Chen, Dong Li, Bin Wang

Recently, reinforcement learning has been used to address logic synthesis by formulating the operator sequence optimization problem as a Markov decision process.

reinforcement-learning Reinforcement Learning +1

Attacking and Defending Deep Reinforcement Learning Policies

no code implementations16 May 2022 Chao Wang

Recent studies have shown that deep reinforcement learning (DRL) policies are vulnerable to adversarial attacks, which raise concerns about applications of DRL to safety-critical systems.

Deep Reinforcement Learning reinforcement-learning +1

Using Augmented Face Images to Improve Facial Recognition Tasks

no code implementations13 May 2022 Shuo Cheng, Guoxian Song, Wan-Chun Ma, Chao Wang, Linjie Luo

We present a framework that uses GAN-augmented images to complement certain specific attributes, usually underrepresented, for machine learning model training.

BIG-bench Machine Learning

A Multi-Transformation Evolutionary Framework for Influence Maximization in Social Networks

1 code implementation7 Apr 2022 Chao Wang, Jiaxuan Zhao, Lingling Li, Licheng Jiao, Jing Liu, Kai Wu

Influence maximization is a crucial issue for mining the deep information of social networks, which aims to select a seed set from the network to maximize the number of influenced nodes.

Federated Self-Supervised Learning for Acoustic Event Classification

no code implementations22 Mar 2022 Meng Feng, Chieh-Chi Kao, Qingming Tang, Ming Sun, Viktor Rozgic, Spyros Matsoukas, Chao Wang

Standard acoustic event classification (AEC) solutions require large-scale collection of data from client devices for model optimization.

Classification Continual Learning +3

A Principled Design of Image Representation: Towards Forensic Tasks

1 code implementation2 Mar 2022 Shuren Qi, Yushu Zhang, Chao Wang, Jiantao Zhou, Xiaochun Cao

Image forensics is a rising topic as the trustworthy multimedia content is critical for modern society.

Image Forensics

Rule Mining over Knowledge Graphs via Reinforcement Learning

no code implementations21 Feb 2022 Lihan Chen, Sihang Jiang, Jingping Liu, Chao Wang, Sheng Zhang, Chenhao Xie, Jiaqing Liang, Yanghua Xiao, Rui Song

Knowledge graphs (KGs) are an important source repository for a wide range of applications and rule mining from KGs recently attracts wide research interest in the KG-related research community.

Knowledge Graphs reinforcement-learning +2

A multi-domain VNE algorithm based on multi-objective optimization for IoD architecture in Industry 4.0

no code implementations8 Feb 2022 Peiying Zhang, Chao Wang, Zeyu Qin, Haotong Cao

Network virtualization technology is a promising technology to support IoD, so the allocation of virtual resources becomes a crucial issue in IoD.

Network Embedding

Resource Management and Security Scheme of ICPSs and IoT Based on VNE Algorithm

no code implementations3 Feb 2022 Peiying Zhang, Chao Wang, Chunxiao Jiang, Neeraj Kumar, Qinghua Lu

Based on the above two problems faced by ICPSs, we propose a virtual network embedded (VNE) algorithm with computing, storage resources and security constraints to ensure the rationality and security of resource allocation in ICPSs.

Attribute Management +1

Multi Objective Resource Optimization of Wireless Network Based on Cross Domain Virtual Network Embedding

no code implementations3 Feb 2022 Chao Wang, Tao Dong, Youxiang Duan, Qifeng Sun, Peiying Zhang

Resource allocation in virtual network is essentially a problem of allocating underlying resources for virtual network requests (VNRs).

Management Network Embedding

Security-Aware Virtual Network Embedding Algorithm based on Reinforcement Learning

no code implementations3 Feb 2022 Peiying Zhang, Chao Wang, Chunxiao Jiang, Abderrahim Benslimane

In addition, as the use of intelligent learning algorithm to solve the problem of VNE has become a trend, this method is gradually outdated.

Network Embedding reinforcement-learning +1

Deep Reinforcement Learning Assisted Federated Learning Algorithm for Data Management of IIoT

no code implementations3 Feb 2022 Peiying Zhang, Chao Wang, Chunxiao Jiang, Zhu Han

Therefore, we propose a FL algorithm assisted by DRL, which can take into account the privacy and efficiency of data training of IIoT equipment.

Deep Reinforcement Learning Federated Learning +4

Network Resource Allocation Strategy Based on Deep Reinforcement Learning

no code implementations3 Feb 2022 Shidong Zhang, Chao Wang, Junsan Zhang, Youxiang Duan, Xinhong You, Peiying Zhang

This paper proposes a two-stage VNE algorithm based on deep reinforcement learning (DRL) (TS-DRL-VNE) for the problem that the mapping result of existing heuristic algorithm is easy to converge to the local optimal solution.

Attribute Deep Reinforcement Learning +3

Space-Air-Ground Integrated Multi-domain Network Resource Orchestration based on Virtual Network Architecture: a DRL Method

no code implementations3 Feb 2022 Peiying Zhang, Chao Wang, Neeraj Kumar, Lei Liu

Based on virtual network architecture and deep reinforcement learning (DRL), we model SAGIN's heterogeneous resource orchestration as a multi-domain virtual network embedding (VNE) problem, and propose a SAGIN cross-domain VNE algorithm.

Deep Reinforcement Learning Network Embedding

LinSyn: Synthesizing Tight Linear Bounds for Arbitrary Neural Network Activation Functions

no code implementations31 Jan 2022 Brandon Paulsen, Chao Wang

The most scalable approaches to certifying neural network robustness depend on computing sound linear lower and upper bounds for the network's activation functions.

Sentiment-Aware Automatic Speech Recognition pre-training for enhanced Speech Emotion Recognition

no code implementations27 Jan 2022 Ayoub Ghriss, Bo Yang, Viktor Rozgic, Elizabeth Shriberg, Chao Wang

We pre-train SER model simultaneously on Automatic Speech Recognition (ASR) and sentiment classification tasks to make the acoustic ASR model more ``emotion aware''.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +5

MOORe: Model-based Offline-to-Online Reinforcement Learning

no code implementations25 Jan 2022 Yihuan Mao, Chao Wang, Bin Wang, Chongjie Zhang

With the success of offline reinforcement learning (RL), offline trained RL policies have the potential to be further improved when deployed online.

D4RL reinforcement-learning +2

Opinion Dynamics in Financial Markets via Random Networks

no code implementations14 Jan 2022 Mateus F. B. Granha, André L. M. Vilela, Chao Wang, Kenric P. Nelson, H. Eugene Stanley

We investigate the financial market dynamics by introducing a heterogeneous agent-based opinion formation model.

Network Collaborator: Knowledge Transfer Between Network Reconstruction and Community Detection

1 code implementation4 Jan 2022 Kai Wu, Chao Wang, Junyuan Chen, Jing Liu

Community detection (CD) from dynamics and network reconstruction (NR) from dynamics are natural synergistic tasks that motivate the proposed evolutionary multitasking NR and CD framework, called network collaborator (NC).

Community Detection Transfer Learning

Evolutionary Multitasking AUC Optimization

1 code implementation4 Jan 2022 Chao Wang, Kai Wu, Jing Liu

Inspired by the characteristic of pairwise learning, the cheap AUC optimization task with a small-scale dataset sampled from the large-scale dataset is constructed to promote the AUC accuracy of the original, large-scale, and expensive AUC optimization task.

Binary Classification

DeepVisualInsight: Time-Travelling Visualization for Spatio-Temporal Causality of Deep Classification Training

no code implementations31 Dec 2021 Xianglin Yang, Yun Lin, Ruofan Liu, Zhenfeng He, Chao Wang, Jin Song Dong, Hong Mei

Moreover, our case study shows that our visual solution can well reflect the characteristics of various training scenarios, showing good potential of DVI as a debugging tool for analyzing deep learning training processes.

Active Learning Deep Learning

Topic Modeling Revisited: A Document Graph-based Neural Network Perspective

1 code implementation NeurIPS 2021 Dazhong Shen, Chuan Qin, Chao Wang, Zheng Dong, HengShu Zhu, Hui Xiong

To this end, in this paper, we revisit the task of topic modeling by transforming each document into a directed graph with word dependency as edges between word nodes, and develop a novel approach, namely Graph Neural Topic Model (GNTM).

Variational Inference

Portfolio optimization with idiosyncratic and systemic risks for financial networks

no code implementations22 Nov 2021 Yajie Yang, Longfeng Zhao, Lin Chen, Chao Wang, Jihui Han

The two risks are measured by the idiosyncratic variance and the network clustering coefficient derived from the asset correlation networks, respectively.

Portfolio Optimization

SEIHAI: A Sample-efficient Hierarchical AI for the MineRL Competition

no code implementations17 Nov 2021 Hangyu Mao, Chao Wang, Xiaotian Hao, Yihuan Mao, Yiming Lu, Chengjie WU, Jianye Hao, Dong Li, Pingzhong Tang

The MineRL competition is designed for the development of reinforcement learning and imitation learning algorithms that can efficiently leverage human demonstrations to drastically reduce the number of environment interactions needed to solve the complex \emph{ObtainDiamond} task with sparse rewards.

Imitation Learning reinforcement-learning +2

Regularizing Variational Autoencoder with Diversity and Uncertainty Awareness

1 code implementation24 Oct 2021 Dazhong Shen, Chuan Qin, Chao Wang, HengShu Zhu, Enhong Chen, Hui Xiong

As one of the most popular generative models, Variational Autoencoder (VAE) approximates the posterior of latent variables based on amortized variational inference.

Decoder Diversity +1

Learning a self-supervised tone mapping operator via feature contrast masking loss

no code implementations19 Oct 2021 Chao Wang, Bin Chen, Hans-Peter Seidel, Karol Myszkowski, Ana Serrano

High Dynamic Range (HDR) content is becoming ubiquitous due to the rapid development of capture technologies.

Tone Mapping

Performance, Successes and Limitations of Deep Learning Semantic Segmentation of Multiple Defects in Transmission Electron Micrographs

no code implementations15 Oct 2021 Ryan Jacobs, Mingren Shen, YuHan Liu, Wei Hao, Xiaoshan Li, Ruoyu He, Jacob RC Greaves, Donglin Wang, Zeming Xie, Zitong Huang, Chao Wang, Kevin G. Field, Dane Morgan

In this work, we perform semantic segmentation of multiple defect types in electron microscopy images of irradiated FeCrAl alloys using a deep learning Mask Regional Convolutional Neural Network (Mask R-CNN) model.

object-detection Object Detection +1

Towards High-fidelity Singing Voice Conversion with Acoustic Reference and Contrastive Predictive Coding

no code implementations10 Oct 2021 Chao Wang, Zhonghao Li, Benlai Tang, Xiang Yin, Yuan Wan, Yibiao Yu, Zejun Ma

Experiments show that, compared with the baseline models, our proposed model can significantly improve the naturalness of converted singing voices and the similarity with the target singer.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +2

Self-Adaptive Partial Domain Adaptation

no code implementations18 Sep 2021 Jian Hu, Hongya Tuo, Shizhao Zhang, Chao Wang, Haowen Zhong, Zhikang Zou, Zhongliang Jing, Henry Leung, Ruping Zou

Partial Domain adaptation (PDA) aims to solve a more practical cross-domain learning problem that assumes target label space is a subset of source label space.

Partial Domain Adaptation