Search Results for author: Ziyang Zhang

Found 40 papers, 18 papers with code

Enhanced Photovoltaic Power Forecasting: An iTransformer and LSTM-Based Model Integrating Temporal and Covariate Interactions

1 code implementation3 Dec 2024 Guang Wu, Yun Wang, Qian Zhou, Ziyang Zhang

Accurate photovoltaic (PV) power forecasting is critical for integrating renewable energy sources into the grid, optimizing real-time energy management, and ensuring energy reliability amidst increasing demand.

energy management Management

R-CoT: Reverse Chain-of-Thought Problem Generation for Geometric Reasoning in Large Multimodal Models

2 code implementations23 Oct 2024 Linger Deng, Yuliang Liu, Bohan Li, Dongliang Luo, Liang Wu, Chengquan Zhang, Pengyuan Lyu, Ziyang Zhang, Gang Zhang, Errui Ding, Yingying Zhu, Xiang Bai

Current geometric data generation approaches, which apply preset templates to generate geometric data or use Large Language Models (LLMs) to rephrase questions and answers (Q&A), unavoidably limit data accuracy and diversity.

Diversity

Measuring Spiritual Values and Bias of Large Language Models

no code implementations15 Oct 2024 Songyuan Liu, Ziyang Zhang, Runze Yan, Wei Wu, Carl Yang, Jiaying Lu

Large language models (LLMs) have become integral tool for users from various backgrounds.

Fairness

Debiasing Federated Learning with Correlated Client Participation

no code implementations2 Oct 2024 Zhenyu Sun, Ziyang Zhang, Zheng Xu, Gauri Joshi, Pranay Sharma, Ermin Wei

In cross-device federated learning (FL) with millions of mobile clients, only a small subset of clients participate in training in every communication round, and Federated Averaging (FedAvg) is the most popular algorithm in practice.

Federated Learning

SWIM: Short-Window CNN Integrated with Mamba for EEG-Based Auditory Spatial Attention Decoding

1 code implementation30 Sep 2024 Ziyang Zhang, Andrew Thwaites, Alexandra Woolgar, Brian Moore, Chao Zhang

By joint training SW$_\text{CNN}$ and Mamba, the proposed SWIM structure uses both short-term and long-term information and achieves an accuracy of 86. 2%, which reduces the classification errors by a relative 31. 0% compared to the previous state-of-the-art result.

Data Augmentation EEG +1

EventAug: Multifaceted Spatio-Temporal Data Augmentation Methods for Event-based Learning

no code implementations18 Sep 2024 Yukun Tian, Hao Chen, Yongjian Deng, Feihong Shen, Kepan Liu, Wei You, Ziyang Zhang

The event camera has demonstrated significant success across a wide range of areas due to its low time latency and high dynamic range.

Data Augmentation Diversity

FODA-PG for Enhanced Medical Imaging Narrative Generation: Adaptive Differentiation of Normal and Abnormal Attributes

no code implementations6 Sep 2024 Kai Shu, Yuzhuo Jia, Ziyang Zhang, Jiechao Gao

Automatic Medical Imaging Narrative generation aims to alleviate the workload of radiologists by producing accurate clinical descriptions directly from radiological images.

Domain Adaptation Image Captioning +1

TACCO: Task-guided Co-clustering of Clinical Concepts and Patient Visits for Disease Subtyping based on EHR Data

1 code implementation14 Jun 2024 Ziyang Zhang, Hejie Cui, ran Xu, Yuzhang Xie, Joyce C. Ho, Carl Yang

In this work, we introduce TACCO, a novel framework that jointly discovers clusters of clinical concepts and patient visits based on a hypergraph modeling of EHR data.

Clustering Phenotype classification

Bayesian WeakS-to-Strong from Text Classification to Generation

no code implementations24 May 2024 Ziyun Cui, Ziyang Zhang, Wen Wu, Guangzhi Sun, Chao Zhang

Advances in large language models raise the question of how alignment techniques will adapt as models become increasingly complex and humans will only be able to supervise them weakly.

text-classification Text Classification +1

Mitigating Prior Shape Bias in Point Clouds via Differentiable Center Learning

no code implementations3 Feb 2024 Zhe Li, Ziyang Zhang, Jinglin Zhao, Zheng Wang, Bocheng Ren, Debin Liu, Laurence T. Yang

Experimental results demonstrate that our method enhances the expressive capacity of existing point cloud models and effectively addresses the issue of information leakage.

Towards interpretable-by-design deep learning algorithms

no code implementations19 Nov 2023 Plamen Angelov, Dmitry Kangin, Ziyang Zhang

The proposed framework named IDEAL (Interpretable-by-design DEep learning ALgorithms) recasts the standard supervised classification problem into a function of similarity to a set of prototypes derived from the training data, while taking advantage of existing latent spaces of large neural networks forming so-called Foundation Models (FM).

class-incremental learning Class Incremental Learning +3

RD-VIO: Robust Visual-Inertial Odometry for Mobile Augmented Reality in Dynamic Environments

1 code implementation23 Oct 2023 Jinyu Li, Xiaokun Pan, Gan Huang, Ziyang Zhang, Nan Wang, Hujun Bao, Guofeng Zhang

In this work, we design a novel visual-inertial odometry (VIO) system called RD-VIO to handle both of these two problems.

ASM: Adaptive Sample Mining for In-The-Wild Facial Expression Recognition

no code implementations9 Oct 2023 Ziyang Zhang, Xiao Sun, Liuwei An, Meng Wang

First, the Adaptive Threshold Learning module generates two thresholds, namely the clean and noisy thresholds, for each category.

Facial Expression Recognition Facial Expression Recognition (FER)

Inherent Redundancy in Spiking Neural Networks

1 code implementation ICCV 2023 Man Yao, Jiakui Hu, Guangshe Zhao, Yaoyuan Wang, Ziyang Zhang, Bo Xu, Guoqi Li

In this work, we pose and focus on three key questions regarding the inherent redundancy in SNNs.

Deep Directly-Trained Spiking Neural Networks for Object Detection

1 code implementation ICCV 2023 Qiaoyi Su, Yuhong Chou, Yifan Hu, Jianing Li, Shijie Mei, Ziyang Zhang, Guoqi Li

Spiking neural networks (SNNs) are brain-inspired energy-efficient models that encode information in spatiotemporal dynamics.

Object object-detection +1

Channel Modeling for Heterogeneous Vehicular ISAC System with Shared Clusters

no code implementations16 Jul 2023 Baiping Xiong, Zaichen Zhang, Yingmeng Ge, Haibo Wang, Hao Jiang, Liang Wu, Ziyang Zhang

In this paper, we consider the channel modeling of a heterogeneous vehicular integrated sensing and communication (ISAC) system, where a dual-functional multi-antenna base station (BS) intends to communicate with a multi-antenna vehicular receiver (MR) and sense the surrounding environments simultaneously.

DVFO: Learning-Based DVFS for Energy-Efficient Edge-Cloud Collaborative Inference

no code implementations2 Jun 2023 Ziyang Zhang, Yang Zhao, Huan Li, Changyao Lin, Jie Liu

Due to limited resources on edge and different characteristics of deep neural network (DNN) models, it is a big challenge to optimize DNN inference performance in terms of energy consumption and end-to-end latency on edge devices.

Collaborative Inference Deep Reinforcement Learning

BCEdge: SLO-Aware DNN Inference Services with Adaptive Batching on Edge Platforms

no code implementations1 May 2023 Ziyang Zhang, Huan Li, Yang Zhao, Changyao Lin, Jie Liu

As deep neural networks (DNNs) are being applied to a wide range of edge intelligent applications, it is critical for edge inference platforms to have both high-throughput and low-latency at the same time.

Deep Reinforcement Learning Scheduling

Dual Memory Aggregation Network for Event-Based Object Detection with Learnable Representation

1 code implementation17 Mar 2023 Dongsheng Wang, Xu Jia, Yang Zhang, Xinyu Zhang, Yaoyuan Wang, Ziyang Zhang, Dong Wang, Huchuan Lu

To fully exploit information with event streams to detect objects, a dual-memory aggregation network (DMANet) is proposed to leverage both long and short memory along event streams to aggregate effective information for object detection.

Object object-detection +1

Facial Affect Recognition based on Transformer Encoder and Audiovisual Fusion for the ABAW5 Challenge

no code implementations16 Mar 2023 Ziyang Zhang, Liuwei An, Zishun Cui, Ao Xu, Tengteng Dong, Yueqi Jiang, Jingyi Shi, Xin Liu, Xiao Sun, Meng Wang

In this paper, we present our solutions for the 5th Workshop and Competition on Affective Behavior Analysis in-the-wild (ABAW), which includes four sub-challenges of Valence-Arousal (VA) Estimation, Expression (Expr) Classification, Action Unit (AU) Detection and Emotional Reaction Intensity (ERI) Estimation.

Koopman neural operator as a mesh-free solver of non-linear partial differential equations

1 code implementation24 Jan 2023 Wei Xiong, Xiaomeng Huang, Ziyang Zhang, Ruixuan Deng, Pei Sun, Yang Tian

By approximating the Koopman operator, an infinite-dimensional operator governing all possible observations of the dynamic system, to act on the flow mapping of the dynamic system, we can equivalently learn the solution of a non-linear PDE family by solving simple linear prediction problems.

Precipitation Forecasting

KoopmanLab: machine learning for solving complex physics equations

1 code implementation3 Jan 2023 Wei Xiong, Muyuan Ma, Xiaomeng Huang, Ziyang Zhang, Pei Sun, Yang Tian

To overcome this challenge, we present KoopmanLab, an efficient module of the Koopman neural operator family, for learning PDEs without analytic solutions or closed forms.

Statistical Physics of Deep Neural Networks: Initialization toward Optimal Channels

no code implementations4 Dec 2022 Kangyu Weng, Aohua Cheng, Ziyang Zhang, Pei Sun, Yang Tian

Finally, we analyze our findings with information bottleneck theory to confirm the precise relations among dynamic isometry, mutual information maximization, and optimal channel properties in deep learning.

Deep Learning

Enhanced Gaussian Process Dynamical Models with Knowledge Transfer for Long-term Battery Degradation Forecasting

1 code implementation3 Dec 2022 Wei W. Xing, Ziyang Zhang, Akeel A. Shah

To improve the accuracy of predictive estimates, especially early in the battery lifetime, a number of algorithms have incorporated features that are available from data collected by battery management systems.

Transfer Learning

MSS-DepthNet: Depth Prediction with Multi-Step Spiking Neural Network

no code implementations22 Nov 2022 Xiaoshan Wu, Weihua He, Man Yao, Ziyang Zhang, Yaoyuan Wang, Guoqi Li

Spiking neural network is a novel event-based computational paradigm that is considered to be well suited for processing event camera tasks.

Computational Efficiency Depth Estimation +1

An Interpretable Deep Semantic Segmentation Method for Earth Observation

no code implementations23 Oct 2022 Ziyang Zhang, Plamen Angelov, Eduardo Soares, Nicolas Longepe, Pierre Philippe Mathieu

Earth observation is fundamental for a range of human activities including flood response as it offers vital information to decision makers.

Earth Observation Segmentation +1

Continuously Controllable Facial Expression Editing in Talking Face Videos

no code implementations17 Sep 2022 Zhiyao Sun, Yu-Hui Wen, Tian Lv, Yanan sun, Ziyang Zhang, Yaoyuan Wang, Yong-Jin Liu

In this paper, we propose a high-quality facial expression editing method for talking face videos, allowing the user to control the target emotion in the edited video continuously.

Image-to-Image Translation Video Generation

Video Interpolation by Event-driven Anisotropic Adjustment of Optical Flow

no code implementations19 Aug 2022 Song Wu, Kaichao You, Weihua He, Chen Yang, Yang Tian, Yaoyuan Wang, Ziyang Zhang, Jianxing Liao

In this paper, we propose an end-to-end training method A^2OF for video frame interpolation with event-driven Anisotropic Adjustment of Optical Flows.

Optical Flow Estimation Video Frame Interpolation

Hybrid Multimodal Feature Extraction, Mining and Fusion for Sentiment Analysis

1 code implementation5 Aug 2022 Jia Li, Ziyang Zhang, Junjie Lang, Yueqi Jiang, Liuwei An, Peng Zou, Yangyang Xu, Sheng Gao, Jie Lin, Chunxiao Fan, Xiao Sun, Meng Wang

In this paper, we present our solutions for the Multimodal Sentiment Analysis Challenge (MuSe) 2022, which includes MuSe-Humor, MuSe-Reaction and MuSe-Stress Sub-challenges.

Data Augmentation Humor Detection +1

Incorporating Voice Instructions in Model-Based Reinforcement Learning for Self-Driving Cars

no code implementations21 Jun 2022 Mingze Wang, Ziyang Zhang, Grace Hui Yang

This paper presents a novel approach that supports natural language voice instructions to guide deep reinforcement learning (DRL) algorithms when training self-driving cars.

Deep Reinforcement Learning Model-based Reinforcement Learning +3

Hub-Pathway: Transfer Learning from A Hub of Pre-trained Models

no code implementations8 Jun 2022 Yang Shu, Zhangjie Cao, Ziyang Zhang, Jianmin Wang, Mingsheng Long

The proposed framework can be trained end-to-end with the target task-specific loss, where it learns to explore better pathway configurations and exploit the knowledge in pre-trained models for each target datum.

Transfer Learning

A unified theory of information transfer and causal relation

no code implementations21 Apr 2022 Yang Tian, Hedong Hou, Yaoyuan Wang, Ziyang Zhang, Pei Sun

Information transfer between coupled stochastic dynamics, measured by transfer entropy and information flow, is suggested as a physical process underlying the causal relation of systems.

Causal Inference Relation

Brain-inspired Multilayer Perceptron with Spiking Neurons

4 code implementations CVPR 2022 Wenshuo Li, Hanting Chen, Jianyuan Guo, Ziyang Zhang, Yunhe Wang

However, due to the simplicity of their structures, the performance highly depends on the local features communication machenism.

Inductive Bias

From Big to Small: Adaptive Learning to Partial-Set Domains

1 code implementation14 Mar 2022 Zhangjie Cao, Kaichao You, Ziyang Zhang, Jianmin Wang, Mingsheng Long

Still, the common requirement of identical class space shared across domains hinders applications of domain adaptation to partial-set domains.

Partial Domain Adaptation

Discrete Time Convolution for Fast Event-Based Stereo

1 code implementation CVPR 2022 Kaixuan Zhang, Kaiwei Che, JianGuo Zhang, Jie Cheng, Ziyang Zhang, Qinghai Guo, Luziwei Leng

Inspired by continuous dynamics of biological neuron models, we propose a novel encoding method for sparse events - continuous time convolution (CTC) - which learns to model the spatial feature of the data with intrinsic dynamics.

Depth Estimation Stereo Matching

Ranking and Tuning Pre-trained Models: A New Paradigm for Exploiting Model Hubs

1 code implementation20 Oct 2021 Kaichao You, Yong liu, Ziyang Zhang, Jianmin Wang, Michael I. Jordan, Mingsheng Long

(2) The best ranked PTM can either be fine-tuned and deployed if we have no preference for the model's architecture or the target PTM can be tuned by the top $K$ ranked PTMs via a Bayesian procedure that we propose.

Deep Spatial Learning with Molecular Vibration

1 code implementation14 Nov 2020 Ziyang Zhang, Yingtao Luo

Machine learning over-fitting caused by data scarcity greatly limits the application of machine learning for molecules.

BIG-bench Machine Learning Computational chemistry

Cannot find the paper you are looking for? You can Submit a new open access paper.