1 code implementation • 3 Dec 2024 • Guang Wu, Yun Wang, Qian Zhou, Ziyang Zhang
Accurate photovoltaic (PV) power forecasting is critical for integrating renewable energy sources into the grid, optimizing real-time energy management, and ensuring energy reliability amidst increasing demand.
2 code implementations • 23 Oct 2024 • Linger Deng, Yuliang Liu, Bohan Li, Dongliang Luo, Liang Wu, Chengquan Zhang, Pengyuan Lyu, Ziyang Zhang, Gang Zhang, Errui Ding, Yingying Zhu, Xiang Bai
Current geometric data generation approaches, which apply preset templates to generate geometric data or use Large Language Models (LLMs) to rephrase questions and answers (Q&A), unavoidably limit data accuracy and diversity.
no code implementations • 15 Oct 2024 • Songyuan Liu, Ziyang Zhang, Runze Yan, Wei Wu, Carl Yang, Jiaying Lu
Large language models (LLMs) have become integral tool for users from various backgrounds.
no code implementations • 2 Oct 2024 • Zhenyu Sun, Ziyang Zhang, Zheng Xu, Gauri Joshi, Pranay Sharma, Ermin Wei
In cross-device federated learning (FL) with millions of mobile clients, only a small subset of clients participate in training in every communication round, and Federated Averaging (FedAvg) is the most popular algorithm in practice.
1 code implementation • 30 Sep 2024 • Ziyang Zhang, Andrew Thwaites, Alexandra Woolgar, Brian Moore, Chao Zhang
By joint training SW$_\text{CNN}$ and Mamba, the proposed SWIM structure uses both short-term and long-term information and achieves an accuracy of 86. 2%, which reduces the classification errors by a relative 31. 0% compared to the previous state-of-the-art result.
no code implementations • 18 Sep 2024 • Yukun Tian, Hao Chen, Yongjian Deng, Feihong Shen, Kepan Liu, Wei You, Ziyang Zhang
The event camera has demonstrated significant success across a wide range of areas due to its low time latency and high dynamic range.
no code implementations • 6 Sep 2024 • Kai Shu, Yuzhuo Jia, Ziyang Zhang, Jiechao Gao
Automatic Medical Imaging Narrative generation aims to alleviate the workload of radiologists by producing accurate clinical descriptions directly from radiological images.
1 code implementation • 14 Jun 2024 • Ziyang Zhang, Hejie Cui, ran Xu, Yuzhang Xie, Joyce C. Ho, Carl Yang
In this work, we introduce TACCO, a novel framework that jointly discovers clusters of clinical concepts and patient visits based on a hypergraph modeling of EHR data.
no code implementations • 24 May 2024 • Ziyun Cui, Ziyang Zhang, Wen Wu, Guangzhi Sun, Chao Zhang
Advances in large language models raise the question of how alignment techniques will adapt as models become increasingly complex and humans will only be able to supervise them weakly.
no code implementations • 13 May 2024 • Ziyang Zhang, Plamen Angelov, Dmitry Kangin, Nicolas Longépé
To overcome these challenges, we proposed an interpretable multi-stage approach to flood detection, IMAFD has been proposed.
1 code implementation • 13 May 2024 • Ziyang Zhang, Qizhen Zhang, Jakob Foerster
A promising approach is to use the LLM itself as the safeguard.
no code implementations • 3 Feb 2024 • Zhe Li, Ziyang Zhang, Jinglin Zhao, Zheng Wang, Bocheng Ren, Debin Liu, Laurence T. Yang
Experimental results demonstrate that our method enhances the expressive capacity of existing point cloud models and effectively addresses the issue of information leakage.
no code implementations • 19 Nov 2023 • Plamen Angelov, Dmitry Kangin, Ziyang Zhang
The proposed framework named IDEAL (Interpretable-by-design DEep learning ALgorithms) recasts the standard supervised classification problem into a function of similarity to a set of prototypes derived from the training data, while taking advantage of existing latent spaces of large neural networks forming so-called Foundation Models (FM).
1 code implementation • 23 Oct 2023 • Jinyu Li, Xiaokun Pan, Gan Huang, Ziyang Zhang, Nan Wang, Hujun Bao, Guofeng Zhang
In this work, we design a novel visual-inertial odometry (VIO) system called RD-VIO to handle both of these two problems.
no code implementations • 9 Oct 2023 • Ziyang Zhang, Xiao Sun, Liuwei An, Meng Wang
First, the Adaptive Threshold Learning module generates two thresholds, namely the clean and noisy thresholds, for each category.
Facial Expression Recognition Facial Expression Recognition (FER)
1 code implementation • ICCV 2023 • Man Yao, Jiakui Hu, Guangshe Zhao, Yaoyuan Wang, Ziyang Zhang, Bo Xu, Guoqi Li
In this work, we pose and focus on three key questions regarding the inherent redundancy in SNNs.
1 code implementation • ICCV 2023 • Qiaoyi Su, Yuhong Chou, Yifan Hu, Jianing Li, Shijie Mei, Ziyang Zhang, Guoqi Li
Spiking neural networks (SNNs) are brain-inspired energy-efficient models that encode information in spatiotemporal dynamics.
no code implementations • 16 Jul 2023 • Baiping Xiong, Zaichen Zhang, Yingmeng Ge, Haibo Wang, Hao Jiang, Liang Wu, Ziyang Zhang
In this paper, we consider the channel modeling of a heterogeneous vehicular integrated sensing and communication (ISAC) system, where a dual-functional multi-antenna base station (BS) intends to communicate with a multi-antenna vehicular receiver (MR) and sense the surrounding environments simultaneously.
no code implementations • 2 Jun 2023 • Ziyang Zhang, Yang Zhao, Huan Li, Changyao Lin, Jie Liu
Due to limited resources on edge and different characteristics of deep neural network (DNN) models, it is a big challenge to optimize DNN inference performance in terms of energy consumption and end-to-end latency on edge devices.
no code implementations • 1 May 2023 • Ziyang Zhang, Huan Li, Yang Zhao, Changyao Lin, Jie Liu
As deep neural networks (DNNs) are being applied to a wide range of edge intelligent applications, it is critical for edge inference platforms to have both high-throughput and low-latency at the same time.
1 code implementation • 17 Mar 2023 • Dongsheng Wang, Xu Jia, Yang Zhang, Xinyu Zhang, Yaoyuan Wang, Ziyang Zhang, Dong Wang, Huchuan Lu
To fully exploit information with event streams to detect objects, a dual-memory aggregation network (DMANet) is proposed to leverage both long and short memory along event streams to aggregate effective information for object detection.
no code implementations • 16 Mar 2023 • Ziyang Zhang, Liuwei An, Zishun Cui, Ao Xu, Tengteng Dong, Yueqi Jiang, Jingyi Shi, Xin Liu, Xiao Sun, Meng Wang
In this paper, we present our solutions for the 5th Workshop and Competition on Affective Behavior Analysis in-the-wild (ABAW), which includes four sub-challenges of Valence-Arousal (VA) Estimation, Expression (Expr) Classification, Action Unit (AU) Detection and Emotional Reaction Intensity (ERI) Estimation.
1 code implementation • 24 Jan 2023 • Wei Xiong, Xiaomeng Huang, Ziyang Zhang, Ruixuan Deng, Pei Sun, Yang Tian
By approximating the Koopman operator, an infinite-dimensional operator governing all possible observations of the dynamic system, to act on the flow mapping of the dynamic system, we can equivalently learn the solution of a non-linear PDE family by solving simple linear prediction problems.
1 code implementation • 3 Jan 2023 • Wei Xiong, Muyuan Ma, Xiaomeng Huang, Ziyang Zhang, Pei Sun, Yang Tian
To overcome this challenge, we present KoopmanLab, an efficient module of the Koopman neural operator family, for learning PDEs without analytic solutions or closed forms.
no code implementations • 4 Dec 2022 • Kangyu Weng, Aohua Cheng, Ziyang Zhang, Pei Sun, Yang Tian
Finally, we analyze our findings with information bottleneck theory to confirm the precise relations among dynamic isometry, mutual information maximization, and optimal channel properties in deep learning.
1 code implementation • 3 Dec 2022 • Wei W. Xing, Ziyang Zhang, Akeel A. Shah
To improve the accuracy of predictive estimates, especially early in the battery lifetime, a number of algorithms have incorporated features that are available from data collected by battery management systems.
no code implementations • 22 Nov 2022 • Xiaoshan Wu, Weihua He, Man Yao, Ziyang Zhang, Yaoyuan Wang, Guoqi Li
Spiking neural network is a novel event-based computational paradigm that is considered to be well suited for processing event camera tasks.
no code implementations • 23 Oct 2022 • Ziyang Zhang, Plamen Angelov, Eduardo Soares, Nicolas Longepe, Pierre Philippe Mathieu
Earth observation is fundamental for a range of human activities including flood response as it offers vital information to decision makers.
no code implementations • 17 Sep 2022 • Zhiyao Sun, Yu-Hui Wen, Tian Lv, Yanan sun, Ziyang Zhang, Yaoyuan Wang, Yong-Jin Liu
In this paper, we propose a high-quality facial expression editing method for talking face videos, allowing the user to control the target emotion in the edited video continuously.
no code implementations • 19 Aug 2022 • Song Wu, Kaichao You, Weihua He, Chen Yang, Yang Tian, Yaoyuan Wang, Ziyang Zhang, Jianxing Liao
In this paper, we propose an end-to-end training method A^2OF for video frame interpolation with event-driven Anisotropic Adjustment of Optical Flows.
1 code implementation • 5 Aug 2022 • Jia Li, Ziyang Zhang, Junjie Lang, Yueqi Jiang, Liuwei An, Peng Zou, Yangyang Xu, Sheng Gao, Jie Lin, Chunxiao Fan, Xiao Sun, Meng Wang
In this paper, we present our solutions for the Multimodal Sentiment Analysis Challenge (MuSe) 2022, which includes MuSe-Humor, MuSe-Reaction and MuSe-Stress Sub-challenges.
no code implementations • 21 Jun 2022 • Mingze Wang, Ziyang Zhang, Grace Hui Yang
This paper presents a novel approach that supports natural language voice instructions to guide deep reinforcement learning (DRL) algorithms when training self-driving cars.
Deep Reinforcement Learning Model-based Reinforcement Learning +3
no code implementations • 8 Jun 2022 • Yang Shu, Zhangjie Cao, Ziyang Zhang, Jianmin Wang, Mingsheng Long
The proposed framework can be trained end-to-end with the target task-specific loss, where it learns to explore better pathway configurations and exploit the knowledge in pre-trained models for each target datum.
no code implementations • 21 Apr 2022 • Yang Tian, Hedong Hou, Yaoyuan Wang, Ziyang Zhang, Pei Sun
Information transfer between coupled stochastic dynamics, measured by transfer entropy and information flow, is suggested as a physical process underlying the causal relation of systems.
4 code implementations • CVPR 2022 • Wenshuo Li, Hanting Chen, Jianyuan Guo, Ziyang Zhang, Yunhe Wang
However, due to the simplicity of their structures, the performance highly depends on the local features communication machenism.
no code implementations • CVPR 2022 • Weihua He, Kaichao You, Zhendong Qiao, Xu Jia, Ziyang Zhang, Wenhui Wang, Huchuan Lu, Yaoyuan Wang, Jianxing Liao
Since event camera is a novel sensor, its potential has not been fulfilled due to the lack of processing algorithms.
1 code implementation • 14 Mar 2022 • Zhangjie Cao, Kaichao You, Ziyang Zhang, Jianmin Wang, Mingsheng Long
Still, the common requirement of identical class space shared across domains hinders applications of domain adaptation to partial-set domains.
1 code implementation • CVPR 2022 • Kaixuan Zhang, Kaiwei Che, JianGuo Zhang, Jie Cheng, Ziyang Zhang, Qinghai Guo, Luziwei Leng
Inspired by continuous dynamics of biological neuron models, we propose a novel encoding method for sparse events - continuous time convolution (CTC) - which learns to model the spatial feature of the data with intrinsic dynamics.
1 code implementation • 20 Oct 2021 • Kaichao You, Yong liu, Ziyang Zhang, Jianmin Wang, Michael I. Jordan, Mingsheng Long
(2) The best ranked PTM can either be fine-tuned and deployed if we have no preference for the model's architecture or the target PTM can be tuned by the top $K$ ranked PTMs via a Bayesian procedure that we propose.
1 code implementation • 14 Nov 2020 • Ziyang Zhang, Yingtao Luo
Machine learning over-fitting caused by data scarcity greatly limits the application of machine learning for molecules.