no code implementations • 7 Jan 2024 • Haiyang Liu, Chunjiang Zhu, Detian Zhang
A sequence-aware graph neural network is proposed and integrated into the Gated Recurrent Unit (GRU) to learn non-fixed graphs at different time steps and capture local temporal relationships.
2 code implementations • 31 Dec 2023 • Haiyang Liu, Zihao Zhu, Giorgio Becherini, Yichen Peng, Mingyang Su, You Zhou, Xuefei Zhe, Naoya Iwamoto, Bo Zheng, Michael J. Black
We propose EMAGE, a framework to generate full-body human gestures from audio and masked gestures, encompassing facial, local body, hands, and global movements.
Ranked #1 on 3D Face Animation on BEAT2
no code implementations • 12 Nov 2023 • Hanfeng Cai, Haiyang Liu, Heyang Sun, Qiao Wang
This paper addresses the issue of enhancing the efficiency of a multiple module system connected in parallel during operation and proposes an algorithm based on equal incremental cost for dynamic load allocation.
no code implementations • 12 Oct 2023 • Haiyang Liu, Chunjiang Zhu, Detian Zhang, Qing Li
Traffic flow prediction is one of the most fundamental tasks of intelligent transportation systems.
1 code implementation • 25 Apr 2023 • Jie Xiang, Yun Wang, Lifeng An, Haiyang Liu, Jian Liu
Although both self-supervised single-frame and multi-frame depth estimation methods only require unlabeled monocular videos for training, the information they leverage varies because single-frame methods mainly rely on appearance-based features while multi-frame methods focus on geometric cues.
no code implementations • 25 Feb 2023 • Haiyang Liu, Chunjiang Zhu, Detian Zhang, Qing Li
The key challenge is to effectively model complex spatial-temporal dependencies and correlations in modern traffic data.
2 code implementations • 18 May 2022 • Jie Xiang, Yun Wang, Lifeng An, Haiyang Liu, Zijun Wang, Jian Liu
Although existing monocular depth estimation methods have made great progress, predicting an accurate absolute depth map from a single image is still challenging due to the limited modeling capacity of networks and the scale ambiguity issue.
2 code implementations • 10 Mar 2022 • Haiyang Liu, Zihao Zhu, Naoya Iwamoto, Yichen Peng, Zhengqing Li, You Zhou, Elif Bozkurt, Bo Zheng
Achieving realistic, vivid, and human-like synthesized conversational gestures conditioned on multi-modal data is still an unsolved problem due to the lack of available datasets, models and standard evaluation metrics.
Ranked #1 on Gesture Generation on BEAT
no code implementations • 20 Oct 2021 • Haiyang Liu, Dingli Luo, Songlin Du, Takeshi Ikenaga
To solve these problems, this paper proposes (i) a new loss organization method which uses self-supervised heatmaps to reduce prediction contradictions and spatial-sequential attention to enhance networks' features extraction; (ii) a new combination of predictions composed by heatmaps, Part Affinity Fields (PAFs) and our block-inside offsets to fix pixel-level joints positions and further demonstrates the effectiveness of proposed loss function.
no code implementations • 20 Jun 2021 • Haiyang Liu, Jihan Zhang
Speech production is a dynamic procedure, which involved multi human organs including the tongue, jaw and lips.
1 code implementation • 1 Jul 2020 • Haiyang Liu, Yichen Wang, Jiayi Zhao, Guowu Yang, Fengmao Lv
Our method assumes that both the source images with full pixel-level labels and unlabeled target images are available during training.
no code implementations • 17 Jun 2020 • Shaoqing Yuan, Parminder Bhatia, Busra Celikkaya, Haiyang Liu, Kyunghwan Choi
Medication name inference is the task of mapping user friendly medication names from a free-form text to a concept in a normalized medication list.
1 code implementation • 19 Mar 2019 • Mohan Shi, Zhihai Wang, Jodong Yuan, Haiyang Liu
Shapelet is a discriminative subsequence of time series.