Search Results for author: Siwei Zhang

Found 14 papers, 9 papers with code

Prompt Learning on Temporal Interaction Graphs

no code implementations9 Feb 2024 Xi Chen, Siwei Zhang, Yun Xiong, Xixi Wu, Jiawei Zhang, Xiangguo Sun, Yao Zhang, Feng Zhao, Yulin kang

In detail, we propose a temporal prompt generator to offer temporally-aware prompts for different tasks.

Representation Learning

RoHM: Robust Human Motion Reconstruction via Diffusion

no code implementations16 Jan 2024 Siwei Zhang, Bharat Lal Bhatnagar, Yuanlu Xu, Alexander Winkler, Petr Kadlecek, Siyu Tang, Federica Bogo

We apply RoHM to a variety of tasks -- from motion reconstruction and denoising to spatial and temporal infilling.

Denoising

EgoGen: An Egocentric Synthetic Data Generator

no code implementations16 Jan 2024 Gen Li, Kaifeng Zhao, Siwei Zhang, Xiaozhong Lyu, Mihai Dusmanu, Yan Zhang, Marc Pollefeys, Siyu Tang

To address this challenge, we introduce EgoGen, a new synthetic data generator that can produce accurate and rich ground-truth training data for egocentric perception tasks.

Human Mesh Recovery Motion Synthesis

iLoRE: Dynamic Graph Representation with Instant Long-term Modeling and Re-occurrence Preservation

no code implementations5 Sep 2023 Siwei Zhang, Yun Xiong, Yao Zhang, Xixi Wu, Yiheng Sun, Jiawei Zhang

To overcome the indiscriminate updating issue, we introduce the Adaptive Short-term Updater module that will automatically discard the useless or noisy edges, ensuring iLoRE's effectiveness and instant ability.

Fraud Detection Representation Learning

SPEED: Streaming Partition and Parallel Acceleration for Temporal Interaction Graph Embedding

1 code implementation27 Aug 2023 Xi Chen, Yongxiang Liao, Yun Xiong, Yao Zhang, Siwei Zhang, Jiawei Zhang, Yiheng Sun

Simultaneously, resource consumption of a single-GPU can be diminished by up to 69%, thus enabling the multiple GPU-based training and acceleration encompassing millions of nodes and billions of edges.

Graph Embedding

POV-Surgery: A Dataset for Egocentric Hand and Tool Pose Estimation During Surgical Activities

1 code implementation19 Jul 2023 Rui Wang, Sophokles Ktistakis, Siwei Zhang, Mirko Meboldt, Quentin Lohmeyer

The surgical usage of Mixed Reality (MR) has received growing attention in areas such as surgical navigation systems, skill assessment, and robot-assisted surgeries.

hand-object pose Mixed Reality +3

Probabilistic Human Mesh Recovery in 3D Scenes from Egocentric Views

1 code implementation ICCV 2023 Siwei Zhang, Qianli Ma, Yan Zhang, Sadegh Aliakbarian, Darren Cosker, Siyu Tang

One of the biggest challenges of this task is severe body truncation due to close social distances in egocentric scenarios, which brings large pose ambiguities for unseen body parts.

Human Mesh Recovery

SAGA: Stochastic Whole-Body Grasping with Contact

1 code implementation19 Dec 2021 Yan Wu, Jiahao Wang, Yan Zhang, Siwei Zhang, Otmar Hilliges, Fisher Yu, Siyu Tang

Given an initial pose and the generated whole-body grasping pose as the start and end of the motion respectively, we design a novel contact-aware generative motion infilling module to generate a diverse set of grasp-oriented motions.

Object

EgoBody: Human Body Shape and Motion of Interacting People from Head-Mounted Devices

1 code implementation14 Dec 2021 Siwei Zhang, Qianli Ma, Yan Zhang, Zhiyin Qian, Taein Kwon, Marc Pollefeys, Federica Bogo, Siyu Tang

Key to reasoning about interactions is to understand the body pose and motion of the interaction partner from the egocentric view.

Motion Estimation

Learning Motion Priors for 4D Human Body Capture in 3D Scenes

1 code implementation ICCV 2021 Siwei Zhang, Yan Zhang, Federica Bogo, Marc Pollefeys, Siyu Tang

To prove the effectiveness of the proposed motion priors, we combine them into a novel pipeline for 4D human body capture in 3D scenes.

Friction

Facial Emotion Recognition with Noisy Multi-task Annotations

1 code implementation19 Oct 2020 Siwei Zhang, Zhiwu Huang, Danda Pani Paudel, Luc van Gool

In our formulation, we exploit a new method to enable the emotion prediction and the joint distribution learning in a unified adversarial learning game.

Facial Emotion Recognition

PLACE: Proximity Learning of Articulation and Contact in 3D Environments

1 code implementation12 Aug 2020 Siwei Zhang, Yan Zhang, Qianli Ma, Michael J. Black, Siyu Tang

To synthesize realistic human-scene interactions, it is essential to effectively represent the physical contact and proximity between the body and the world.

Neural Architecture Search as Sparse Supernet

no code implementations31 Jul 2020 Yan Wu, Aoming Liu, Zhiwu Huang, Siwei Zhang, Luc van Gool

This paper aims at enlarging the problem of Neural Architecture Search (NAS) from Single-Path and Multi-Path Search to automated Mixed-Path Search.

Neural Architecture Search

One-shot Face Reenactment

2 code implementations5 Aug 2019 Yunxuan Zhang, Siwei Zhang, Yue He, Cheng Li, Chen Change Loy, Ziwei Liu

However, in real-world scenario end-users often only have one target face at hand, rendering existing methods inapplicable.

Face Reconstruction Face Reenactment

Cannot find the paper you are looking for? You can Submit a new open access paper.