1 code implementation • CVPR 2024 • Xiyi Chen, Marko Mihajlovic, Shaofei Wang, Sergey Prokudin, Siyu Tang
To the best of our knowledge, our proposed framework is the first diffusion model to enable the creation of fully 3D-consistent, animatable, and photorealistic human avatars from a single image of an unseen subject; extensive quantitative and qualitative evaluations demonstrate the advantages of our approach over existing state-of-the-art avatar creation models on both novel view and novel expression synthesis tasks.
1 code implementation • CVPR 2024 • Zhiyin Qian, Shaofei Wang, Marko Mihajlovic, Andreas Geiger, Siyu Tang
In this paper, we use 3D Gaussian Splatting and learn a non-rigid deformation network to reconstruct animatable clothed human avatars that can be trained within 30 minutes and rendered at real-time frame rates (50+ FPS).
1 code implementation • CVPR 2024 • Shaofei Wang, Božidar Antić, Andreas Geiger, Siyu Tang
We present IntrinsicAvatar, a novel approach to recovering the intrinsic properties of clothed human avatars including geometry, albedo, material, and environment lighting from only monocular videos.
no code implementations • 28 Sep 2023 • Yinheng Li, Shaofei Wang, Han Ding, Hang Chen
In this paper, we provide a practical survey focused on two key aspects of utilizing LLMs for financial tasks: existing solutions and guidance for adoption.
no code implementations • ICCV 2023 • Kaifeng Zhao, Yan Zhang, Shaofei Wang, Thabo Beeler, Siyu Tang
We present a novel method for populating 3D indoor scenes with virtual humans that can navigate in the environment and interact with objects in a realistic manner.
no code implementations • 23 Jan 2023 • Yinheng Li, Han Ding, Shaofei Wang
Self-supervised learning has become a popular approach in recent years for its ability to learn meaningful representations without the need for data annotation.
no code implementations • 18 Oct 2022 • Shaofei Wang, Katja Schwarz, Andreas Geiger, Siyu Tang
We demonstrate that our proposed pipeline can generate clothed avatars with high-quality pose-dependent geometry and appearance from a sparse set of multi-view RGB videos.
1 code implementation • 26 Jul 2022 • Kaifeng Zhao, Shaofei Wang, Yan Zhang, Thabo Beeler, Siyu Tang
Furthermore, inspired by the compositional nature of interactions that humans can simultaneously interact with multiple objects, we define interaction semantics as the composition of varying numbers of atomic action-object pairs.
no code implementations • 12 Jul 2021 • Cynthia Pagliaro, Dhagash Mehta, Han-Tai Shiao, Shaofei Wang, Luwei Xiong
With the help of natural language processing (NLP) we analyze an unstructured (textual) dataset of financial advisors' summary notes, taken after every investor conversation, to gain first ever insights into advisor-investor interactions.
1 code implementation • NeurIPS 2021 • Shaofei Wang, Marko Mihajlovic, Qianli Ma, Andreas Geiger, Siyu Tang
In contrast, we propose an approach that can quickly generate realistic clothed human avatars, represented as controllable neural SDFs, given only monocular depth images.
no code implementations • CVPR 2021 • Shaofei Wang, Andreas Geiger, Siyu Tang
We combine PTF with multi-class occupancy networks, obtaining a novel learning-based framework that learns to simultaneously predict shape and per-point correspondences between the posed space and the canonical space for clothed human.
no code implementations • 5 Mar 2021 • Xintian Wu, Pengfei Qu, Shaofei Wang, Lin Xie, Jie Dong
This paper introduces a new set of video analytics plugins developed for the FFmpeg framework.
1 code implementation • 6 Dec 2019 • Shaofei Wang, Vishnu Lokhande, Maneesh Singh, Konrad Kording, Julian Yarkony
These algorithms can efficiently and exactly solve sub-problems and directly optimize a convex upper bound of the real problem, providing optimality certificates on the way.
1 code implementation • 12 Sep 2019 • Vishnu Suresh Lokhande, Shaofei Wang, Maneesh Singh, Julian Yarkony
We tackle optimization of weighted set packing by relaxing integrality in our ILP formulation.
no code implementations • 24 Jul 2019 • Nidhi Seethapathi, Shaofei Wang, Rachit Saluja, Gunnar Blohm, Konrad P. Kording
Over the last decade, computer science has made progress towards extracting body pose from single camera photographs or videos.
no code implementations • ECCV 2018 • Shaofei Wang, Alexander Ihler, Konrad Kording, Julian Yarkony
We present a novel approach to solve dynamic programs (DP), which are frequent in computer vision, on tree-structured graphs with exponential node state space.
no code implementations • 13 May 2018 • Julian Yarkony, Shaofei Wang
To circumvent the difficulty of enumerating the vector product of state spaces of hyper-variables we introduce a novel Benders decomposition approach.
no code implementations • 21 Nov 2017 • Shaofei Wang, Konrad Paul Kording, Julian Yarkony
We test our approach on the MPII-Multiperson dataset, showing that our approach obtains comparable results with the state-of-the-art algorithm for joint node labeling and grouping problems, and that NBD achieves considerable speed-ups relative to a naive dynamic programming approach.
no code implementations • 21 Sep 2017 • Chong Zhang, Shaofei Wang, Miguel A. Gonzalez-Ballester, Julian Yarkony
To solve this integer program, we propose a column generation formulation where the pricing program is solved via exact optimization of very small scale integer programs.
no code implementations • 18 Sep 2017 • Shaofei Wang, Chong Zhang, Miguel A. Gonzalez-Ballester, Alexander Ihler, Julian Yarkony
We give a novel integer program formulation of the multi-person pose estimation problem, in which variables correspond to assignments of parts in the image to poses in a two-tier, hierarchical way.
no code implementations • 13 Sep 2017 • Shaofei Wang, Konrad Kording, Julian Yarkony
Many annotation problems in computer vision can be phrased as integer linear programs (ILPs).
no code implementations • 1 Dec 2016 • Shaofei Wang, Chong Zhang, Miguel A. Gonzalez-Ballester, Julian Yarkony
We study the problems of multi-person pose segmentation in natural images and instance segmentation in biological images with crowded cells.
no code implementations • 5 Oct 2016 • Shaofei Wang, Charless C. Fowlkes
In this learning framework, we evaluate two different approaches to finding an optimal set of tracks under a quadratic model objective, one based on an LP relaxation and the other based on novel greedy variants of dynamic programming that handle pairwise interactions.
no code implementations • 8 Dec 2015 • Shaofei Wang, Steffen Wolf, Charless Fowlkes, Julian Yarkony
We study the problem of multi-target tracking and data association in video.
no code implementations • 5 Dec 2014 • Shaofei Wang, Charless C. Fowlkes
We describe a model for multi-target tracking based on associating collections of candidate detections across frames of a video.