no code implementations • 25 Apr 2024 • Junting Dong, Qi Fang, Zehuan Huang, Xudong Xu, Jingbo Wang, Sida Peng, Bo Dai
Previous works usually encode the human body and clothes as a holistic model and generate the whole model in a single-stage optimization, which makes them struggle for clothing editing and meanwhile lose fine-grained control over the whole generation process.
no code implementations • 4 Apr 2024 • Kailin Li, Jingbo Wang, Lixin Yang, Cewu Lu, Bo Dai
We introduce a discrete representation that aligns the grasp space with semantic space, enabling the generation of grasp postures in accordance with language instructions.
1 code implementation • 18 Jan 2024 • Shilin Xu, Haobo Yuan, Qingyu Shi, Lu Qi, Jingbo Wang, Yibo Yang, Yining Li, Kai Chen, Yunhai Tong, Bernard Ghanem, Xiangtai Li, Ming-Hsuan Yang
Segment Anything Model (SAM) is one remarkable model that can achieve generalized segmentation.
no code implementations • 4 Dec 2023 • Wenyang Zhou, Zhiyang Dou, Zeyu Cao, Zhouyingcheng Liao, Jingbo Wang, Wenjia Wang, YuAn Liu, Taku Komura, Wenping Wang, Lingjie Liu
We introduce Efficient Motion Diffusion Model (EMDM) for fast and high-quality human motion generation.
no code implementations • 29 Nov 2023 • Xuekun Jiang, Anyi Rao, Jingbo Wang, Dahua Lin, Bo Dai
In the evolving landscape of digital media and video production, the precise manipulation and reproduction of visual elements like camera movements and character actions are highly desired.
1 code implementation • 27 Nov 2023 • Zhenzhi Wang, Jingbo Wang, Yixuan Li, Dahua Lin, Bo Dai
Furthermore, we demonstrate that the distance between joint pairs for human-wise interactions can be generated using an off-the-shelf Large Language Model (LLM).
1 code implementation • 14 Sep 2023 • Zeqi Xiao, Tai Wang, Jingbo Wang, Jinkun Cao, Wenwei Zhang, Bo Dai, Dahua Lin, Jiangmiao Pang
Based on the definition, UniHSI constitutes a Large Language Model (LLM) Planner to translate language prompts into task plans in the form of CoC, and a Unified Controller that turns CoC into uniform task execution.
1 code implementation • 17 Aug 2023 • Liang Pan, Jingbo Wang, Buzhen Huang, Junyu Zhang, Haofan Wang, Xu Tang, Yangang Wang
Experimental results demonstrate that our framework can synthesize physically plausible long-term human motions in complex 3D scenes.
1 code implementation • ICCV 2023 • Wei Cheng, Ruixiang Chen, Wanqi Yin, Siming Fan, Keyu Chen, Honglin He, Huiwen Luo, Zhongang Cai, Jingbo Wang, Yang Gao, Zhengming Yu, Zhengyu Lin, Daxuan Ren, Lei Yang, Ziwei Liu, Chen Change Loy, Chen Qian, Wayne Wu, Dahua Lin, Bo Dai, Kwan-Yee Lin
Realistic human-centric rendering plays a key role in both computer vision and computer graphics.
no code implementations • 17 Jul 2023 • Yannan Li, Jingbo Wang, Chao Wang
In other words, they cannot falsify the truly-non-robust cases.
no code implementations • 17 Jul 2023 • Yannan Li, Jingbo Wang, Chao Wang
We propose a method for certifying the fairness of the classification result of a widely used supervised learning algorithm, the k-nearest neighbors (KNN), under the assumption that the training data may have historical bias caused by systematic mislabeling of samples from a protected minority group.
no code implementations • 1 Jun 2023 • Yi Shi, Jingbo Wang, Xuekun Jiang, Bo Dai
To enable real-time motion synthesis with diffusion models in response to time-varying control signals, we propose the framework of the Controllable Motion Diffusion Model (COMODO).
no code implementations • 25 May 2023 • Xiaokang Chen, Jiaxiang Tang, Diwen Wan, Jingbo Wang, Gang Zeng
We propose to imitate the backbone feature of off-the-shelf perception models to achieve zero-shot semantic segmentation with NeRF.
no code implementations • 23 Mar 2023 • Quanzhou Li, Jingbo Wang, Chen Change Loy, Bo Dai
Generating task-oriented human-object interaction motions in simulation is challenging.
no code implementations • ICCV 2023 • Jingbo Wang, Ye Yuan, Zhengyi Luo, Kevin Xie, Dahua Lin, Umar Iqbal, Sanja Fidler, Sameh Khamis
In this work, we propose a holistic framework for learning physically plausible human dynamics from real driving scenarios, narrowing the gap between real and simulated human behavior in safety-critical applications.
2 code implementations • 30 May 2022 • Jiaxiang Tang, Xiaokang Chen, Jingbo Wang, Gang Zeng
To circumvent the hurdle, in this paper, we present an explicit neural field representation that enables efficient and convenient manipulation of models.
no code implementations • CVPR 2022 • Jingbo Wang, Yu Rong, Jingyuan Liu, Sijie Yan, Dahua Lin, Bo Dai
The ability to synthesize long-term human motion sequences in real-world scenes can facilitate numerous applications.
1 code implementation • 10 Apr 2022 • Shilin Xu, Xiangtai Li, Jingbo Wang, Guangliang Cheng, Yunhai Tong, DaCheng Tao
This focus on joint human fashion segmentation and attribute recognition.
1 code implementation • 31 Mar 2022 • Jiaxiang Tang, Xiaokang Chen, Jingbo Wang, Gang Zeng
Semantic scene reconstruction from point cloud is an essential and challenging task for 3D scene understanding.
no code implementations • 24 Dec 2021 • Xiaokang Chen, Jiaxiang Tang, Jingbo Wang, Gang Zeng
Firstly, we transfer the voxelized scenes to point clouds by removing these visible empty voxels and adopt a deep point stream to capture semantic information from the scene efficiently.
Ranked #4 on 3D Semantic Scene Completion on NYUv2
no code implementations • 1 Nov 2021 • Yu Rong, Jingbo Wang, Ziwei Liu, Chen Change Loy
In this paper, we make the first attempt to reconstruct 3D interacting hands from monocular single RGB images.
1 code implementation • 4 Sep 2021 • Robin Schmucker, Jingbo Wang, Shijia Hu, Tom M. Mitchell
This student performance (SP) modeling problem is a critical step for building adaptive online teaching systems.
no code implementations • CVPR 2021 • Jingbo Wang, Sijie Yan, Bo Dai, Dahua Lin
We revisit human motion synthesis, a task useful in various real world applications, in this paper.
no code implementations • CUHK Course IERG5350 2020 • Jingbo Wang, Zijing YIN
Character controlling is a longstanding problem in understanding the behavior of human.
1 code implementation • NeurIPS 2020 • Xu Liu, Chengtao Li, Jian Wang, Jingbo Wang, Boxin Shi, Xiaodong He
In this work, we extended the contextual encoding layer that was originally designed for 2D tasks to 3D Point Cloud scenarios.
no code implementations • 21 Sep 2020 • Brandon Paulsen, Jingbo Wang, Jiawei Wang, Chao Wang
Unfortunately, existing methods either focus on verifying a single network or rely on loose approximations to prove the equivalence of two networks.
2 code implementations • ECCV 2020 • Yajie Xing, Jingbo Wang, Gang Zeng
In this paper, we propose a novel operator called malleable 2. 5D convolution to learn the receptive field along the depth-axis.
Ranked #46 on Semantic Segmentation on NYU Depth v2
2 code implementations • ECCV 2020 • Xiaokang Chen, Kwan-Yee Lin, Jingbo Wang, Wayne Wu, Chen Qian, Hongsheng Li, Gang Zeng
Depth information has proven to be a useful cue in the semantic segmentation of RGB-D images for providing a geometric counterpart to the RGB representation.
1 code implementation • ECCV 2020 • Jingbo Wang, Sijie Yan, Yuanjun Xiong, Dahua Lin
We propose a new loss function, called motion loss, for the problem of monocular 3D Human pose estimation from 2D pose.
Ranked #19 on 3D Human Pose Estimation on Human3.6M
7 code implementations • 5 Apr 2020 • Changqian Yu, Changxin Gao, Jingbo Wang, Gang Yu, Chunhua Shen, Nong Sang
We propose to treat these spatial details and categorical semantics separately to achieve high accuracy and high efficiency for realtime semantic segmentation.
Ranked #1 on Real-Time Semantic Segmentation on COCO-Stuff
2 code implementations • CVPR 2020 • Changqian Yu, Jingbo Wang, Changxin Gao, Gang Yu, Chunhua Shen, Nong Sang
Given an input image and corresponding ground truth, Affinity Loss constructs an ideal affinity map to supervise the learning of Context Prior.
Ranked #1 on Scene Understanding on ADE20K val
1 code implementation • 5 Mar 2020 • Edric Matwiejew, Jingbo Wang
QSW_MPI is a python package developed for the modeling of quantum stochastic walks, a generalization of the classical random walk and continuous-time quantum walk in the Lindblad formalism.
Quantum Physics Distributed, Parallel, and Cluster Computing Computational Physics D.1.3; G.4
no code implementations • 10 Jan 2020 • Brandon Paulsen, Jingbo Wang, Chao Wang
Existing verification techniques such as Reluplex, ReluVal, and DeepPoly provide formal guarantees, but they are designed for analyzing a single network instead of the relationship between two networks.
2 code implementations • 16 Dec 2019 • Samuel Marsh, Jingbo Wang
CTQWs form the core mixing operation of a generalised version of the Quantum Approximate Optimisation Algorithm, which works by 'steering' the quantum amplitude into high-quality solutions.
Quantum Physics
no code implementations • CVPR 2019 • Huanyu Liu, Chao Peng, Changqian Yu, Jingbo Wang, Xu Liu, Gang Yu, Wei Jiang
Panoptic segmentation, which needs to assign a category label to each pixel and segment each object instance simultaneously, is a challenging topic.
no code implementations • 25 Aug 2018 • Emre Demirkaya, Yingying Fan, Lan Gao, Jinchi Lv, Patrick Vossler, Jingbo Wang
The weighted nearest neighbors (WNN) estimator has been popularly used as a flexible and easy-to-implement nonparametric tool for mean regression estimation.
18 code implementations • ECCV 2018 • Changqian Yu, Jingbo Wang, Chao Peng, Changxin Gao, Gang Yu, Nong Sang
Semantic segmentation requires both rich spatial information and sizeable receptive field.
Ranked #4 on Semantic Segmentation on SkyScapes-Dense
Dichotomous Image Segmentation Real-Time Semantic Segmentation +2
3 code implementations • CVPR 2018 • Changqian Yu, Jingbo Wang, Chao Peng, Changxin Gao, Gang Yu, Nong Sang
Most existing methods of semantic segmentation still suffer from two aspects of challenges: intra-class inconsistency and inter-class indistinction.
Ranked #5 on Semantic Segmentation on PASCAL VOC 2012 test
2 code implementations • 23 Apr 2018 • Samuel Marsh, Jingbo Wang
This paper describes an application of the Quantum Approximate Optimisation Algorithm (QAOA) to efficiently find approximate solutions for computational problems contained in the polynomially bounded NP optimisation complexity class (NPO PB).
Quantum Physics
no code implementations • 2 Apr 2017 • Kun He, Jingbo Wang, Haochuan Li, Yao Shu, Mengxiao Zhang, Man Zhu, Li-Wei Wang, John E. Hopcroft
Toward a deeper understanding on the inner work of deep neural networks, we investigate CNN (convolutional neural network) using DCN (deconvolutional network) and randomization technique, and gain new insights for the intrinsic property of this network architecture.