Search Results for author: Jingbo Wang

Found 43 papers, 21 papers with code

RoomTex: Texturing Compositional Indoor Scenes via Iterative Inpainting

no code implementations4 Jun 2024 Qi Wang, Ruijie Lu, Xudong Xu, Jingbo Wang, Michael Yu Wang, Bo Dai, Gang Zeng, Dan Xu

In the coarse stage, RoomTex first unwraps the scene mesh to a panoramic depth map and leverages ControlNet to generate a room panorama, which is regarded as the coarse reference to ensure the global texture consistency.

Edge Detection Text to 3D

PACER+: On-Demand Pedestrian Animation Controller in Driving Scenarios

no code implementations CVPR 2024 Jingbo Wang, Zhengyi Luo, Ye Yuan, Yixuan Li, Bo Dai

We address the challenge of content diversity and controllability in pedestrian simulation for driving scenarios.

MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Model

1 code implementation30 Apr 2024 Wenxun Dai, Ling-Hao Chen, Jingbo Wang, Jinpeng Liu, Bo Dai, Yansong Tang

By employing one-step (or few-step) inference, we further improve the runtime efficiency of the motion latent diffusion model for motion generation.

TELA: Text to Layer-wise 3D Clothed Human Generation

no code implementations25 Apr 2024 Junting Dong, Qi Fang, Zehuan Huang, Xudong Xu, Jingbo Wang, Sida Peng, Bo Dai

Previous works usually encode the human body and clothes as a holistic model and generate the whole model in a single-stage optimization, which makes them struggle for clothing editing and meanwhile lose fine-grained control over the whole generation process.

Disentanglement Virtual Try-on

SemGrasp: Semantic Grasp Generation via Language Aligned Discretization

no code implementations4 Apr 2024 Kailin Li, Jingbo Wang, Lixin Yang, Cewu Lu, Bo Dai

We introduce a discrete representation that aligns the grasp space with semantic space, enabling the generation of grasp postures in accordance with language instructions.

Grasp Generation Language Modelling +2

Cinematic Behavior Transfer via NeRF-based Differentiable Filming

no code implementations CVPR 2024 Xuekun Jiang, Anyi Rao, Jingbo Wang, Dahua Lin, Bo Dai

In the evolving landscape of digital media and video production, the precise manipulation and reproduction of visual elements like camera movements and character actions are highly desired.

Pose Estimation

InterControl: Generate Human Motion Interactions by Controlling Every Joint

1 code implementation27 Nov 2023 Zhenzhi Wang, Jingbo Wang, Yixuan Li, Dahua Lin, Bo Dai

Furthermore, we demonstrate that the distance between joint pairs for human-wise interactions can be generated using an off-the-shelf Large Language Model (LLM).

Language Modelling Large Language Model +1

Unified Human-Scene Interaction via Prompted Chain-of-Contacts

1 code implementation14 Sep 2023 Zeqi Xiao, Tai Wang, Jingbo Wang, Jinkun Cao, Wenwei Zhang, Bo Dai, Dahua Lin, Jiangmiao Pang

Based on the definition, UniHSI constitutes a Large Language Model (LLM) Planner to translate language prompts into task plans in the form of CoC, and a Unified Controller that turns CoC into uniform task execution.

Language Modelling Large Language Model

Synthesizing Physically Plausible Human Motions in 3D Scenes

1 code implementation17 Aug 2023 Liang Pan, Jingbo Wang, Buzhen Huang, Junyu Zhang, Haofan Wang, Xu Tang, Yangang Wang

Experimental results demonstrate that our framework can synthesize physically plausible long-term human motions in complex 3D scenes.

Certifying the Fairness of KNN in the Presence of Dataset Bias

no code implementations17 Jul 2023 Yannan Li, Jingbo Wang, Chao Wang

We propose a method for certifying the fairness of the classification result of a widely used supervised learning algorithm, the k-nearest neighbors (KNN), under the assumption that the training data may have historical bias caused by systematic mislabeling of samples from a protected minority group.

Fairness

Controllable Motion Diffusion Model

no code implementations1 Jun 2023 Yi Shi, Jingbo Wang, Xuekun Jiang, Bo Dai

To enable real-time motion synthesis with diffusion models in response to time-varying control signals, we propose the framework of the Controllable Motion Diffusion Model (COMODO).

Image Generation Motion Synthesis

Interactive Segment Anything NeRF with Feature Imitation

no code implementations25 May 2023 Xiaokang Chen, Jiaxiang Tang, Diwen Wan, Jingbo Wang, Gang Zeng

We propose to imitate the backbone feature of off-the-shelf perception models to achieve zero-shot semantic segmentation with NeRF.

Decoder Segmentation +2

Learning Human Dynamics in Autonomous Driving Scenarios

no code implementations ICCV 2023 Jingbo Wang, Ye Yuan, Zhengyi Luo, Kevin Xie, Dahua Lin, Umar Iqbal, Sanja Fidler, Sameh Khamis

In this work, we propose a holistic framework for learning physically plausible human dynamics from real driving scenarios, narrowing the gap between real and simulated human behavior in safety-critical applications.

Autonomous Driving Human Dynamics

Compressible-composable NeRF via Rank-residual Decomposition

2 code implementations30 May 2022 Jiaxiang Tang, Xiaokang Chen, Jingbo Wang, Gang Zeng

To circumvent the hurdle, in this paper, we present an explicit neural field representation that enables efficient and convenient manipulation of models.

Towards Diverse and Natural Scene-aware 3D Human Motion Synthesis

no code implementations CVPR 2022 Jingbo Wang, Yu Rong, Jingyuan Liu, Sijie Yan, Dahua Lin, Bo Dai

The ability to synthesize long-term human motion sequences in real-world scenes can facilitate numerous applications.

Motion Synthesis

Point Scene Understanding via Disentangled Instance Mesh Reconstruction

1 code implementation31 Mar 2022 Jiaxiang Tang, Xiaokang Chen, Jingbo Wang, Gang Zeng

Semantic scene reconstruction from point cloud is an essential and challenging task for 3D scene understanding.

Retrieval Scene Understanding

Not All Voxels Are Equal: Semantic Scene Completion from the Point-Voxel Perspective

no code implementations24 Dec 2021 Xiaokang Chen, Jiaxiang Tang, Jingbo Wang, Gang Zeng

Firstly, we transfer the voxelized scenes to point clouds by removing these visible empty voxels and adopt a deep point stream to capture semantic information from the scene efficiently.

3D Semantic Scene Completion

Monocular 3D Reconstruction of Interacting Hands via Collision-Aware Factorized Refinements

no code implementations1 Nov 2021 Yu Rong, Jingbo Wang, Ziwei Liu, Chen Change Loy

In this paper, we make the first attempt to reconstruct 3D interacting hands from monocular single RGB images.

3D Reconstruction

Assessing the Performance of Online Students -- New Data, New Approaches, Improved Accuracy

1 code implementation4 Sep 2021 Robin Schmucker, Jingbo Wang, Shijia Hu, Tom M. Mitchell

This student performance (SP) modeling problem is a critical step for building adaptive online teaching systems.

Knowledge Tracing regression

Scene-aware Generative Network for Human Motion Synthesis

no code implementations CVPR 2021 Jingbo Wang, Sijie Yan, Bo Dai, Dahua Lin

We revisit human motion synthesis, a task useful in various real world applications, in this paper.

Motion Synthesis

Group Contextual Encoding for 3D Point Clouds

1 code implementation NeurIPS 2020 Xu Liu, Chengtao Li, Jian Wang, Jingbo Wang, Boxin Shi, Xiaodong He

In this work, we extended the contextual encoding layer that was originally designed for 2D tasks to 3D Point Cloud scenarios.

Scene Understanding

NeuroDiff: Scalable Differential Verification of Neural Networks using Fine-Grained Approximation

no code implementations21 Sep 2020 Brandon Paulsen, Jingbo Wang, Jiawei Wang, Chao Wang

Unfortunately, existing methods either focus on verifying a single network or rely on loose approximations to prove the equivalence of two networks.

BiSeNet V2: Bilateral Network with Guided Aggregation for Real-time Semantic Segmentation

7 code implementations5 Apr 2020 Changqian Yu, Changxin Gao, Jingbo Wang, Gang Yu, Chunhua Shen, Nong Sang

We propose to treat these spatial details and categorical semantics separately to achieve high accuracy and high efficiency for realtime semantic segmentation.

Real-Time Semantic Segmentation Segmentation

Context Prior for Scene Segmentation

2 code implementations CVPR 2020 Changqian Yu, Jingbo Wang, Changxin Gao, Gang Yu, Chunhua Shen, Nong Sang

Given an input image and corresponding ground truth, Affinity Loss constructs an ideal affinity map to supervise the learning of Context Prior.

Scene Segmentation Scene Understanding +1

QSW_MPI: a framework for parallel simulation of quantum stochastic walks

1 code implementation5 Mar 2020 Edric Matwiejew, Jingbo Wang

QSW_MPI is a python package developed for the modeling of quantum stochastic walks, a generalization of the classical random walk and continuous-time quantum walk in the Lindblad formalism.

Quantum Physics Distributed, Parallel, and Cluster Computing Computational Physics D.1.3; G.4

ReluDiff: Differential Verification of Deep Neural Networks

no code implementations10 Jan 2020 Brandon Paulsen, Jingbo Wang, Chao Wang

Existing verification techniques such as Reluplex, ReluVal, and DeepPoly provide formal guarantees, but they are designed for analyzing a single network instead of the relationship between two networks.

Efficient quantum walks over exponentially large sets of combinatorial objects for optimisation

2 code implementations16 Dec 2019 Samuel Marsh, Jingbo Wang

CTQWs form the core mixing operation of a generalised version of the Quantum Approximate Optimisation Algorithm, which works by 'steering' the quantum amplitude into high-quality solutions.

Quantum Physics

An End-to-End Network for Panoptic Segmentation

no code implementations CVPR 2019 Huanyu Liu, Chao Peng, Changqian Yu, Jingbo Wang, Xu Liu, Gang Yu, Wei Jiang

Panoptic segmentation, which needs to assign a category label to each pixel and segment each object instance simultaneously, is a challenging topic.

Panoptic Segmentation Segmentation

Optimal Nonparametric Inference with Two-Scale Distributional Nearest Neighbors

no code implementations25 Aug 2018 Emre Demirkaya, Yingying Fan, Lan Gao, Jinchi Lv, Patrick Vossler, Jingbo Wang

The weighted nearest neighbors (WNN) estimator has been popularly used as a flexible and easy-to-implement nonparametric tool for mean regression estimation.

Causal Inference regression +1

Learning a Discriminative Feature Network for Semantic Segmentation

3 code implementations CVPR 2018 Changqian Yu, Jingbo Wang, Chao Peng, Changxin Gao, Gang Yu, Nong Sang

Most existing methods of semantic segmentation still suffer from two aspects of challenges: intra-class inconsistency and inter-class indistinction.

Semantic Segmentation Thermal Image Segmentation

A quantum walk assisted approximate algorithm for bounded NP optimisation problems

2 code implementations23 Apr 2018 Samuel Marsh, Jingbo Wang

This paper describes an application of the Quantum Approximate Optimisation Algorithm (QAOA) to efficiently find approximate solutions for computational problems contained in the polynomially bounded NP optimisation complexity class (NPO PB).

Quantum Physics

Randomness in Deconvolutional Networks for Visual Representation

no code implementations2 Apr 2017 Kun He, Jingbo Wang, Haochuan Li, Yao Shu, Mengxiao Zhang, Man Zhu, Li-Wei Wang, John E. Hopcroft

Toward a deeper understanding on the inner work of deep neural networks, we investigate CNN (convolutional neural network) using DCN (deconvolutional network) and randomization technique, and gain new insights for the intrinsic property of this network architecture.

General Classification Image Reconstruction

Cannot find the paper you are looking for? You can Submit a new open access paper.