Search Results for author: Zijie Wu

Found 11 papers, 1 papers with code

SC4D: Sparse-Controlled Video-to-4D Generation and Motion Transfer

no code implementations4 Apr 2024 Zijie Wu, Chaohui Yu, Yanqin Jiang, Chenjie Cao, Fan Wang, Xiang Bai

Recent advances in 2D/3D generative models enable the generation of dynamic 3D objects from a single-view video.

motion prediction

3D Object Detection from Point Cloud via Voting Step Diffusion

no code implementations21 Mar 2024 Haoran Hou, Mingtao Feng, Zijie Wu, Weisheng Dong, Qing Zhu, Yaonan Wang, Ajmal Mian

In this work, we focus on the distributional properties of point clouds and formulate the voting process as generating new points in the high-density region of the distribution of object centers.

3D Object Detection Object +2

External Knowledge Enhanced 3D Scene Generation from Sketch

no code implementations21 Mar 2024 Zijie Wu, Mingtao Feng, Yaonan Wang, He Xie, Weisheng Dong, Bo Miao, Ajmal Mian

Generating realistic 3D scenes is challenging due to the complexity of room layouts and object geometries. We propose a sketch based knowledge enhanced diffusion architecture (SEK) for generating customized, diverse, and plausible 3D scenes.

Denoising Object +1

Beyond Skeletons: Integrative Latent Mapping for Coherent 4D Sequence Generation

no code implementations20 Mar 2024 Qitong Yang, Mingtao Feng, Zijie Wu, ShiJie Sun, Weisheng Dong, Yaonan Wang, Ajmal Mian

To address this, we propose a novel framework that generates coherent 4D sequences with animation of 3D shapes under given conditions with dynamic evolution of shape and color over time through integrative latent mapping.

Enhancing Scene Text Detectors with Realistic Text Image Synthesis Using Diffusion Models

no code implementations28 Nov 2023 Ling Fu, Zijie Wu, Yingying Zhu, Yuliang Liu, Xiang Bai

We contend that one main limitation of existing generation methods is the insufficient integration of foreground text with the background.

Image Generation Scene Text Detection +1

SingleInsert: Inserting New Concepts from a Single Image into Text-to-Image Models for Flexible Editing

no code implementations12 Oct 2023 Zijie Wu, Chaohui Yu, Zhen Zhu, Fan Wang, Xiang Bai

To utilize the abundant visual priors in the off-the-shelf T2I models, a series of methods try to invert an image to proper embedding that aligns with the semantic space of the T2I model.

Image Generation Novel View Synthesis

Sketch and Text Guided Diffusion Model for Colored Point Cloud Generation

no code implementations ICCV 2023 Zijie Wu, Yaonan Wang, Mingtao Feng, He Xie, Ajmal Mian

In this paper, we propose a sketch and text guided probabilistic diffusion model for colored point cloud generation that conditions the denoising process jointly with a hand drawn sketch of the object and its textual description.

Denoising Image Generation +1

Learning in a Single Domain for Non-Stationary Multi-Texture Synthesis

no code implementations10 May 2023 Xudong Xie, Zhen Zhu, Zijie Wu, Zhiliang Xu, Yingying Zhu

To our knowledge, ours is the first scheme for this challenging task, including model, training, and evaluation.

Texture Synthesis

3D Spatial Multimodal Knowledge Accumulation for Scene Graph Prediction in Point Cloud

no code implementations CVPR 2023 Mingtao Feng, Haoran Hou, Liang Zhang, Zijie Wu, Yulan Guo, Ajmal Mian

In-depth understanding of a 3D scene not only involves locating/recognizing individual objects, but also requires to infer the relationships and interactions among them.

CCPL: Contrastive Coherence Preserving Loss for Versatile Style Transfer

1 code implementation11 Jul 2022 Zijie Wu, Zhen Zhu, Junping Du, Xiang Bai

CCPL can preserve the coherence of the content source during style transfer without degrading stylization.

Image-to-Image Translation Style Transfer +1

Minimum Potential Energy of Point Cloud for Robust Global Registration

no code implementations11 Jun 2020 Zijie Wu, Yaonan Wang, Qing Zhu, Jianxu Mao, Haotian Wu, Mingtao Feng, Ajmal Mian

Different from the most existing point set registration methods which usually extract the descriptors to find correspondences between point sets, our proposed MPE alignment method is able to handle large scale raw data offset without depending on traditional descriptors extraction, whether for the local or global registration methods.

Cannot find the paper you are looking for? You can Submit a new open access paper.