Search Results for author: Ying He

Found 44 papers, 19 papers with code

Large Motion Model for Unified Multi-Modal Motion Generation

no code implementations1 Apr 2024 Mingyuan Zhang, Daisheng Jin, Chenyang Gu, Fangzhou Hong, Zhongang Cai, Jingfang Huang, Chongzhi Zhang, Xinying Guo, Lei Yang, Ying He, Ziwei Liu

In this work, we present Large Motion Model (LMM), a motion-centric, multi-modal framework that unifies mainstream motion generation tasks into a generalist model.

ParaPoint: Learning Global Free-Boundary Surface Parameterization of 3D Point Clouds

no code implementations15 Mar 2024 Qijian Zhang, Junhui Hou, Ying He

To the best of our knowledge, this work makes the first attempt to investigate neural point cloud parameterization that pursues both global mappings and free boundaries.

3D Gaussian as a New Vision Era: A Survey

no code implementations11 Feb 2024 Ben Fei, Jingyi Xu, Rui Zhang, Qingyuan Zhou, Weidong Yang, Ying He

3D Gaussian Splatting (3D-GS) has emerged as a significant advancement in the field of Computer Graphics, offering explicit scene representation and novel view synthesis without the reliance on neural networks, such as Neural Radiance Fields (NeRF).

Autonomous Navigation Novel View Synthesis

Topology-Aware Latent Diffusion for 3D Shape Generation

no code implementations31 Jan 2024 Jiangbei Hu, Ben Fei, Baixin Xu, Fei Hou, Weidong Yang, Shengfa Wang, Na lei, Chen Qian, Ying He

By strategically incorporating topological features into the diffusion process, our generative module is able to produce a richer variety of 3D shapes with different topological structures.

3D Shape Generation Navigate

Robust Geometry and Reflectance Disentanglement for 3D Face Reconstruction from Sparse-view Images

no code implementations11 Dec 2023 Daisheng Jin, Jiangbei Hu, Baixin Xu, Yuxin Dai, Chen Qian, Ying He

This paper presents a novel two-stage approach for reconstructing human faces from sparse-view images, a task made challenging by the unique geometry and complex skin reflectance of each individual.

3D Face Reconstruction Disentanglement +1

Identity-Obscured Neural Radiance Fields: Privacy-Preserving 3D Facial Reconstruction

no code implementations7 Dec 2023 Jiayi Kong, Baixin Xu, Xurui Song, Chen Qian, Jun Luo, Ying He

Neural radiance fields (NeRF) typically require a complete set of images taken from multiple camera perspectives to accurately reconstruct geometric details.

Privacy Preserving

Dynamic Link Prediction for New Nodes in Temporal Graph Networks

no code implementations15 Oct 2023 Xiaobo Zhu, Yan Wu, Qinhu Zhang, Zhanheng Chen, Ying He

To overcome the few-shot challenge, we incorporate the encoder-predictor into the meta-learning paradigm, which can learn two types of implicit information during the formation of the temporal network through span adaptation and node adaptation.

Dynamic Link Prediction Meta-Learning +1

Parameterization-driven Neural Implicit Surfaces Editing

no code implementations9 Oct 2023 Baixin Xu, Jiangbei Hu, Fei Hou, Kwan-Yee Lin, Wayne Wu, Chen Qian, Ying He

In this paper, we present a novel neural algorithm to parameterize neural implicit surfaces to simple parametric domains, such as spheres, cubes, or polycubes, thereby facilitating visualization and various editing tasks.

Neural Rendering

Robust Zero Level-Set Extraction from Unsigned Distance Fields Based on Double Covering

1 code implementation5 Oct 2023 Fei Hou, Xuhui Chen, Wencheng Wang, Hong Qin, Ying He

We show that the computed iso-surface is the boundary of the $r$-offset volume of the target zero level-set $S$, which is an orientable manifold, regardless of the topology of $S$.

O$^2$-Recon: Completing 3D Reconstruction of Occluded Objects in the Scene with a Pre-trained 2D Diffusion Model

1 code implementation18 Aug 2023 Yubin Hu, Sheng Ye, Wang Zhao, Matthieu Lin, Yuze He, Yu-Hui Wen, Ying He, Yong-Jin Liu

In this paper, we propose a novel framework, empowered by a 2D diffusion-based in-painting model, to reconstruct complete surfaces for the hidden parts of objects.

3D Reconstruction Blocking

RePaint-NeRF: NeRF Editting via Semantic Masks and Diffusion Models

no code implementations9 Jun 2023 Xingchen Zhou, Ying He, F. Richard Yu, Jianqiang Li, You Li

The emergence of Neural Radiance Fields (NeRF) has promoted the development of synthesized high-fidelity views of the intricate real world.

NeuroGF: A Neural Representation for Fast Geodesic Distance and Path Queries

1 code implementation NeurIPS 2023 Qijian Zhang, Junhui Hou, Yohanes Yudhi Adikusuma, Wenping Wang, Ying He

To bridge this gap, this paper presents the first attempt to represent geodesics on 3D mesh models using neural implicit functions.

GTNet: Graph Transformer Network for 3D Point Cloud Classification and Semantic Segmentation

no code implementations24 May 2023 Wei Zhou, Qian Wang, Weiwei Jin, Xinzhe Shi, Ying He

Local Transformer uses a dynamic graph to calculate all neighboring point weights by intra-domain cross-attention with dynamically updated graph relations, so that every neighboring point could affect the features of centroid with different weights; Global Transformer enlarges the receptive field of Local Transformer by a global self-attention.

3D Point Cloud Classification Point Cloud Classification +1

Self-supervised Learning for Pre-Training 3D Point Clouds: A Survey

no code implementations8 May 2023 Ben Fei, Weidong Yang, Liwen Liu, Tianyue Luo, Rui Zhang, Yixuan Li, Ying He

Finally, we share our thoughts on some of the challenges and potential issues that future research in self-supervised learning for pre-training 3D point clouds may encounter.

Autonomous Driving Representation Learning +1

IterativePFN: True Iterative Point Cloud Filtering

1 code implementation CVPR 2023 Dasith de Silva Edirimuni, Xuequan Lu, Zhiwen Shao, Gang Li, Antonio Robles-Kelly, Ying He

Consequently, a fundamental 3D vision task is the removal of noise, known as point cloud filtering or denoising.

Denoising

2S-UDF: A Novel Two-stage UDF Learning Method for Robust Non-watertight Model Reconstruction from Multi-view Images

1 code implementation27 Mar 2023 Junkai Deng, Fei Hou, Xuhui Chen, Wencheng Wang, Ying He

Yet, a central challenge in UDF-based volume rendering is formulating a proper way to convert unsigned distance values into volume density, ensuring that the resulting weight function remains unbiased and sensitive to occlusions.

3D Reconstruction

Deformable Model-Driven Neural Rendering for High-Fidelity 3D Reconstruction of Human Heads Under Low-View Settings

2 code implementations ICCV 2023 Baixin Xu, Jiarui Zhang, Kwan-Yee Lin, Chen Qian, Ying He

To address this, we propose geometry decomposition and adopt a two-stage, coarse-to-fine training strategy, allowing for progressively capturing high-frequency geometric details.

3D Reconstruction Neural Rendering +1

OPE-SR: Orthogonal Position Encoding for Designing a Parameter-free Upsampling Module in Arbitrary-scale Image Super-Resolution

no code implementations CVPR 2023 Gaochao Song, Luo Zhang, Ran Su, Jianfeng Shi, Ying He, Qian Sun

Motivated by position encoding, we propose orthogonal position encoding (OPE) - an extension of position encoding - and an OPE-Upscale module to replace the INR-based upsampling module for arbitrary-scale image super-resolution.

Image Reconstruction Image Super-Resolution +1

Flattening-Net: Deep Regular 2D Representation for 3D Point Cloud Analysis

1 code implementation17 Dec 2022 Qijian Zhang, Junhui Hou, Yue Qian, Yiming Zeng, Juyong Zhang, Ying He

In this paper, we present an unsupervised deep neural architecture called Flattening-Net to represent irregular 3D point clouds of arbitrary geometry and topology as a completely regular 2D point geometry image (PGI) structure, in which coordinates of spatial points are captured in colors of image pixels.

GeoUDF: Surface Reconstruction from 3D Point Clouds via Geometry-guided Distance Representation

1 code implementation ICCV 2023 Siyu Ren, Junhui Hou, Xiaodong Chen, Ying He, Wenping Wang

We present a learning-based method, namely GeoUDF, to tackle the long-standing and challenging problem of reconstructing a discrete surface from a sparse point cloud. To be specific, we propose a geometry-guided learning method for UDF and its gradient estimation that explicitly formulates the unsigned distance of a query point as the learnable affine averaging of its distances to the tangent planes of neighboring points on the surface.

Surface Reconstruction

PCDNF: Revisiting Learning-based Point Cloud Denoising via Joint Normal Filtering

no code implementations2 Sep 2022 Zheng Liu, Yaowu Zhao, Sijing Zhan, Yuanyuan Liu, Renjie Chen, Ying He

Motivated by the essential interplay between point cloud denoising and normal filtering, we revisit point cloud denoising from a multitask perspective, and propose an end-to-end network, named PCDNF, to denoise point clouds via joint normal filtering.

Denoising

RT-KGD: Relation Transition Aware Knowledge-Grounded Dialogue Generation

1 code implementation17 Jul 2022 Kexin Wang, Zhixu Li, Jiaan Wang, Jianfeng Qu, Ying He, An Liu, Lei Zhao

Nevertheless, the correlations between knowledge implied in the multi-turn context and the transition regularities between relations in KGs are under-explored.

Dialogue Generation Knowledge Graphs +2

Hierarchical Vectorization for Portrait Images

no code implementations24 May 2022 QiAn Fu, Linlin Liu, Fei Hou, Ying He

We evaluate our method on the FFHQR dataset and show that our method is effective for common portrait editing tasks, such as retouching, light editing, color transfer and expression editing.

Flexible Portrait Image Editing with Fine-Grained Control

no code implementations4 Apr 2022 Linlin Liu, QiAn Fu, Fei Hou, Ying He

We develop a new method for portrait image editing, which supports fine-grained editing of geometries, colors, lights and shadows using a single neural network model.

Image Generation Sketch-to-Image Translation

IDEA-Net: Dynamic 3D Point Cloud Interpolation via Deep Embedding Alignment

1 code implementation CVPR 2022 Yiming Zeng, Yue Qian, Qijian Zhang, Junhui Hou, Yixuan Yuan, Ying He

This paper investigates the problem of temporally interpolating dynamic 3D point clouds with large non-rigid deformation.

3D Point Cloud Interpolation

Multi-Person Passive WiFi Indoor Localization with Intelligent Reflecting Surface

no code implementations5 Jan 2022 Ganlin Zhang, Dongheng Zhang, Ying He, Jinbo Chen, Fang Zhou, Yan Chen

The past years have witnessed increasing research interest in achieving passive human localization with commodity WiFi devices.

Indoor Localization

High-Resolution WiFi Imaging with Reconfigurable Intelligent Surfaces

no code implementations1 Dec 2021 Ying He, Dongheng Zhang, Yan Chen

Thus, in this paper, we propose a RIS-aided WiFi imaging framework to achieve high-resolution imaging with the off-the-shelf WiFi devices.

Privacy Preserving Quantization +3

Multi Point-Voxel Convolution (MPVConv) for Deep Learning on Point Clouds

no code implementations28 Jul 2021 Wei Zhou, Xin Cao, Xiaodan Zhang, Xingxing Hao, Dekui Wang, Ying He

Extensive experiments on benchmark datasets such as ShapeNet Part, S3DIS and KITTI for various tasks show that MPVConv improves the accuracy of the backbone (PointNet) by up to \textbf{36\%}, and achieves higher accuracy than the voxel-based model with up to \textbf{34}$\times$ speedups.

PU-Flow: a Point Cloud Upsampling Network with Normalizing Flows

1 code implementation13 Jul 2021 Aihua Mao, Zihui Du, Junhui Hou, Yaqi Duan, Yong-Jin Liu, Ying He

Point cloud upsampling aims to generate dense point clouds from given sparse ones, which is a challenging task due to the irregular and unordered nature of point sets.

point cloud upsampling

Multi Voxel-Point Neurons Convolution (MVPConv) for Fast and Accurate 3D Deep Learning

no code implementations30 Apr 2021 Wei Zhou, Xin Cao, Xiaodan Zhang, Xingxing Hao, Dekui Wang, Ying He

Extensive experiments on benchmark datasets such as ShapeNet Part, S3DIS and KITTI for various tasks show that MVPConv improves the accuracy of the backbone (PointNet) by up to 36%, and achieves higher accuracy than the voxel-based model with up to 34 times speedup.

CorrNet3D: Unsupervised End-to-end Learning of Dense Correspondence for 3D Point Clouds

1 code implementation CVPR 2021 Yiming Zeng, Yue Qian, Zhiyu Zhu, Junhui Hou, Hui Yuan, Ying He

The symmetric deformer, with an additional regularized loss, transforms the two permuted point clouds to each other to drive the unsupervised learning of the correspondence.

Ranked #6 on 3D Dense Shape Correspondence on SHREC'19 (using extra training data)

3D Dense Shape Correspondence

ParaNet: Deep Regular Representation for 3D Point Clouds

no code implementations5 Dec 2020 Qijian Zhang, Junhui Hou, Yue Qian, Juyong Zhang, Ying He

Although convolutional neural networks have achieved remarkable success in analyzing 2D images/videos, it is still non-trivial to apply the well-developed 2D techniques in regular domains to the irregular 3D point cloud data.

point cloud upsampling

Deep Magnification-Flexible Upsampling over 3D Point Clouds

1 code implementation25 Nov 2020 Yue Qian, Junhui Hou, Sam Kwong, Ying He

In addition, we propose a simple yet effective training strategy to drive such a flexible ability.

MOPS-Net: A Matrix Optimization-driven Network forTask-Oriented 3D Point Cloud Downsampling

1 code implementation1 May 2020 Yue Qian, Junhui Hou, Qijian Zhang, Yiming Zeng, Sam Kwong, Ying He

This paper explores the problem of task-oriented downsampling over 3D point clouds, which aims to downsample a point cloud while maintaining the performance of subsequent applications applied to the downsampled sparse points as much as possible.

Point Cloud Classification

PUGeo-Net: A Geometry-centric Network for 3D Point Cloud Upsampling

1 code implementation ECCV 2020 Yue Qian, Junhui Hou, Sam Kwong, Ying He

Matrix $\mathbf T$ approximates the augmented Jacobian matrix of a local parameterization and builds a one-to-one correspondence between the 2D parametric domain and the 3D tangent plane so that we can lift the adaptively distributed 2D samples (which are also learned from data) to 3D space.

Point Cloud Super Resolution point cloud upsampling +1

Pointfilter: Point Cloud Filtering via Encoder-Decoder Modeling

no code implementations14 Feb 2020 Dongbo Zhang, Xuequan Lu, Hong Qin, Ying He

In this paper, we propose a novel deep learning approach that automatically and robustly filters point clouds with removing noise and preserving sharp features and geometric details.

Graphics

Spotting Macro- and Micro-expression Intervals in Long Video Sequences

2 code implementations18 Dec 2019 Ying He, Su-Jing Wang, Jingting Li, Moi Hoon Yap

Both macro- and micro-expression intervals in CAS(ME)$^2$ and SAMM Long Videos are spotted by employing the method of Main Directional Maximal Difference Analysis (MDMD).

Micro-Expression Spotting Optical Flow Estimation

HLO: Half-kernel Laplacian Operator for Surface Smoothing

1 code implementation12 May 2019 Wei Pan, Xuequan Lu, Yuanhao Gong, Wenming Tang, Jun Liu, Ying He, Guoping Qiu

This paper presents a simple yet effective method for feature-preserving surface smoothing.

Computational Geometry Graphics

Blur Removal via Blurred-Noisy Image Pair

no code implementations26 Mar 2019 Chunzhi Gu, Xuequan Lu, Ying He, Chao Zhang

Complex blur such as the mixup of space-variant and space-invariant blur, which is hard to model mathematically, widely exists in real images.

Deblurring Image Deblurring +1

Parallel and Scalable Heat Methods for Geodesic Distance Computation

1 code implementation14 Dec 2018 Jiong Tao, Juyong Zhang, Bailin Deng, Zheng Fang, Yue Peng, Ying He

In this paper, we propose a parallel and scalable approach for geodesic distance computation on triangle meshes.

Graphics

Cannot find the paper you are looking for? You can Submit a new open access paper.