Search Results for author: Xingzhe He

Found 15 papers, 7 papers with code

Unsupervised Keypoints from Pretrained Diffusion Models

1 code implementation29 Nov 2023 Eric Hedlin, Gopal Sharma, Shweta Mahajan, Xingzhe He, Hossam Isack, Abhishek Kar Helge Rhodin, Andrea Tagliasacchi, Kwang Moo Yi

Unsupervised learning of keypoints and landmarks has seen significant progress with the help of modern neural network architectures, but performance is yet to match the supervised counterpart, making their practicability questionable.

Denoising Unsupervised Human Pose Estimation +1

Few-shot Geometry-Aware Keypoint Localization

no code implementations CVPR 2023 Xingzhe He, Gaurav Bharaj, David Ferman, Helge Rhodin, Pablo Garrido

Supervised keypoint localization methods rely on large manually labeled image datasets, where objects can deform, articulate, or occlude.

Object Localization

Neural Partial Differential Equations with Functional Convolution

no code implementations10 Mar 2023 Ziqian Wu, Xingzhe He, Yijun Li, Cheng Yang, Rui Liu, Shiying Xiong, Bo Zhu

We present a lightweighted neural PDE representation to discover the hidden structure and predict the solution of different nonlinear PDEs.

AutoLink: Self-supervised Learning of Human Skeletons and Object Outlines by Linking Keypoints

1 code implementation21 May 2022 Xingzhe He, Bastian Wandt, Helge Rhodin

Our key ingredients are i) an encoder that predicts keypoint locations in an input image, ii) a shared graph as a latent variable that links the same pairs of keypoints in every image, iii) an intermediate edge map that combines the latent graph edge weights and keypoint locations in a soft, differentiable manner, and iv) an inpainting objective on randomly masked images.

Pose Estimation Self-Supervised Learning +6

LatentKeypointGAN: Controlling Images via Latent Keypoints -- Extended Abstract

no code implementations6 May 2022 Xingzhe He, Bastian Wandt, Helge Rhodin

Generative adversarial networks (GANs) can now generate photo-realistic images.

VortexNet: Learning Complex Dynamic Systems with Physics-Embedded Networks

no code implementations1 Jan 2021 Shiying Xiong, Xingzhe He, Yunjin Tong, Yitong Deng, Bo Zhu

Since the number of such vortices are much smaller than that of the Eulerian, grid discretization, this Lagrangian discretization in essence encodes the system dynamics on a compact physics-based latent space.

Nonseparable Symplectic Neural Networks

no code implementations ICLR 2021 Shiying Xiong, Yunjin Tong, Xingzhe He, Shuqi Yang, Cheng Yang, Bo Zhu

The enabling mechanics of our approach is an augmented symplectic time integrator to decouple the position and momentum energy terms and facilitate their evolution.

Position

Learning Physical Constraints with Neural Projections

1 code implementation NeurIPS 2020 Shuqi Yang, Xingzhe He, Bo Zhu

A neural projection operator lies at the heart of our approach, composed of a lightweight network with an embedded recursive architecture that interactively enforces learned underpinning constraints and predicts the various governed behaviors of different physical systems.

RoeNets: Predicting Discontinuity of Hyperbolic Systems from Continuous Data

no code implementations7 Jun 2020 Shiying Xiong, Xingzhe He, Yunjin Tong, Runze Liu, Bo Zhu

The ability of our model to predict long-term discontinuity from a short window of continuous training data is in general considered impossible using traditional machine learning approaches.

Neural Vortex Method: from Finite Lagrangian Particles to Infinite Dimensional Eulerian Dynamics

no code implementations7 Jun 2020 Shiying Xiong, Xingzhe He, Yunjin Tong, Yitong Deng, Bo Zhu

To tackle this challenge, we propose a novel learning-based framework, the Neural Vortex Method (NVM), which builds a neural-network description of the Lagrangian vortex structures and their interaction dynamics to reconstruct the high-resolution Eulerian flow field in a physically-precise manner.

Symplectic Neural Networks in Taylor Series Form for Hamiltonian Systems

1 code implementation11 May 2020 Yunjin Tong, Shiying Xiong, Xingzhe He, Guanghan Pan, Bo Zhu

We propose an effective and lightweight learning algorithm, Symplectic Taylor Neural Networks (Taylor-nets), to conduct continuous, long-term predictions of a complex Hamiltonian dynamic system based on sparse, short-term observations.

AdvectiveNet: An Eulerian-Lagrangian Fluidic reservoir for Point Cloud Processing

1 code implementation ICLR 2020 Xingzhe He, Helen Lu Cao, Bo Zhu

This paper presents a novel physics-inspired deep learning approach for point cloud processing motivated by the natural flow phenomena in fluid mechanics.

Point Cloud Classification

Cannot find the paper you are looking for? You can Submit a new open access paper.