Search Results for author: ZiYun Wang

Found 22 papers, 8 papers with code

Continuous-Time Human Motion Field from Events

no code implementations2 Dec 2024 ZiYun Wang, Ruijun Zhang, Zi-Yan Liu, Yufu Wang, Kostas Daniilidis

In this work, we predict a continuous-time human motion field directly from events by leveraging a recurrent feed-forward neural network to predict human motion in the latent space of possible human motions.

Human Mesh Recovery Motion Estimation

EqNIO: Subequivariant Neural Inertial Odometry

no code implementations12 Aug 2024 Royina Karegoudra Jayanth, Yinshuang Xu, ZiYun Wang, Evangelos Chatzipantazis, Daniel Gehrig, Kostas Daniilidis

We then map the IMU data into this frame, thereby achieving an invariant canonicalization that can be directly used with off-the-shelf inertial odometry networks.

Inductive Bias

Motion-prior Contrast Maximization for Dense Continuous-Time Motion Estimation

1 code implementation15 Jul 2024 Friedhelm Hamann, ZiYun Wang, Ioannis Asmanis, Kenneth Chaney, Guillermo Gallego, Kostas Daniilidis

In optical flow estimation, our method elevates a simple UNet to achieve state-of-the-art performance among self-supervised methods on the DSEC optical flow benchmark.

Motion Estimation Optical Flow Estimation +1

TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videos

1 code implementation26 Mar 2024 Yufu Wang, ZiYun Wang, Lingjie Liu, Kostas Daniilidis

We propose TRAM, a two-stage method to reconstruct a human's global trajectory and motion from in-the-wild videos.

3D Human Pose Estimation

Track Everything Everywhere Fast and Robustly

no code implementations26 Mar 2024 Yunzhou Song, Jiahui Lei, ZiYun Wang, Lingjie Liu, Kostas Daniilidis

We propose a novel test-time optimization approach for efficiently and robustly tracking any pixel at any time in a video.

Inductive Bias Monocular Depth Estimation

Un-EvMoSeg: Unsupervised Event-based Independent Motion Segmentation

no code implementations30 Nov 2023 ZiYun Wang, Jinyuan Guo, Kostas Daniilidis

Event cameras are a novel type of biologically inspired vision sensor known for their high temporal resolution, high dynamic range, and low power consumption.

Motion Segmentation Optical Flow Estimation

Event-based Continuous Color Video Decompression from Single Frames

no code implementations30 Nov 2023 ZiYun Wang, Friedhelm Hamann, Kenneth Chaney, Wen Jiang, Guillermo Gallego, Kostas Daniilidis

We present ContinuityCam, a novel approach to generate a continuous video from a single static RGB image and an event camera stream.

Benchmarking

EV-Catcher: High-Speed Object Catching Using Low-latency Event-based Neural Networks

no code implementations14 Apr 2023 ZiYun Wang, Fernando Cladera Ojeda, Anthony Bisulco, Daewon Lee, Camillo J. Taylor, Kostas Daniilidis, M. Ani Hsieh, Daniel D. Lee, Volkan Isler

Event-based sensors have recently drawn increasing interest in robotic perception due to their lower latency, higher dynamic range, and lower bandwidth requirements compared to standard CMOS-based imagers.

EvAC3D: From Event-based Apparent Contours to 3D Models via Continuous Visual Hulls

1 code implementation11 Apr 2023 ZiYun Wang, Kenneth Chaney, Kostas Daniilidis

3D reconstruction from multiple views is a successful computer vision field with multiple deployments in applications.

3D Reconstruction

Improving Load Forecast in Energy Markets During COVID-19

no code implementations1 Oct 2021 ZiYun Wang, Hao Wang

The abrupt outbreak of the COVID-19 pandemic was the most significant event in 2020, which had profound and lasting impacts across the world.

Load Forecasting

Cross-lingual Text Classification with Heterogeneous Graph Neural Network

1 code implementation ACL 2021 ZiYun Wang, Xuan Liu, Peiji Yang, Shixing Liu, Zhisheng Wang

Cross-lingual text classification aims at training a classifier on the source language and transferring the knowledge to target languages, which is very useful for low-resource languages.

Graph Neural Network Semantic Similarity +3

Geodesic-HOF: 3D Reconstruction Without Cutting Corners

no code implementations14 Jun 2020 Ziyun Wang, Eric A. Mitchell, Volkan Isler, Daniel D. Lee

To address this issue, we propose learning an image-conditioned mapping function from a canonical sampling domain to a high dimensional space where the Euclidean distance is equal to the geodesic distance on the object.

3D Object Reconstruction 3D Reconstruction +2

Surface HOF: Surface Reconstruction from a Single Image Using Higher Order Function Networks

no code implementations18 Dec 2019 Ziyun Wang, Volkan Isler, Daniel D. Lee

Our approach is to learn a Higher Order Function (HOF) which takes an image of an object as input and generates a mapping function.

3D Reconstruction Image Reconstruction +1

EventGAN: Leveraging Large Scale Image Datasets for Event Cameras

1 code implementation3 Dec 2019 Alex Zihao Zhu, ZiYun Wang, Kaung Khant, Kostas Daniilidis

Event cameras provide a number of benefits over traditional cameras, such as the ability to track incredibly fast motions, high dynamic range, and low power consumption.

2D Human Pose Estimation Image Reconstruction +4

Motion Equivariance OF Event-based Camera Data with the Temporal Normalization Transform

no code implementations28 Nov 2019 Ziyun Wang

In this work, we focus on using convolution neural networks (CNN) to perform object recognition on the event data.

Object Recognition

Modeling question asking using neural program generation

1 code implementation23 Jul 2019 Ziyun Wang, Brenden M. Lake

People ask questions that are far richer, more informative, and more creative than current AI systems.

Decoder Question Generation +4

Motion Equivariant Networks for Event Cameras with the Temporal Normalization Transform

no code implementations18 Feb 2019 Alex Zihao Zhu, ZiYun Wang, Kostas Daniilidis

In this work, we propose a novel transformation for events from an event camera that is equivariant to optical flow under convolutions in the 3-D spatiotemporal domain.

Data Augmentation General Classification +1

Robustness Meets Deep Learning: An End-to-End Hybrid Pipeline for Unsupervised Learning of Egomotion

no code implementations20 Dec 2018 Alex Zihao Zhu, Wenxin Liu, ZiYun Wang, Vijay Kumar, Kostas Daniilidis

In this work, we propose a method that combines unsupervised deep learning predictions for optical flow and monocular disparity with a model based optimization procedure for instantaneous camera pose.

Optical Flow Estimation

Distributional Inclusion Vector Embedding for Unsupervised Hypernymy Detection

no code implementations NAACL 2018 Haw-Shiuan Chang, ZiYun Wang, Luke Vilnis, Andrew McCallum

Modeling hypernymy, such as poodle is-a dog, is an important generalization aid to many NLP tasks, such as entailment, coreference, relation extraction, and question answering.

Hypernym Discovery Question Answering +1

Topic Sensitive Neural Headline Generation

no code implementations20 Aug 2016 Lei Xu, ZiYun Wang, Ayana, Zhiyuan Liu, Maosong Sun

Neural models have recently been used in text summarization including headline generation.

Headline Generation Text Summarization

Cannot find the paper you are looking for? You can Submit a new open access paper.