no code implementations • 2 Dec 2024 • ZiYun Wang, Ruijun Zhang, Zi-Yan Liu, Yufu Wang, Kostas Daniilidis
In this work, we predict a continuous-time human motion field directly from events by leveraging a recurrent feed-forward neural network to predict human motion in the latent space of possible human motions.
no code implementations • 12 Aug 2024 • Royina Karegoudra Jayanth, Yinshuang Xu, ZiYun Wang, Evangelos Chatzipantazis, Daniel Gehrig, Kostas Daniilidis
We then map the IMU data into this frame, thereby achieving an invariant canonicalization that can be directly used with off-the-shelf inertial odometry networks.
1 code implementation • 15 Jul 2024 • Friedhelm Hamann, ZiYun Wang, Ioannis Asmanis, Kenneth Chaney, Guillermo Gallego, Kostas Daniilidis
In optical flow estimation, our method elevates a simple UNet to achieve state-of-the-art performance among self-supervised methods on the DSEC optical flow benchmark.
1 code implementation • 26 Mar 2024 • Yufu Wang, ZiYun Wang, Lingjie Liu, Kostas Daniilidis
We propose TRAM, a two-stage method to reconstruct a human's global trajectory and motion from in-the-wild videos.
Ranked #1 on 3D Human Pose Estimation on EMDB
no code implementations • 26 Mar 2024 • Yunzhou Song, Jiahui Lei, ZiYun Wang, Lingjie Liu, Kostas Daniilidis
We propose a novel test-time optimization approach for efficiently and robustly tracking any pixel at any time in a video.
no code implementations • 30 Nov 2023 • ZiYun Wang, Jinyuan Guo, Kostas Daniilidis
Event cameras are a novel type of biologically inspired vision sensor known for their high temporal resolution, high dynamic range, and low power consumption.
no code implementations • 30 Nov 2023 • ZiYun Wang, Friedhelm Hamann, Kenneth Chaney, Wen Jiang, Guillermo Gallego, Kostas Daniilidis
We present ContinuityCam, a novel approach to generate a continuous video from a single static RGB image and an event camera stream.
no code implementations • 14 Apr 2023 • ZiYun Wang, Fernando Cladera Ojeda, Anthony Bisulco, Daewon Lee, Camillo J. Taylor, Kostas Daniilidis, M. Ani Hsieh, Daniel D. Lee, Volkan Isler
Event-based sensors have recently drawn increasing interest in robotic perception due to their lower latency, higher dynamic range, and lower bandwidth requirements compared to standard CMOS-based imagers.
1 code implementation • 11 Apr 2023 • ZiYun Wang, Kenneth Chaney, Kostas Daniilidis
3D reconstruction from multiple views is a successful computer vision field with multiple deployments in applications.
no code implementations • 1 Oct 2021 • ZiYun Wang, Hao Wang
The abrupt outbreak of the COVID-19 pandemic was the most significant event in 2020, which had profound and lasting impacts across the world.
1 code implementation • ACL 2021 • ZiYun Wang, Xuan Liu, Peiji Yang, Shixing Liu, Zhisheng Wang
Cross-lingual text classification aims at training a classifier on the source language and transferring the knowledge to target languages, which is very useful for low-resource languages.
no code implementations • 14 Jun 2020 • Ziyun Wang, Eric A. Mitchell, Volkan Isler, Daniel D. Lee
To address this issue, we propose learning an image-conditioned mapping function from a canonical sampling domain to a high dimensional space where the Euclidean distance is equal to the geodesic distance on the object.
no code implementations • 18 Dec 2019 • Ziyun Wang, Volkan Isler, Daniel D. Lee
Our approach is to learn a Higher Order Function (HOF) which takes an image of an object as input and generates a mapping function.
1 code implementation • 3 Dec 2019 • Alex Zihao Zhu, ZiYun Wang, Kaung Khant, Kostas Daniilidis
Event cameras provide a number of benefits over traditional cameras, such as the ability to track incredibly fast motions, high dynamic range, and low power consumption.
no code implementations • 28 Nov 2019 • Ziyun Wang
In this work, we focus on using convolution neural networks (CNN) to perform object recognition on the event data.
1 code implementation • 23 Jul 2019 • Ziyun Wang, Brenden M. Lake
People ask questions that are far richer, more informative, and more creative than current AI systems.
1 code implementation • 1 Apr 2019 • Martin Hangaard Hansen, José A. Garrido Torres, Paul C. Jennings, ZiYun Wang, Jacob R. Boes, Osman G. Mamun, Thomas Bligaard
We present work flows and a software module for machine learning model building in surface science and heterogeneous catalysis.
no code implementations • 18 Feb 2019 • Alex Zihao Zhu, ZiYun Wang, Kostas Daniilidis
In this work, we propose a novel transformation for events from an event camera that is equivariant to optical flow under convolutions in the 3-D spatiotemporal domain.
no code implementations • 20 Dec 2018 • Alex Zihao Zhu, Wenxin Liu, ZiYun Wang, Vijay Kumar, Kostas Daniilidis
In this work, we propose a method that combines unsupervised deep learning predictions for optical flow and monocular disparity with a model based optimization procedure for instantaneous camera pose.
1 code implementation • EMNLP 2018 • Xu Han, Hao Zhu, Pengfei Yu, ZiYun Wang, Yuan YAO, Zhiyuan Liu, Maosong Sun
The relation of each sentence is first recognized by distant supervision methods, and then filtered by crowdworkers.
no code implementations • NAACL 2018 • Haw-Shiuan Chang, ZiYun Wang, Luke Vilnis, Andrew McCallum
Modeling hypernymy, such as poodle is-a dog, is an important generalization aid to many NLP tasks, such as entailment, coreference, relation extraction, and question answering.
no code implementations • 20 Aug 2016 • Lei Xu, ZiYun Wang, Ayana, Zhiyuan Liu, Maosong Sun
Neural models have recently been used in text summarization including headline generation.