Search Results for author: Yoni Kasten

Found 25 papers, 10 papers with code

RESFM: Robust Equivariant Multiview Structure from Motion

no code implementations22 Apr 2024 Fadi Khatib, Yoni Kasten, Dror Moran, Meirav Galun, Ronen Basri

Multiview Structure from Motion is a fundamental and challenging computer vision problem.

Learning Priors for Non Rigid SfM from Casual Videos

no code implementations10 Apr 2024 Yoni Kasten, Wuyue Lu, Haggai Maron

We tackle the long-standing challenge of reconstructing 3D structures and camera positions from videos.

Point Tracking

Training-Free Consistent Text-to-Image Generation

1 code implementation5 Feb 2024 Yoad Tewel, Omri Kaduri, Rinon Gal, Yoni Kasten, Lior Wolf, Gal Chechik, Yuval Atzmon

Text-to-image models offer a new level of creative flexibility by allowing users to guide the image generation process through natural language.

Story Visualization Text-to-Image Generation

Space-Time Diffusion Features for Zero-Shot Text-Driven Motion Transfer

no code implementations28 Nov 2023 Danah Yatim, Rafail Fridman, Omer Bar-Tal, Yoni Kasten, Tali Dekel

This loss guides the generation process to preserve the overall motion of the input video while complying with the target object in terms of shape and fine-grained motion traits.

CALM: Conditional Adversarial Latent Models for Directable Virtual Characters

no code implementations2 May 2023 Chen Tessler, Yoni Kasten, Yunrong Guo, Shie Mannor, Gal Chechik, Xue Bin Peng

In this work, we present Conditional Adversarial Latent Models (CALM), an approach for generating diverse and directable behaviors for user-controlled interactive virtual characters.

Imitation Learning

Neural LiDAR Fields for Novel View Synthesis

no code implementations ICCV 2023 Shengyu Huang, Zan Gojcic, Zian Wang, Francis Williams, Yoni Kasten, Sanja Fidler, Konrad Schindler, Or Litany

We present Neural Fields for LiDAR (NFL), a method to optimise a neural field scene representation from LiDAR measurements, with the goal of synthesizing realistic LiDAR scans from novel viewpoints.

Novel LiDAR View Synthesis Semantic Segmentation

Neural Congealing: Aligning Images to a Joint Semantic Atlas

no code implementations CVPR 2023 Dolev Ofri-Amar, Michal Geyer, Yoni Kasten, Tali Dekel

We present Neural Congealing -- a zero-shot self-supervised framework for detecting and jointly aligning semantically-common content across a given set of images.

SceneScape: Text-Driven Consistent Scene Generation

no code implementations NeurIPS 2023 Rafail Fridman, Amit Abecasis, Yoni Kasten, Tali Dekel

We present a method for text-driven perpetual view generation -- synthesizing long-term videos of various scenes solely, given an input text prompt describing the scene and camera poses.

Depth Estimation Depth Prediction +3

Text2LIVE: Text-Driven Layered Image and Video Editing

1 code implementation5 Apr 2022 Omer Bar-Tal, Dolev Ofri-Amar, Rafail Fridman, Yoni Kasten, Tali Dekel

Given an input image or video and a target text prompt, our goal is to edit the appearance of existing objects (e. g., object's texture) or augment the scene with visual effects (e. g., smoke, fire) in a semantically meaningful manner.

Video Editing

Layered Neural Atlases for Consistent Video Editing

2 code implementations23 Sep 2021 Yoni Kasten, Dolev Ofri, Oliver Wang, Tali Dekel

We present a method that decomposes, or "unwraps", an input video into a set of layered 2D atlases, each providing a unified representation of the appearance of an object (or background) over the video.

Style Transfer Video Editing +2

Volume Rendering of Neural Implicit Surfaces

3 code implementations NeurIPS 2021 Lior Yariv, Jiatao Gu, Yoni Kasten, Yaron Lipman

Accurate sampling is important to provide a precise coupling of geometry and radiance; and (iii) it allows efficient unsupervised disentanglement of shape and appearance in volume rendering.

Disentanglement Inductive Bias

Deep Permutation Equivariant Structure from Motion

1 code implementation ICCV 2021 Dror Moran, Hodaya Koslowsky, Yoni Kasten, Haggai Maron, Meirav Galun, Ronen Basri

Existing deep methods produce highly accurate 3D reconstructions in stereo and multiview stereo settings, i. e., when cameras are both internally and externally calibrated.

Matrix Completion

End-To-End Convolutional Neural Network for 3D Reconstruction of Knee Bones From Bi-Planar X-Ray Images

no code implementations2 Apr 2020 Yoni Kasten, Daniel Doktofsky, Ilya Kovler

In contrast to the common approach of statistically modeling the shape of each bone, our deep network learns the distribution of the bones' shapes directly from the training images.

3D Reconstruction Style Transfer

Frequency Bias in Neural Networks for Input of Non-Uniform Density

no code implementations ICML 2020 Ronen Basri, Meirav Galun, Amnon Geifman, David Jacobs, Yoni Kasten, Shira Kritchman

Recent works have partly attributed the generalization ability of over-parameterized neural networks to frequency bias -- networks trained with gradient descent on data drawn from a uniform distribution find a low frequency fit before high frequency ones.

The Convergence Rate of Neural Networks for Learned Functions of Different Frequencies

1 code implementation NeurIPS 2019 Ronen Basri, David Jacobs, Yoni Kasten, Shira Kritchman

We study the relationship between the frequency of a function and the speed at which a neural network learns it.

Algebraic Characterization of Essential Matrices and Their Averaging in Multiview Settings

no code implementations ICCV 2019 Yoni Kasten, Amnon Geifman, Meirav Galun, Ronen Basri

A common approach to essential matrix averaging is to separately solve for camera orientations and subsequently for camera positions.

Resultant Based Incremental Recovery of Camera Pose from Pairwise Matches

1 code implementation27 Jan 2019 Yoni Kasten, Meirav Galun, Ronen Basri

In this paper, we introduce a novel solution to the six-point online algorithm to recover the exterior parameters associated with $I_n$.

GPSfM: Global Projective SFM Using Algebraic Constraints on Multi-View Fundamental Matrices

1 code implementation CVPR 2019 Yoni Kasten, Amnon Geifman, Meirav Galun, Ronen Basri

First, given ${n \choose 2}$ fundamental matrices computed for $n$ images, we provide a complete algebraic characterization in the form of conditions that are both necessary and sufficient to enabling the recovery of camera matrices.

Two view constraints on the epipoles from few correspondences

no code implementations22 Oct 2018 Yoni Kasten, Michael Werman

We show how it can be used to reduce the number of required points for the epipolar geometry when some information about the epipoles is available and demonstrate this with a buddy search app.

Vocal Bursts Valence Prediction

Fundamental Matrices from Moving Objects Using Line Motion Barcodes

no code implementations26 Jul 2016 Yoni Kasten, Gil Ben-Artzi, Shmuel Peleg, Michael Werman

Corresponding epipolar lines have similar motion barcodes, and candidate pairs of corresponding epipoar lines are found by the similarity of their motion barcodes.

Camera Calibration from Dynamic Silhouettes Using Motion Barcodes

no code implementations CVPR 2016 Gil Ben-Artzi, Yoni Kasten, Shmuel Peleg, Michael Werman

The use of motion barcodes leads to increased speed, accuracy, and robustness in computing the epipolar geometry.

Camera Calibration

Cannot find the paper you are looking for? You can Submit a new open access paper.