Search Results for author:
Found 13 papers, 3 papers with code
Dynamic Temporal Alignment of Speech to Lips
This alignment is based on deep audio-visual features, mapping the lips video and the speech signal to a shared representation.
Neural separation of observed and unobserved distributions
In this work, we introduce a new method---Neural Egg Separation---to tackle the scenario of extracting a signal from an unobserved distribution additively mixed with a signal from an observed distribution.
Neural Separation of Observed and Unobserved Distribution
In this work, we introduce a new method---Neural Egg Separation---to tackle the scenario of extracting a signal from an unobserved distribution additively mixed with a signal from an observed distribution.
Seeing Through Noise: Visually Driven Speaker Separation and Enhancement
Isolating the voice of a specific person while filtering out other voices or background noises is challenging when video is shot in noisy environments.
An Epipolar Line from a Single Pixel
In this paper we propose a new method to compute the epipolar geometry from a video stream, by exploiting the following observation: For a pixel p in Image A, all pixels corresponding to p in Image B are on the same epipolar line.
Improved Speech Reconstruction from Silent Video
Speechreading is the task of inferring phonetic information from visually observed articulatory facial movements, and is a notoriously difficult task for humans to perform.
EgoSampling: Wide View Hyperlapse from Egocentric Videos
However, this accentuates the shake caused by natural head motion in an egocentric video, making the fast forwarded video useless.
Epipolar Geometry Based On Line Similarity
This paper proposes a similarity measure between lines that indicates whether two lines are corresponding epipolar lines and enables finding epipolar line correspondences as needed for the computation of epipolar geometry.
EgoSampling: Fast-Forward and Stereo for Egocentric Videos
While egocentric cameras like GoPro are gaining popularity, the videos they capture are long, boring, and difficult to watch from start to end.
Clear Skies Ahead: Towards Real-Time Automatic Sky Replacement in Video
Digital videos such as those captured by a smartphone often exhibit exposure inconsistencies, a poorly exposed sky, or simply suffer from an uninteresting or plain looking sky.
Endless Loops: Detecting and Animating Periodic Patterns in Still Images
We present an algorithm for producing a seamless animated loop from a single image.
Temporally stable video segmentation without video annotations
Temporally consistent dense video annotations are scarce and hard to collect.
Diffusing Colors: Image Colorization with Text Guided Diffusion
To tackle these issues, we present a novel image colorization framework that utilizes image diffusion techniques with granular text prompts.
