Search Results for author: Zhilei Shu

Found 2 papers, 0 papers with code

RAIN: Real-time Animation of Infinite Video Stream

no code implementations27 Dec 2024 Zhilei Shu, Ruili Feng, Yang Cao, Zheng-Jun Zha

Consequently, a Stable Diffusion model fine-tuned with RAIN in just a few epochs can produce video streams in real-time and low latency without much compromise in quality or consistency, up to infinite long.

Denoising

The Matrix: Infinite-Horizon World Generation with Real-Time Moving Control

no code implementations4 Dec 2024 Ruili Feng, Han Zhang, Zhantao Yang, Jie Xiao, Zhilei Shu, Zhiheng Liu, Andy Zheng, Yukun Huang, Yu Liu, Hongyang Zhang

We present The Matrix, the first foundational realistic world simulator capable of generating continuous 720p high-fidelity real-scene video streams with real-time, responsive control in both first- and third-person perspectives, enabling immersive exploration of richly dynamic environments.

Zero-shot Generalization

Cannot find the paper you are looking for? You can Submit a new open access paper.