MagicTime: Time-lapse Video Generation Models as Metamorphic Simulators

2 code implementations • 7 Apr 2024 • Shenghai Yuan, Jinfa Huang, Yujun Shi, Yongqi Xu, Ruijie Zhu, Bin Lin, Xinhua Cheng, Li Yuan, Jiebo Luo

Recent advances in Text-to-Video generation (T2V) have achieved remarkable success in synthesizing high-quality general videos from textual descriptions.

Text-to-Video Generation Video Generation

TIFace: Improving Facial Reconstruction through Tensorial Radiance Fields and Implicit Surfaces

2 code implementations • 15 Dec 2023 • Ruijie Zhu, Jiahao Chang, Ziyang Song, Jiahuan Yu, Tianzhu Zhang

This report describes the solution that secured the first place in the "View Synthesis Challenge for Human Heads (VSCHH)" at the ICCV 2023 workshop.

Face Reconstruction Neural Rendering +1

Tensor Decomposition Based Attention Module for Spiking Neural Networks

1 code implementation • 23 Oct 2023 • Haoyu Deng, Ruijie Zhu, Xuerui Qiu, Yule Duan, Malu Zhang, LiangJian Deng

Then, in AMC, we exploit the inverse procedure of the tensor decomposition process to combine the three tensors into the attention map using a so-called connecting factor.

Tensor Decomposition

EC-Depth: Exploring the consistency of self-supervised monocular depth estimation in challenging scenes

no code implementations • 12 Oct 2023 • Ziyang Song, Ruijie Zhu, Chuxin Wang, Jiacheng Deng, Jianfeng He, Tianzhu Zhang

Self-supervised monocular depth estimation holds significant importance in the fields of autonomous driving and robotics.

Autonomous Driving Depth Prediction +4

The RoboDepth Challenge: Methods and Advancements Towards Robust Depth Estimation

1 code implementation • 27 Jul 2023 • Lingdong Kong, Yaru Niu, Shaoyuan Xie, Hanjiang Hu, Lai Xing Ng, Benoit R. Cottereau, Ding Zhao, Liangjun Zhang, Hesheng Wang, Wei Tsang Ooi, Ruijie Zhu, Ziyang Song, Li Liu, Tianzhu Zhang, Jun Yu, Mohan Jing, Pengwei Li, Xiaohua Qi, Cheng Jin, Yingfeng Chen, Jie Hou, Jie Zhang, Zhen Kan, Qiang Ling, Liang Peng, Minglei Li, Di Xu, Changpeng Yang, Yuanqi Yao, Gang Wu, Jian Kuai, Xianming Liu, Junjun Jiang, Jiamian Huang, Baojun Li, Jiale Chen, Shuang Zhang, Sun Ao, Zhenyu Li, Runze Chen, Haiyong Luo, Fang Zhao, Jingze Yu

In this paper, we summarize the winning solutions from the RoboDepth Challenge -- an academic competition designed to facilitate and advance robust OoD depth estimation.

Depth Estimation Image Restoration +1

A generative artificial intelligence framework based on a molecular diffusion model for the design of metal-organic frameworks for carbon capture

1 code implementation • 14 Jun 2023 • Hyun Park, Xiaoli Yan, Ruijie Zhu, E. A. Huerta, Santanu Chaudhuri, Donny Cooper, Ian Foster, Emad Tajkhorshid

Metal-organic frameworks (MOFs) exhibit great promise for CO2 capture.

End-to-end AI framework for interpretable prediction of molecular and crystal properties

1 code implementation • 21 Dec 2022 • Hyun Park, Ruijie Zhu, E. A. Huerta, Santanu Chaudhuri, Emad Tajkhorshid, Donny Cooper

We introduce an end-to-end computational framework that allows for hyperparameter optimization using the DeepHyper library, accelerated model training, and interpretable AI inference.

Hyperparameter Optimization

Multi-Agent Broad Reinforcement Learning for Intelligent Traffic Light Control

no code implementations • 8 Mar 2022 • Ruijie Zhu, Lulu Li, Shuning Wu, Pei Lv, Yafai Li, Mingliang Xu

Existing approaches of MAS are largely based on Multi-Agent Deep Reinforcement Learning (MADRL).

reinforcement-learning Reinforcement Learning (RL)