Search Results for author: Sihyun Yu

Found 8 papers, 5 papers with code

Efficient Video Diffusion Models via Content-Frame Motion-Latent Decomposition

no code implementations21 Mar 2024 Sihyun Yu, Weili Nie, De-An Huang, Boyi Li, Jinwoo Shin, Anima Anandkumar

To tackle this issue, we propose content-motion latent diffusion model (CMD), a novel efficient extension of pretrained image diffusion models for video generation.

Video Generation

Enhancing Multiple Reliability Measures via Nuisance-extended Information Bottleneck

1 code implementation CVPR 2023 Jongheon Jeong, Sihyun Yu, Hankook Lee, Jinwoo Shin

In practical scenarios where training data is limited, many predictive signals in the data can be rather from some biases in data acquisition (i. e., less generalizable), so that one cannot prevent a model from co-adapting on such (so-called) "shortcut" signals: this makes the model fragile in various distribution shifts.

Adversarial Robustness Novelty Detection

Video Probabilistic Diffusion Models in Projected Latent Space

1 code implementation CVPR 2023 Sihyun Yu, Kihyuk Sohn, Subin Kim, Jinwoo Shin

Specifically, PVDM is composed of two components: (a) an autoencoder that projects a given video as 2D-shaped latent vectors that factorize the complex cubic structure of video pixels and (b) a diffusion model architecture specialized for our new factorized latent space and the training/sampling procedure to synthesize videos of arbitrary length with a single model.

Video Generation

Scalable Neural Video Representations with Learnable Positional Features

1 code implementation13 Oct 2022 Subin Kim, Sihyun Yu, Jaeho Lee, Jinwoo Shin

Succinct representation of complex signals using coordinate-based neural representations (CNRs) has seen great progress, and several recent efforts focus on extending them for handling videos.

Video Compression Video Frame Interpolation +2

Generating Videos with Dynamics-aware Implicit Generative Adversarial Networks

1 code implementation ICLR 2022 Sihyun Yu, Jihoon Tack, Sangwoo Mo, Hyunsu Kim, Junho Kim, Jung-Woo Ha, Jinwoo Shin

In this paper, we found that the recent emerging paradigm of implicit neural representations (INRs) that encodes a continuous signal into a parameterized neural network effectively mitigates the issue.

Generative Adversarial Network Video Generation

RoMA: Robust Model Adaptation for Offline Model-based Optimization

no code implementations NeurIPS 2021 Sihyun Yu, Sungsoo Ahn, Le Song, Jinwoo Shin

We consider the problem of searching an input maximizing a black-box objective function given a static dataset of input-output queries.

Abstract Reasoning via Logic-guided Generation

no code implementations22 Jul 2021 Sihyun Yu, Sangwoo Mo, Sungsoo Ahn, Jinwoo Shin

Abstract reasoning, i. e., inferring complicated patterns from given observations, is a central building block of artificial general intelligence.

Consistency Regularization for Adversarial Robustness

1 code implementation ICML Workshop AML 2021 Jihoon Tack, Sihyun Yu, Jongheon Jeong, Minseon Kim, Sung Ju Hwang, Jinwoo Shin

Adversarial training (AT) is currently one of the most successful methods to obtain the adversarial robustness of deep neural networks.

Adversarial Robustness Data Augmentation

Cannot find the paper you are looking for? You can Submit a new open access paper.