Search Results for author: Mengwei Ren

Found 17 papers, 7 papers with code

SynthLight: Portrait Relighting with Diffusion Model by Learning to Re-render Synthetic Faces

no code implementations16 Jan 2025 Sumit Chaturvedi, Mengwei Ren, Yannick Hold-Geoffroy, Jingyuan Liu, Julie Dorsey, Zhixin Shu

Our method generalizes to diverse real photographs and produces realistic illumination effects, including specular highlights and cast shadows, while preserving the subject's identity.

Image Relighting

Text2Relight: Creative Portrait Relighting with Text Guidance

no code implementations18 Dec 2024 Junuk Cha, Mengwei Ren, Krishna Kumar Singh, He Zhang, Yannick Hold-Geoffroy, Seunghyun Yoon, HyunJoon Jung, Jae Shin Yoon, Seungryul Baek

As a condition of the lighting images, we perform image-based relighting for both foreground and background using a single portrait image or a set of OLAT (One-Light-at-A-Time) images captured from lightstage system.

Image Generation Image Relighting +1

Generative Image Layer Decomposition with Visual Effects

no code implementations26 Nov 2024 Jinrui Yang, Qing Liu, Yijun Li, Soo Ye Kim, Daniil Pakhomov, Mengwei Ren, Jianming Zhang, Zhe Lin, Cihang Xie, Yuyin Zhou

Layered representations, which allow for independent editing of image components, are essential for user-driven content creation, yet existing approaches often struggle to decompose image into plausible layers with accurately retained transparent visual effects such as shadows and reflections.

Learning General-Purpose Biomedical Volume Representations using Randomized Synthesis

1 code implementation4 Nov 2024 Neel Dey, Benjamin Billot, Hallee E. Wong, Clinton J. Wang, Mengwei Ren, P. Ellen Grant, Adrian V. Dalca, Polina Golland

Current volumetric biomedical foundation models struggle to generalize as public 3D datasets are small and do not cover the broad diversity of medical procedures, conditions, anatomical regions, and imaging protocols.

Contrastive Learning Diversity +2

WiCV@CVPR2024: The Thirteenth Women In Computer Vision Workshop at the Annual CVPR Conference

no code implementations3 Nov 2024 Asra Aslam, Sachini Herath, Ziqi Huang, Estefania Talavera, Deblina Bhattacharjee, Himangi Mittal, Vanessa Staderini, Mengwei Ren, Azade Farshad

In this paper, we present the details of Women in Computer Vision Workshop - WiCV 2024, organized alongside the CVPR 2024 in Seattle, Washington, United States.

Generative Portrait Shadow Removal

no code implementations7 Oct 2024 Jae Shin Yoon, Zhixin Shu, Mengwei Ren, Xuaner Zhang, Yannick Hold-Geoffroy, Krishna Kumar Singh, He Zhang

For robust and natural shadow removal, we propose to train the diffusion model with a compositional repurposing framework: a pre-trained text-guided image generation model is first fine-tuned to harmonize the lighting and color of the foreground with a background scene by using a background harmonization dataset; and then the model is further fine-tuned to generate a shadow-free portrait image via a shadow-paired dataset.

Image Generation Shadow Removal

Relightful Harmonization: Lighting-aware Portrait Background Replacement

no code implementations CVPR 2024 Mengwei Ren, Wei Xiong, Jae Shin Yoon, Zhixin Shu, Jianming Zhang, HyunJoon Jung, Guido Gerig, He Zhang

Portrait harmonization aims to composite a subject into a new background, adjusting its lighting and color to ensure harmony with the background scene.

Microscopy Image Segmentation via Point and Shape Regularized Data Synthesis

1 code implementation18 Aug 2023 Shijie Li, Mengwei Ren, Thomas Ach, Guido Gerig

Current deep learning-based approaches for the segmentation of microscopy images heavily rely on large amount of training data with dense annotation, which is highly costly and laborious in practice.

Image Segmentation Segmentation +1

Improving Tuning-Free Real Image Editing with Proximal Guidance

1 code implementation8 Jun 2023 Ligong Han, Song Wen, Qi Chen, Zhixing Zhang, Kunpeng Song, Mengwei Ren, Ruijiang Gao, Anastasis Stathopoulos, Xiaoxiao He, Yuxiao Chen, Di Liu, Qilong Zhangli, Jindong Jiang, Zhaoyang Xia, Akash Srivastava, Dimitris Metaxas

Null-text inversion (NTI) optimizes null embeddings to align the reconstruction and inversion trajectories with larger CFG scales, enabling real image editing with cross-attention control.

Multiscale Structure Guided Diffusion for Image Deblurring

no code implementations ICCV 2023 Mengwei Ren, Mauricio Delbracio, Hossein Talebi, Guido Gerig, Peyman Milanfar

We evaluate a single-dataset trained model on diverse datasets and demonstrate more robust deblurring results with fewer artifacts on unseen data.

Deblurring Denoising +2

Local Spatiotemporal Representation Learning for Longitudinally-consistent Neuroimage Analysis

1 code implementation9 Jun 2022 Mengwei Ren, Neel Dey, Martin A. Styner, Kelly Botteron, Guido Gerig

Recent self-supervised advances in medical computer vision exploit global and local anatomical self-similarity for pretraining prior to downstream tasks such as segmentation.

One-Shot Segmentation Representation Learning +1

Q-space Conditioned Translation Networks for Directional Synthesis of Diffusion Weighted Images from Multi-modal Structural MRI

1 code implementation24 Jun 2021 Mengwei Ren, Heejong Kim, Neel Dey, Guido Gerig

Further, such approaches can restrict downstream usage of variably sampled DWIs for usages including the estimation of microstructural indices or tractography.

Translation

Structure-Attentioned Memory Network for Monocular Depth Estimation

no code implementations10 Sep 2019 Jing Zhu, Yunxiao Shi, Mengwei Ren, Yi Fang, Kuo-Chin Lien, Junli Gu

To this end, we introduce a new Structure-Oriented Memory (SOM) module to learn and memorize the structure-specific information between RGB image domain and the depth domain.

Domain Adaptation Monocular Depth Estimation

3D-A-Nets: 3D Deep Dense Descriptor for Volumetric Shapes with Adversarial Networks

no code implementations28 Nov 2017 Mengwei Ren, Liang Niu, Yi Fang

In this paper, powered with a novel design of adversarial networks (3D-A-Nets), we have developed a novel 3D deep dense shape descriptor (3D-DDSD) to address the challenging issues of efficient and effective 3D volumetric data processing.

3D Shape Classification Clustering +1

Cannot find the paper you are looking for? You can Submit a new open access paper.