Adaptive Instance Normalization

Introduced by Huang et al. in Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization

Adaptive Instance Normalization is a normalization method that aligns the mean and variance of the content features with those of the style features.

Instance Normalization normalizes the input to a single style specified by the affine parameters. Adaptive Instance Normaliation is an extension. In AdaIN, we receive a content input $x$ and a style input $y$, and we simply align the channel-wise mean and variance of $x$ to match those of $y$. Unlike Batch Normalization, Instance Normalization or Conditional Instance Normalization, AdaIN has no learnable affine parameters. Instead, it adaptively computes the affine parameters from the style input:

$$ \textrm{AdaIN}(x, y)= \sigma(y)\left(\frac{x-\mu(x)}{\sigma(x)}\right)+\mu(y) $$

Source: Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization

Latest Papers

PAPER DATE
One Model to Reconstruct Them All: A Novel Way to Use the Stochastic Noise in StyleGAN
| Christian BartzJoseph BethgeHaojin YangChristoph Meinel
2020-10-21
Depth Guided Adaptive Meta-Fusion Network for Few-shot Video Recognition
Yuqian FuLi ZhangJunke WangYanwei FuYu-Gang Jiang
2020-10-20
Resolution Dependant GAN Interpolation for Controllable Image Synthesis Between Domains
Justin N. M. PinkneyDoron Adler
2020-10-11
Permuted AdaIN: Enhancing the Representation of Local Cues in Image Classifiers
Oren NurielSagie BenaimLior Wolf
2020-10-09
Arbitrary Style Transfer using Graph Instance Normalization
Dongki JungSeunghan YangJaehoon ChoiChangick Kim
2020-10-06
PIE: Portrait Image Embedding for Semantic Control
Ayush TewariMohamed ElgharibMallikarjun B R.Florian BernardHans-Peter SeidelPatrick PérezMichael ZollhöferChristian Theobalt
2020-09-20
MIPGAN -- Generating Robust and High Quality Morph Attacks Using Identity Prior Driven GAN
Haoyu ZhangSushma VenkateshRaghavendra RamachandraKiran RajaNaser DamerChristoph Busch
2020-09-03
Switchable Deep Beamformer
Shujaat KhanJaeyoung HuhJong Chul Ye
2020-08-31
DeepLandscape: Adversarial Modeling of Landscape Video
Elizaveta LogachevaRoman SuvorovOleg KhomenkoAnton MashikhinVictor Lempitsky
2020-08-21
AdaIN-Switchable CycleGAN for Efficient Unsupervised Low-Dose CT Denoising
Jawook GuJong Chul Ye
2020-08-13
StyleFlow: Attribute-conditioned Exploration of StyleGAN-Generated Images using Conditional Continuous Normalizing Flows
Rameen AbdalPeihao ZhuNiloy MitraPeter Wonka
2020-08-06
Encoding in Style: a StyleGAN Encoder for Image-to-Image Translation
Elad RichardsonYuval AlalufOr PatashnikYotam NitzanYaniv AzarStav ShapiroDaniel Cohen-Or
2020-08-03
Detection, Attribution and Localization of GAN Generated Images
Michael GoebelLakshmanan NatarajTejaswi NanjundaswamyTajuddin Manhar MohammedShivkumar ChandrasekaranB. S. Manjunath
2020-07-20
Generative Hierarchical Features from Synthesizing Images
| Yinghao XuYujun ShenJiapeng ZhuCeyuan YangBolei Zhou
2020-07-20
Can GAN Generated Morphs Threaten Face Recognition Systems Equally as Landmark Based Morphs? -- Vulnerability and Detection
Sushma VenkateshHaoyu ZhangRaghavendra RamachandraKiran RajaNaser DamerChristoph Busch
2020-07-07
A Free Viewpoint Portrait Generator with Dynamic Styling
| Anpei ChenRuiyang LiuLing XieJingyi Yu
2020-07-07
Collaborative Learning for Faster StyleGAN Embedding
Shanyan GuanYing TaiBingbing NiFeida ZhuFeiyue HuangXiaokang Yang
2020-07-03
PriorGAN: Real Data Prior for Generative Adversarial Nets
Shuyang GuJianmin BaoDong ChenFang Wen
2020-06-30
Generating Master Faces for Use in Performing Wolf Attacks on Face Recognition Systems
Huy H. NguyenJunichi YamagishiIsao EchizenSébastien Marcel
2020-06-15
Rényi Generative Adversarial Networks
Himesh BhatiaWilliam PaulFady AlajajiBahman GharesifardPhilippe Burlina
2020-06-03
Enhanced Blind Face Restoration With Multi-Exemplar Images and Adaptive Spatial Feature Fusion
| Xiaoming Li Wenyu Li Dongwei Ren Hongzhi Zhang Meng Wang Wangmeng Zuo
2020-06-01
Disentangling in Latent Space by Harnessing a Pretrained Generator
Yotam NitzanAmit BermanoYangyan LiDaniel Cohen-Or
2020-05-15
Unpaired Motion Style Transfer from Video to Animation
| Kfir AbermanYijia WengDani LischinskiDaniel Cohen-OrBaoquan Chen
2020-05-12
Editing in Style: Uncovering the Local Semantics of GANs
| Edo CollinsRaja BalaBob PriceSabine Süsstrunk
2020-04-29
Adversarial Latent Autoencoders
| Stanislav PidhorskyiDonald AdjerohGianfranco Doretto
2020-04-09
Feature Quantization Improves GAN Training
| Yang ZhaoChunyuan LiPing YuJianfeng GaoChangyou Chen
2020-04-05
StyleRig: Rigging StyleGAN for 3D Control over Portrait Images
Ayush TewariMohamed ElgharibGaurav BharajFlorian BernardHans-Peter SeidelPatrick PérezMichael ZollhöferChristian Theobalt
2020-03-31
One-Shot Domain Adaptation For Face Generation
Chao YangSer-Nam Lim
2020-03-28
Deep Line Art Video Colorization with a Few References
Min ShiJia-Qi ZhangShu-Yu ChenLin GaoYu-Kun LaiFang-Lue Zhang
2020-03-24
Re-Training StyleGAN -- A First Step Towards Building Large, Scalable Synthetic Facial Datasets
Viktor VarkarakisShabab BazrafkanPeter Corcoran
2020-03-24
Knowledge distillation via adaptive instance normalization
Jing YangBrais MartinezAdrian BulatGeorgios Tzimiropoulos
2020-03-09
Perceptual Image Super-Resolution with Progressive Adversarial Network
Lone WongDeli ZhaoShaohua WanBo Zhang
2020-03-08
Semi-Supervised StyleGAN for Disentanglement Learning
Weili NieTero KarrasAnimesh GargShoubhik DebnathAnjul PatneyAnkit B. PatelAnima Anandkumar
2020-03-06
Transfer Learning from Synthetic to Real-Noise Denoising with Adaptive Instance Normalization
| Yoonsik KimJae Woong SohGu Yong ParkNam Ik Cho
2020-02-26
Freeze the Discriminator: a Simple Baseline for Fine-Tuning GANs
| Sangwoo MoMinsu ChoJinwoo Shin
2020-02-25
Remove Appearance Shift for Ultrasound Image Segmentation via Fast and Universal Style Transfer
Zhendong LiuXin YangRui GaoShengfeng LiuHaoran DouShuangchi HeYuhao HuangYankai HuangHuanjia LuoYuanji ZhangYi XiongDong Ni
2020-02-14
HRFA: High-Resolution Feature-based Attack
| Zhixing YeSizhe ChenPeidong ZhangChengjin SunXiaolin Huang
2020-01-21
Unsupervised multi-modal Styled Content Generation
Omry SendikDani LischinskiDaniel Cohen-Or
2020-01-10
Disentangled GANs for Controllable Generation of High-Resolution Images
Anonymous
2020-01-01
CNN-generated images are surprisingly easy to spot... for now
| Sheng-Yu WangOliver WangRichard ZhangAndrew OwensAlexei A. Efros
2019-12-23
Unconstrained Facial Expression Transfer using Style-based Generator
| Chao YangSer-Nam Lim
2019-12-12
Achieving Robustness in the Wild via Adversarial Mixing with Disentangled Representations
Sven GowalChongli QinPo-Sen HuangTaylan CemgilKrishnamurthy DvijothamTimothy MannPushmeet Kohli
2019-12-06
Detecting GAN generated errors
Xiru ZhuFengdi CheTianzi YangTzuyang YuDavid MegerGregory Dudek
2019-12-02
Semantic Hierarchy Emerges in Deep Generative Representations for Scene Synthesis
| Ceyuan YangYujun ShenBolei Zhou
2019-11-21
Unsupervised Projection Networks for Generative Adversarial Networks
Daiyaan ArfeenJesse Zhang
2019-09-30
RGBD-GAN: Unsupervised 3D Representation Learning From Natural Image Datasets via RGBD Image Synthesis
| Atsuhiro NoguchiTatsuya Harada
2019-09-27
LoGANv2: Conditional Style-Based Logo Generation with Generative Adversarial Networks
| Cedric OeldorfGerasimos Spanakis
2019-09-22
Generating High-Resolution Fashion Model Images Wearing Custom Outfits
Gökhan YildirimNikolay JetchevRoland VollgrafUrs Bergmann
2019-08-23
Image Synthesis From Reconfigurable Layout and Style
| Wei SunTianfu Wu
2019-08-20
A Convolutional Decoder for Point Clouds using Adaptive Instance Normalization
Isaak LimMoritz IbingLeif Kobbelt
2019-06-27
What and Where to Translate: Local Mask-based Image-to-Image Translation
Wonwoong ChoSeunghwan ChoiJunwoo ParkDavid Keetae ParkTao QinJaegul Choo
2019-06-09
A Closed-form Solution to Universal Style Transfer
| Ming LuHao ZhaoAnbang YaoYurong ChenFeng XuLi Zhang
2019-06-03
Emergence of Object Segmentation in Perturbed Generative Models
| Adam BielskiPaolo Favaro
2019-05-29
Local Image-to-Image Translation via Pixel-wise Highway Adaptive Instance Normalization
Wonwoong ChoSeunghwan ChoiJunwoo ParkDavid Keetae ParkTao QinJaegul Choo
2019-05-01
Improved Precision and Recall Metric for Assessing Generative Models
| Tuomas KynkäänniemiTero KarrasSamuli LaineJaakko LehtinenTimo Aila
2019-04-15
Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?
| Rameen AbdalYipeng QinPeter Wonka
2019-04-05
A Style-Based Generator Architecture for Generative Adversarial Networks
| Tero KarrasSamuli LaineTimo Aila
2018-12-12
Style and Content Disentanglement in Generative Adversarial Networks
Hadi KazemiSeyed Mehdi IranmaneshNasser M. Nasrabadi
2018-11-14
Neural Comic Style Transfer: Case Study
Maciej PęśkoTomasz Trzciński
2018-09-05
Towards Metamerism via Foveated Style Transfer
| Arturo DezaAditya JonnalagaddaMiguel Eckstein
2017-05-29
Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization
| Xun HuangSerge Belongie
2017-03-20

Tasks

TASK PAPERS SHARE
Image Generation 16 20.78%
Style Transfer 8 10.39%
Image-to-Image Translation 5 6.49%
Face Generation 4 5.19%
Denoising 4 5.19%
Face Recognition 3 3.90%
Semantic Segmentation 3 3.90%
Super-Resolution 3 3.90%
Face Verification 2 2.60%

Components

COMPONENT TYPE
🤖 No Components Found You can add them if they exist; e.g. Mask R-CNN uses RoIAlign

Categories