## Normalizing Flows

Introduced by Rezende et al. in Variational Inference with Normalizing Flows

Normalizing Flows are a method for constructing complex distributions by transforming a probability density through a series of invertible mappings. By repeatedly applying the rule for change of variables, the initial density ‘flows’ through the sequence of invertible mappings. At the end of this sequence we obtain a valid probability distribution and hence this type of flow is referred to as a normalizing flow.

In the case of finite flows, the basic rule for the transformation of densities considers an invertible, smooth mapping $f : \mathbb{R}^{d} \rightarrow \mathbb{R}^{d}$ with inverse $f^{-1} = g$, i.e. the composition $g \cdot f\left(z\right) = z$. If we use this mapping to transform a random variable $z$ with distribution $q\left(z\right)$, the resulting random variable $z' = f\left(z\right)$ has a distribution:

$$q\left(\mathbf{z}'\right) = q\left(\mathbf{z}\right)\bigl\vert{\text{det}}\frac{\delta{f}^{-1}}{\delta{\mathbf{z'}}}\bigr\vert = q\left(\mathbf{z}\right)\bigl\vert{\text{det}}\frac{\delta{f}}{\delta{\mathbf{z}}}\bigr\vert ^{-1}$$ ? where the last equality can be seen by applying the chain rule (inverse function theorem) and is a property of Jacobians of invertible functions. We can construct arbitrarily complex densities by composing several simple maps and successively applying the above equation. The density $q_{K}\left(\mathbf{z}\right)$ obtained by successively transforming a random variable $z_{0}$ with distribution $q_{0}$ through a chain of $K$ transformations $f_{k}$ is:

$$z_{K} = f_{K} \cdot \dots \cdot f_{2} \cdot f_{1}\left(z_{0}\right)$$

$$\ln{q}_{K}\left(z_{K}\right) = \ln{q}_{0}\left(z_{0}\right) − \sum^{K}_{k=1}\ln\vert\det\frac{\delta{f_{k}}}{\delta{\mathbf{z_{k-1}}}}\vert$$ ? The path traversed by the random variables $z_{k} = f_{k}\left(z_{k}−1\right)$ with initial distribution $q_{0}\left(z_{0}\right)$ is called the flow and the path formed by the successive distributions $q_{k}$ is a normalizing flow.

#### Latest Papers

PAPER DATE
Blind Image Restoration with Flow Based Priors
Leonhard HelmingerMichael BernasconiAbdelaziz DjelouahMarkus GrossChristopher Schroers
2020-09-09
Variational Mixture of Normalizing Flows
Guilherme G. P. Freitas PiresMário A. T. Figueiredo
2020-09-01
Same Same But DifferNet: Semi-Supervised Defect Detection with Normalizing Flows
| Marco RudolphBastian WandtBodo Rosenhahn
2020-08-28
Lossy Image Compression with Normalizing Flows
Leonhard HelmingerAbdelaziz DjelouahMarkus GrossChristopher Schroers
2020-08-24
ClimAlign: Unsupervised statistical downscaling of climate variables via normalizing flows
Brian GroenkeLuke MadausClaire Monteleoni
2020-08-11
StyleFlow: Attribute-conditioned Exploration of StyleGAN-Generated Images using Conditional Continuous Normalizing Flows
Rameen AbdalPeihao ZhuNiloy MitraPeter Wonka
2020-08-06
Learning from a Complementary-label Source Domain: Theory and Algorithms
Yiyang ZhangFeng LiuZhen FangBo YuanGuangquan ZhangJie Lu
2020-08-04
Imitative Planning using Conditional Normalizing Flow
Shubhankar AgarwalHarshit SikchiCole GulinoEric Wilkinson
2020-07-31
Clarinet: A One-step Approach Towards Budget-friendly Unsupervised Domain Adaptation
| Yiyang ZhangFeng LiuZhen FangBo YuanGuangquan ZhangJie Lu
2020-07-29
SeismoGlow -- Data augmentation for the class imbalance problem
Ruy Luiz MilidiúLuis Felipe Müller
2020-07-23
Discrete Point Flow Networks for Efficient Point Cloud Generation
| Roman KlokovEdmond BoyerJakob Verbeek
2020-07-20
AdvFlow: Inconspicuous Black-box Adversarial Attacks using Normalizing Flows
2020-07-15
Faster Uncertainty Quantification for Inverse Problems with Conditional Normalizing Flows
Ali SiahkoohiGabrio RizzutiPhilipp A. WitteFelix J. Herrmann
2020-07-15
Projected Latent Markov Chain Monte Carlo: Conditional Inference with Normalizing Flows
Chris CannellaMohammadreza SoltaniVahid Tarokh
2020-07-13
Variational Inference with Continuously-Indexed Normalizing Flows
| Anthony CateriniRob CornishDino SejdinovicArnaud Doucet
2020-07-10
NVAE: A Deep Hierarchical Variational Autoencoder
Arash VahdatJan Kautz
2020-07-08
SurVAE Flows: Surjections to Bridge the Gap between VAEs and Flows
| Didrik NielsenPriyank JainiEmiel HoogeboomOle WintherMax Welling
2020-07-06
Sliced Iterative Generator
| Biwei DaiUros Seljak
2020-07-01
Mixture of Discrete Normalizing Flows for Variational Inference
| Tomasz KuśmierczykArto Klami
2020-06-28
Normalizing Flows Across Dimensions
Edmond CunninghamRenos ZabounidisAbhinav AgrawalIna FiterauDaniel Sheldon
2020-06-23
Riemannian Continuous Normalizing Flows
Emile MathieuMaximilian Nickel
2020-06-18
Advances in Black-Box VI: Normalizing Flows, Importance Weighting, and Optimization
Abhinav AgrawalDaniel SheldonJustin Domke
2020-06-18
Neural Manifold Ordinary Differential Equations
| Aaron LouDerek LimIsay KatsmanLeo HuangQingxuan JiangSer-Nam LimChristopher De Sa
2020-06-18
AI Feynman 2.0: Pareto-optimal symbolic regression exploiting graph modularity
| Silviu-Marian UdrescuAndrew TanJiahai FengOrisvaldo NetoTailin WuMax Tegmark
2020-06-18
Categorical Normalizing Flows via Continuous Transformations
| Phillip LippeEfstratios Gavves
2020-06-17
Flows Succeed Where GANs Fail: Lessons from Low-Dimensional Data
Tianci LiuJeffrey Regier
2020-06-17
MoFlow: An Invertible Flow Model for Generating Molecular Graphs
Chengxi ZangFei Wang
2020-06-17
Understanding and mitigating exploding inverses in invertible neural networks
| Jens BehrmannPaul VicolKuan-Chieh WangRoger GrosseJörn-Henrik Jacobsen
2020-06-16
Posterior Network: Uncertainty Estimation without OOD Samples via Density-Based Pseudo-Counts
Bertrand CharpentierDaniel ZügnerStephan Günnemann
2020-06-16
Density Deconvolution with Normalizing Flows
Tim DockhornJames A. RitchieYaoliang YuIain Murray
2020-06-16
Why Normalizing Flows Fail to Detect Out-of-Distribution Data
Polina KirichenkoPavel IzmailovAndrew Gordon Wilson
2020-06-15
Exponential Tilting of Generative Models: Improving Sample Quality by Training and Sampling from Latent Energy
Zhisheng XiaoQing YanYali Amit
2020-06-15
Ordering Dimensions with Nested Dropout Normalizing Flows
Artur BekasovIain Murray
2020-06-15
HyperFlow: Representing 3D Objects as Surfaces
Przemysław SpurekMaciej ZiębaJacek TaborTomasz Trzciński
2020-06-15
Neural Ordinary Differential Equations on Manifolds
Luca FalorsiPatrick Forré
2020-06-11
Learning normalizing flows from Entropy-Kantorovich potentials
2020-06-10
Recurrent Flow Networks: A Recurrent Latent Variable Model for Spatio-Temporal Density Modelling
| Daniele GammelliFilipe Rodrigues
2020-06-09
SoftFlow: Probabilistic Framework for Normalizing Flow on Manifolds
Hyeongju KimHyeonseung LeeWoo Hyun KangJoun Yeop LeeNam Soo Kim
2020-06-08
Auto-decoding Graphs
Sohil Atul ShahVladlen Koltun
2020-06-04
Equivariant Flows: exact likelihood generative learning for symmetric densities
Jonas KöhlerLeon KleinFrank Noé
2020-06-03
Graphical Normalizing Flows
Antoine WehenkelGilles Louppe
2020-06-03
The Expressive Power of a Class of Normalizing Flow Models
Zhifeng KongKamalika Chaudhuri
2020-05-31
CLARINET: A RISC-V Based Framework for Posit Arithmetic Empiricism
Riya JainNiraj SharmaFarhad MerchantSachin PatkarRainer Leupers
2020-05-30
OT-Flow: Fast and Accurate Continuous Normalizing Flows via Optimal Transport
| Derek OnkenSamy Wu FungXingjian LiLars Ruthotto
2020-05-29
Discretize-Optimize vs. Optimize-Discretize for Time-Series Regression and Continuous Normalizing Flows
Derek OnkenLars Ruthotto
2020-05-27
Exhaustive Neural Importance Sampling applied to Monte Carlo event generation
Sebastian Pina-OteyFederico SánchezThorsten LuxVicens Gaitan
2020-05-26
A comparison of Vietnamese Statistical Parametric Speech Synthesis Systems
Huy Kinh PhanViet Lam PhungTuan Anh DinhBao Quoc Nguyen
2020-05-26
Style-Controllable Speech-Driven Gesture Synthesis Using Normalising Flows
| Simon AlexandersonGustav Eje HenterTaras KucherenkoJonas Beskow
2020-05-25
Constraining the Reionization History using Bayesian Normalizing Flows
Héctor J. HortúaLuigi MalagoRiccardo Volpi
2020-05-14
Anomaly Detection in Trajectory Data with Normalizing Flows
Madson L. D. DiasCésar Lincoln C. MattosTiciana L. C. da SilvaJosé Antônio F. de MacedoWellington C. P. Silva
2020-04-13
Variational Autoencoders with Normalizing Flow Decoders
Rogan MorrowWei-Chen Chiu
2020-04-12
Scaling Bayesian inference of mixed multinomial logit models to very large datasets
Filipe Rodrigues
2020-04-11
Stochastic Flows and Geometric Optimization on the Orthogonal Group
Krzysztof ChoromanskiDavid CheikhiJared DavisValerii LikhosherstovAchille NazaretAchraf BahamouXingyou SongMrugank AkarteJack Parker-HolderJacob BergquistYuan GaoAldo PacchianoTamas SarlosAdrian WellerVikas Sindhwani
2020-03-30
Modeling Contrary-to-Duty with CP-nets
Roberta CalegariAndrea LoreggiaEmiliano LoriniFrancesca RossiGiovanni Sartor
2020-03-23
Gaussianization Flows
Chenlin MengYang SongJiaming SongStefano Ermon
2020-03-04
Implicit Functions in Feature Space for 3D Shape Reconstruction and Completion
| Julian ChibaneThiemo AlldieckGerard Pons-Moll
2020-03-03
MetFlow: A New Efficient Method for Bridging the Gap between Markov Chain Monte Carlo and Variational Inference
Achille ThinNikita KotelevskiiJean-Stanislas DenainLeo GrinsztajnAlain DurmusMaxim PanovEric Moulines
2020-02-27
Gradient Boosted Normalizing Flows
Robert GiaquintoArindam Banerjee
2020-02-27
Emosaic: Visualizing Affective Content of Text at Varying Granularity
Philipp GeuderMarie Claire LeidingerMartin von LupinMarian DörkTobias Schröder
2020-02-24
Stochastic Normalizing Flows
Liam HodgkinsonChris van der HeideFred RoostaMichael W. Mahoney
2020-02-21
Schoenberg-Rao distances: Entropy-based and geometry-aware statistical Hilbert distances
| Gaëtan HadjeresFrank Nielsen
2020-02-19
Gravitational-wave parameter estimation with autoregressive neural network flows
Stephen R. GreenChristine SimpsonJonathan Gair
2020-02-18
Stochastic Normalizing Flows
Hao WuJonas KöhlerFrank Noé
2020-02-16
Latent Variable Modelling with Hyperbolic Normalizing Flows
| Avishek Joey BoseAriella SmofskyRenjie LiaoPrakash PanangadenWilliam L. Hamilton
2020-02-15
TrajectoryNet: A Dynamic Optimal Transport Network for Modeling Cellular Dynamics
| Alexander TongJessie HuangGuy WolfDavid van DijkSmita Krishnaswamy
2020-02-09
Multimodal Controller for Generative Models
Enmao DiaoJie DingVahid Tarokh
2020-02-07
Efficient Probabilistic Logic Reasoning with Graph Neural Networks
| Yuyu ZhangXinshi ChenYuan YangArun RamamurthyBo LiYuan QiLe Song
2020-01-29
Fair Transfer of Multiple Style Attributes in Text
Karan DabasNishtha MadanVijay AryaSameep MehtaGautam SinghTanmoy Chakraborty
2020-01-18
Training Normalizing Flows with the Information Bottleneck for Competitive Generative Classification
| Lynton ArdizzoneRadek MackowiakCarsten RotherUllrich Köthe
2020-01-17
SqueezeWave: Extremely Lightweight Vocoders for On-device Speech Synthesis
Bohan ZhaiTianren GaoFlora XueDaniel RothchildBichen WuJoseph E. GonzalezKurt Keutzer
2020-01-16
i-flow: High-dimensional Integration and Sampling with Normalizing Flows
Christina GaoJoshua IsaacsonClaudius Krause
2020-01-15
Disentanglement by Nonlinear ICA with General Incompressible-flow Networks (GIN)
Peter SorrensonCarsten RotherUllrich Köthe
2020-01-14
Relational State-Space Model for Stochastic Multi-Object Systems
Fan YangLing ChenFan ZhouYusong GaoWei Cao
2020-01-13
Self-Supervised Learning of Generative Spin-Glasses with Normalizing Flows
Gavin S. HartnettMasoud Mohseni
2020-01-02
Neural Video Encoding
Anonymous
2020-01-01
InfoCNF: Efficient Conditional Continuous Normalizing Flow Using Adaptive Solvers
Anonymous
2020-01-01
Co-Attentive Equivariant Neural Networks: Focusing Equivariance On Transformations Co-Ocurring in Data
Anonymous
2020-01-01
Disentanglement through Nonlinear ICA with General Incompressible-flow Networks (GIN)
Anonymous
2020-01-01
GENERALIZATION GUARANTEES FOR NEURAL NETS VIA HARNESSING THE LOW-RANKNESS OF JACOBIAN
Anonymous
2020-01-01
Training Deep Neural Networks with Partially Adaptive Momentum
Anonymous
2020-01-01
Word embedding re-examined: is the symmetrical factorization optimal?
Anonymous
2020-01-01
Shallow VAEs with RealNVP Prior Can Perform as Well as Deep Hierarchical VAEs
Anonymous
2020-01-01
Understanding l4-based Dictionary Learning: Interpretation, Stability, and Robustness
| Anonymous
2020-01-01
Avoiding Spurious Local Minima in Deep Quadratic Networks
Abbas KazemipourBrett W. LarsenShaul Druckmann
2019-12-31
Discrete and Continuous Action Representation for Practical RL in Video Games
Olivier DelalleauMaxim PeterEloi AlonsoAdrien Logut
2019-12-23
Probing the phonetic and phonological knowledge of tones in Mandarin TTS models
| Jian Zhu
2019-12-23
Normalizing flows for deep anomaly detection
Artem RyzhikovMaxim BorisyakAndrey UstyuzhaninDenis Derkach
2019-12-19
Temporal Normalizing Flows
| Remy KustersGert-Jan Both
2019-12-19
Invertible Gaussian Reparameterization: Revisiting the Gumbel-Softmax
| Andres PotapczynskiGabriel Loaiza-GanemJohn P. Cunningham
2019-12-19
C-Flow: Conditional Generative Flow Models for Images and 3D Point Clouds
Albert PumarolaStefan PopovFrancesc Moreno-NoguerVittorio Ferrari
2019-12-15
InfoCNF: An Efficient Conditional Continuous Normalizing Flow with Adaptive Solvers
Tan M. NguyenAnimesh GargRichard G. BaraniukAnima Anandkumar
2019-12-09
WaveFlow: A Compact Flow-based Model for Raw Audio
| Wei PingKainan PengKexin ZhaoZhao Song
2019-12-03
Invertible Convolutional Flow
| Mahdi KaramiDale SchuurmansJascha Sohl-DicksteinLaurent DinhDaniel Duckworth
2019-12-01
Learning Likelihoods with Conditional Normalizing Flows
Christina WinklerDaniel WorrallEmiel HoogeboomMax Welling
2019-11-29
How Much Over-parameterization Is Sufficient to Learn Deep ReLU Networks?
Zixiang ChenYuan CaoDifan ZouQuanquan Gu
2019-11-27
Natural Image Manipulation for Autoregressive Models Using Fisher Scores
Wilson YanJonathan HoPieter Abbeel
2019-11-25
Adversarial Robustness of Flow-Based Generative Models
Phillip PopeYogesh BalajiSoheil Feizi
2019-11-20
Any-Precision Deep Neural Networks
| Haichao YuHaoxiang LiHonghui ShiThomas S. HuangGang Hua
2019-11-17
A Configuration-Space Decomposition Scheme for Learning-based Collision Checking
Yiheng HanWang ZhaoJia PanZipeng YeRan YiYong-Jin Liu
2019-11-17
Speaker independence of neural vocoders and their effect on parametric resynthesis speech enhancement
Soumi MaitiMichael I Mandel
2019-11-14
Deep Generative Models Strike Back! Improving Understanding and Evaluation in Light of Unmet Expectations for OoD Data
John JustSambuddha Ghosal
2019-11-12
Incentive-aware Contextual Pricing with Non-parametric Market Noise
Negin GolrezaeiPatrick JailletJason Cheuk Nam Liang
2019-11-08
A Method to Model Conditional Distributions with Normalizing Flows
Zhisheng XiaoQing YanYali Amit
2019-11-05
Variational Autoencoders for Generative Modelling of Water Cherenkov Detectors
Abhishek AbhishekWojciech FedorkoPatrick de PerioNicholas ProuseJulian Z. Ding
2019-11-01
Small-GAN: Speeding Up GAN Training Using Core-sets
Samarth SinhaHan ZhangAnirudh GoyalYoshua BengioHugo LarochelleAugustus Odena
2019-10-29
Transferring neural speech waveform synthesizers to musical instrument sounds generation
Yi ZhaoXin WangLauri JuvelaJunichi Yamagishi
2019-10-27
An Unbiased Risk Estimator for Learning with Augmented Classes
Yu-Jie ZhangPeng ZhaoZhi-Hua Zhou
2019-10-21
Label-Conditioned Next-Frame Video Generation with Neural Flows
David Donahue
2019-10-16
Adaptive Exploration in Linear Contextual Bandit
Botao HaoTor LattimoreCsaba Szepesvari
2019-10-15
Beyond Linearization: On Quadratic and Higher-Order Approximation of Wide Neural Networks
Yu BaiJason D. Lee
2019-10-03
Intensity-Free Learning of Temporal Point Processes
| Oleksandr ShchurMarin BilošStephan Günnemann
2019-09-26
Attraction-Repulsion Actor-Critic for Continuous Control Reinforcement Learning
Thang DoanBogdan MazoureMoloud AbdarAudrey DurandJoelle PineauR Devon Hjelm
2019-09-17
Normalizing Flows: An Introduction and Review of Current Methods
Ivan KobyzevSimon J. D. PrinceMarcus A. Brubaker
2019-08-25
A Linear Systems Theory of Normalizing Flows
Reuben FeinmanNikhil Parthasarathy
2019-07-15
Tails of Lipschitz Triangular Flows
Priyank JainiIvan KobyzevYaoliang YuMarcus Brubaker
2019-07-10
Multi-Speaker End-to-End Speech Synthesis
Jihyun ParkKexin ZhaoKainan PengWei Ping
2019-07-09
Copula & Marginal Flows: Disentangling the Marginal from its Joint
Magnus WieseRobert KnoblochRalf Korn
2019-07-07
Universal audio synthesizer control with normalizing flows
| Philippe EslingNaotake MasudaAdrien BardetRomeo DespresAxel Chemla--Romeu-Santos
2019-07-01
Interpolated Spectral NGram Language Models
2019-07-01
PointFlow: 3D Point Cloud Generation with Continuous Normalizing Flows
| Guandao YangXun HuangZekun HaoMing-Yu LiuSerge BelongieBharath Hariharan
2019-06-28
Multi-Category Fairness in Sponsored Search Auctions
Shuchi ChawlaChristina IlventoMeena Jagadeesan
2019-06-20
Normalizing flows for novelty detection in industrial time series data
Maximilian SchmidtMarko Simic
2019-06-17
Parametric Resynthesis with neural vocoders
| Soumi MaitiMichael I Mandel
2019-06-16
Generalization Guarantees for Neural Networks via Harnessing the Low-rank Structure of the Jacobian
Samet OymakZalan FabianMingchen LiMahdi Soltanolkotabi
2019-06-12
Evaluating the Robustness of Nearest Neighbor Classifiers: A Primal-Dual Perspective
Lu WangXuanqing LiuJinfeng YiZhi-Hua ZhouCho-Jui Hsieh
2019-06-10
Distributed Training with Heterogeneous Data: Bridging Median- and Mean-Based Algorithms
Xiangyi ChenTiancong ChenHaoran SunZhiwei Steven WuMingyi Hong
2019-06-04
CIC at SemEval-2019 Task 5: Simple Yet Very Efficient Approach to Hate Speech Detection, Aggressive Behavior Detection, and Target Classification in Twitter
Iqra AmeerMuhammad Hammad Fahim SiddiquiGrigori SidorovAlex Gelbukher
2019-06-01
Graph Normalizing Flows
Jenny LiuAviral KumarJimmy BaJamie KirosKevin Swersky
2019-05-30
AlignFlow: Cycle Consistent Learning from Multiple Domains via Normalizing Flows
Aditya GroverChristopher ChuteRui ShuZhangjie CaoStefano Ermon
2019-05-30
Structured Output Learning with Conditional Generative Flows
You LuBert Huang
2019-05-30
Discrete Flows: Invertible Generative Models of Discrete Data
| Dustin TranKeyon VafaKumar Krishna AgrawalLaurent DinhBen Poole
2019-05-24
Generative Flow via Invertible nxn Convolution
Thanh-Dat TruongKhoa LuuChi Nhan DuongNgan LeMinh-Triet Tran
2019-05-24
Non-Autoregressive Neural Text-to-Speech
| Kainan PengWei PingZhao SongKexin Zhao
2019-05-21
Leveraging exploration in off-policy algorithms via normalizing flows
Bogdan MazoureThang DoanAudrey DurandR Devon HjelmJoelle Pineau
2019-05-16
X2CT-GAN: Reconstructing CT from Biplanar X-Rays with Generative Adversarial Networks
Xingde YingHeng GuoKai MaJian WuZhengxin WengYefeng Zheng
2019-05-16
DoubleSqueeze: Parallel Stochastic Gradient Descent with Double-Pass Error-Compensated Compression
Hanlin TangXiangru LianChen YuTong ZhangJi Liu
2019-05-15
Deep Ordinal Reinforcement Learning
Alexander ZapTobias JoppenJohannes Fürnkranz
2019-05-06
$A^*$ sampling with probability matching
Yichi ZhouJun Zhu
2019-05-01
Padam: Closing the Generalization Gap of Adaptive Gradient Methods in Training Deep Neural Networks
Jinghui ChenQuanquan Gu
2019-05-01
Learning metrics for persistence-based summaries and applications for graph classification
Qi ZhaoYusu Wang
2019-04-27
Learning metrics for persistence-based summaries and applications for graph classification
Qi ZhaoYusu Wang
2019-04-27
Neural source-filter waveform models for statistical parametric speech synthesis
Xin WangShinji TakakiJunichi Yamagishi
2019-04-27
A Skeleton-bridged Deep Learning Approach for Generating Meshesof Complex Topologies from Single RGB Image
| Jiapeng TangXiaoguang HanJunyi PanKui JiaXin Tong
2019-04-10
WaveCycleGAN2: Time-domain Neural Post-filter for Speech Waveform Generation
Kou TanakaHirokazu KameokaTakuhiro KanekoNobukatsu Hojo
2019-04-05
Conditional Adversarial Generative Flow for Controllable Image Synthesis
Rui LiuYu LiuXinyu GongXiaogang WangHongsheng Li
2019-04-03
A Skeleton-bridged Deep Learning Approach for Generating Meshes of Complex Topologies from Single RGB Images
| Jiapeng TangXiaoguang HanJunyi PanKui JiaXin Tong
2019-03-12
TzK: Flow-Based Conditional Generative Model
Micha LivneDavid Fleet
2019-02-05
Emerging Convolutions for Generative Normalizing Flows
| Emiel HoogeboomRianne van den BergMax Welling
2019-01-30
Latent Normalizing Flows for Discrete Sequences
| Zachary M. ZieglerAlexander M. Rush
2019-01-29
Throttling Malware Families in 2D
Mohamed NassarHaidar Safa
2019-01-29
How is Your Mood When Writing Sexist tweets? Detecting the Emotion Type and Intensity of Emotion Using Natural Language Processing Techniques
Sima SharifiradBorna JafarpourStan Matwin
2019-01-28
Semi-supervised learning in unbalanced and heterogeneous networks
Ting LiNingchen YingXianshi YuBin-Yi Jing
2019-01-07
Sparse Learning in reproducing kernel Hilbert space
Xin HeJunhui Wang
2019-01-03
On the Benefit of Width for Neural Networks: Disappearance of Bad Basins
Dawei LiTian DingRuoyu Sun
2018-12-28
AdaFlow: Domain-Adaptive Density Estimator with Application to Anomaly Detection and Unpaired Cross-Domain Translation
Masataka YamaguchiYuma KoizumiNoboru Harada
2018-12-14
Adversarial Defense of Image Classification Using a Variational Auto-Encoder
| Yi LuoHenry Pfister
2018-12-07
Feature selection with optimal coordinate ascent (OCA)
David SaltielEric Benhamou
2018-11-29
Stochastic Gradient Descent Optimizes Over-parameterized Deep ReLU Networks
Difan ZouYuan CaoDongruo ZhouQuanquan Gu
2018-11-21
State Aggregation Learning from Markov Transition Data
Yaqi DuanZheng Tracy KeMengdi Wang
2018-11-06
FloWaveNet : A Generative Flow for Raw Audio
Sungwon KimSang-gil LeeJongyoon SongSungroh Yoon
2018-11-06
Task Embedded Coordinate Update: A Realizable Framework for Multivariate Non-convex Optimization
Yiyang WangRisheng LiuLong MaXiaoliang Song
2018-11-05
WaveGlow: A Flow-based Generative Network for Speech Synthesis
| Ryan PrengerRafael ValleBryan Catanzaro
2018-10-31
Optimizing Waiting Thresholds Within A State Machine
Rohit PandeyYifan ChangCameron WhiteGaurav JagtianiAerin Young KimGil Lapid ShafririSathya Singh
2018-10-08
Boosting Trust Region Policy Optimization by Normalizing Flows Policy
| Yunhao TangShipra Agrawal
2018-09-27
Online Dictionary Learning for Approximate Archetypal Analysis
Jieru MeiChunyu WangWenjun Zeng
2018-09-01
Making \emph{ordinary least squares} linear classfiers more robust
Babatunde M. Ayeni
2018-08-28
ClariNet: Parallel Wave Generation in End-to-End Text-to-Speech
| Wei PingKainan PengJitong Chen
2018-07-19
IntroVAE: Introspective Variational Autoencoders for Photographic Image Synthesis
| Huaibo HuangZhihang LiRan HeZhenan SunTieniu Tan
2018-07-17
Payoff Control in the Iterated Prisoner's Dilemma
Dong HaoKai LiTao Zhou
2018-07-17
Glow: Generative Flow with Invertible 1x1 Convolutions
| Diederik P. KingmaPrafulla Dhariwal
2018-07-09
ReCoNet: Real-time Coherent Video Style Transfer Network
| Chang GaoDerun GuFangjun ZhangYizhou Yu
2018-07-03
Implicit Regularization in Nonconvex Statistical Estimation: Gradient Descent Converges Linearly for Phase Retrieval and Matrix Completion
Cong MaKaizheng WangYuejie ChiYuxin Chen
2018-07-01
Deep Neural Decision Trees
| Yongxin YangIrene Garcia MorilloTimothy M. Hospedales
2018-06-19
Closing the Generalization Gap of Adaptive Gradient Methods in Training Deep Neural Networks
| Jinghui ChenDongruo ZhouYiqi TangZiyan YangYuan CaoQuanquan Gu
2018-06-18
What Knowledge is Needed to Solve the RTE5 Textual Entailment Challenge?
Peter Clark
2018-06-10
Randomized Value Functions via Multiplicative Normalizing Flows
Ahmed TouatiHarsh SatijaJoshua RomoffJoelle PineauPascal Vincent
2018-06-06
Online Deep Metric Learning
Wenbin LiJing HuoYinghuan ShiYang GaoLei WangJiebo Luo
2018-05-15
Robust Blind Deconvolution via Mirror Descent
| Sathya N. RaviRonak MehtaVikas Singh
2018-03-21
Sylvester Normalizing Flows for Variational Inference
| Rianne van den BergLeonard HasencleverJakub M. TomczakMax Welling
2018-03-15
Large Margin Deep Networks for Classification
| Gamaleldin F. ElsayedDilip KrishnanHossein MobahiKevin ReganSamy Bengio
2018-03-15
An Alternative View: When Does SGD Escape Local Minima?
Robert KleinbergYuanzhi LiYang Yuan
2018-02-17
Persistence Fisher Kernel: A Riemannian Manifold Kernel for Persistence Diagrams
| Tam LeMakoto Yamada
2018-02-10
Reparametrization of COM-Poisson Regression Models with Applications in the Analysis of Experimental Data
Eduardo E. Ribeiro JrWalmes M. ZevianiWagner H. BonatClarice G. B. DemétrioJohn Hinde
2018-01-29
Evaluation of generative networks through their data augmentation capacity
Timothée LesortFlorian BordesJean-Francois GoudouDavid Filliat
2018-01-01
A Spectral Approach to Generalization and Optimization in Neural Networks
Farzan FarniaJesse ZhangDavid Tse
2018-01-01
CNNs are Globally Optimal Given Multi-Layer Support
Chen HuangChen KongSimon Lucey
2017-12-07
On Frank-Wolfe and Equilibrium Computation
Jacob D. AbernethyJun-Kun Wang
2017-12-01
State Space LSTM Models with Particle MCMC Inference
Xun ZhengManzil ZaheerAmr AhmedYuan WangEric P XingAlexander J Smola
2017-11-30
Implicit Regularization in Nonconvex Statistical Estimation: Gradient Descent Converges Linearly for Phase Retrieval, Matrix Completion, and Blind Deconvolution
Cong MaKaizheng WangYuejie ChiYuxin Chen
2017-11-28
Proximal Alternating Direction Network: A Globally Converged Deep Unrolling Framework
Risheng LiuXin FanShichao ChengXiangyu WangZhongxuan Luo
2017-11-21
Wasserstein Auto-Encoders
| Ilya TolstikhinOlivier BousquetSylvain GellyBernhard Schoelkopf
2017-11-05
Analysis of planar ornament patterns via motif asymmetry assumption and local connections
2017-10-12
Fast and Strong Convergence of Online Learning Algorithms
Zheng-Chu GuoLei Shi
2017-10-10
Generative Adversarial Mapping Networks
Jianbo GuoGuangxiang ZhuJian Li
2017-09-28
Order-Preserving Abstractive Summarization for Spoken Content Based on Connectionist Temporal Classification
Bo-Ru LuFrank ShyuYun-Nung ChenHung-Yi LeeLin-shan Lee
2017-09-16
Continuous-Time Flows for Efficient Inference and Density Estimation
Changyou ChenChunyuan LiLiqun ChenWenlin WangYunchen PuLawrence Carin
2017-09-04
Deep vs. Diverse Architectures for Classification Problems
Colleen M. Farrelly
2017-08-21
Geometric Enclosing Networks
Trung LeHung VuTu Dinh NguyenDinh Phung
2017-08-16
Follow the Moving Leader in Deep Learning
Shuai ZhengJames T. Kwok
2017-08-01
Restricted Eigenvalue from Stable Rank with Applications to Sparse Linear Regression
Shiva Prasad KasiviswanathanMark Rudelson
2017-07-25
Big Data Regression Using Tree Based Segmentation
Rajiv SambasivanSourish Das
2017-07-24
Adversarial Examples, Uncertainty, and Transfer Testing Robustness in Gaussian Process Hybrid Deep Networks
John BradshawAlexander G. de G. MatthewsZoubin Ghahramani
2017-07-08
Maintaining cooperation in complex social dilemmas using deep reinforcement learning
2017-07-04
Convergence Analysis of Two-layer Neural Networks with ReLU Activation
Yuanzhi LiYang Yuan
2017-05-28
MUTAN: Multimodal Tucker Fusion for Visual Question Answering
| Hedi Ben-younesRémi CadeneMatthieu CordNicolas Thome
2017-05-18
Generalized Ideals and Co-Granular Rough Sets
A Mani
2017-04-18
Identification of Multiword Expressions for Latvian and Lithuanian: Hybrid Approach
MJustina ravickait{\.e}Tomas Krilavi{\v{c}}ius
2017-04-01
On architectural choices in deep learning: From network structure to gradient convergence and parameter estimation
Vamsi K IthapuSathya N RaviVikas Singh
2017-02-28
Wages of wins: could an amateur make money from match outcome predictions?
Albrecht Zimmermann
2017-02-17
Bayesian System Identification based on Hierarchical Sparse Bayesian Learning and Gibbs Sampling with Application to Structural Damage Assessment
Yong HuangJames L. BeckHui Li
2017-01-13
Factor-Adjusted Regularized Model Selection
Jianqing FanYuan KeKaizheng Wang
2016-12-27
Saliency Driven Image Manipulation
| Roey MechrezEli ShechtmanLihi Zelnik-Manor
2016-12-07
Improved Variational Inference with Inverse Autoregressive Flow
| Durk P. KingmaTim SalimansRafal JozefowiczXi ChenIlya SutskeverMax Welling
2016-12-01
Vectors or Graphs? On Differences of Representations for Distributional Semantic Models
Chris Biemann
2016-12-01
Normalizing Flows on Riemannian Manifolds
Mevlana C. GemiciDanilo RezendeShakir Mohamed
2016-11-07
Optimizing Codes for Source Separation in Color Image Demosaicing and Compressive Video Recovery
2016-09-07
Hybrid Jacobian and Gauss-Seidel proximal block coordinate update methods for linearly constrained convex programming
Yangyang Xu
2016-08-13
Improving Variational Inference with Inverse Autoregressive Flow
| Diederik P. KingmaTim SalimansRafal JozefowiczXi ChenIlya SutskeverMax Welling
2016-06-15
Density estimation using Real NVP
| Laurent DinhJascha Sohl-DicksteinSamy Bengio
2016-05-27
Interaction pursuit in high-dimensional multi-response regression via distance correlation
Yinfei KongDaoji LiYingying FanJinchi Lv
2016-05-11
The constrained Dantzig selector with enhanced consistency
Yinfei KongZemin ZhengJinchi Lv
2016-05-11
Makeup like a superstar: Deep Localized Makeup Transfer Network
Si LiuXinyu OuRuihe QianWei WangXiaochun Cao
2016-04-25
A strengthening of rational closure in DLs: reasoning about multiple aspects
Valentina Gliozzi
2016-04-01
Identity Mappings in Deep Residual Networks
| Kaiming HeXiangyu ZhangShaoqing RenJian Sun
2016-03-16
Local-likelihood transformation kernel density estimation for positive random variables
Gery GeenensCraig Wang
2016-02-15
Universal Dependency Analysis
Hoang-Vu NguyenJilles Vreeken
2015-10-28
Scalable Bayesian Non-Negative Tensor Factorization for Massive Count Data
Changwei HuPiyush RaiChangyou ChenMatthew HardingLawrence Carin
2015-08-18
A MAP approach for $\ell_q$-norm regularized sparse parameter estimation using the EM algorithm
Rodrigo CarvajalJuan C. AgüeroBoris I. GodoyDimitrios Katselis
2015-08-05
An SVM-like Approach for Expectile Regression
2015-07-14
Supervised Learning of Semantics-Preserving Hash via Deep Convolutional Neural Networks
| Huei-Fang YangKevin LinChu-Song Chen
2015-07-01
On Distributive Subalgebras of Qualitative Spatial and Temporal Calculi
Zhiguo LongSanjiang Li
2015-06-01
Variational Inference with Normalizing Flows
| Danilo Jimenez RezendeShakir Mohamed
2015-05-21