Linear Layer

A Linear Layer is a projection $\mathbf{XW + b}$.

Latest Papers

PAPER DATE
Efficient Transformers: A Survey
Yi TayMostafa DehghaniDara BahriDonald Metzler
2020-09-14
not-so-BigGAN: Generating High-Fidelity Images on a Small Compute Budget
Seungwook HanAkash SrivastavaCole HurwitzPrasanna SattigeriDavid D. Cox
2020-09-09
WaveGrad: Estimating Gradients for Waveform Generation
| Nanxin ChenYu ZhangHeiga ZenRon J. WeissMohammad NorouziWilliam Chan
2020-09-02
Neural Crossbreed: Neural Based Image Metamorphosis
Sanghun ParkKwanggyoon SeoJunyong Noh
2020-09-02
SpeedySpeech: Efficient Neural Speech Synthesis
Jan VainerOndřej Dušek
2020-08-09
Predicting What You Already Know Helps: Provable Self-Supervised Learning
Jason D. LeeQi LeiNikunj SaunshiJiacheng Zhuo
2020-08-03
One Model, Many Languages: Meta-learning for Multilingual Text-to-Speech
| Tomáš NekvindaOndřej Dušek
2020-08-03
A Spectral Energy Distance for Parallel Speech Synthesis
Alexey A. GritsenkoTim SalimansRianne van den BergJasper SnoekNal Kalchbrenner
2020-08-03
node2coords: Graph Representation Learning with Wasserstein Barycenters
Effrosyni SimouDorina ThanouPascal Frossard
2020-07-31
Instance Selection for GANs
Terrance DeVriesMichal DrozdzalGraham W. Taylor
2020-07-30
WeightNet: Revisiting the Design Space of Weight Networks
| Ningning MaXiangyu ZhangJiawei HuangJian Sun
2020-07-23
Interpolating GANs to Scaffold Autotelic Creativity
Ziv EpsteinOcéane BoulaisSkylar GordonMatt Groh
2020-07-21
Deep Low-Rank Subspace Clustering
| Mohsen KheirandishfardFariba ZohrizadehFarhad Kamangar
2020-06-18
Differentiable Augmentation for Data-Efficient GAN Training
| Shengyu ZhaoZhijian LiuJi LinJun-Yan ZhuSong Han
2020-06-18
A block coordinate descent optimizer for classification problems exploiting convexity
Ravi G. PatelNathaniel A. TraskMamikon A. GulianEric C. Cyr
2020-06-17
Training Generative Adversarial Networks with Limited Data
| Tero KarrasMiika AittalaJanne HellstenSamuli LaineJaakko LehtinenTimo Aila
2020-06-11
A t-distribution based operator for enhancing out of distribution robustness of neural network classifiers
| Niccolò AntonelloPhilip N. Garner
2020-06-09
Learning disconnected manifolds: a no GANs land
Ugo TanielianThibaut IssenhuthElvis DohmatobJeremie Mary
2020-06-08
Big GANs Are Watching You: Towards Unsupervised Object Segmentation with Off-the-Shelf Generative Models
| Andrey VoynovStanislav MorozovArtem Babenko
2020-06-08
Linformer: Self-Attention with Linear Complexity
| Sinong WangBelinda Z. LiMadian KhabsaHan FangHao Ma
2020-06-08
AutoPrivacy: Automated Layer-wise Parameter Selection for Secure Neural Network Inference
Qian LouBian SongLei Jiang
2020-06-07
A U-Net Based Discriminator for Generative Adversarial Networks
Edgar Schonfeld Bernt Schiele Anna Khoreva
2020-06-01
Network Fusion for Content Creation with Conditional INNs
Robin RombachPatrick EsserBjörn Ommer
2020-05-27
Flowtron: an Autoregressive Flow-based Generative Network for Text-to-Speech Synthesis
| Rafael ValleKevin ShihRyan PrengerBryan Catanzaro
2020-05-12
GANSpace: Discovering Interpretable GAN Controls
| Erik HärkönenAaron HertzmannJaakko LehtinenSylvain Paris
2020-04-06
Evolving Normalization-Activation Layers
| Hanxiao LiuAndrew BrockKaren SimonyanQuoc V. Le
2020-04-06
Feature Quantization Improves GAN Training
| Yang ZhaoChunyuan LiPing YuJianfeng GaoChangyou Chen
2020-04-05
BigGAN-based Bayesian reconstruction of natural images from human brain activity
Kai QiaoJian ChenLinyuan WangChi ZhangLi TongBin Yan
2020-03-13
A U-Net Based Discriminator for Generative Adversarial Networks
| Edgar SchönfeldBernt SchieleAnna Khoreva
2020-02-28
Layer-wise Conditioning Analysis in Exploring the Learning Dynamics of DNNs
Lei HuangJie QinLi LiuFan ZhuLing Shao
2020-02-25
Deep Transform and Metric Learning Network: Wedding Deep Dictionary Learning and Neural Networks
Wen TangEmilie ChouzenouxJean-Christophe PesquetHamid Krim
2020-02-18
Improved Consistency Regularization for GANs
Zhengli ZhaoSameer SinghHonglak LeeZizhao ZhangAugustus OdenaHan Zhang
2020-02-11
Fully-hierarchical fine-grained prosody modeling for interpretable speech synthesis
Guangzhi SunYu ZhangRon J. WeissYuan CaoHeiga ZenYonghui Wu
2020-02-06
WaveTTS: Tacotron-based TTS with Joint Time-Frequency Domain Loss
Rui LiuBerrak SismanFeilong BaoGuanglai GaoHaizhou Li
2020-02-02
Reconstructing Natural Scenes from fMRI Patterns using BigBiGAN
Milad MozafariLeila ReddyRufin VanRullen
2020-01-31
Random Matrix Theory Proves that Deep Learning Representations of GAN-data Behave as Gaussian Mixtures
Mohamed El Amine SeddikCosme LouartMohamed TamaazoustiRomain Couillet
2020-01-21
Compounding the Performance Improvements of Assembled Techniques in a Convolutional Neural Network
| Jungkyu LeeTaeryun WonTae Kwan LeeHyemin LeeGeonmo GuKiho Hong
2020-01-17
CNN-generated images are surprisingly easy to spot... for now
| Sheng-Yu WangOliver WangRichard ZhangAndrew OwensAlexei A. Efros
2019-12-23
Probing the phonetic and phonological knowledge of tones in Mandarin TTS models
| Jian Zhu
2019-12-23
LOGAN: Latent Optimisation for Generative Adversarial Networks
| Yan WuJeff DonahueDavid BalduzziKaren SimonyanTimothy Lillicrap
2019-12-02
Detecting GAN generated errors
Xiru ZhuFengdi CheTianzi YangTzuyang YuDavid MegerGregory Dudek
2019-12-02
Beyond temperature scaling: Obtaining well-calibrated multi-class probabilities with Dirichlet calibration
| Meelis KullMiquel Perello NietoMarkus KängseppTelmo Silva FilhoHao SongPeter Flach
2019-12-01
Semantic Hierarchy Emerges in Deep Generative Representations for Scene Synthesis
| Ceyuan YangYujun ShenBolei Zhou
2019-11-21
Improving Natural Language Understanding by Reverse Mapping Bytepair Encoding
Chaodong TongHuailiang PengQiong DaiLei JiangJianghua Huang
2019-11-01
Beyond temperature scaling: Obtaining well-calibrated multiclass probabilities with Dirichlet calibration
| Meelis KullMiquel Perello-NietoMarkus KängseppTelmo Silva FilhoHao SongPeter Flach
2019-10-28
Mellotron: Multispeaker expressive voice synthesis by conditioning on rhythm, pitch and global style tokens
| Rafael ValleJason LiRyan PrengerBryan Catanzaro
2019-10-26
Improving sample diversity of a pre-trained, class-conditional GAN by changing its class embeddings
| Qi LiLong MaiMichael A. AlcornAnh Nguyen
2019-10-10
Embeddings for DNN speaker adaptive training
Joanna RownickaPeter BellSteve Renals
2019-09-30
Biomedical relation extraction with pre-trained language representations and minimal task-specific architecture
Ashok ThillaisundaramTheodosia Togia
2019-09-26
High Fidelity Speech Synthesis with Adversarial Networks
| Mikołaj BińkowskiJeff DonahueSander DielemanAidan ClarkErich ElsenNorman CasagrandeLuis C. CoboKaren Simonyan
2019-09-25
Approximation Capabilities of Neural ODEs and Invertible Residual Networks
Han ZhangXi GaoJacob UntermanTom Arodz
2019-07-30
Adversarial Video Generation on Complex Datasets
Aidan ClarkJeff DonahueKaren Simonyan
2019-07-15
Large Scale Adversarial Representation Learning
| Jeff DonahueKaren Simonyan
2019-07-04
Controlling Neural Level Sets
| Matan AtzmonNiv HaimLior YarivOfer IsraelovHaggai MaronYaron Lipman
2019-05-28
Deep Compressed Sensing
| Yan WuMihaela RoscaTimothy Lillicrap
2019-05-16
Convolution, attention and structure embedding
Jean-Marc Andreoli
2019-05-03
Deep Layers as Stochastic Solvers
Adel BibiBernard GhanemVladlen KoltunRene Ranftl
2019-05-01
Improved Precision and Recall Metric for Assessing Generative Models
| Tuomas KynkäänniemiTero KarrasSamuli LaineJaakko LehtinenTimo Aila
2019-04-15
CondConv: Conditionally Parameterized Convolutions for Efficient Inference
| Brandon YangGabriel BenderQuoc V. LeJiquan Ngiam
2019-04-10
Equivariant Entity-Relationship Networks
Devon GrahamJunhao WangSiamak Ravanbakhsh
2019-03-21
High-Fidelity Image Generation With Fewer Labels
| Mario LucicMichael TschannenMarvin RitterXiaohua ZhaiOlivier BachemSylvain Gelly
2019-03-06
Breaking the Softmax Bottleneck via Learnable Monotonic Pointwise Non-linearities
Octavian-Eugen GaneaSylvain GellyGary BécigneulAliaksei Severyn
2019-02-21
Pay Less Attention with Lightweight and Dynamic Convolutions
| Felix WuAngela FanAlexei BaevskiYann N. DauphinMichael Auli
2019-01-29
Mathematical Analysis of Adversarial Attacks
Zehao DouStanley J. OsherBao Wang
2018-11-15
Metropolis-Hastings view on variational inference and adversarial training
Kirill NeklyudovEvgenii EgorovPavel ShvechikovDmitry Vetrov
2018-10-16
Large Scale GAN Training for High Fidelity Natural Image Synthesis
| Andrew BrockJeff DonahueKaren Simonyan
2018-09-28
Revisit Multinomial Logistic Regression in Deep Learning: Data Dependent Model Initialization for Image Recognition
Bowen ChengRong XiaoYandong GuoYuxiao HuJianfeng WangLei Zhang
2018-09-17
Big-Little Net: An Efficient Multi-Scale Feature Representation for Visual and Speech Recognition
| Chun-Fu ChenQuanfu FanNeil MallinarTom SercuRogerio Feris
2018-07-10
Representation Learning with Contrastive Predictive Coding
| Aaron van den OordYazhe LiOriol Vinyals
2018-07-10
Kernelized Synaptic Weight Matrices
| Lorenz MullerJulien MartelGiacomo Indiveri
2018-07-01
Direct Shape Regression Networks for End-to-End Face Alignment
Xin MiaoXiantong ZhenXianglong LiuCheng DengVassilis AthitsosHeng Huang
2018-06-01
Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictions
| Jonathan ShenRuoming PangRon J. WeissMike SchusterNavdeep JaitlyZongheng YangZhifeng ChenYu ZhangYuxuan WangRJ Skerry-RyanRif A. SaurousYannis AgiomyrgiannakisYonghui Wu
2017-12-16
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
| Chelsea FinnPieter AbbeelSergey Levine
2017-03-09
Language Modeling with Gated Convolutional Networks
| Yann N. DauphinAngela FanMichael AuliDavid Grangier
2016-12-23
Adversarial Images for Variational Autoencoders
| Pedro TabacofJulia TavaresEduardo Valle
2016-12-01
Temporal Generative Adversarial Nets with Singular Value Clipping
| Masaki SaitoEiichi MatsumotoShunta Saito
2016-11-21
Scaling up Echo-State Networks with multiple light scattering
Jonathan DongSylvain GiganFlorent KrzakalaGilles Wainrib
2016-09-15
ACDC: A Structured Efficient Linear Layer
| Marcin MoczulskiMisha DenilJeremy AppleyardNando de Freitas
2015-11-18

Components

COMPONENT TYPE
🤖 No Components Found You can add them if they exist; e.g. Mask R-CNN uses RoIAlign

Categories