Search Results for author: Melih Barsbey

Found 7 papers, 4 papers with code

Implicit Compressibility of Overparametrized Neural Networks Trained with Heavy-Tailed SGD

1 code implementation13 Jun 2023 Yijun Wan, Melih Barsbey, Abdellatif Zaidi, Umut Simsekli

Neural network compression has been an increasingly important subject, not only due to its practical relevance, but also due to its theoretical implications, as there is an explicit connection between compressibility and generalization error.

Neural Network Compression

Algorithmic Stability of Heavy-Tailed Stochastic Gradient Descent on Least Squares

no code implementations2 Jun 2022 Anant Raj, Melih Barsbey, Mert Gürbüzbalaban, Lingjiong Zhu, Umut Şimşekli

Recent studies have shown that heavy tails can emerge in stochastic optimization and that the heaviness of the tails have links to the generalization error.

Stochastic Optimization

DebiasedDTA: A Framework for Improving the Generalizability of Drug-Target Affinity Prediction Models

3 code implementations4 Jul 2021 Rıza Özçelik, Alperen Bağ, Berk Atıl, Melih Barsbey, Arzucan Özgür, Elif Özkırımlı

Here, we present DebiasedDTA, a novel drug-target affinity (DTA) prediction model training framework that addresses dataset biases to improve the generalizability of affinity prediction models.

Drug Discovery Ensemble Learning

Heavy Tails in SGD and Compressibility of Overparametrized Neural Networks

1 code implementation NeurIPS 2021 Melih Barsbey, Milad Sefidgaran, Murat A. Erdogdu, Gaël Richard, Umut Şimşekli

Neural network compression techniques have become increasingly popular as they can drastically reduce the storage and computation requirements for very large networks.

Generalization Bounds Neural Network Compression

Bayesian Model Selection for Identifying Markov Equivalent Causal Graphs

no code implementations pproximateinference AABI Symposium 2019 Mehmet Burak Kurutmaz, Melih Barsbey, Ali Taylan Cemgil, Sinan Yildirim, Umut Şimşekli

We believe that the Bayesian approach to causal discovery both allows the rich methodology of Bayesian inference to be used in various difficult aspects of this problem and provides a unifying framework to causal discovery research.

Bayesian Inference Causal Discovery +1

Bayesian Allocation Model: Inference by Sequential Monte Carlo for Nonnegative Tensor Factorizations and Topic Models using Polya Urns

1 code implementation11 Mar 2019 Ali Taylan Cemgil, Mehmet Burak Kurutmaz, Sinan Yildirim, Melih Barsbey, Umut Simsekli

We introduce a dynamic generative model, Bayesian allocation model (BAM), which establishes explicit connections between nonnegative tensor factorization (NTF), graphical models of discrete probability distributions and their Bayesian extensions, and the topic models such as the latent Dirichlet allocation.

Model Selection Topic Models

Cannot find the paper you are looking for? You can Submit a new open access paper.