no code implementations • 28 Feb 2024 • Hafiz Tiomoko Ali, Umberto Michieli, Ji Joong Moon, Daehyun Kim, Mete Ozay
Inspired by NC properties, we explore in this paper the transferability of DNN models trained with their last layer weight fixed according to ETF.
2 code implementations • ICLR 2022 • Hafiz Tiomoko Ali, Zhenyu Liao, Romain Couillet
As a result, for any kernel matrix ${\bf K}$ of the form above, we propose a novel random features technique, called Ternary Random Feature (TRF), that (i) asymptotically yields the same limiting kernel as the original ${\bf K}$ in a spectral sense and (ii) can be computed and stored much more efficiently, by wisely tuning (in a data-dependent manner) the function $\sigma$ and the random vector ${\bf w}$, both taking values in $\{-1, 0, 1\}$.
no code implementations • ICLR 2021 • Malik Tiomoko, Hafiz Tiomoko Ali, Romain Couillet
This article provides theoretical insights into the inner workings of multi-task and transfer learning methods, by studying the tractable least-square support vector machine multi-task learning (LS-SVM MTL) method, in the limit of large ($p$) and numerous ($n$) data.
no code implementations • 16 Jun 2018 • Hafiz Tiomoko Ali, Sijia Liu, Yasin Yilmaz, Romain Couillet, Indika Rajapakse, Alfred Hero
We propose a method for simultaneously detecting shared and unshared communities in heterogeneous multilayer weighted and undirected networks.
no code implementations • 10 Feb 2018 • Emanuele Sansone, Hafiz Tiomoko Ali, Sun Jiacheng
Learning the true density in high-dimensional feature spaces is a well-known problem in machine learning.
no code implementations • 3 Nov 2016 • Hafiz Tiomoko Ali, Romain Couillet
The analysis of this equivalent spiked random matrix allows us to improve spectral methods for community detection and assess their performances in the regime under study.
no code implementations • 25 Mar 2016 • Romain Couillet, Gilles Wainrib, Harry Sevi, Hafiz Tiomoko Ali
In this article, a study of the mean-square error (MSE) performance of linear echo-state neural networks is performed, both for training and testing tasks.