1 code implementation • 31 Mar 2023 • Ryuichi Ito, Yuya Sasaki, Chuan Xiao, Makoto Onizuka
In recent years, machine learning-based cardinality estimation methods are replacing traditional methods.
no code implementations • 6 Jul 2022 • Ryuichi Ito, Seng Pei Liew, Tsubasa Takahashi, Yuya Sasaki, Makoto Onizuka
Applying Differentially Private Stochastic Gradient Descent (DPSGD) to training modern, large-scale neural networks such as transformer-based models is a challenging task, as the magnitude of noise added to the gradients at each iteration scales with model dimension, hindering the learning capability significantly.
