no code implementations • 14 Feb 2024 • Ali Saheb Pasand, Reza Moravej, Mahdi Biparva, Raika Karimi, Ali Ghodsi
Our experiments demonstrate that the cost associated with the loss computation can be reduced via node or dimension sampling without lowering the downstream performance.
no code implementations • 14 Feb 2024 • Ali Saheb Pasand, Reza Moravej, Mahdi Biparva, Ali Ghodsi
A common phenomena confining the representation quality in Self-Supervised Learning (SSL) is dimensional collapse (also known as rank degeneration), where the learned representations are mapped to a low dimensional subspace of the representation space.
no code implementations • COLING 2022 • Mehdi Rezagholizadeh, Aref Jafari, Puneeth Salad, Pranav Sharma, Ali Saheb Pasand, Ali Ghodsi
A case in point is that the best performing checkpoint of the teacher might not necessarily be the best teacher for training the student in KD.
1 code implementation • 6 Sep 2019 • Benyamin Ghojogh, Ali Saheb Pasand, Fakhri Karray, Mark Crowley
This paper proposes a new subspace learning method, named Quantized Fisher Discriminant Analysis (QFDA), which makes use of both machine learning and information theory.
2 code implementations • Proceedings of the AAAI Conference on Artificial Intelligence 2019 • Hadi NekoeiQachkanloo, Benyamin Ghojogh, Ali Saheb Pasand, Mark Crowley
This paper proposes a novel trading system which plays the role of an artificial counselor for stock investment.
Portfolio Optimization Stock Prediction +1 General Finance Computational Engineering, Finance, and Science General Economics Economics