Search Results for author: Shaeke Salman

Found 6 papers, 0 papers with code

Intriguing Differences Between Zero-Shot and Systematic Evaluations of Vision-Language Transformer Models

no code implementations13 Feb 2024 Shaeke Salman, Md Montasir Bin Shams, Xiuwen Liu, Lingjiong Zhu

Transformer-based models have dominated natural language processing and other areas in the last few years due to their superior (zero-shot) performance on benchmark datasets.

Language Modelling Zero-Shot Learning

Intriguing Equivalence Structures of the Embedding Space of Vision Transformers

no code implementations28 Jan 2024 Shaeke Salman, Md Montasir Bin Shams, Xiuwen Liu

Pre-trained large foundation models play a central role in the recent surge of artificial intelligence, resulting in fine-tuned models with remarkable abilities when measured on benchmark datasets, standard exams, and applications.

Improved Stock Price Movement Classification Using News Articles Based on Embeddings and Label Smoothing

no code implementations25 Jan 2023 Luis Villamil, Ryan Bausback, Shaeke Salman, Ting L. Liu, Conrad Horn, Xiuwen Liu

We further incorporate weight decay, batch normalization, dropout, and label smoothing to improve the generalization of the trained models.

Towards Quantifying Intrinsic Generalization of Deep ReLU Networks

no code implementations18 Oct 2019 Shaeke Salman, Canlin Zhang, Xiuwen Liu, Washington Mio

We show that the generalization intervals of a ReLU network behave similarly along pairwise directions between samples of the same label in both real and random cases on the MNIST and CIFAR-10 datasets.

Consensus-based Interpretable Deep Neural Networks with Application to Mortality Prediction

no code implementations14 May 2019 Shaeke Salman, Seyedeh Neelufar Payrovnaziri, Xiuwen Liu, Pablo Rengifo-Moreno, Zhe He

In particular, while the proposed method maintains similar interpretability as conventional shallow models such as logistic regression, it improves the prediction accuracy significantly.

Feature Importance Mortality Prediction

Overfitting Mechanism and Avoidance in Deep Neural Networks

no code implementations19 Jan 2019 Shaeke Salman, Xiuwen Liu

Assisted by the availability of data and high performance computing, deep learning techniques have achieved breakthroughs and surpassed human performance empirically in difficult tasks, including object recognition, speech recognition, and natural language processing.

General Classification Object Recognition +2

Cannot find the paper you are looking for? You can Submit a new open access paper.