no code implementations • 20 Sep 2023 • Youssef Abdelkareem, Shady Shehata, Fakhri Karray
Generalizable human view synthesis methods combine the pre-fitted 3D human meshes with image features to reach generalization, yet they are mainly designed to operate on single-human scenes.
1 code implementation • 7 Jun 2023 • Massa Baali, Ibrahim Almakky, Shady Shehata, Fakhri Karray
We perform further validation on real English dysarthric speech showing a WER improvement of 124% compared to the baseline trained only on healthy English LJSpeech dataset.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+1
no code implementations • 30 May 2023 • Sarit Khirirat, Eduard Gorbunov, Samuel Horváth, Rustem Islamov, Fakhri Karray, Peter Richtárik
Motivated by the increasing popularity and importance of large-scale training under differential privacy (DP) constraints, we study distributed gradient methods with gradient clipping, i. e., clipping applied to the gradients computed from local information at the nodes.
no code implementations • 3 Mar 2023 • Youssef Abdelkareem, Shady Shehata, Fakhri Karray
Multi-plane Neural Radiance Fields (MINE) open the door for combining implicit and explicit scene representations.
no code implementations • 20 Feb 2023 • Neveen Hijazi, Moayad Aloqaily, Bassem Ouni, Fakhri Karray, Merouane Debbah
Although IoT applications are helpful in smart building applications, they present a real risk as the large number of interconnected devices in those buildings, using heterogeneous networks, increases the number of potential IoT attacks.
no code implementations • 3 Oct 2022 • Moayad Aloqaily, Ouns Bouachir, Fakhri Karray, Ismaeel Al Ridhawi, Abdulmotaleb El Saddik
In this article, we discuss some of the key issues required in order to attain realization of metaverse services.
no code implementations • 12 Apr 2022 • Md. Milon Islam, Sheikh Nooruddin, Fakhri Karray, Ghulam Muhammad
In this paper, the most common and popular IoT device capabilities, architectures, and protocols are demonstrated in brief to provide a clear overview of the IoT technology to the researchers in this area.
no code implementations • 25 Mar 2022 • Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley
Locally Linear Embedding (LLE) is a nonlinear spectral dimensionality reduction and manifold learning method.
no code implementations • 3 Feb 2022 • Benyamin Ghojogh, Fakhri Karray, Mark Crowley
Using an induction in a pyramid structure, we also extend the embedding dimensionality to lower embedding dimensionalities to show the validity of manifold hypothesis for embedding dimensionalities $\{1, 2, \dots, d-1\}$.
no code implementations • 2 Feb 2022 • Md. Milon Islam, Sheikh Nooruddin, Fakhri Karray, Ghulam Muhammad
Human Activity Recognition (HAR) plays a significant role in the everyday life of people because of its ability to learn extensive high-level information about human activity from wearable or stationary devices.
no code implementations • 23 Jan 2022 • Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley
In deep learning methods, we first introduce reconstruction autoencoders and supervised loss functions for metric learning.
no code implementations • 26 Nov 2021 • Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley
Finally, we explain the autoencoders based on adversarial learning including adversarial autoencoder, PixelGAN, and implicit autoencoder.
no code implementations • 18 Oct 2021 • Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley
Finally, we explain Kernel Dimension Reduction (KDR) both for supervised and unsupervised learning.
no code implementations • 5 Oct 2021 • Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley
Then, we explain second-order methods including Newton's method for unconstrained, equality constrained, and inequality constrained problems....
no code implementations • 15 Sep 2021 • Haya Elayan, Moayad Aloqaily, Fakhri Karray, Mohsen Guizani
The scenario results showed a decrease of 522. 2 kW of active power when compared to original consumption over a 200-hours period.
no code implementations • 25 Aug 2021 • Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley
We start with UMAP algorithm where we explain probabilities of neighborhood in the input and embedding spaces, optimization of cost function, training algorithm, derivation of gradients, and supervised and semi-supervised embedding by UMAP.
1 code implementation • 25 Aug 2021 • Reza Godaz, Benyamin Ghojogh, Reshad Hosseini, Reza Monsefi, Fakhri Karray, Mark Crowley
Riemannian LBFGS (RLBFGS) is an extension of this method to Riemannian manifolds.
no code implementations • 9 Aug 2021 • Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley
This is a tutorial and survey paper on the Johnson-Lindenstrauss (JL) lemma and linear and nonlinear random projections.
no code implementations • 26 Jul 2021 • Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley
Then, we introduce the structures of BM and RBM.
1 code implementation • Software Impacts 2021 • Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley
One can unfold the nonlinear manifold of a dataset for low-dimensional visualization and feature extraction.
no code implementations • 29 Jun 2021 • Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley
This is a tutorial and survey paper on unification of spectral dimensionality reduction methods, kernel learning by Semidefinite Programming (SDP), Maximum Variance Unfolding (MVU) or Semidefinite Embedding (SDE), and its variants.
no code implementations • 24 Jun 2021 • Mahmoud Nasr, Md. Milon Islam, Shady Shehata, Fakhri Karray, Yuri Quintana
The significant increase in the number of individuals with chronic ailments (including the elderly and disabled) has dictated an urgent need for an innovative model for healthcare systems.
no code implementations • 15 Jun 2021 • Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley
We start with reviewing the history of kernels in functional analysis and machine learning.
no code implementations • 3 Jun 2021 • Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley
Versions of graph embedding are then explained which are generalized versions of Laplacian eigenmap and locality preserving projection.
1 code implementation • 18 May 2021 • Moloud Abdar, Soorena Salari, Sina Qahremani, Hak-Keung Lam, Fakhri Karray, Sadiq Hussain, Abbas Khosravi, U. Rajendra Acharya, Vladimir Makarenkov, Saeid Nahavandi
Differently from most of existing studies, which used either CT scan or X-ray images in COVID-19-case classification, we present a simple but efficient deep learning feature fusion model, called UncertaintyFuseNet, which is able to classify accurately large datasets of both of these types of images.
1 code implementation • 4 Apr 2021 • Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley
In this work, we propose two novel generative versions of LLE, named Generative LLE (GLLE), whose linear reconstruction steps are stochastic rather than deterministic.
no code implementations • 17 Feb 2021 • Mohita Chaudhary, Mohamed Sadok Gastli, Lobna Nassar, Fakhri Karray
Computational tools for forecasting yields and prices for fresh produce have been based on traditional machine learning approaches or time series modelling.
no code implementations • 11 Feb 2021 • Yingxu Wang, Fakhri Karray, Sam Kwong, Konstantinos N. Plataniotis, Henry Leung, Ming Hou, Edward Tunstel, Imre J. Rudas, Ljiljana Trajkovic, Okyay Kaynak, Janusz Kacprzyk, Mengchu Zhou, Michael H. Smith, Philip Chen, Shushma Patel
Symbiotic Autonomous Systems (SAS) are advanced intelligent and cognitive systems exhibiting autonomous collective intelligence enabled by coherent symbiosis of human-machine interactions in hybrid societies.
1 code implementation • 18 Jan 2021 • Milad Sikaroudi, Benyamin Ghojogh, Fakhri Karray, Mark Crowley, H. R. Tizhoosh
However, a useful task in histopathology embedding is to train an embedding space regardless of the magnification level.
Breast Cancer Histology Image Classification
Classification Of Breast Cancer Histology Images
+3
no code implementations • 4 Jan 2021 • Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley
Finally, VAE is explained where the encoder, decoder and sampling from the latent space are introduced.
1 code implementation • 22 Nov 2020 • Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley
In this paper, we first cover LLE, kernel LLE, inverse LLE, and feature fusion with LLE.
no code implementations • 2 Nov 2020 • Benyamin Ghojogh, Hadi Nekoei, Aydin Ghojogh, Fakhri Karray, Mark Crowley
This paper is a tutorial and literature review on sampling algorithms.
1 code implementation • 29 Sep 2020 • Parisa Abdolrahim Poorheravi, Benyamin Ghojogh, Vincent Gaudet, Fakhri Karray, Mark Crowley
Many triplet mining methods have been developed for Siamese networks; however, these techniques have not been applied on the triplets of large margin metric learning for nearest neighbor classification.
1 code implementation • 22 Sep 2020 • Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley
Stochastic Neighbor Embedding (SNE) is a manifold learning and dimensionality reduction method with a probabilistic approach.
1 code implementation • 17 Sep 2020 • Benyamin Ghojogh, Ali Ghodsi, Fakhri Karray, Mark Crowley
Then, Sammon mapping, Isomap, and kernel Isomap are explained.
no code implementations • 9 Aug 2020 • Md. Milon Islam, Fakhri Karray, Reda Alhajj, Jia Zeng
Novel coronavirus (COVID-19) outbreak, has raised a calamitous situation all over the world and has become one of the most acute and severe ailments in the past hundred years.
1 code implementation • 10 Jul 2020 • Milad Sikaroudi, Benyamin Ghojogh, Fakhri Karray, Mark Crowley, H. R. Tizhoosh
However, sampling from stochastic distributions of data rather than sampling merely from the existing embedding instances can provide more discriminative information.
Dimensionality Reduction
Histopathological Image Classification
+1
1 code implementation • 4 Jul 2020 • Milad Sikaroudi, Benyamin Ghojogh, Amir Safarpoor, Fakhri Karray, Mark Crowley, H. R. Tizhoosh
We analyze the effect of offline and online triplet mining for colorectal cancer (CRC) histopathology dataset containing 100, 000 patches.
Dimensionality Reduction
Histopathological Image Classification
+1
1 code implementation • 28 Jun 2020 • Benyamin Ghojogh, Fakhri Karray, Mark Crowley
Although various methods have been proposed for 3D action recognition, some of which are basic and some use deep learning, the need of basic methods based on generalized eigenvalue problem is sensed for action recognition.
1 code implementation • 19 Jun 2020 • Benyamin Ghojogh, Fakhri Karray, Mark Crowley
We propose a new embedding method, named Quantile-Quantile Embedding (QQE), for distribution transformation and manifold embedding with the ability to choose the embedding distribution.
1 code implementation • 5 Apr 2020 • Benyamin Ghojogh, Fakhri Karray, Mark Crowley
We propose a novel approach to anomaly detection called Curvature Anomaly Detection (CAD) and Kernel CAD based on the idea of polyhedron curvature.
1 code implementation • 5 Apr 2020 • Benyamin Ghojogh, Milad Sikaroudi, Sobhan Shafiei, H. R. Tizhoosh, Fakhri Karray, Mark Crowley
The FDT and FDC loss functions are designed based on the statistical formulation of the Fisher Discriminant Analysis (FDA), which is a linear subspace learning method.
Classification Of Breast Cancer Histology Images
Dimensionality Reduction
+3
1 code implementation • 5 Apr 2020 • Benyamin Ghojogh, Fakhri Karray, Mark Crowley
After the tremendous development of neural networks trained by backpropagation, it is a good time to develop other algorithms for training neural networks to gain more insights into networks.
no code implementations • 4 Apr 2020 • Benyamin Ghojogh, Fakhri Karray, Mark Crowley
Generative models and inferential autoencoders mostly make use of $\ell_2$ norm in their optimization objectives.
1 code implementation • 4 Apr 2020 • Benyamin Ghojogh, Milad Sikaroudi, H. R. Tizhoosh, Fakhri Karray, Mark Crowley
We also propose a weighted FDA in the feature space to establish a weighted kernel FDA for both existing and newly proposed weights.
no code implementations • engrXiv 2019 • Benyamin Ghojogh, Fakhri Karray, Mark Crowley
Then, we explain how to train HMM using EM and the Baum-Welch algorithm.
1 code implementation • 11 Oct 2019 • Benyamin Ghojogh, Fakhri Karray, Mark Crowley
We also propose kernel RDA, generalizing kernel PCA, kernel SPCA, and kernel FDA, using both dual RDA and representation theory.
1 code implementation • 6 Sep 2019 • Benyamin Ghojogh, Ali Saheb Pasand, Fakhri Karray, Mark Crowley
This paper proposes a new subspace learning method, named Quantized Fisher Discriminant Analysis (QFDA), which makes use of both machine learning and information theory.
1 code implementation • 25 Aug 2019 • Benyamin Ghojogh, Fakhri Karray, Mark Crowley
We propose a new manifold learning method, Locally Linear Image Structural Embedding (LLISE), and kernel LLISE for learning this manifold.
1 code implementation • 25 Aug 2019 • Benyamin Ghojogh, Fakhri Karray, Mark Crowley
Despite the advances of deep learning in specific tasks using images, the principled assessment of image fidelity and similarity is still a critical ability to develop.
2 code implementations • 22 Jun 2019 • Benyamin Ghojogh, Fakhri Karray, Mark Crowley
This is a detailed tutorial paper which explains the Fisher discriminant Analysis (FDA) and kernel FDA.
2 code implementations • 7 May 2019 • Benyamin Ghojogh, Maria N. Samad, Sayema Asif Mashhadi, Tania Kapoor, Wahab Ali, Fakhri Karray, Mark Crowley
Pattern analysis often requires a pre-processing stage for extracting or selecting features in order to help the classification, prediction, or clustering stage discriminate or represent the data in a better way.
1 code implementation • 25 Mar 2019 • Benyamin Ghojogh, Fakhri Karray, Mark Crowley
This paper is a tutorial for eigenvalue and generalized eigenvalue problems.
BIG-bench Machine Learning
Matrix Factorization / Decomposition
1 code implementation • 3 Mar 2019 • Benyamin Ghojogh, Mark Crowley, Fakhri Karray
Two main methods for exploring patterns in data are data visualization and machine learning.
Data Visualization
Applications
1 code implementation • 20 Jan 2019 • Benyamin Ghojogh, Aydin Ghojogh, Mark Crowley, Fakhri Karray
In explaining the main algorithm, first, fitting a mixture of two distributions is detailed and examples of fitting two Gaussians and Poissons, respectively for continuous and discrete cases, are introduced.
no code implementations • 4 Mar 2018 • Arief Koesdwiady, Fakhri Karray
This paper presents a practical approach for detecting non-stationarity in time series prediction.
no code implementations • 4 Mar 2018 • Arief Koesdwiady, Fakhri Karray
Multi-step traffic flow prediction extends this set-up to the case where predicting multiple time-steps into the future based on some finite history is of interest.
no code implementations • 25 Apr 2016 • Mehrdad J. Gangeh, Safaa M. A. Bedawi, Ali Ghodsi, Fakhri Karray
The proposed method benefits from the supervisory information by learning the dictionary in a space where the dependency between the data and class labels is maximized.
no code implementations • 1 Feb 2015 • Céline Craye, Fakhri Karray
Based on active sensor Kinect and computer vision tools, we have built an efficient module for detecting driver distraction and recognizing the type of distraction.
no code implementations • 11 Nov 2013 • Ahmed Elgohary, Ahmed K. Farahat, Mohamed S. Kamel, Fakhri Karray
Exploiting the proposed parallelization strategy, we present two scalable MapReduce algorithms for kernel $k$-means.