Search Results for author: Muhammad Shafique

Found 105 papers, 24 papers with code

SNN4Agents: A Framework for Developing Energy-Efficient Embodied Spiking Neural Networks for Autonomous Agents

no code implementations14 Apr 2024 Rachmad Vidya Wicaksana Putra, Alberto Marchisio, Muhammad Shafique

The experimental results show that our proposed framework can maintain high accuracy (i. e., 84. 12% accuracy) with 68. 75% memory saving, 3. 58x speed-up, and 4. 03x energy efficiency improvement as compared to the state-of-the-art work for NCARS dataset, thereby enabling energy-efficient embodied SNN deployments for autonomous agents.

Quantization

Embodied Neuromorphic Artificial Intelligence for Robotics: Perspectives, Challenges, and Research Development Stack

no code implementations4 Apr 2024 Rachmad Vidya Wicaksana Putra, Alberto Marchisio, Fakhreddine Zayer, Jorge Dias, Muhammad Shafique

Toward this, recent advances in neuromorphic computing with Spiking Neural Networks (SNN) have demonstrated the potential to enable the embodied intelligence for robotics through bio-plausible computing paradigm that mimics how the biological brain works, known as "neuromorphic artificial intelligence (AI)".

A Methodology to Study the Impact of Spiking Neural Network Parameters considering Event-Based Automotive Data

no code implementations4 Apr 2024 Iqra Bano, Rachmad Vidya Wicaksana Putra, Alberto Marchisio, Muhammad Shafique

Toward this, we propose a novel methodology to systematically study and analyze the impact of SNN parameters considering event-based automotive data, then leverage this analysis for enhancing SNN developments.

Autonomous Driving Image Classification +2

QFNN-FFD: Quantum Federated Neural Network for Financial Fraud Detection

no code implementations3 Apr 2024 Nouhaila Innan, Alberto Marchisio, Muhammad Shafique, Mohamed Bennai

This study introduces the Quantum Federated Neural Network for Financial Fraud Detection (QFNN-FFD), a cutting-edge framework merging Quantum Machine Learning (QML) and quantum computing with Federated Learning (FL) to innovate financial fraud detection.

Federated Learning Fraud Detection +1

A Methodology for Improving Accuracy of Embedded Spiking Neural Networks through Kernel Size Scaling

no code implementations2 Apr 2024 Rachmad Vidya Wicaksana Putra, Muhammad Shafique

Spiking Neural Networks (SNNs) can offer ultra low power/ energy consumption for machine learning-based applications due to their sparse spike-based operations.

Model Selection

MindArm: Mechanized Intelligent Non-Invasive Neuro-Driven Prosthetic Arm System

no code implementations29 Mar 2024 Maha Nawaz, Abdul Basit, Muhammad Shafique

This demonstrates that our MindArm provides a novel approach for an alternate low-cost mind-controlled prosthetic devices for all patients.

Brain Computer Interface EEG

SSAP: A Shape-Sensitive Adversarial Patch for Comprehensive Disruption of Monocular Depth Estimation in Autonomous Navigation Applications

no code implementations18 Mar 2024 Amira Guesmi, Muhammad Abdullah Hanif, Ihsen Alouani, Bassem Ouni, Muhammad Shafique

In this paper, we introduce SSAP (Shape-Sensitive Adversarial Patch), a novel approach designed to comprehensively disrupt monocular depth estimation (MDE) in autonomous navigation applications.

Autonomous Driving Autonomous Navigation +2

FedQNN: Federated Learning using Quantum Neural Networks

no code implementations16 Mar 2024 Nouhaila Innan, Muhammad Al-Zafar Khan, Alberto Marchisio, Muhammad Shafique, Mohamed Bennai

In this study, we explore the innovative domain of Quantum Federated Learning (QFL) as a framework for training Quantum Machine Learning (QML) models via distributed networks.

Federated Learning Quantum Machine Learning

Embedded Deployment of Semantic Segmentation in Medicine through Low-Resolution Inputs

no code implementations8 Mar 2024 Erik Ostrowski, Muhammad Shafique

In this paper, we propose our architecture that takes advantage of the fact that in hardware-limited environments, we often refrain from using the highest available input resolutions to guarantee a higher throughput.

Semantic Segmentation

MedAide: Leveraging Large Language Models for On-Premise Medical Assistance on Edge Devices

no code implementations28 Feb 2024 Abdul Basit, Khizar Hussain, Muhammad Abdullah Hanif, Muhammad Shafique

MedAide achieves 77\% accuracy in medical consultations and scores 56 in USMLE benchmark, enabling an energy-efficient healthcare assistance platform that alleviates privacy concerns due to edge-based deployment, thereby empowering the community.

Chatbot Edge-computing

A Comprehensive Survey of Convolutions in Deep Learning: Applications, Challenges, and Future Trends

no code implementations23 Feb 2024 Abolfazl Younesi, Mohsen Ansari, Mohammadamin Fazli, Alireza Ejlali, Muhammad Shafique, Jörg Henkel

In today's digital age, Convolutional Neural Networks (CNNs), a subset of Deep Learning (DL), are widely used for various computer vision tasks such as image classification, object detection, and image segmentation.

6D Vision Image Classification +7

SpikeNAS: A Fast Memory-Aware Neural Architecture Search Framework for Spiking Neural Network-based Autonomous Agents

no code implementations17 Feb 2024 Rachmad Vidya Wicaksana Putra, Muhammad Shafique

Autonomous mobile agents (e. g., UAVs and UGVs) are typically expected to incur low power/energy consumption for solving machine learning tasks (such as object recognition), as these mobile agents are usually powered by portable batteries.

Neural Architecture Search Object Recognition

ResQuNNs:Towards Enabling Deep Learning in Quantum Convolution Neural Networks

no code implementations14 Feb 2024 Muhammad Kashif, Muhammad Shafique

To resolve this, we propose a novel architecture, Residual Quanvolutional Neural Networks (ResQuNNs), leveraging the concept of residual learning, which facilitates the flow of gradients by adding skip connections between layers.

ODDR: Outlier Detection & Dimension Reduction Based Defense Against Adversarial Patches

no code implementations20 Nov 2023 Nandish Chattopadhyay, Amira Guesmi, Muhammad Abdullah Hanif, Bassem Ouni, Muhammad Shafique

ODDR employs a three-stage pipeline: Fragmentation, Segregation, and Neutralization, providing a model-agnostic solution applicable to both image classification and object detection tasks.

Dimensionality Reduction Image Classification +3

Tiny-VBF: Resource-Efficient Vision Transformer based Lightweight Beamformer for Ultrasound Single-Angle Plane Wave Imaging

no code implementations20 Nov 2023 Abdul Rahoof, Vivek Chaturvedi, Mahesh Raveendranatha Panicker, Muhammad Shafique

Accelerating compute intensive non-real-time beam-forming algorithms in ultrasound imaging using deep learning architectures has been gaining momentum in the recent past.

Quantization

A Homomorphic Encryption Framework for Privacy-Preserving Spiking Neural Networks

no code implementations10 Aug 2023 Farzad Nikfam, Raffaele Casaburi, Alberto Marchisio, Maurizio Martina, Muhammad Shafique

Machine learning (ML) is widely used today, especially through deep neural networks (DNNs), however, increasing computational load and resource requirements have led to cloud-based solutions.

Privacy Preserving

Approximate Computing Survey, Part II: Application-Specific & Architectural Approximation Techniques and Applications

no code implementations20 Jul 2023 Vasileios Leon, Muhammad Abdullah Hanif, Giorgos Armeniakos, Xun Jiao, Muhammad Shafique, Kiamal Pekmestzi, Dimitrios Soudris

The challenging deployment of compute-intensive applications from domains such Artificial Intelligence (AI) and Digital Signal Processing (DSP), forces the community of computing systems to explore new design approaches.

Scaling Model Checking for DNN Analysis via State-Space Reduction and Input Segmentation (Extended Version)

1 code implementation29 Jun 2023 Mahum Naseer, Osman Hasan, Muhammad Shafique

This in turn allows the analysis of NN safety properties using the new framework, in addition to all the NN properties already included with FANNet.

FAQ: Mitigating the Impact of Faults in the Weight Memory of DNN Accelerators through Fault-Aware Quantization

no code implementations21 May 2023 Muhammad Abdullah Hanif, Muhammad Shafique

To address this issue, we propose a novel Fault-Aware Quantization (FAQ) technique for mitigating the effects of stuck-at permanent faults in the on-chip weight memory of DNN accelerators at a negligible overhead cost compared to fault-aware retraining while offering comparable accuracy results.

Quantization

DAP: A Dynamic Adversarial Patch for Evading Person Detectors

no code implementations19 May 2023 Amira Guesmi, Ruitian Ding, Muhammad Abdullah Hanif, Ihsen Alouani, Muhammad Shafique

Patch-based adversarial attacks were proven to compromise the robustness and reliability of computer vision systems.

MRI Recovery with Self-Calibrated Denoisers without Fully-Sampled Data

2 code implementations25 Apr 2023 Sizhuo Liu, Muhammad Shafique, Philip Schniter, Rizwan Ahmad

However, unlike traditional PnP approaches that utilize generic denoisers or train application-specific denoisers using high-quality images or image patches, ReSiDe directly trains the denoiser on the image or images that are being reconstructed from the undersampled data.

Denoising MRI Reconstruction

eFAT: Improving the Effectiveness of Fault-Aware Training for Mitigating Permanent Faults in DNN Hardware Accelerators

no code implementations20 Apr 2023 Muhammad Abdullah Hanif, Muhammad Shafique

To realize these concepts, in this work, we present a novel framework, eFAT, that computes the resilience of a given DNN to faults at different fault rates and with different levels of retraining, and it uses that knowledge to build a resilience map given a user-defined accuracy constraint.

RobCaps: Evaluating the Robustness of Capsule Networks against Affine Transformations and Adversarial Attacks

no code implementations8 Apr 2023 Alberto Marchisio, Antonio De Marco, Alessio Colucci, Maurizio Martina, Muhammad Shafique

Overall, CapsNets achieve better robustness against adversarial examples and affine transformations, compared to a traditional CNN with a similar number of parameters.

Image Classification

SwiftTron: An Efficient Hardware Accelerator for Quantized Transformers

1 code implementation8 Apr 2023 Alberto Marchisio, Davide Dura, Maurizio Capra, Maurizio Martina, Guido Masera, Muhammad Shafique

In particular, fixed-point quantization is desirable to ease the computations using lightweight blocks, like adders and multipliers, of the underlying hardware.

Neural Network Compression Quantization

EnforceSNN: Enabling Resilient and Energy-Efficient Spiking Neural Network Inference considering Approximate DRAMs for Embedded Systems

no code implementations8 Apr 2023 Rachmad Vidya Wicaksana Putra, Muhammad Abdullah Hanif, Muhammad Shafique

The key mechanisms of our EnforceSNN are: (1) employing quantized weights to reduce the DRAM access energy; (2) devising an efficient DRAM mapping policy to minimize the DRAM energy-per-access; (3) analyzing the SNN error tolerance to understand its accuracy profile considering different bit error rate (BER) values; (4) leveraging the information for developing an efficient fault-aware training (FAT) that considers different BER values and bit error locations in DRAM to improve the SNN error tolerance; and (5) developing an algorithm to select the SNN model that offers good trade-offs among accuracy, memory, and energy consumption.

RescueSNN: Enabling Reliable Executions on Spiking Neural Network Accelerators under Permanent Faults

no code implementations8 Apr 2023 Rachmad Vidya Wicaksana Putra, Muhammad Abdullah Hanif, Muhammad Shafique

Our FAM technique leverages the fault map of SNN compute engine for (i) minimizing weight corruption when mapping weight bits on the faulty memory cells, and (ii) selectively employing faulty neurons that do not cause significant accuracy degradation to maintain accuracy and throughput, while considering the SNN operations and processing dataflow.

Poster: Link between Bias, Node Sensitivity and Long-Tail Distribution in trained DNNs

no code implementations29 Mar 2023 Mahum Naseer, Muhammad Shafique

Owing to their remarkable learning (and relearning) capabilities, deep neural networks (DNNs) find use in numerous real-world applications.

Physical Backdoor Trigger Activation of Autonomous Vehicle using Reachability Analysis

no code implementations24 Mar 2023 Wenqing Li, Yue Wang, Muhammad Shafique, Saif Eddin Jabari

Recent studies reveal that Autonomous Vehicles (AVs) can be manipulated by hidden backdoors, causing them to perform harmful actions when activated by physical triggers.

Autonomous Vehicles

ISLE: A Framework for Image Level Semantic Segmentation Ensemble

1 code implementation14 Mar 2023 Erik Ostrowski, Muhammad Shafique

One key bottleneck of employing state-of-the-art semantic segmentation networks in the real world is the availability of training labels.

Segmentation Semantic Segmentation

FPUS23: An Ultrasound Fetus Phantom Dataset with Deep Neural Network Evaluations for Fetus Orientations, Fetal Planes, and Anatomical Features

1 code implementation14 Mar 2023 Bharath Srinivas Prabakaran, Paul Hamelmann, Erik Ostrowski, Muhammad Shafique

Ultrasound imaging is one of the most prominent technologies to evaluate the growth, progression, and overall health of a fetus during its gestation.

ReFit: A Framework for Refinement of Weakly Supervised Semantic Segmentation using Object Border Fitting for Medical Images

2 code implementations14 Mar 2023 Bharath Srinivas Prabakaran, Erik Ostrowski, Muhammad Shafique

Weakly Supervised Semantic Segmentation (WSSS) relying only on image-level supervision is a promising approach to deal with the need for Segmentation networks, especially for generating a large number of pixel-wise masks in a given dataset.

Object Segmentation +3

SILOP: An Automated Framework for Semantic Segmentation Using Image Labels Based on Object Perimeters

2 code implementations14 Mar 2023 Erik Ostrowski, Bharath Srinivas Prabakaran, Muhammad Shafique

Our new PerimeterFit module will be applied to pre-refine the CAM predictions before using the pixel-similarity-based network.

Edge Detection Object +2

Exploring Weakly Supervised Semantic Segmentation Ensembles for Medical Imaging Systems

1 code implementation14 Mar 2023 Erik Ostrowski, Bharath Srinivas Prabakaran, Muhammad Shafique

Reliable classification and detection of certain medical conditions, in images, with state-of-the-art semantic segmentation networks, require vast amounts of pixel-wise annotation.

Segmentation Weakly supervised Semantic Segmentation +1

ISimDL: Importance Sampling-Driven Acceleration of Fault Injection Simulations for Evaluating the Robustness of Deep Learning

no code implementations14 Mar 2023 Alessio Colucci, Andreas Steininger, Muhammad Shafique

Using importance sampling in FAT reduces the overhead required for finding faults that lead to a predetermined drop in accuracy by more than 12x.

Exploring Machine Learning Privacy/Utility trade-off from a hyperparameters Lens

no code implementations3 Mar 2023 Ayoub Arous, Amira Guesmi, Muhammad Abdullah Hanif, Ihsen Alouani, Muhammad Shafique

Towards investigating new ground for better privacy-utility trade-off, this work questions; (i) if models' hyperparameters have any inherent impact on ML models' privacy-preserving properties, and (ii) if models' hyperparameters have any impact on the privacy/utility trade-off of differentially private models.

Privacy Preserving

AdvART: Adversarial Art for Camouflaged Object Detection Attacks

no code implementations3 Mar 2023 Amira Guesmi, Ioan Marius Bilasco, Muhammad Shafique, Ihsen Alouani

Physical adversarial attacks pose a significant practical threat as it deceives deep learning systems operating in the real world by producing prominent and maliciously designed physical perturbations.

Object object-detection +1

TopSpark: A Timestep Optimization Methodology for Energy-Efficient Spiking Neural Networks on Autonomous Mobile Agents

no code implementations3 Mar 2023 Rachmad Vidya Wicaksana Putra, Muhammad Shafique

These requirements can be fulfilled by Spiking Neural Networks (SNNs) as they offer low power/energy processing due to their sparse computations and efficient online learning with bio-inspired learning mechanisms for adapting to different environments.

APARATE: Adaptive Adversarial Patch for CNN-based Monocular Depth Estimation for Autonomous Navigation

no code implementations2 Mar 2023 Amira Guesmi, Muhammad Abdullah Hanif, Ihsen Alouani, Muhammad Shafique

APARATE, results in a mean depth estimation error surpassing $0. 5$, significantly impacting as much as $99\%$ of the targeted region when applied to CNN-based MDE models.

Autonomous Driving Autonomous Navigation +3

AdvRain: Adversarial Raindrops to Attack Camera-based Smart Vision Systems

no code implementations2 Mar 2023 Amira Guesmi, Muhammad Abdullah Hanif, Muhammad Shafique

Unlike mask based fake-weather attacks that require access to the underlying computing hardware or image memory, our attack is based on emulating the effects of a natural weather condition (i. e., Raindrops) that can be printed on a translucent sticker, which is externally placed over the lens of a camera.

Adversarial Attack Autonomous Vehicles

UnbiasedNets: A Dataset Diversification Framework for Robustness Bias Alleviation in Neural Networks

1 code implementation24 Feb 2023 Mahum Naseer, Bharath Srinivas Prabakaran, Osman Hasan, Muhammad Shafique

In contrast, UnbiasedNets provides a notable improvement over existing works, while even reducing the robustness bias significantly in some cases, as observed by comparing the NNs trained on the diversified and original datasets.

Mantis: Enabling Energy-Efficient Autonomous Mobile Agents with Spiking Neural Networks

no code implementations24 Dec 2022 Rachmad Vidya Wicaksana Putra, Muhammad Shafique

Towards this, we propose a Mantis methodology to systematically employ SNNs on autonomous mobile agents to enable energy-efficient processing and adaptive capabilities in dynamic environments.

Model Selection

Building Resilience to Out-of-Distribution Visual Data via Input Optimization and Model Finetuning

no code implementations29 Nov 2022 Christopher J. Holder, Majid Khonji, Jorge Dias, Muhammad Shafique

A major challenge in machine learning is resilience to out-of-distribution data, that is data that exists outside of the distribution of a model's training data.

Autonomous Vehicles Semantic Segmentation

AccelAT: A Framework for Accelerating the Adversarial Training of Deep Neural Networks through Accuracy Gradient

1 code implementation13 Oct 2022 Farzad Nikfam, Alberto Marchisio, Maurizio Martina, Muhammad Shafique

The experiments show comparable results with the related works, and in several experiments, the adversarial training of DNNs using our AccelAT framework is conducted up to 2 times faster than the existing techniques.

Adversarial Attack

LaneSNNs: Spiking Neural Networks for Lane Detection on the Loihi Neuromorphic Processor

no code implementations3 Aug 2022 Alberto Viale, Alberto Marchisio, Maurizio Martina, Guido Masera, Muhammad Shafique

Autonomous Driving (AD) related features represent important elements for the next generation of mobile robots and autonomous vehicles focused on increasingly intelligent, autonomous, and interconnected systems.

Autonomous Driving Lane Detection

CoNLoCNN: Exploiting Correlation and Non-Uniform Quantization for Energy-Efficient Low-precision Deep Convolutional Neural Networks

no code implementations31 Jul 2022 Muhammad Abdullah Hanif, Giuseppe Maria Sarda, Alberto Marchisio, Guido Masera, Maurizio Martina, Muhammad Shafique

The high computational complexity of these networks, which translates to increased energy consumption, is the foremost obstacle towards deploying large DNNs in resource-constrained systems.

Quantization

enpheeph: A Fault Injection Framework for Spiking and Compressed Deep Neural Networks

no code implementations31 Jul 2022 Alessio Colucci, Andreas Steininger, Muhammad Shafique

Towards better reliability analysis for DNNs, we present enpheeph, a Fault Injection Framework for Spiking and Compressed DNNs.

Autonomous Driving Quantization

Enabling Capsule Networks at the Edge through Approximate Softmax and Squash Operations

no code implementations21 Jun 2022 Alberto Marchisio, Beatrice Bussolino, Edoardo Salvati, Maurizio Martina, Guido Masera, Muhammad Shafique

In our experiments, we evaluate tradeoffs between area, power consumption, and critical path delay of the designs implemented with the ASIC design flow, and the accuracy of the quantized CapsNets, compared to the exact functions.

On Efficient Real-Time Semantic Segmentation: A Survey

no code implementations17 Jun 2022 Christopher J. Holder, Muhammad Shafique

Semantic segmentation is the problem of assigning a class label to every pixel in an image, and is an important component of an autonomous vehicle vision stack for facilitating scene understanding and object detection.

object-detection Object Detection +2

tinySNN: Towards Memory- and Energy-Efficient Spiking Neural Networks

no code implementations17 Jun 2022 Rachmad Vidya Wicaksana Putra, Muhammad Shafique

Larger Spiking Neural Network (SNN) models are typically favorable as they can offer higher accuracy.

Quantization

fakeWeather: Adversarial Attacks for Deep Neural Networks Emulating Weather Conditions on the Camera Lens of Autonomous Systems

no code implementations27 May 2022 Alberto Marchisio, Giovanni Caramia, Maurizio Martina, Muhammad Shafique

Recently, Deep Neural Networks (DNNs) have achieved remarkable performances in many applications, while several studies have enhanced their vulnerabilities to malicious attacks.

lpSpikeCon: Enabling Low-Precision Spiking Neural Network Processing for Efficient Unsupervised Continual Learning on Autonomous Agents

no code implementations24 May 2022 Rachmad Vidya Wicaksana Putra, Muhammad Shafique

Our lpSpikeCon methodology employs the following key steps: (1) analyzing the impacts of training the SNN model under unsupervised continual learning settings with reduced weight precision on the inference accuracy; (2) leveraging this study to identify SNN parameters that have a significant impact on the inference accuracy; and (3) developing an algorithm for searching the respective SNN parameter values that improve the quality of unsupervised continual learning.

Continual Learning

PiDAn: A Coherence Optimization Approach for Backdoor Attack Detection and Mitigation in Deep Neural Networks

no code implementations17 Mar 2022 Yue Wang, Wenqing Li, Esha Sarkar, Muhammad Shafique, Michail Maniatakos, Saif Eddin Jabari

Based on our theoretical analysis and experimental results, we demonstrate the effectiveness of PiDAn in defending against backdoor attacks that use different settings of poisoned samples on GTSRB and ILSVRC2012 datasets.

Anomaly Detection Backdoor Attack

SoftSNN: Low-Cost Fault Tolerance for Spiking Neural Network Accelerators under Soft Errors

no code implementations10 Mar 2022 Rachmad Vidya Wicaksana Putra, Muhammad Abdullah Hanif, Muhammad Shafique

These errors can change the weight values and neuron operations in the compute engine of SNN accelerators, thereby leading to incorrect outputs and accuracy degradation.

Towards Energy-Efficient and Secure Edge AI: A Cross-Layer Framework

no code implementations20 Sep 2021 Muhammad Shafique, Alberto Marchisio, Rachmad Vidya Wicaksana Putra, Muhammad Abdullah Hanif

Afterward, we discuss how to further improve the performance (latency) and the energy efficiency of Edge AI systems through HW/SW-level optimizations, such as pruning, quantization, and approximation.

Quantization

BioNetExplorer: Architecture-Space Exploration of Bio-Signal Processing Deep Neural Networks for Wearables

no code implementations7 Sep 2021 Bharath Srinivas Prabakaran, Asima Akhtar, Semeen Rehman, Osman Hasan, Muhammad Shafique

We are successful in identifying Pareto-optimal designs, which can reduce the storage overhead of the DNN by ~30MB for a quality loss of less than 0. 5%.

Model Compression

R-SNN: An Analysis and Design Methodology for Robustifying Spiking Neural Networks against Adversarial Attacks through Noise Filters for Dynamic Vision Sensors

1 code implementation1 Sep 2021 Alberto Marchisio, Giacomo Pira, Maurizio Martina, Guido Masera, Muhammad Shafique

Spiking Neural Networks (SNNs) aim at providing energy-efficient learning capabilities when implemented on neuromorphic chips with event-based Dynamic Vision Sensors (DVS).

ReSpawn: Energy-Efficient Fault-Tolerance for Spiking Neural Networks considering Unreliable Memories

no code implementations23 Aug 2021 Rachmad Vidya Wicaksana Putra, Muhammad Abdullah Hanif, Muhammad Shafique

Since recent works still focus on the fault-modeling and random fault injection in SNNs, the impact of memory faults in SNN hardware architectures on accuracy and the respective fault-mitigation techniques are not thoroughly explored.

Q-SpiNN: A Framework for Quantizing Spiking Neural Networks

no code implementations5 Jul 2021 Rachmad Vidya Wicaksana Putra, Muhammad Shafique

A prominent technique for reducing the memory footprint of Spiking Neural Networks (SNNs) without decreasing the accuracy significantly is quantization.

Quantization

DVS-Attacks: Adversarial Attacks on Dynamic Vision Sensors for Spiking Neural Networks

1 code implementation1 Jul 2021 Alberto Marchisio, Giacomo Pira, Maurizio Martina, Guido Masera, Muhammad Shafique

Spiking Neural Networks (SNNs), despite being energy-efficient when implemented on neuromorphic hardware and coupled with event-based Dynamic Vision Sensors (DVS), are vulnerable to security threats, such as adversarial attacks, i. e., small perturbations added to the input for inducing a misclassification.

Adversarial Attack

Continual Learning for Real-World Autonomous Systems: Algorithms, Challenges and Frameworks

no code implementations26 May 2021 Khadija Shaheen, Muhammad Abdullah Hanif, Osman Hasan, Muhammad Shafique

Continual learning is essential for all real-world applications, as frozen pre-trained models cannot effectively deal with non-stationary data distributions.

Continual Learning

Exploiting Vulnerabilities in Deep Neural Networks: Adversarial and Fault-Injection Attacks

no code implementations5 May 2021 Faiq Khalid, Muhammad Abdullah Hanif, Muhammad Shafique

From tiny pacemaker chips to aircraft collision avoidance systems, the state-of-the-art Cyber-Physical Systems (CPS) have increasingly started to rely on Deep Neural Networks (DNNs).

Collision Avoidance

SpikeDyn: A Framework for Energy-Efficient Spiking Neural Networks with Continual and Unsupervised Learning Capabilities in Dynamic Environments

no code implementations28 Feb 2021 Rachmad Vidya Wicaksana Putra, Muhammad Shafique

Spiking Neural Networks (SNNs) bear the potential of efficient unsupervised and continual learning capabilities because of their biological plausibility, but their complexity still poses a serious research challenge to enable their energy-efficient design for resource-constrained scenarios (like embedded systems, IoT-Edge, etc.).

Avg Continual Learning

SparkXD: A Framework for Resilient and Energy-Efficient Spiking Neural Network Inference using Approximate DRAM

no code implementations28 Feb 2021 Rachmad Vidya Wicaksana Putra, Muhammad Abdullah Hanif, Muhammad Shafique

The key mechanisms of SparkXD are: (1) improving the SNN error tolerance through fault-aware training that considers bit errors from approximate DRAM, (2) analyzing the error tolerance of the improved SNN model to find the maximum tolerable bit error rate (BER) that meets the targeted accuracy constraint, and (3) energy-efficient DRAM data mapping for the resilient SNN model that maps the weights in the appropriate DRAM location to minimize the DRAM access energy.

DNN-Life: An Energy-Efficient Aging Mitigation Framework for Improving the Lifetime of On-Chip Weight Memories in Deep Neural Network Hardware Architectures

no code implementations29 Jan 2021 Muhammad Abdullah Hanif, Muhammad Shafique

We propose DNN-Life, a specialized aging analysis and mitigation framework for DNNs, which jointly exploits hardware- and software-level knowledge to improve the lifetime of a DNN weight memory with reduced energy overhead.

Quantization Hardware Architecture

Robust Machine Learning Systems: Challenges, Current Trends, Perspectives, and the Road Ahead

no code implementations4 Jan 2021 Muhammad Shafique, Mahum Naseer, Theocharis Theocharides, Christos Kyrkou, Onur Mutlu, Lois Orosa, Jungwook Choi

Machine Learning (ML) techniques have been rapidly adopted by smart Cyber-Physical Systems (CPS) and Internet-of-Things (IoT) due to their powerful decision-making capabilities.

BIG-bench Machine Learning Decision Making

Securing Deep Spiking Neural Networks against Adversarial Attacks through Inherent Structural Parameters

1 code implementation9 Dec 2020 Rida El-Allami, Alberto Marchisio, Muhammad Shafique, Ihsen Alouani

We thoroughly study SNNs security under different adversarial attacks in the strong white-box setting, with different noise budgets and under variable spiking parameters.

MacLeR: Machine Learning-based Run-Time Hardware Trojan Detection in Resource-Constrained IoT Edge Devices

no code implementations21 Nov 2020 Faiq Khalid, Syed Rafay Hasan, Sara Zia, Osman Hasan, Falah Awwad, Muhammad Shafique

To reduce the overhead of data acquisition, we propose a single power-port current acquisition block using current sensors in time-division multiplexing, which increases accuracy while incurring reduced area overhead.

BIG-bench Machine Learning

DESCNet: Developing Efficient Scratchpad Memories for Capsule Network Hardware

no code implementations12 Oct 2020 Alberto Marchisio, Vojtech Mrazek, Muhammad Abdullah Hanif, Muhammad Shafique

We analyze the corresponding on-chip memory requirements and leverage it to propose a novel methodology to explore different scratchpad memory designs and their energy/area trade-offs.

Management

NASCaps: A Framework for Neural Architecture Search to Optimize the Accuracy and Hardware Efficiency of Convolutional Capsule Networks

1 code implementation19 Aug 2020 Alberto Marchisio, Andrea Massa, Vojtech Mrazek, Beatrice Bussolino, Maurizio Martina, Muhammad Shafique

Deep Neural Networks (DNNs) have made significant improvements to reach the desired accuracy to be employed in a wide variety of Machine Learning (ML) applications.

Neural Architecture Search

FSpiNN: An Optimization Framework for Memory- and Energy-Efficient Spiking Neural Networks

no code implementations17 Jul 2020 Rachmad Vidya Wicaksana Putra, Muhammad Shafique

FSpiNN reduces the computational requirements by reducing the number of neuronal operations, the STDP-based synaptic weight updates, and the STDP complexity.

Quantization

An Efficient Spiking Neural Network for Recognizing Gestures with a DVS Camera on the Loihi Neuromorphic Processor

1 code implementation16 May 2020 Riccardo Massa, Alberto Marchisio, Maurizio Martina, Muhammad Shafique

Towards the conversion from a DNN to an SNN, we perform a comprehensive analysis of such process, specifically designed for Intel Loihi, showing our methodology for the design of an SNN that achieves nearly the same accuracy results as its corresponding DNN.

Gesture Recognition Image Classification

DRMap: A Generic DRAM Data Mapping Policy for Energy-Efficient Processing of Convolutional Neural Networks

no code implementations21 Apr 2020 Rachmad Vidya Wicaksana Putra, Muhammad Abdullah Hanif, Muhammad Shafique

Many convolutional neural network (CNN) accelerators face performance- and energy-efficiency challenges which are crucial for embedded implementations, due to high DRAM access latency and energy.

Q-CapsNets: A Specialized Framework for Quantizing Capsule Networks

no code implementations15 Apr 2020 Alberto Marchisio, Beatrice Bussolino, Alessio Colucci, Maurizio Martina, Guido Masera, Muhammad Shafique

Capsule Networks (CapsNets), recently proposed by the Google Brain team, have superior learning capabilities in machine learning tasks, like image classification, compared to the traditional CNNs.

Image Classification Quantization

FANNet: Formal Analysis of Noise Tolerance, Training Bias and Input Sensitivity in Neural Networks

no code implementations3 Dec 2019 Mahum Naseer, Mishal Fatima Minhas, Faiq Khalid, Muhammad Abdullah Hanif, Osman Hasan, Muhammad Shafique

With a constant improvement in the network architectures and training methodologies, Neural Networks (NNs) are increasingly being deployed in real-world Machine Learning systems.

General Classification

ReD-CaNe: A Systematic Methodology for Resilience Analysis and Design of Capsule Networks under Approximations

no code implementations2 Dec 2019 Alberto Marchisio, Vojtech Mrazek, Muhammad Abudllah Hanif, Muhammad Shafique

To the best of our knowledge, this is the first proof-of-concept for employing approximations on the specialized CapsNet hardware.

FT-ClipAct: Resilience Analysis of Deep Neural Networks and Improving their Fault Tolerance using Clipped Activation

no code implementations2 Dec 2019 Le-Ha Hoang, Muhammad Abdullah Hanif, Muhammad Shafique

In this paper, we perform a comprehensive error resilience analysis of DNNs subjected to hardware faults (e. g., permanent faults) in the weight memory.

Autonomous Driving General Classification

ALWANN: Automatic Layer-Wise Approximation of Deep Neural Network Accelerators without Retraining

1 code implementation11 Jun 2019 Vojtech Mrazek, Zdenek Vasicek, Lukas Sekanina, Muhammad Abdullah Hanif, Muhammad Shafique

A suitable approximate multiplier is then selected for each computing element from a library of approximate multipliers in such a way that (i) one approximate multiplier serves several layers, and (ii) the overall classification error and energy consumption are minimized.

Multiobjective Optimization

FasTrCaps: An Integrated Framework for Fast yet Accurate Training of Capsule Networks

1 code implementation24 May 2019 Alberto Marchisio, Beatrice Bussolino, Alessio Colucci, Muhammad Abdullah Hanif, Maurizio Martina, Guido Masera, Muhammad Shafique

The goal is to reduce the hardware requirements of CapsNets by removing unused/redundant connections and capsules, while keeping high accuracy through tests of different learning rate policies and batch sizes.

Image Classification Object Detection

autoAx: An Automatic Design Space Exploration and Circuit Building Methodology utilizing Libraries of Approximate Components

2 code implementations22 Feb 2019 Vojtech Mrazek, Muhammad Abdullah Hanif, Zdenek Vasicek, Lukas Sekanina, Muhammad Shafique

Because these libraries contain from tens to thousands of approximate implementations for a single arithmetic operation it is intractable to find an optimal combination of approximate circuits in the library even for an application consisting of a few operations.

ROMANet: Fine-Grained Reuse-Driven Off-Chip Memory Access Management and Data Organization for Deep Neural Network Accelerators

no code implementations4 Feb 2019 Rachmad Vidya Wicaksana Putra, Muhammad Abdullah Hanif, Muhammad Shafique

Our experimental results show that the ROMANet saves DRAM access energy by 12% for the AlexNet, by 36% for the VGG-16, and by 46% for the MobileNet, while also improving the DRAM throughput by 10%, as compared to the state-of-the-art.

Management Scheduling

CapStore: Energy-Efficient Design and Management of the On-Chip Memory for CapsuleNet Inference Accelerators

no code implementations4 Feb 2019 Alberto Marchisio, Muhammad Abdullah Hanif, Mohammad Taghi Teimoori, Muhammad Shafique

By leveraging this analysis, we propose a methodology to explore different on-chip memory designs and a power-gating technique to further reduce the energy consumption, depending upon the utilization across different operations of a CapsuleNet.

Management

Is Spiking Secure? A Comparative Study on the Security Vulnerabilities of Spiking and Deep Neural Networks

no code implementations4 Feb 2019 Alberto Marchisio, Giorgio Nanfa, Faiq Khalid, Muhammad Abdullah Hanif, Maurizio Martina, Muhammad Shafique

We perform an in-depth evaluation for a Spiking Deep Belief Network (SDBN) and a DNN having the same number of layers and neurons (to obtain a fair comparison), in order to study the efficiency of our methodology and to understand the differences between SNNs and DNNs w. r. t.

Data Poisoning

RED-Attack: Resource Efficient Decision based Attack for Machine Learning

1 code implementation29 Jan 2019 Faiq Khalid, Hassan Ali, Muhammad Abdullah Hanif, Semeen Rehman, Rehan Ahmed, Muhammad Shafique

To address this limitation, decision-based attacks have been proposed which can estimate the model but they require several thousand queries to generate a single untargeted attack image.

BIG-bench Machine Learning General Classification +1

CapsAttacks: Robust and Imperceptible Adversarial Attacks on Capsule Networks

no code implementations28 Jan 2019 Alberto Marchisio, Giorgio Nanfa, Faiq Khalid, Muhammad Abdullah Hanif, Maurizio Martina, Muhammad Shafique

Capsule Networks preserve the hierarchical spatial relationships between objects, and thereby bears a potential to surpass the performance of traditional Convolutional Neural Networks (CNNs) in performing tasks like image classification.

Image Classification Traffic Sign Recognition

Security for Machine Learning-based Systems: Attacks and Challenges during Training and Inference

no code implementations5 Nov 2018 Faiq Khalid, Muhammad Abdullah Hanif, Semeen Rehman, Muhammad Shafique

Therefore, computing paradigms are evolving towards machine learning (ML)-based systems because of their ability to efficiently and accurately process the enormous amount of data.

BIG-bench Machine Learning Traffic Sign Recognition

FAdeML: Understanding the Impact of Pre-Processing Noise Filtering on Adversarial Machine Learning

no code implementations4 Nov 2018 Faiq Khalid, Muhammmad Abdullah Hanif, Semeen Rehman, Junaid Qadir, Muhammad Shafique

Deep neural networks (DNN)-based machine learning (ML) algorithms have recently emerged as the leading ML paradigm particularly for the task of classification due to their superior capability of learning efficiently from large datasets.

Adversarial Attack BIG-bench Machine Learning +1

SIMCom: Statistical Sniffing of Inter-Module Communications for Run-time Hardware Trojan Detection

no code implementations4 Nov 2018 Faiq Khalid, Syed Rafay Hasan, Osman Hasan, Muhammad Shafique

We present a run-time methodology for HT detection that employs a multi-parameter statistical traffic modeling of the communication channel in a given System-on-Chip (SoC), named as SIMCom.

SSCNets: Robustifying DNNs using Secure Selective Convolutional Filters

1 code implementation4 Nov 2018 Hassan Ali, Faiq Khalid, Hammad Tariq, Muhammad Abdullah Hanif, Semeen Rehman, Rehan Ahmed, Muhammad Shafique

In this paper, we introduce a novel technique based on the Secure Selective Convolutional (SSC) techniques in the training loop that increases the robustness of a given DNN by allowing it to learn the data distribution based on the important edges in the input image.

QuSecNets: Quantization-based Defense Mechanism for Securing Deep Neural Network against Adversarial Attacks

1 code implementation4 Nov 2018 Faiq Khalid, Hassan Ali, Hammad Tariq, Muhammad Abdullah Hanif, Semeen Rehman, Rehan Ahmed, Muhammad Shafique

Adversarial examples have emerged as a significant threat to machine learning algorithms, especially to the convolutional neural networks (CNNs).

Quantization

CapsAcc: An Efficient Hardware Accelerator for CapsuleNets with Data Reuse

no code implementations2 Nov 2018 Alberto Marchisio, Muhammad Abdullah Hanif, Muhammad Shafique

In this paper, we propose CapsAcc, the first specialized CMOS-based hardware architecture to perform CapsuleNets inference with high performance and energy efficiency.

Distributed, Parallel, and Cluster Computing Hardware Architecture

TrISec: Training Data-Unaware Imperceptible Security Attacks on Deep Neural Networks

no code implementations2 Nov 2018 Faiq Khalid, Muhammad Abdullah Hanif, Semeen Rehman, Rehan Ahmed, Muhammad Shafique

Most of the data manipulation attacks on deep neural networks (DNNs) during the training stage introduce a perceptible noise that can be catered by preprocessing during inference or can be identified during the validation phase.

Autonomous Driving Data Poisoning +4

MPNA: A Massively-Parallel Neural Array Accelerator with Dataflow Optimization for Convolutional Neural Networks

no code implementations30 Oct 2018 Muhammad Abdullah Hanif, Rachmad Vidya Wicaksana Putra, Muhammad Tanvir, Rehan Hafiz, Semeen Rehman, Muhammad Shafique

The state-of-the-art accelerators for Convolutional Neural Networks (CNNs) typically focus on accelerating only the convolutional layers, but do not prioritize the fully-connected layers much.

A Roadmap Towards Resilient Internet of Things for Cyber-Physical Systems

no code implementations16 Oct 2018 Denise Ratasich, Faiq Khalid, Florian Geissler, Radu Grosu, Muhammad Shafique, Ezio Bartocci

Furthermore, this paper presents the main challenges in building a resilient IoT for CPS which is crucial in the era of smart CPS with enhanced connectivity (an excellent example of such a system is connected autonomous vehicles).

Anomaly Detection Autonomous Vehicles

Cannot find the paper you are looking for? You can Submit a new open access paper.