Search Results for author: Lakshmi Nair

Found 10 papers, 2 papers with code

CLIP-Embed-KD: Computationally Efficient Knowledge Distillation Using Embeddings as Teachers

2 code implementations9 Apr 2024 Lakshmi Nair

Contrastive Language-Image Pre-training (CLIP) has been shown to improve zero-shot generalization capabilities of language and vision models.

Knowledge Distillation Zero-shot Generalization

A Blueprint for Precise and Fault-Tolerant Analog Neural Networks

no code implementations19 Sep 2023 Cansu Demirkiran, Lakshmi Nair, Darius Bunandar, Ajay Joshi

Our study demonstrates that analog accelerators utilizing the RNS-based approach can achieve ${\geq}99\%$ of FP32 accuracy for state-of-the-art DNN inference using data converters with only $6$-bit precision whereas a conventional analog core requires more than $8$-bit precision to achieve the same accuracy in the same DNNs.

INT-FP-QSim: Mixed Precision and Formats For Large Language Models and Vision Transformers

1 code implementation7 Jul 2023 Lakshmi Nair, Mikhail Bernadskiy, Arulselvan Madhavan, Craig Chan, Ayon Basumallik, Darius Bunandar

To supplement this ongoing effort, we propose INT-FP-QSim: an open-source simulator that enables flexible evaluation of LLMs and vision transformers at various numerical precisions and formats.

Quantization

Sensitivity-Aware Finetuning for Accuracy Recovery on Deep Learning Hardware

no code implementations5 Jun 2023 Lakshmi Nair, Darius Bunandar

Existing methods to recover model accuracy on analog-digital hardware in the presence of quantization and analog noise include noise-injection training.

Quantization

Adaptive Block Floating-Point for Analog Deep Learning Hardware

no code implementations12 May 2022 Ayon Basumallik, Darius Bunandar, Nicholas Dronen, Nicholas Harris, Ludmila Levkova, Calvin Mccarter, Lakshmi Nair, David Walter, David Widemann

Analog mixed-signal (AMS) devices promise faster, more energy-efficient deep neural network (DNN) inference than their digital counterparts.

Quantization

Creative Problem Solving in Artificially Intelligent Agents: A Survey and Framework

no code implementations21 Apr 2022 Evana Gizzi, Lakshmi Nair, Sonia Chernova, Jivko Sinapov

Creative Problem Solving (CPS) is a sub-area within Artificial Intelligence (AI) that focuses on methods for solving off-nominal, or anomalous problems in autonomous systems.

Towards Robust One-shot Task Execution using Knowledge Graph Embeddings

no code implementations10 May 2021 Angel Daruna, Lakshmi Nair, Weiyu Liu, Sonia Chernova

We validated the approach on a physical platform, which resulted in the successful generalization of initial task plans to 38 of 50 execution environments with errors resulting from autonomous robot operation included.

Knowledge Graph Embeddings

Tool Substitution with Shape and Material Reasoning Using Dual Neural Networks

no code implementations11 Nov 2019 Nithin Shrivatsav, Lakshmi Nair, Sonia Chernova

This paper explores the problem of tool substitution, namely, identifying substitute tools for performing a task from a given set of candidate tools.

Action Categorization for Computationally Improved Task Learning and Planning

no code implementations26 Apr 2018 Lakshmi Nair, Sonia Chernova

This paper explores the problem of task learning and planning, contributing the Action-Category Representation (ACR) to improve computational performance of both Planning and Reinforcement Learning (RL).

reinforcement-learning Reinforcement Learning (RL) +1

Cannot find the paper you are looking for? You can Submit a new open access paper.