Search Results for author: Sumit Kumar Jha

Found 10 papers, 1 papers with code

Quantifying Membership Inference Vulnerability via Generalization Gap and Other Model Metrics

no code implementations11 Sep 2020 Jason W. Bentley, Daniel Gibney, Gary Hoppenworth, Sumit Kumar Jha

We demonstrate how a target model's generalization gap leads directly to an effective deterministic black box membership inference attack (MIA).

Inference Attack Membership Inference Attack

An Extension of Fano's Inequality for Characterizing Model Susceptibility to Membership Inference Attacks

no code implementations17 Sep 2020 Sumit Kumar Jha, Susmit Jha, Rickard Ewetz, Sunny Raj, Alvaro Velasquez, Laura L. Pullum, Ananthram Swami

We present a new extension of Fano's inequality and employ it to theoretically establish that the probability of success for a membership inference attack on a deep neural network can be bounded using the mutual information between its inputs and its activations.

Inference Attack Membership Inference Attack

Robust Ensembles of Neural Networks using Itô Processes

no code implementations1 Jan 2021 Sumit Kumar Jha, Susmit Jha, Rickard Ewetz, Alvaro Velasquez

We exploit this connection and the theory of stochastic dynamical systems to construct a novel ensemble of Itô processes as a new deep learning representation that is more robust than classical residual networks.

CrossedWires: A Dataset of Syntactically Equivalent but Semantically Disparate Deep Learning Models

1 code implementation29 Aug 2021 Max Zvyagin, Thomas Brettin, Arvind Ramanathan, Sumit Kumar Jha

Currently, our ability to build standardized deep learning models is limited by the availability of a suite of neural network and corresponding training hyperparameter benchmarks that expose differences between existing deep learning frameworks.

Hyperparameter Optimization

Protein Folding Neural Networks Are Not Robust

no code implementations9 Sep 2021 Sumit Kumar Jha, Arvind Ramanathan, Rickard Ewetz, Alvaro Velasquez, Susmit Jha

We define the robustness measure for the predicted structure of a protein sequence to be the inverse of the root-mean-square distance (RMSD) in the predicted structure and the structure of its adversarially perturbed sequence.

Adversarial Attack Protein Folding

A Game-theoretic Understanding of Repeated Explanations in ML Models

no code implementations5 Feb 2022 Kavita Kumari, Murtuza Jadliwala, Sumit Kumar Jha, Anindya Maiti

This paper formally models the strategic repeated interactions between a system, comprising of a machine learning (ML) model and associated explanation method, and an end-user who is seeking a prediction/label and its explanation for a query/input, by means of game theory.

Neural Stochastic Differential Equations for Robust and Explainable Analysis of Electromagnetic Unintended Radiated Emissions

no code implementations27 Sep 2023 Sumit Kumar Jha, Susmit Jha, Rickard Ewetz, Alvaro Velasquez

We provide an empirical demonstration of the fragility of ResNet-like models to Gaussian noise perturbations, where the model performance deteriorates sharply and its F1-score drops to near insignificance at 0. 008 with a Gaussian noise of only 0. 5 standard deviation.

Attribute Interpretable Machine Learning

Neuro Symbolic Reasoning for Planning: Counterexample Guided Inductive Synthesis using Large Language Models and Satisfiability Solving

no code implementations28 Sep 2023 Sumit Kumar Jha, Susmit Jha, Patrick Lincoln, Nathaniel D. Bastian, Alvaro Velasquez, Rickard Ewetz, Sandeep Neema

We posit that we can use the satisfiability modulo theory (SMT) solvers as deductive reasoning engines to analyze the generated solutions from the LLMs, produce counterexamples when the solutions are incorrect, and provide that feedback to the LLMs exploiting the dialog capability of instruct-trained LLMs.

Hallucination Question Answering +1

Towards a Game-theoretic Understanding of Explanation-based Membership Inference Attacks

no code implementations10 Apr 2024 Kavita Kumari, Murtuza Jadliwala, Sumit Kumar Jha, Anindya Maiti

By means of a comprehensive set of simulations of the proposed game model, we assess different factors that can impact the capability of an adversary to launch MIA in such repeated interaction settings.

Cannot find the paper you are looking for? You can Submit a new open access paper.