no code implementations • 14 Mar 2019 • Susmit Jha, Sunny Raj, Steven Lawrence Fernandes, Sumit Kumar Jha, Somesh Jha, Gunjan Verma, Brian Jalaian, Ananthram Swami
We study the robustness of machine learning models on benign and adversarial inputs in this neighborhood.
no code implementations • 11 Sep 2020 • Jason W. Bentley, Daniel Gibney, Gary Hoppenworth, Sumit Kumar Jha
We demonstrate how a target model's generalization gap leads directly to an effective deterministic black box membership inference attack (MIA).
no code implementations • 17 Sep 2020 • Sumit Kumar Jha, Susmit Jha, Rickard Ewetz, Sunny Raj, Alvaro Velasquez, Laura L. Pullum, Ananthram Swami
We present a new extension of Fano's inequality and employ it to theoretically establish that the probability of success for a membership inference attack on a deep neural network can be bounded using the mutual information between its inputs and its activations.
no code implementations • 1 Jan 2021 • Sumit Kumar Jha, Susmit Jha, Rickard Ewetz, Alvaro Velasquez
We exploit this connection and the theory of stochastic dynamical systems to construct a novel ensemble of Itô processes as a new deep learning representation that is more robust than classical residual networks.
1 code implementation • 29 Aug 2021 • Max Zvyagin, Thomas Brettin, Arvind Ramanathan, Sumit Kumar Jha
Currently, our ability to build standardized deep learning models is limited by the availability of a suite of neural network and corresponding training hyperparameter benchmarks that expose differences between existing deep learning frameworks.
no code implementations • 9 Sep 2021 • Sumit Kumar Jha, Arvind Ramanathan, Rickard Ewetz, Alvaro Velasquez, Susmit Jha
We define the robustness measure for the predicted structure of a protein sequence to be the inverse of the root-mean-square distance (RMSD) in the predicted structure and the structure of its adversarially perturbed sequence.
no code implementations • 5 Feb 2022 • Kavita Kumari, Murtuza Jadliwala, Sumit Kumar Jha, Anindya Maiti
This paper formally models the strategic repeated interactions between a system, comprising of a machine learning (ML) model and associated explanation method, and an end-user who is seeking a prediction/label and its explanation for a query/input, by means of game theory.
no code implementations • 27 Sep 2023 • Sumit Kumar Jha, Susmit Jha, Rickard Ewetz, Alvaro Velasquez
We provide an empirical demonstration of the fragility of ResNet-like models to Gaussian noise perturbations, where the model performance deteriorates sharply and its F1-score drops to near insignificance at 0. 008 with a Gaussian noise of only 0. 5 standard deviation.
no code implementations • 28 Sep 2023 • Sumit Kumar Jha, Susmit Jha, Patrick Lincoln, Nathaniel D. Bastian, Alvaro Velasquez, Rickard Ewetz, Sandeep Neema
We posit that we can use the satisfiability modulo theory (SMT) solvers as deductive reasoning engines to analyze the generated solutions from the LLMs, produce counterexamples when the solutions are incorrect, and provide that feedback to the LLMs exploiting the dialog capability of instruct-trained LLMs.
no code implementations • 10 Apr 2024 • Kavita Kumari, Murtuza Jadliwala, Sumit Kumar Jha, Anindya Maiti
By means of a comprehensive set of simulations of the proposed game model, we assess different factors that can impact the capability of an adversary to launch MIA in such repeated interaction settings.