1 code implementation • 5 Apr 2023 • Michael Weiss, Paolo Tonella
Systems relying on large-scale DNNs thus have to call the corresponding model over the network, leading to substantial costs for hosting and running the large-scale remote model, costs which are often charged on a per-use basis.
no code implementations • 14 Dec 2022 • Michael Weiss, Paolo Tonella
After overviewing the main approaches to uncertainty estimation and discussing their pros and cons, we motivate the need for a specific empirical assessment method that can deal with the experimental setting in which supervisors are used, where the accuracy of the DNN matters only as long as the supervisor lets the DLS continue to operate.
no code implementations • 24 Aug 2022 • Michael Weiss
On complex problems, state of the art prediction accuracy of Deep Neural Networks (DNN) can be achieved using very large-scale models, consisting of billions of parameters.
no code implementations • 21 Jul 2022 • Michael Weiss, André García Gómez, Paolo Tonella
In this paper, we propose a novel way to generate ambiguous inputs to test DNN supervisors and used it to empirically compare several existing supervisor techniques.
3 code implementations • 2 May 2022 • Michael Weiss, Paolo Tonella
Test Input Prioritizers (TIP) for Deep Neural Networks (DNN) are an important technique to handle the typically very large test datasets efficiently, saving computation and labeling costs.
2 code implementations • 10 Mar 2021 • Michael Weiss, Rwiddhi Chakraborty, Paolo Tonella
As an adequacy criterion, it has been used to assess the strength of DL test suites.
2 code implementations • 1 Feb 2021 • Michael Weiss, Paolo Tonella
Modern software systems rely on Deep Neural Networks (DNN) when processing complex, unstructured inputs, such as images, videos, natural language texts or audio signals.
1 code implementation • 29 Dec 2020 • Michael Weiss, Paolo Tonella
Uncertainty and confidence have been shown to be useful metrics in a wide variety of techniques proposed for deep learning testing, including test data selection and system supervision. We present uncertainty-wizard, a tool that allows to quantify such uncertainty and confidence in artificial neural networks.
1 code implementation • 10 Oct 2019 • Andrea Stocco, Michael Weiss, Marco Calzana, Paolo Tonella
Deep Neural Networks (DNNs) are the core component of modern autonomous driving systems.
Signal Processing