Search Results for author: Erin Lanus

Found 4 papers, 0 papers with code

Test & Evaluation Best Practices for Machine Learning-Enabled Systems

no code implementations10 Oct 2023 Jaganmohan Chandrasekaran, Tyler Cody, Nicola McCarthy, Erin Lanus, Laura Freeman

This report presents best practices for the Test and Evaluation (T&E) of ML-enabled software systems across its lifecycle.

Evaluating Automated Driving Planner Robustness against Adversarial Influence

no code implementations29 May 2022 Andres Molina-Markham, Silvia G. Ionescu, Erin Lanus, Derek Ng, Sam Sommerer, Joseph J. Rushanan

In contrast with established practices that evaluate safety using the same evaluation dataset for all vehicles, we argue that adversarial evaluation fundamentally requires a process that seeks to defeat a specific protection.

Systematic Training and Testing for Machine Learning Using Combinatorial Interaction Testing

no code implementations28 Jan 2022 Tyler Cody, Erin Lanus, Daniel D. Doyle, Laura Freeman

In contrast to prior work which has focused on the use of coverage in regard to the internal of neural networks, this paper considers coverage over simple features derived from inputs and outputs.

BIG-bench Machine Learning

Test and Evaluation Framework for Multi-Agent Systems of Autonomous Intelligent Agents

no code implementations25 Jan 2021 Erin Lanus, Ivan Hernandez, Adam Dachowicz, Laura Freeman, Melanie Grande, Andrew Lang, Jitesh H. Panchal, Anthony Patrick, Scott Welch

Test and evaluation is a necessary process for ensuring that engineered systems perform as intended under a variety of conditions, both expected and unexpected.

Cannot find the paper you are looking for? You can Submit a new open access paper.