no code implementations • 15 Dec 2020 • Benjamin Elder, Matthew Arnold, Anupama Murthi, Jiri Navratil
We address this core problem of performance prediction uncertainty with a method to compute prediction intervals for model performance.
no code implementations • 10 Jul 2020 • Begum Taskazan, Jiri Navratil, Matthew Arnold, Anupama Murthi, Ganesh Venkataraman, Benjamin Elder
Building and maintaining high-quality test sets remains a laborious and expensive task.
no code implementations • 28 Mar 2020 • Matthew Arnold, Jeffrey Boston, Michael Desmond, Evelyn Duesterwald, Benjamin Elder, Anupama Murthi, Jiri Navratil, Darrell Reimer
Today's AI deployments often require significant human involvement and skill in the operational stages of the model lifecycle, including pre-release testing, monitoring, problem diagnosis and model improvements.
no code implementations • 9 May 2019 • Evelyn Duesterwald, Anupama Murthi, Ganesh Venkataraman, Mathieu Sinn, Deepak Vijaykeerthy
We present a sensitivity analysis that illustrates that the effectiveness of adversarial training hinges on the settings of a few salient hyperparameters.