no code implementations • 11 Dec 2023 • Kevin Coakley, Christine R. Kirkpatrick, Odd Erik Gundersen
To account for these implementation factors, researchers should run their experiments multiple times in different hardware and software environments to verify their conclusions are not affected.
no code implementations • 15 Apr 2022 • Odd Erik Gundersen, Kevin Coakley, Christine Kirkpatrick, Yolanda Gil
Objective: The objective of this paper is to develop a framework that enable applied data science practitioners and researchers to understand which experiment design choices can lead to false findings and how and by this help in analyzing the conclusions of reproducibility experiments.