Experimental Design
77 papers with code • 0 benchmarks • 0 datasets
Benchmarks
These leaderboards are used to track progress in Experimental Design
Most implemented papers
OpenBox: A Generalized Black-box Optimization Service
Black-box optimization (BBO) has a broad range of applications, including automatic machine learning, engineering, physics, and experimental design.
Creation and analysis of biochemical constraint-based models: the COBRA Toolbox v3.0
This protocol can be adapted for the generation and analysis of a constraint-based model in a wide variety of molecular systems biology scenarios.
Empirical Study of Off-Policy Policy Evaluation for Reinforcement Learning
We offer an experimental benchmark and empirical study for off-policy policy evaluation (OPE) in reinforcement learning, which is a key problem in many safety critical applications.
Gaussian Process Optimization in the Bandit Setting: No Regret and Experimental Design
Many applications require optimizing an unknown, noisy function that is expensive to evaluate.
Learning a nonlinear dynamical system model of gene regulation: A perturbed steady-state approach
Model-based methods founded on quantitative descriptions of gene regulation are among the most promising, but many such methods rely on simple, local models or on ad hoc inference approaches lacking experimental interpretability.
Pitfalls and Best Practices in Algorithm Configuration
Good parameter settings are crucial to achieve high performance in many areas of artificial intelligence (AI), such as propositional satisfiability solving, AI planning, scheduling, and machine learning (in particular deep learning).
Optimal design of experiments to identify latent behavioral types
We apply our procedure to a game of imperfect information to evaluate and quantify the computational improvements.
Attention is not not Explanation
sarahwie/attention
•
•
IJCNLP 2019
We show that even when reliable adversarial distributions can be found, they don't perform well on the simple diagnostic, indicating that prior work does not disprove the usefulness of attention mechanisms for explainability.
hls4ml: An Open-Source Codesign Workflow to Empower Scientific Low-Power Machine Learning Devices
fastmachinelearning/hls4ml
•
•
Accessible machine learning algorithms, software, and diagnostic tools for energy-efficient devices and systems are extremely valuable across a broad range of application domains.
FLEX: Unifying Evaluation for Few-Shot NLP
Few-shot NLP research is highly active, yet conducted in disjoint research threads with evaluation suites that lack challenging-yet-realistic testing setups and fail to employ careful experimental design.
