BioPlanner: Automatic Evaluation of LLMs on Protocol Planning in Biology

1 code implementation • 16 Oct 2023 • Odhran O'Donoghue, Aleksandar Shtedritski, John Ginger, Ralph Abboud, Ali Essa Ghareeb, Justin Booth, Samuel G Rodriques

Here we present an automatic evaluation framework for the task of planning experimental protocols, and we introduce BioProt: a dataset of biology protocols with corresponding pseudocode representations.

Language Modelling Question Answering