RAmBLA: A Framework for Evaluating the Reliability of LLMs as Assistants in the Biomedical Domain

1 code implementation • 21 Mar 2024 • William James Bolton, Rafael Poyiadzi, Edward R. Morrell, Gabriela van Bergen Gonzalez Bueno, Lea Goetz

Large Language Models (LLMs) increasingly support applications in a wide range of domains, some with potential high societal impact such as biomedicine, yet their reliability in realistic use cases is under-researched.

Semantic Similarity Semantic Textual Similarity