Search Results for author:
Found 1 papers, 0 papers with code
PRD: Peer Rank and Discussion Improve Large Language Model based Evaluations
Specifically, we propose the (1) peer rank (PR) algorithm that takes into account each peer LLM's pairwise preferences of all answer pairs, and outputs a final ranking of models; and (2) peer discussion (PD), where we prompt two LLMs to discuss and try to reach a mutual agreement on preferences of two answers.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
