Search Results for author:
Found 5 papers, 5 papers with code
RAGChecker: A Fine-grained Framework for Diagnosing Retrieval-Augmented Generation
Despite Retrieval-Augmented Generation (RAG) showing promising capability in leveraging external knowledge, a comprehensive evaluation of RAG systems is still challenging due to the modular nature of RAG, evaluation of long-form responses and reliability of measurements.
OpenResearcher: Unleashing AI for Accelerated Scientific Research
The rapid growth of scientific literature imposes significant challenges for researchers endeavoring to stay updated with the latest advancements in their fields and delve into new areas.
Halu-J: Critique-Based Hallucination Judge
To address these challenges, we introduce Halu-J, a critique-based hallucination judge with 7 billion parameters.
BeHonest: Benchmarking Honesty in Large Language Models
Building on this foundation, we designed 10 scenarios to evaluate and analyze 9 popular LLMs on the market, including both closed-source and open-source models from different model families with varied model sizes.
OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI
We delve into the models' cognitive reasoning abilities, their performance across different modalities, and their outcomes in process-level evaluations, which are vital for tasks requiring complex reasoning with lengthy solutions.
