Search Results for author:
Found 9 papers, 7 papers with code
Data Contamination Report from the 2024 CONDA Shared Task
The workshop fostered a shared task to collect evidence on data contamination in current available datasets and models.
OlympicArena Medal Ranks: Who Is the Most Intelligent AI So Far?
In this report, we pose the following question: Who is the most intelligent AI model to date, as measured by the OlympicArena (an Olympic-level, multi-discipline, multi-modal benchmark for superintelligent AI)?
OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI
We delve into the models' cognitive reasoning abilities, their performance across different modalities, and their outcomes in process-level evaluations, which are vital for tasks requiring complex reasoning with lengthy solutions.
Benchmarking Benchmark Leakage in Large Language Models
By analyzing 31 LLMs under the context of mathematical reasoning, we reveal substantial instances of training even test set misuse, resulting in potentially unfair comparisons.
Generative AI for Math: Part I -- MathPile: A Billion-Token-Scale Pretraining Corpus for Math
Our meticulous data collection and processing efforts included a complex suite of preprocessing, prefiltering, language identification, cleaning, filtering, and deduplication, ensuring the high quality of our corpus.
Ask Again, Then Fail: Large Language Models' Vacillations in Judgment
We observe that current conversational language models often waver in their judgments when faced with follow-up questions, even if the original judgment was correct.
MEMD-ABSA: A Multi-Element Multi-Domain Dataset for Aspect-Based Sentiment Analysis
Aspect-based sentiment analysis is a long-standing research interest in the field of opinion mining, and in recent years, researchers have gradually shifted their focus from simple ABSA subtasks to end-to-end multi-element ABSA tasks.
Is ChatGPT a Good Sentiment Analyzer? A Preliminary Study
Recently, ChatGPT has drawn great attention from both the research community and the public.
UnifiedABSA: A Unified ABSA Framework Based on Multi-task Instruction Tuning
Aspect-Based Sentiment Analysis (ABSA) aims to provide fine-grained aspect-level sentiment information.
Ranked #5 on
Aspect-Based Sentiment Analysis (ABSA)
on ACOS
(using extra training data)
Aspect-Based Sentiment Analysis
Aspect-Category-Opinion-Sentiment Quadruple Extraction
+5
