Search Results for author:
Found 8 papers, 5 papers with code
Untangle the KNOT: Interweaving Conflicting Knowledge and Reasoning Skills in Large Language Models
However, knowledge in the document may conflict with the memory of LLMs due to outdated or incorrect knowledge in the LLMs' parameters.
Evaluating Generative Language Models in Information Extraction as Subjective Question Correction
(1) The imprecision of existing evaluation metrics that struggle to effectively gauge semantic consistency between model outputs and ground truth, and (2) The inherent incompleteness of evaluation benchmarks, primarily due to restrictive human annotation schemas, resulting in underestimated LLM performances.
KnowCoder: Coding Structured Knowledge into LLMs for Universal Information Extraction
After instruction tuning, KnowCoder further exhibits strong generalization ability on unseen schemas and achieves up to $\textbf{12. 5%}$ and $\textbf{21. 9%}$, compared to sota baselines, under the zero-shot setting and the low resource setting, respectively.
Retrieval-Augmented Code Generation for Universal Information Extraction
Therefore, in this paper, we propose a universal retrieval-augmented code generation framework based on LLMs, called Code4UIE, for IE tasks.
An In-Context Schema Understanding Method for Knowledge Base Question Answering
The Knowledge Base Question Answering (KBQA) task aims to answer natural language questions based on a given knowledge base.
Nested Event Extraction upon Pivot Element Recogniton
Since existing NEE datasets (e. g., Genia11) are limited to specific domains and contain a narrow range of event types with nested structures, we systematically categorize nested events in the generic domain and construct a new NEE dataset, called ACE2005-Nest.
KoRC: Knowledge oriented Reading Comprehension Benchmark for Deep Text Understanding
However, these benchmarks have encountered two major limitations.
KoLA: Carefully Benchmarking World Knowledge of Large Language Models
The unprecedented performance of large language models (LLMs) necessitates improvements in evaluations.
