CMRC (Chinese Machine Reading Comprehension)

Introduced by Cui et al. in A Span-Extraction Dataset for Chinese Machine Reading Comprehension

CMRC is a dataset is annotated by human experts with near 20,000 questions as well as a challenging set which is composed of the questions that need reasoning over multiple clues.

Source: A Span-Extraction Dataset for Chinese Machine Reading Comprehension

Homepage

Benchmarks

Add a new result Link an existing benchmark

Task	Dataset Variant	Best Model
Chinese Reading Comprehension	CMRC 2018 (Chinese Machine Reading Comprehension 2018)	MacBERT-large-extData-v2
Chinese Reading Comprehension	CMRC 2019 (Chinese Machine Reading Comprehension 2019)	bert_scp_spm
Reading Comprehension (Few-Shot)	CMRC 2018	PanGu-α 2.6B
Cloze (multi-choices) (Zero-Shot)	CMRC 2019	PanGu-α 2.6B
Cloze (multi-choices) (One-Shot)	CMRC 2019	PanGu-α 2.6B
Reading Comprehension (Zero-Shot)	CMRC 2018	PanGu-α 2.6B
Cloze (multi-choices) (Zero-Shot)	CMRC 2017	PanGu-α 2.6B
Cloze (multi-choices) (One-Shot)	CMRC 2017	PanGu-α 2.6B
Cloze (multi-choices) (Few-Shot)	CMRC 2017	PanGu-α 2.6B
Cloze (multi-choices) (Few-Shot)	CMRC 2019	PanGu-α 2.6B
Reading Comprehension (One-Shot)	CMRC 2018	PanGu-α 2.6B