TASK	DATASET	MODEL	METRIC NAME	METRIC VALUE	GLOBAL RANK
Discourse Parsing	Instructional-DT (Instr-DT)	Bottom-up (DeBERTa)	Standard Parseval (Span)	77.8	# 1
Discourse Parsing	Instructional-DT (Instr-DT)	Bottom-up (DeBERTa)	Standard Parseval (Nuclearity)	60.0	# 1
Discourse Parsing	Instructional-DT (Instr-DT)	Bottom-up (DeBERTa)	Standard Parseval (Relation)	51.4	# 1
Discourse Parsing	Instructional-DT (Instr-DT)	Bottom-up (DeBERTa)	Standard Parseval (Full)	44.4	# 1
Discourse Parsing	Instructional-DT (Instr-DT)	Bottom-up (SpanBERT)	Standard Parseval (Span)	72.9	# 8
Discourse Parsing	Instructional-DT (Instr-DT)	Bottom-up (SpanBERT)	Standard Parseval (Nuclearity)	53.8	# 8
Discourse Parsing	Instructional-DT (Instr-DT)	Bottom-up (SpanBERT)	Standard Parseval (Relation)	46.0	# 7
Discourse Parsing	Instructional-DT (Instr-DT)	Bottom-up (SpanBERT)	Standard Parseval (Full)	40.5	# 6
Discourse Parsing	Instructional-DT (Instr-DT)	Bottom-up (XLNet)	Standard Parseval (Span)	73.6	# 6
Discourse Parsing	Instructional-DT (Instr-DT)	Bottom-up (XLNet)	Standard Parseval (Nuclearity)	56.4	# 3
Discourse Parsing	Instructional-DT (Instr-DT)	Bottom-up (XLNet)	Standard Parseval (Relation)	47.4	# 5
Discourse Parsing	Instructional-DT (Instr-DT)	Bottom-up (XLNet)	Standard Parseval (Full)	40.7	# 5
Discourse Parsing	Instructional-DT (Instr-DT)	Bottom-up (RoBERTa)	Standard Parseval (Span)	73.2	# 7
Discourse Parsing	Instructional-DT (Instr-DT)	Bottom-up (RoBERTa)	Standard Parseval (Nuclearity)	55.5	# 5
Discourse Parsing	Instructional-DT (Instr-DT)	Bottom-up (RoBERTa)	Standard Parseval (Relation)	47.9	# 4
Discourse Parsing	Instructional-DT (Instr-DT)	Bottom-up (RoBERTa)	Standard Parseval (Full)	41.4	# 4
Discourse Parsing	Instructional-DT (Instr-DT)	Bottom-up (BERT)	Standard Parseval (Span)	66.6	# 9
Discourse Parsing	Instructional-DT (Instr-DT)	Bottom-up (BERT)	Standard Parseval (Nuclearity)	46.3	# 10
Discourse Parsing	Instructional-DT (Instr-DT)	Bottom-up (BERT)	Standard Parseval (Relation)	39.5	# 9
Discourse Parsing	Instructional-DT (Instr-DT)	Bottom-up (BERT)	Standard Parseval (Full)	32.9	# 9
Discourse Parsing	Instructional-DT (Instr-DT)	Top-down (DeBERTa)	Standard Parseval (Span)	77.3	# 2
Discourse Parsing	Instructional-DT (Instr-DT)	Top-down (DeBERTa)	Standard Parseval (Nuclearity)	57.9	# 2
Discourse Parsing	Instructional-DT (Instr-DT)	Top-down (DeBERTa)	Standard Parseval (Relation)	50.0	# 2
Discourse Parsing	Instructional-DT (Instr-DT)	Top-down (DeBERTa)	Standard Parseval (Full)	43.4	# 2
Discourse Parsing	Instructional-DT (Instr-DT)	Top-down (SpanBERT)	Standard Parseval (Span)	73.7	# 5
Discourse Parsing	Instructional-DT (Instr-DT)	Top-down (SpanBERT)	Standard Parseval (Nuclearity)	54.5	# 7
Discourse Parsing	Instructional-DT (Instr-DT)	Top-down (SpanBERT)	Standard Parseval (Relation)	42.7	# 8
Discourse Parsing	Instructional-DT (Instr-DT)	Top-down (SpanBERT)	Standard Parseval (Full)	36.7	# 8
Discourse Parsing	Instructional-DT (Instr-DT)	Top-down (XLNet)	Standard Parseval (Span)	74.3	# 4
Discourse Parsing	Instructional-DT (Instr-DT)	Top-down (XLNet)	Standard Parseval (Nuclearity)	55.2	# 6
Discourse Parsing	Instructional-DT (Instr-DT)	Top-down (XLNet)	Standard Parseval (Relation)	47.0	# 6
Discourse Parsing	Instructional-DT (Instr-DT)	Top-down (XLNet)	Standard Parseval (Full)	40.2	# 7
Discourse Parsing	Instructional-DT (Instr-DT)	Top-down (RoBERTa)	Standard Parseval (Span)	75.7	# 3
Discourse Parsing	Instructional-DT (Instr-DT)	Top-down (RoBERTa)	Standard Parseval (Nuclearity)	56.1	# 4
Discourse Parsing	Instructional-DT (Instr-DT)	Top-down (RoBERTa)	Standard Parseval (Relation)	48.7	# 3
Discourse Parsing	Instructional-DT (Instr-DT)	Top-down (RoBERTa)	Standard Parseval (Full)	41.5	# 3
Discourse Parsing	Instructional-DT (Instr-DT)	Top-down (BERT)	Standard Parseval (Span)	65.3	# 11
Discourse Parsing	Instructional-DT (Instr-DT)	Top-down (BERT)	Standard Parseval (Nuclearity)	44.6	# 11
Discourse Parsing	Instructional-DT (Instr-DT)	Top-down (BERT)	Standard Parseval (Relation)	37.6	# 10
Discourse Parsing	Instructional-DT (Instr-DT)	Top-down (BERT)	Standard Parseval (Full)	30.9	# 10
Discourse Parsing	RST-DT	Top-down (XLNet)	Standard Parseval (Span)	77.8	# 2
Discourse Parsing	RST-DT	Top-down (XLNet)	Standard Parseval (Nuclearity)	67.4	# 3
Discourse Parsing	RST-DT	Top-down (XLNet)	Standard Parseval (Relation)	57.0	# 2
Discourse Parsing	RST-DT	Top-down (XLNet)	Standard Parseval (Full)	54.8	# 2
Discourse Parsing	RST-DT	Bottom-up (DeBERTa)	Standard Parseval (Nuclearity)	68.0	# 1
Discourse Parsing	RST-DT	Bottom-up (DeBERTa)	Standard Parseval (Relation)	57.3	# 1
Discourse Parsing	RST-DT	Bottom-up (DeBERTa)	Standard Parseval (Full)	55.4	# 1
Discourse Parsing	RST-DT	Top-down (DeBERTa)	Standard Parseval (Span)	78.5	# 1
Discourse Parsing	RST-DT	Top-down (DeBERTa)	Standard Parseval (Nuclearity)	67.9	# 2
Discourse Parsing	RST-DT	Top-down (DeBERTa)	Standard Parseval (Relation)	56.6	# 3
Discourse Parsing	RST-DT	Top-down (DeBERTa)	Standard Parseval (Full)	54.4	# 3
Discourse Parsing	RST-DT	Bottom-up (SpanBERT)	Standard Parseval (Nuclearity)	65.3	# 8
Discourse Parsing	RST-DT	Bottom-up (SpanBERT)	Standard Parseval (Relation)	54.9	# 7
Discourse Parsing	RST-DT	Bottom-up (SpanBERT)	Standard Parseval (Full)	52.7	# 7
Discourse Parsing	RST-DT	Top-down (BERT)	Standard Parseval (Span)	69.8	# 15
Discourse Parsing	RST-DT	Top-down (BERT)	Standard Parseval (Nuclearity)	59.1	# 17
Discourse Parsing	RST-DT	Top-down (BERT)	Standard Parseval (Relation)	48.3	# 13
Discourse Parsing	RST-DT	Top-down (BERT)	Standard Parseval (Full)	46.6	# 15
Discourse Parsing	RST-DT	Bottom-up (XLNet)	Standard Parseval (Nuclearity)	65.9	# 6
Discourse Parsing	RST-DT	Bottom-up (XLNet)	Standard Parseval (Relation)	56.3	# 4
Discourse Parsing	RST-DT	Bottom-up (XLNet)	Standard Parseval (Full)	54.2	# 4
Discourse Parsing	RST-DT	Top-down (SpanBERT)	Standard Parseval (Span)	76.5	# 4
Discourse Parsing	RST-DT	Top-down (SpanBERT)	Standard Parseval (Nuclearity)	65.4	# 7
Discourse Parsing	RST-DT	Top-down (SpanBERT)	Standard Parseval (Relation)	54.5	# 8
Discourse Parsing	RST-DT	Top-down (SpanBERT)	Standard Parseval (Full)	52.2	# 8
Discourse Parsing	RST-DT	Bottom-up (RoBERTa)	Standard Parseval (Span)	76.1	# 5
Discourse Parsing	RST-DT	Bottom-up (RoBERTa)	Standard Parseval (Nuclearity)	66.5	# 5
Discourse Parsing	RST-DT	Bottom-up (RoBERTa)	Standard Parseval (Relation)	55.4	# 6
Discourse Parsing	RST-DT	Bottom-up (RoBERTa)	Standard Parseval (Full)	53.7	# 6
Discourse Parsing	RST-DT	Top-down (RoBERTa)	Standard Parseval (Span)	77.3	# 3
Discourse Parsing	RST-DT	Top-down (RoBERTa)	Standard Parseval (Nuclearity)	66.6	# 4
Discourse Parsing	RST-DT	Top-down (RoBERTa)	Standard Parseval (Relation)	55.8	# 5
Discourse Parsing	RST-DT	Top-down (RoBERTa)	Standard Parseval (Full)	53.8	# 5
Discourse Parsing	RST-DT	Bottom-up (BERT)	Standard Parseval (Span)	68.3	# 16
Discourse Parsing	RST-DT	Bottom-up (BERT)	Standard Parseval (Nuclearity)	57.8	# 18
Discourse Parsing	RST-DT	Bottom-up (BERT)	Standard Parseval (Relation)	47.8	# 14
Discourse Parsing	RST-DT	Bottom-up (BERT)	Standard Parseval (Full)	46.0	# 16

Badge	Markdown
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/a-simple-and-strong-baseline-for-end-to-end/discourse-parsing-on-instructional-dt-instr)](https://paperswithcode.com/sota/discourse-parsing-on-instructional-dt-instr?p=a-simple-and-strong-baseline-for-end-to-end)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/a-simple-and-strong-baseline-for-end-to-end/discourse-parsing-on-rst-dt)](https://paperswithcode.com/sota/discourse-parsing-on-rst-dt?p=a-simple-and-strong-baseline-for-end-to-end)`

A Simple and Strong Baseline for End-to-End Neural RST-style Discourse Parsing

15 Oct 2022 · Naoki Kobayashi, Tsutomu Hirao, Hidetaka Kamigaito, Manabu Okumura, Masaaki Nagata ·

To promote and further develop RST-style discourse parsing models, we need a strong baseline that can be regarded as a reference for reporting reliable experimental results. This paper explores a strong baseline by integrating existing simple parsing strategies, top-down and bottom-up, with various transformer-based pre-trained language models. The experimental results obtained from two benchmark datasets demonstrate that the parsing performance strongly relies on the pretrained language models rather than the parsing strategies. In particular, the bottom-up parser achieves large performance gains compared to the current best parser when employing DeBERTa. We further reveal that language models with a span-masking scheme especially boost the parsing performance through our analysis within intra- and multi-sentential parsing, and nuclearity prediction.

PDF Abstract

Code

Add Remove Mark official

nttcslab-nlp/rstparser_emnlp22 official

Tasks

Add Remove

Discourse Parsing

Datasets

RST-DT Instructional-DT (Instr-DT)

Results from the Paper

Edit

Ranked #1 on Discourse Parsing on Instructional-DT (Instr-DT)

Get a GitHub badge

Task	Dataset	Model	Metric Name	Metric Value	Global Rank	Benchmark
Discourse Parsing	Instructional-DT (Instr-DT)	Bottom-up (DeBERTa)	Standard Parseval (Span)	77.8	# 1	Compare
			Standard Parseval (Nuclearity)	60.0	# 1	Compare
			Standard Parseval (Relation)	51.4	# 1	Compare
			Standard Parseval (Full)	44.4	# 1	Compare
Discourse Parsing	Instructional-DT (Instr-DT)	Bottom-up (SpanBERT)	Standard Parseval (Span)	72.9	# 8	Compare
			Standard Parseval (Nuclearity)	53.8	# 8	Compare
			Standard Parseval (Relation)	46.0	# 7	Compare
			Standard Parseval (Full)	40.5	# 6	Compare
Discourse Parsing	Instructional-DT (Instr-DT)	Bottom-up (XLNet)	Standard Parseval (Span)	73.6	# 6	Compare
			Standard Parseval (Nuclearity)	56.4	# 3	Compare
			Standard Parseval (Relation)	47.4	# 5	Compare
			Standard Parseval (Full)	40.7	# 5	Compare
Discourse Parsing	Instructional-DT (Instr-DT)	Bottom-up (RoBERTa)	Standard Parseval (Span)	73.2	# 7	Compare
			Standard Parseval (Nuclearity)	55.5	# 5	Compare
			Standard Parseval (Relation)	47.9	# 4	Compare
			Standard Parseval (Full)	41.4	# 4	Compare
Discourse Parsing	Instructional-DT (Instr-DT)	Bottom-up (BERT)	Standard Parseval (Span)	66.6	# 9	Compare
			Standard Parseval (Nuclearity)	46.3	# 10	Compare
			Standard Parseval (Relation)	39.5	# 9	Compare
			Standard Parseval (Full)	32.9	# 9	Compare
Discourse Parsing	Instructional-DT (Instr-DT)	Top-down (DeBERTa)	Standard Parseval (Span)	77.3	# 2	Compare
			Standard Parseval (Nuclearity)	57.9	# 2	Compare
			Standard Parseval (Relation)	50.0	# 2	Compare
			Standard Parseval (Full)	43.4	# 2	Compare
Discourse Parsing	Instructional-DT (Instr-DT)	Top-down (SpanBERT)	Standard Parseval (Span)	73.7	# 5	Compare
			Standard Parseval (Nuclearity)	54.5	# 7	Compare
			Standard Parseval (Relation)	42.7	# 8	Compare
			Standard Parseval (Full)	36.7	# 8	Compare
Discourse Parsing	Instructional-DT (Instr-DT)	Top-down (XLNet)	Standard Parseval (Span)	74.3	# 4	Compare
			Standard Parseval (Nuclearity)	55.2	# 6	Compare
			Standard Parseval (Relation)	47.0	# 6	Compare
			Standard Parseval (Full)	40.2	# 7	Compare
Discourse Parsing	Instructional-DT (Instr-DT)	Top-down (RoBERTa)	Standard Parseval (Span)	75.7	# 3	Compare
			Standard Parseval (Nuclearity)	56.1	# 4	Compare
			Standard Parseval (Relation)	48.7	# 3	Compare
			Standard Parseval (Full)	41.5	# 3	Compare
Discourse Parsing	Instructional-DT (Instr-DT)	Top-down (BERT)	Standard Parseval (Span)	65.3	# 11	Compare
			Standard Parseval (Nuclearity)	44.6	# 11	Compare
			Standard Parseval (Relation)	37.6	# 10	Compare
			Standard Parseval (Full)	30.9	# 10	Compare
Discourse Parsing	RST-DT	Top-down (XLNet)	Standard Parseval (Span)	77.8	# 2	Compare
			Standard Parseval (Nuclearity)	67.4	# 3	Compare
			Standard Parseval (Relation)	57.0	# 2	Compare
			Standard Parseval (Full)	54.8	# 2	Compare
Discourse Parsing	RST-DT	Bottom-up (DeBERTa)	Standard Parseval (Nuclearity)	68.0	# 1	Compare
			Standard Parseval (Relation)	57.3	# 1	Compare
			Standard Parseval (Full)	55.4	# 1	Compare
Discourse Parsing	RST-DT	Top-down (DeBERTa)	Standard Parseval (Span)	78.5	# 1	Compare
			Standard Parseval (Nuclearity)	67.9	# 2	Compare
			Standard Parseval (Relation)	56.6	# 3	Compare
			Standard Parseval (Full)	54.4	# 3	Compare
Discourse Parsing	RST-DT	Bottom-up (SpanBERT)	Standard Parseval (Nuclearity)	65.3	# 8	Compare
			Standard Parseval (Relation)	54.9	# 7	Compare
			Standard Parseval (Full)	52.7	# 7	Compare
Discourse Parsing	RST-DT	Top-down (BERT)	Standard Parseval (Span)	69.8	# 15	Compare
			Standard Parseval (Nuclearity)	59.1	# 17	Compare
			Standard Parseval (Relation)	48.3	# 13	Compare
			Standard Parseval (Full)	46.6	# 15	Compare
Discourse Parsing	RST-DT	Bottom-up (XLNet)	Standard Parseval (Nuclearity)	65.9	# 6	Compare
			Standard Parseval (Relation)	56.3	# 4	Compare
			Standard Parseval (Full)	54.2	# 4	Compare
Discourse Parsing	RST-DT	Top-down (SpanBERT)	Standard Parseval (Span)	76.5	# 4	Compare
			Standard Parseval (Nuclearity)	65.4	# 7	Compare
			Standard Parseval (Relation)	54.5	# 8	Compare
			Standard Parseval (Full)	52.2	# 8	Compare
Discourse Parsing	RST-DT	Bottom-up (RoBERTa)	Standard Parseval (Span)	76.1	# 5	Compare
			Standard Parseval (Nuclearity)	66.5	# 5	Compare
			Standard Parseval (Relation)	55.4	# 6	Compare
			Standard Parseval (Full)	53.7	# 6	Compare
Discourse Parsing	RST-DT	Top-down (RoBERTa)	Standard Parseval (Span)	77.3	# 3	Compare
			Standard Parseval (Nuclearity)	66.6	# 4	Compare
			Standard Parseval (Relation)	55.8	# 5	Compare
			Standard Parseval (Full)	53.8	# 5	Compare
Discourse Parsing	RST-DT	Bottom-up (BERT)	Standard Parseval (Span)	68.3	# 16	Compare
			Standard Parseval (Nuclearity)	57.8	# 18	Compare
			Standard Parseval (Relation)	47.8	# 14	Compare
			Standard Parseval (Full)	46.0	# 16	Compare

Methods

Add Remove

DeBERTa • Disentangled Attention Mechanism

Edit Social Preview

A Simple and Strong Baseline for End-to-End Neural RST-style Discourse Parsing

Code Edit Add Remove Mark official

Tasks Edit Add Remove

Datasets Edit

Results from the Paper Edit

Methods Edit Add Remove

Code

Add Remove Mark official

Tasks

Add Remove

Datasets

Results from the Paper

Edit

Methods

Add Remove