Search Results for author: Shiki Sato

Found 5 papers, 3 papers with code

Bipartite-play Dialogue Collection for Practical Automatic Evaluation of Dialogue Systems

no code implementations19 Nov 2022 Shiki Sato, Yosuke Kishinami, Hiroaki Sugiyama, Reina Akama, Ryoko Tokuhisa, Jun Suzuki

Automation of dialogue system evaluation is a driving force for the efficient development of dialogue systems.

Target-Guided Open-Domain Conversation Planning

1 code implementation COLING 2022 Yosuke Kishinami, Reina Akama, Shiki Sato, Ryoko Tokuhisa, Jun Suzuki, Kentaro Inui

Prior studies addressing target-oriented conversational tasks lack a crucial notion that has been intensively studied in the context of goal-oriented artificial intelligence agents, namely, planning.

Retrieval

N-best Response-based Analysis of Contradiction-awareness in Neural Response Generation Models

1 code implementation SIGDIAL (ACL) 2022 Shiki Sato, Reina Akama, Hiroki Ouchi, Ryoko Tokuhisa, Jun Suzuki, Kentaro Inui

In this scenario, the quality of the n-best list considerably affects the occurrence of contradictions because the final response is chosen from this n-best list.

Response Generation

Evaluating Dialogue Generation Systems via Response Selection

1 code implementation ACL 2020 Shiki Sato, Reina Akama, Hiroki Ouchi, Jun Suzuki, Kentaro Inui

Existing automatic evaluation metrics for open-domain dialogue response generation systems correlate poorly with human evaluation.

Dialogue Generation Response Generation

Cannot find the paper you are looking for? You can Submit a new open access paper.