no code implementations • 8 Mar 2021 • Tuomo Hiippala, John A. Bateman
In this article, we bring together theories of multimodal communication and computational methods to study how primary school science diagrams combine multiple expressive resources.
no code implementations • 30 Jan 2020 • Tuomo Hiippala, John A. Bateman
As the use and diversity of diagrams across many disciplines grows, there is an increasing interest in the diagrams research community concerning how such diversity might be documented and explained.
no code implementations • 9 Dec 2019 • Tuomo Hiippala, Malihe Alikhani, Jonas Haverinen, Timo Kalliokoski, Evanfiya Logacheva, Serafina Orekhova, Aino Tuomainen, Matthew Stone, John A. Bateman
This article introduces AI2D-RST, a multimodal corpus of 1000 English-language diagrams that represent topics in primary school natural sciences, such as food webs, life cycles, moon phases and human physiology.