no code implementations • 15 Sep 2023 • Bernhard Bermeitinger, Tomas Hrycej, Siegfried Handschuh
A stack of residual connection layers can be expressed as an expansion of terms similar to the Taylor expansion.
no code implementations • 15 Sep 2022 • Tomas Hrycej, Bernhard Bermeitinger, Siegfried Handschuh
Determining an appropriate number of attention heads on one hand and the number of transformer-encoders, on the other hand, is an important choice for Computer Vision (CV) tasks using the Transformer architecture.
no code implementations • 15 Sep 2022 • Tomas Hrycej, Bernhard Bermeitinger, Siegfried Handschuh
For strongly nonlinear tasks, both algorithm classes find only solutions fairly poor in terms of mean square error as related to the output variance.
no code implementations • 7 Jan 2020 • Simon Donig, Maria Christoforaki, Bernhard Bermeitinger, Siegfried Handschuh
In the last years, image classification processes like neural networks in the area of art-history and Heritage Informatics have experienced a broad distribution (Lang and Ommer 2018).
no code implementations • 19 Jul 2019 • Bernhard Bermeitinger, Tomas Hrycej, Siegfried Handschuh
This does not directly contradict the theoretical findings---it is possible that the superior representational capacity of deep networks is genuine while finding the mean square minimum of such deep networks is a substantially harder problem than with shallow ones.
no code implementations • 27 Jun 2019 • Bernhard Bermeitinger, Tomas Hrycej, Siegfried Handschuh
Singular Value Decomposition (SVD) constitutes a bridge between the linear algebra concepts and multi-layer neural networks---it is their linear analogy.
no code implementations • 13 Oct 2017 • Bernhard Bermeitinger, Maria Christoforaki, Simon Donig, Siegfried Handschuh
In this paper, we report on our efforts for using Deep Learning for classifying artifacts and their features in digital visuals as a part of the Neoclassica framework.
no code implementations • COLING 2016 • Christina Niklaus, Bernhard Bermeitinger, Siegfried Handschuh, André Freitas
In this demo paper, we present a text simplification approach that is directed at improving the performance of state-of-the-art Open Relation Extraction (RE) systems.
no code implementations • 7 Mar 2017 • Bernhard Bermeitinger, André Freitas, Simon Donig, Siegfried Handschuh
This short paper outlines research results on object classification in images of Neoclassical furniture.