Search Results for author:
Found 10 papers, 0 papers with code
Make Deep Networks Shallow Again
A stack of residual connection layers can be expressed as an expansion of terms similar to the Taylor expansion.
Number of Attention Heads vs Number of Transformer-Encoders in Computer Vision
Determining an appropriate number of attention heads on one hand and the number of transformer-encoders, on the other hand, is an important choice for Computer Vision (CV) tasks using the Transformer architecture.
Training Neural Networks in Single vs Double Precision
For strongly nonlinear tasks, both algorithm classes find only solutions fairly poor in terms of mean square error as related to the output variance.
Multimodal Semantic Transfer from Text to Image. Fine-Grained Image Classification by Distributional Semantics
In the last years, image classification processes like neural networks in the area of art-history and Heritage Informatics have experienced a broad distribution (Lang and Ommer 2018).
Representational Capacity of Deep Neural Networks -- A Computing Study
This does not directly contradict the theoretical findings---it is possible that the superior representational capacity of deep networks is genuine while finding the mean square minimum of such deep networks is a substantially harder problem than with shallow ones.
Singular Value Decomposition and Neural Networks
Singular Value Decomposition (SVD) constitutes a bridge between the linear algebra concepts and multi-layer neural networks---it is their linear analogy.
Object Classification in Images of Neoclassical Artifacts Using Deep Learning
In this paper, we report on our efforts for using Deep Learning for classifying artifacts and their features in digital visuals as a part of the Neoclassica framework.
A Sentence Simplification System for Improving Relation Extraction
In this demo paper, we present a text simplification approach that is directed at improving the performance of state-of-the-art Open Relation Extraction (RE) systems.
Object classification in images of Neoclassical furniture using Deep Learning
This short paper outlines research results on object classification in images of Neoclassical furniture.
