Search Results for author: Tilo Burghardt

Found 33 papers, 18 papers with code

ChimpVLM: Ethogram-Enhanced Chimpanzee Behaviour Recognition

no code implementations13 Apr 2024 Otto Brookes, Majid Mirmehdi, Hjalmar Kuhl, Tilo Burghardt

We show that chimpanzee behaviour understanding from camera traps can be enhanced by providing visual architectures with access to an embedding of text descriptions that detail species behaviours.

Language Modelling

RBF-PINN: Non-Fourier Positional Embedding in Physics-Informed Neural Networks

1 code implementation13 Feb 2024 Chengxi Zeng, Tilo Burghardt, Alberto M Gambaruto

While many recent Physics-Informed Neural Networks (PINNs) variants have had considerable success in solving Partial Differential Equations, the empirical benefits of feature mapping drawn from the broader Neural Representations research have been largely overlooked.

Training dynamics in Physics-Informed Neural Networks with feature mapping

1 code implementation10 Feb 2024 Chengxi Zeng, Tilo Burghardt, Alberto M Gambaruto

Physics-Informed Neural Networks (PINNs) have emerged as an iconic machine learning approach for solving Partial Differential Equations (PDEs).

Diving with Penguins: Detecting Penguins and their Prey in Animal-borne Underwater Videos via Deep Learning

1 code implementation14 Aug 2023 Kejia Zhang, Mingyu Yang, Stephen D. J. Lang, Alistair M. McInnes, Richard B. Sherley, Tilo Burghardt

In this paper, we publish an animal-borne underwater video dataset of penguins and introduce a ready-to-deploy deep learning system capable of robustly detecting penguins (mAP50@98. 0%) and also instances of fish (mAP50@73. 3%).

Deep Visual-Genetic Biometrics for Taxonomic Classification of Rare Species

1 code implementation11 May 2023 Tayfun Karaderi, Tilo Burghardt, Raphael Morard, Daniela Schmidt

We demonstrate for the first time that such alignment can be achieved via deep embedding models and that the approach is directly applicable to boosting long-tailed recognition (LTR) particularly for rare species.

Use Your Head: Improving Long-Tail Video Recognition

1 code implementation CVPR 2023 Toby Perrett, Saptarshi Sinha, Tilo Burghardt, Majid Mirmehdi, Dima Damen

We demonstrate that, unlike naturally-collected video datasets and existing long-tail image benchmarks, current video benchmarks fall short on multiple long-tailed properties.

Video Recognition

Video-TransUNet: Temporally Blended Vision Transformer for CT VFSS Instance Segmentation

2 code implementations17 Aug 2022 Chengxi Zeng, Xinyu Yang, Majid Mirmehdi, Alberto M Gambaruto, Tilo Burghardt

Our findings suggest that the proposed model can indeed enhance the TransUNet architecture via exploiting temporal information and improving segmentation performance by a significant margin.

Instance Segmentation Segmentation +1

Inertial Hallucinations -- When Wearable Inertial Devices Start Seeing Things

no code implementations14 Jul 2022 Alessandro Masullo, Toby Perrett, Tilo Burghardt, Ian Craddock, Dima Damen, Majid Mirmehdi

We propose a novel approach to multimodal sensor fusion for Ambient Assisted Living (AAL) which takes advantage of learning using privileged information (LUPI).

Hallucination Sensor Fusion

Towards Individual Grevy's Zebra Identification via Deep 3D Fitting and Metric Learning

1 code implementation5 Jun 2022 Maria Stennett, Daniel I. Rubenstein, Tilo Burghardt

This paper combines deep learning techniques for species detection, 3D model fitting, and metric learning in one pipeline to perform individual animal identification from photographs by exploiting unique coat patterns.

Metric Learning

Dynamic Curriculum Learning for Great Ape Detection in the Wild

1 code implementation30 Apr 2022 Xinyu Yang, Tilo Burghardt, Majid Mirmehdi

We propose a novel end-to-end curriculum learning approach for sparsely labelled animal datasets leveraging large volumes of unlabelled data to improve supervised species detectors.

object-detection Object Detection

Label a Herd in Minutes: Individual Holstein-Friesian Cattle Identification

1 code implementation22 Apr 2022 Jing Gao, Tilo Burghardt, Neill W. Campbell

In particular, for the task of automatic identification of individual Holstein-Friesians in real-world farm CCTV, we show that self-supervision, metric learning, cluster analysis, and active learning can complement each other to significantly reduce the annotation requirements usually needed to train cattle identification frameworks.

Active Learning Metric Learning

Visual Microfossil Identification via Deep Metric Learning

1 code implementation17 Dec 2021 Tayfun Karaderi, Tilo Burghardt, Allison Y. Hsiang, Jacob Ramaer, Daniela N. Schmidt

We show that metric learning outperforms all published CNN-based state-of-the-art benchmarks in this domain.

Metric Learning

Small or Far Away? Exploiting Deep Super-Resolution and Altitude Data for Aerial Animal Surveillance

1 code implementation12 Nov 2021 Mowen Xue, Theo Greenslade, Majid Mirmehdi, Tilo Burghardt

In particular, we show that the integration of a holistic attention network based super-resolution approach and a custom-built altitude data exploitation network into standard recognition pipelines can considerably increase the detection efficacy in real-world settings.

Super-Resolution

Towards Self-Supervision for Video Identification of Individual Holstein-Friesian Cattle: The Cows2021 Dataset

2 code implementations5 May 2021 Jing Gao, Tilo Burghardt, William Andrew, Andrew W. Dowsey, Neill W. Campbell

Motivated by the labelling burden involved in constructing visual cattle identification systems, we propose exploiting the temporal coat pattern appearance across videos as a self-supervision signal for animal identity learning.

Contrastive Learning

A Dataset and Application for Facial Recognition of Individual Gorillas in Zoo Environments

no code implementations8 Dec 2020 Otto Brookes, Tilo Burghardt

We put forward a video dataset with 5k+ facial bounding box annotations across a troop of 7 western lowland gorillas at Bristol Zoo Gardens.

Visual Recognition of Great Ape Behaviours in the Wild

1 code implementation21 Nov 2020 Faizaan Sakib, Tilo Burghardt

We propose a first great ape-specific visual behaviour recognition system utilising deep learning that is capable of detecting nine core ape behaviours.

Back to the Future: Cycle Encoding Prediction for Self-supervised Contrastive Video Representation Learning

1 code implementation14 Oct 2020 Xinyu Yang, Majid Mirmehdi, Tilo Burghardt

In this paper we show that learning video feature spaces in which temporal cycles are maximally predictable benefits action classification.

Action Classification Action Recognition +1

Meta-Learning with Context-Agnostic Initialisations

1 code implementation29 Jul 2020 Toby Perrett, Alessandro Masullo, Tilo Burghardt, Majid Mirmehdi, Dima Damen

This produces an initialisation for fine-tuning to target which is both context-agnostic and task-generalised.

Meta-Learning

Visual Identification of Individual Holstein-Friesian Cattle via Deep Metric Learning

2 code implementations16 Jun 2020 William Andrew, Jing Gao, Siobhan Mullan, Neill Campbell, Andrew W Dowsey, Tilo Burghardt

Holstein-Friesian cattle exhibit individually-characteristic black and white coat patterns visually akin to those arising from Turing's reaction-diffusion systems.

Metric Learning

Sit-to-Stand Analysis in the Wild using Silhouettes for Longitudinal Health Monitoring

no code implementations3 Oct 2019 Alessandro Masullo, Tilo Burghardt, Toby Perrett, Dima Damen, Majid Mirmehdi

We present the first fully automated Sit-to-Stand or Stand-to-Sit (StS) analysis framework for long-term monitoring of patients in free-living environments using video silhouettes.

STS

Aerial Animal Biometrics: Individual Friesian Cattle Recovery and Visual Identification via an Autonomous UAV with Onboard Deep Inference

no code implementations11 Jul 2019 William Andrew, Colin Greatwood, Tilo Burghardt

This paper describes a computationally-enhanced M100 UAV platform with an onboard deep learning inference system for integrated computer vision and navigation able to autonomously find and visually identify by coat pattern individual Holstein Friesian cattle in freely moving herds.

TAG

DeepKey: Towards End-to-End Physical Key Replication From a Single Photograph

no code implementations4 Nov 2018 Rory Smith, Tilo Burghardt

This paper describes DeepKey, an end-to-end deep neural architecture capable of taking a digital RGB image of an 'everyday' scene containing a pin tumbler key (e. g. lying on a table or carpet) and fully automatically inferring a printable 3D key model.

Key Detection

CaloriNet: From silhouettes to calorie estimation in private environments

no code implementations21 Jun 2018 Alessandro Masullo, Tilo Burghardt, Dima Damen, Sion Hannuna, Victor Ponce-López, Majid Mirmehdi

We propose a novel deep fusion architecture, CaloriNet, for the online estimation of energy expenditure for free living monitoring in private environments, where RGB data is discarded and replaced by silhouettes.

Semantically Selective Augmentation for Deep Compact Person Re-Identification

no code implementations11 Jun 2018 Víctor Ponce-López, Tilo Burghardt, Sion Hannunna, Dima Damen, Alessandro Masullo, Majid Mirmehdi

We present a deep person re-identification approach that combines semantically selective, deep data augmentation with clustering-based network compression to generate high performance, light and fast inference networks.

Clustering Data Augmentation +3

Automated Visual Fin Identification of Individual Great White Sharks

no code implementations20 Sep 2016 Benjamin Hughes, Tilo Burghardt

To the best of our knowledge this line of work establishes the first fully automated contour-based visual ID system in the field of animal biometrics.

Calorie Counter: RGB-Depth Visual Estimation of Energy Expenditure at Home

no code implementations27 Jul 2016 Lili Tao, Tilo Burghardt, Majid Mirmehdi, Dima Damen, Ashley Cooper, Sion Hannuna, Massimo Camplani, Adeline Paiement, Ian Craddock

We present a new framework for vision-based estimation of calorific expenditure from RGB-D data - the first that is validated on physical gas exchange measurements and applied to daily living scenarios.

Multiple Human Tracking in RGB-D Data: A Survey

no code implementations14 Jun 2016 Massimo Camplani, Adeline Paiement, Majid Mirmehdi, Dima Damen, Sion Hannuna, Tilo Burghardt, Lili Tao

Finally, we present a brief comparative evaluation of the performance of those works that have applied their methods to these datasets.

Cannot find the paper you are looking for? You can Submit a new open access paper.