Search Results for author: Hermann Blum

Found 16 papers, 7 papers with code

"Where am I?" Scene Retrieval with Language

no code implementations22 Apr 2024 Jiaqi Chen, Daniel Barath, Iro Armeni, Marc Pollefeys, Hermann Blum

As such, we need methods that interface between natural language and map representations of the environment.

Retrieval

Spot-Compose: A Framework for Open-Vocabulary Object Retrieval and Drawer Manipulation in Point Clouds

no code implementations18 Apr 2024 Oliver Lemke, Zuria Bauer, René Zurbrügg, Marc Pollefeys, Francis Engelmann, Hermann Blum

This allows for accurate detection directly in 3D scenes, object- and environment-aware grasp prediction, as well as robust and repeatable robotic manipulation.

3D Instance Segmentation Pose Estimation +3

LABELMAKER: Automatic Semantic Label Generation from RGB-D Trajectories

no code implementations20 Nov 2023 Silvan Weder, Hermann Blum, Francis Engelmann, Marc Pollefeys

Semantic annotations are indispensable to train or evaluate perception models, yet very costly to acquire.

Neural Rendering

Active Visual Localization for Multi-Agent Collaboration: A Data-Driven Approach

no code implementations4 Oct 2023 Matthew Hanlon, Boyang Sun, Marc Pollefeys, Hermann Blum

However, localizing e. g. a ground robot in the map of a drone or head-mounted MR headset presents unique challenges due to viewpoint changes.

Visual Localization

Unsupervised Continual Semantic Adaptation through Neural Rendering

1 code implementation CVPR 2023 Zhizheng Liu, Francesco Milano, Jonas Frey, Roland Siegwart, Hermann Blum, Cesar Cadena

Due to the mismatch between training and deployment data, adapting the model on the new scenes is often crucial to obtain good performance.

Neural Rendering Segmentation +3

SCIM: Simultaneous Clustering, Inference, and Mapping for Open-World Semantic Scene Understanding

1 code implementation21 Jun 2022 Hermann Blum, Marcus G. Müller, Abel Gawel, Roland Siegwart, Cesar Cadena

In order to operate in human environments, a robot's semantic perception has to overcome open-world challenges such as novel objects and domain gaps.

Clustering Object Discovery +3

See Yourself in Others: Attending Multiple Tasks for Own Failure Detection

no code implementations6 Oct 2021 Boyang Sun, Jiaxu Xing, Hermann Blum, Roland Siegwart, Cesar Cadena

The proposed framework infers task failures by evaluating the individual prediction, across multiple visual perception tasks for different regions in an image.

Depth Estimation Semantic Segmentation

Self-Improving Semantic Perception for Indoor Localisation

1 code implementation4 May 2021 Hermann Blum, Francesco Milano, René Zurbrügg, Roland Siegward, Cesar Cadena, Abel Gawel

We find memory replay an effective measure to reduce forgetting and show how the robotic system can improve even when switching between different environments.

2D Semantic Segmentation Continual Learning

SegmentMeIfYouCan: A Benchmark for Anomaly Segmentation

2 code implementations30 Apr 2021 Robin Chan, Krzysztof Lis, Svenja Uhlemeyer, Hermann Blum, Sina Honari, Roland Siegwart, Pascal Fua, Mathieu Salzmann, Matthias Rottmann

State-of-the-art semantic or instance segmentation deep neural networks (DNNs) are usually trained on a closed set of semantic classes.

Instance Segmentation Object +2

Pixel-wise Anomaly Detection in Complex Driving Scenes

1 code implementation CVPR 2021 Giancarlo Di Biase, Hermann Blum, Roland Siegwart, Cesar Cadena

The inability of state-of-the-art semantic segmentation methods to detect anomaly instances hinders them from being deployed in safety-critical and complex applications, such as autonomous driving.

Ranked #3 on Anomaly Detection on Lost and Found (using extra training data)

Anomaly Detection Autonomous Driving +2

The Hidden Uncertainty in a Neural Networks Activations

no code implementations5 Dec 2020 Janis Postels, Hermann Blum, Yannick Strümpler, Cesar Cadena, Roland Siegwart, Luc van Gool, Federico Tombari

We find that this leads to improved OOD detection of epistemic uncertainty at the cost of ambiguous calibration close to the data distribution.

Density Estimation Out of Distribution (OOD) Detection

A Fully-Integrated Sensing and Control System for High-Accuracy Mobile Robotic Building Construction

no code implementations4 Dec 2019 Abel Gawel, Hermann Blum, Johannes Pankert, Koen Krämer, Luca Bartolomei, Selen Ercan, Farbod Farshidian, Margarita Chli, Fabio Gramazio, Roland Siegwart, Marco Hutter, Timothy Sandy

We present a fully-integrated sensing and control system which enables mobile manipulator robots to execute building tasks with millimeter-scale accuracy on building construction sites.

Trajectory Planning

Learning Densities in Feature Space for Reliable Segmentation of Indoor Scenes

no code implementations1 Aug 2019 Nicolas Marchal, Charlotte Moraldo, Roland Siegwart, Hermann Blum, Cesar Cadena, Abel Gawel

Foreground objects are therefore detected as areas in an image for which the descriptors are unlikely given the background distribution.

Scene Understanding Semantic Segmentation

Modular Sensor Fusion for Semantic Segmentation

1 code implementation30 Jul 2018 Hermann Blum, Abel Gawel, Roland Siegwart, Cesar Cadena

Sensor fusion is a fundamental process in robotic systems as it extends the perceptual range and increases robustness in real-world operations.

Segmentation Semantic Segmentation +1

Cannot find the paper you are looking for? You can Submit a new open access paper.