Search Results for author: Joseph Ortiz

Found 12 papers, 7 papers with code

DMC-VB: A Benchmark for Representation Learning for Control with Visual Distractors

1 code implementation26 Sep 2024 Joseph Ortiz, Antoine Dedieu, Wolfgang Lehrach, Swaroop Guntupalli, Carter Wendelken, Ahmad Humayun, Guangyao Zhou, Sivaramakrishnan Swaminathan, Miguel Lázaro-Gredilla, Kevin Murphy

In this paper, we present theDeepMind Control Visual Benchmark (DMC-VB), a dataset collected in the DeepMind Control Suite to evaluate the robustness of offline RL agents for solving continuous control tasks from visual input in the presence of visual distractors.

Continuous Control Offline RL +2

A Touch, Vision, and Language Dataset for Multimodal Alignment

1 code implementation20 Feb 2024 Letian Fu, Gaurav Datta, Huang Huang, William Chung-Ho Panitch, Jaimyn Drake, Joseph Ortiz, Mustafa Mukadam, Mike Lambeta, Roberto Calandra, Ken Goldberg

This is partially due to the difficulty of obtaining natural language labels for tactile data and the complexity of aligning tactile readings with both visual observations and language descriptions.

Language Modelling Text Generation

Decentralization and Acceleration Enables Large-Scale Bundle Adjustment

1 code implementation11 May 2023 Taosha Fan, Joseph Ortiz, Ming Hsiao, Maurizio Monge, Jing Dong, Todd Murphey, Mustafa Mukadam

In this paper, we present a fully decentralized method that alleviates computation and communication bottlenecks to solve arbitrarily large bundle adjustment problems.

Theseus: A Library for Differentiable Nonlinear Optimization

1 code implementation19 Jul 2022 Luis Pineda, Taosha Fan, Maurizio Monge, Shobha Venkataraman, Paloma Sodhi, Ricky T. Q. Chen, Joseph Ortiz, Daniel DeTone, Austin Wang, Stuart Anderson, Jing Dong, Brandon Amos, Mustafa Mukadam

We present Theseus, an efficient application-agnostic open source library for differentiable nonlinear least squares (DNLS) optimization built on PyTorch, providing a common framework for end-to-end structured learning in robotics and vision.

A Robot Web for Distributed Many-Device Localisation

no code implementations7 Feb 2022 Riku Murai, Joseph Ortiz, Sajad Saeedi, Paul H. J. Kelly, Andrew J. Davison

We show that a distributed network of robots or other devices which make measurements of each other can collaborate to globally localise via efficient ad-hoc peer to peer communication.

Incremental Abstraction in Distributed Probabilistic SLAM Graphs

no code implementations13 Sep 2021 Joseph Ortiz, Talfan Evans, Edgar Sucar, Andrew J. Davison

Scene graphs represent the key components of a scene in a compact and semantically rich way, but are difficult to build during incremental SLAM operation because of the challenges of robustly identifying abstract scene elements and optimising continually changing, complex graphs.

A visual introduction to Gaussian Belief Propagation

no code implementations5 Jul 2021 Joseph Ortiz, Talfan Evans, Andrew J. Davison

In this article, we present a visual introduction to Gaussian Belief Propagation (GBP), an approximate probabilistic inference algorithm that operates by passing messages between the nodes of arbitrarily structured factor graphs.

iMAP: Implicit Mapping and Positioning in Real-Time

4 code implementations ICCV 2021 Edgar Sucar, Shikun Liu, Joseph Ortiz, Andrew J. Davison

We show for the first time that a multilayer perceptron (MLP) can serve as the only scene representation in a real-time SLAM system for a handheld RGB-D camera.

Bundle Adjustment on a Graph Processor

1 code implementation CVPR 2020 Joseph Ortiz, Mark Pupilli, Stefan Leutenegger, Andrew J. Davison

Graph processors such as Graphcore's Intelligence Processing Unit (IPU) are part of the major new wave of novel computer architecture for AI, and have a general design with massively parallel computation, distributed on-chip memory and very high inter-core communication bandwidth which allows breakthrough performance for message passing algorithms on arbitrary graphs.

FutureMapping 2: Gaussian Belief Propagation for Spatial AI

no code implementations30 Oct 2019 Andrew J. Davison, Joseph Ortiz

We argue the case for Gaussian Belief Propagation (GBP) as a strong algorithmic framework for the distributed, generic and incremental probabilistic estimation we need in Spatial AI as we aim at high performance smart robots and devices which operate within the constraints of real products.

Cannot find the paper you are looking for? You can Submit a new open access paper.