Search Results for author:
Found 37 papers, 12 papers with code
RefFusion: Reference Adapted Diffusion Models for 3D Scene Inpainting
In this work, we propose an approach for 3D scene inpainting -- the task of coherently replacing parts of the reconstructed scene with desired content.
Producing and Leveraging Online Map Uncertainty in Trajectory Prediction
High-definition (HD) maps have played an integral role in the development of modern autonomous vehicle (AV) stacks, albeit with high associated labeling and maintenance costs.
Vid2Robot: End-to-end Video-conditioned Policy Learning with Cross-Attention Transformers
Given a video demonstration of a manipulation task and current visual observations, Vid2Robot directly produces robot actions.
Dissecting Deep RL with High Update Ratios: Combatting Value Overestimation and Divergence
We show that deep reinforcement learning can maintain its ability to learn without resetting network parameters in settings where the number of gradient updates greatly exceeds the number of environment samples.
SPAD : Spatially Aware Multiview Diffusers
We present SPAD, a novel approach for creating consistent multi-view images from text prompts or single images.
AToM: Amortized Text-to-Mesh using 2D Diffusion
We introduce Amortized Text-to-Mesh (AToM), a feed-forward text-to-mesh framework optimized across multiple text prompts simultaneously.
LEOD: Label-Efficient Object Detection for Event Cameras
On 1Mpx, RVT-S with 10% labels even surpasses its fully-supervised counterpart using 100% labels.
Reconstructive Latent-Space Neural Radiance Fields for Efficient 3D Scene Representations
The resulting latent-space NeRF can produce novel views with higher quality than standard colour-space NeRFs, as the AE can correct certain visual artifacts, while rendering over three times faster.
iNVS: Repurposing Diffusion Inpainters for Novel View Synthesis
Our approach focuses on maximizing the reuse of visible pixels from the source image.
Watch Your Steps: Local Image and Scene Editing by Text Instructions
A field is trained on relevance maps of training views, denoted as the relevance field, defining the 3D region within which modifications should be made.
trajdata: A Unified Interface to Multiple Human Trajectory Datasets
The field of trajectory forecasting has grown significantly in recent years, partially owing to the release of numerous large-scale, real-world human trajectory datasets for autonomous vehicles (AVs) and pedestrian motion tracking.
$λ$-models: Effective Decision-Aware Reinforcement Learning with Latent Models
The idea of decision-aware model learning, that models should be accurate where it matters for decision-making, has gained prominence in model-based reinforcement learning.
EventCLIP: Adapting CLIP for Event-based Object Recognition
Recent advances in zero-shot and few-shot classification heavily rely on the success of pre-trained vision-language models (VLMs) such as CLIP.
SlotDiffusion: Object-Centric Generative Modeling with Diffusion Models
Finally, we demonstrate the scalability of SlotDiffusion to unconstrained real-world datasets such as PASCAL VOC and COCO, when integrated with self-supervised pre-trained image encoders.
Reference-guided Controllable Inpainting of Neural Radiance Fields
The popularity of Neural Radiance Fields (NeRFs) for view synthesis has led to a desire for NeRF editing tools.
CAMM: Building Category-Agnostic and Animatable 3D Models from Monocular Videos
Animating an object in 3D often requires an articulated structure, e. g. a kinematic chain or skeleton of the manipulated object with proper skinning weights, to obtain smooth movements and surface deformations.
Invertible Neural Skinning
Next, we combine PIN with a differentiable LBS module to build an expressive and end-to-end Invertible Neural Skinning (INS) pipeline.
Building Scalable Video Understanding Benchmarks through Sports
Our human studies indicate that ASAP can align videos and annotations with high fidelity, precision, and speed.
SparsePose: Sparse-View Camera Pose Regression and Refinement
Camera pose estimation is a key step in standard 3D reconstruction pipelines that operate on a dense set of images of a single object or scene.
SPIn-NeRF: Multiview Segmentation and Perceptual Inpainting with Neural Radiance Fields
We refer to this task as 3D inpainting.
Solving Continuous Control via Q-learning
While there has been substantial success for solving continuous control with actor-critic methods, simpler critic-only methods such as Q-learning find limited application in the associated high-dimensional action spaces.
See, Plan, Predict: Language-guided Cognitive Planning with Video Prediction
Cognitive planning is the structural decomposition of complex tasks into a sequence of future behaviors.
LaTeRF: Label and Text Driven Object Radiance Fields
In this paper we introduce LaTeRF, a method for extracting an object of interest from a scene given 2D images of the entire scene, known camera poses, a natural language description of the object, and a set of point-labels of object and non-object points in the input images.
Housekeep: Tidying Virtual Households using Commonsense Reasoning
Instead, the agent must learn from and is evaluated against human preferences of which objects belong where in a tidy house.
Neighborhood Mixup Experience Replay: Local Convex Interpolation for Improved Sample Efficiency in Continuous Control Tasks
Experience replay plays a crucial role in improving the sample efficiency of deep reinforcement learning agents.
Learning Interactive Driving Policies via Data-driven Simulation
Data-driven simulators promise high data-efficiency for driving policy learning.
VISTA 2.0: An Open, Data-driven Simulator for Multimodal Sensing and Policy Learning for Autonomous Vehicles
Simulation has the potential to transform the development of robust algorithms for mobile agents deployed in safety-critical scenarios.
Is Bang-Bang Control All You Need? Solving Continuous Control with Bernoulli Policies
Reinforcement learning (RL) for continuous control typically employs distributions whose support covers the entire action space.
HYPER: Learned Hybrid Trajectory Prediction via Factored Inference and Adaptive Sampling
Modeling multi-modal high-level intent is important for ensuring diversity in trajectory prediction.
Deep Latent Competition: Learning to Race Using Visual Control Policies in Latent Space
We demonstrate the effectiveness of our algorithm in learning competitive behaviors on a novel multi-agent racing benchmark that requires planning from image observations.
Deep Orientation Uncertainty Learning based on a Bingham Loss
Reasoning about uncertain orientations is one of the core problems in many perception tasks such as object pose estimation or motion estimation.
Deep Context Maps: Agent Trajectory Prediction using Location-specific Latent Maps
Our main contribution is the concept of learning context maps to improve the prediction task.
SiPPing Neural Networks: Sensitivity-informed Provable Pruning of Neural Networks
We introduce a pruning algorithm that provably sparsifies the parameters of a trained model in a way that approximately preserves the model's predictive accuracy.
LandmarkBoost: Efficient Visual Context Classifiers for Robust Localization
We propose LandmarkBoost - an approach that, in contrast to the conventional 2D-3D matching methods, casts the search problem as a landmark classification task.
Data-Dependent Coresets for Compressing Neural Networks with Applications to Generalization Bounds
We present an efficient coresets-based neural network compression algorithm that sparsifies the parameters of a trained fully-connected neural network in a manner that provably approximates the network's output.
Directional Statistics and Filtering Using libDirectional
In this paper, we present libDirectional, a MATLAB library for directional statistics and directional estimation.
maplab: An Open Framework for Research in Visual-inertial Mapping and Localization
On the other hand, maplab provides the research community with a collection of multisession mapping tools that include map merging, visual-inertial batch optimization, and loop closure.
Robotics
