Search Results for author:
Found 34 papers, 14 papers with code
Tracking Different Ant Species: An Unsupervised Domain Adaptation Framework and a Dataset for Multi-object Tracking
This approach is built upon a joint-detection-and-tracking framework that is extended by a set of domain discriminator modules integrating an adversarial training strategy in addition to the tracking loss.
Predicting Topological Maps for Visual Navigation in Unexplored Environments
We propose a robotic learning system for autonomous exploration and navigation in unexplored environments.
ActiveRMAP: Radiance Field for Active Mapping And Planning
We, for the first time, present an RGB-only active vision framework using radiance field representation for active 3D reconstruction and planning in an online manner.
MARLIN: Masked Autoencoder for facial video Representation LearnINg
This paper proposes a self-supervised approach to learn universal facial representations from videos, that can transfer across a variety of facial analysis tasks such as Facial Attribute Recognition (FAR), Facial Expression Recognition (FER), DeepFake Detection (DFD), and Lip Synchronization (LS).
Unifying Flow, Stereo and Depth Estimation
We present a unified formulation and model for three motion and 3D perception tasks: optical flow, rectified stereo matching and unrectified stereo depth estimation from posed images.
Ranked #1 on
Optical Flow Estimation
on Sintel-clean
JRDB-Pose: A Large-scale Dataset for Multi-Person Pose Estimation and Tracking
In crowded human scenes with close-up human-robot interaction and robot navigation, a deep understanding requires reasoning about human motion and body dynamics over time with human body pose estimation and tracking.
Multi-Person Pose Estimation
Multi-Person Pose Estimation and Tracking
+1
LAVA: Label-efficient Visual Learning and Adaptation
We present LAVA, a simple yet effective method for multi-domain visual transfer learning with limited data.
SoMoFormer: Multi-Person Pose Forecasting with Transformers
Although there are several previous works targeting the problem of multi-person dynamic pose forecasting, they often model the entire pose sequence as time series (ignoring the underlying relationship between joints) or only output the future pose sequence of one person at a time.
Learning of Global Objective for Network Flow in Multi-Object Tracking
This paper concerns the problem of multi-object tracking based on the min-cost flow (MCF) formulation, which is conventionally studied as an instance of linear program.
Accurate and Real-time 3D Pedestrian Detection Using an Efficient Attentive Pillar Network
Efficiently and accurately detecting people from 3D point cloud data is of great importance in many robotic and autonomous driving applications.
Ranked #1 on
3D Object Detection
on KITTI Pedestrian
GMFlow: Learning Optical Flow via Global Matching
Learning-based optical flow estimation has been dominated with the pipeline of cost volume with convolutions for flow regression, which is inherently limited to local correlations and thus is hard to address the long-standing challenge of large displacements.
Guided-GAN: Adversarial Representation Learning for Activity Recognition with Wearables
Human activity recognition (HAR) is an important research field in ubiquitous computing where the acquisition of large-scale labeled sensor data is tedious, labor-intensive and time consuming.
ODAM: Object Detection, Association, and Mapping using Posed RGB Video
Localizing objects and estimating their extent in 3D is an important step towards high-level 3D scene understanding, which has many applications in Augmented Reality and Robotics.
Unsupervised Image Segmentation by Mutual Information Maximization and Adversarial Regularization
In this paper, we propose a novel fully unsupervised semantic segmentation method, the so-called Information Maximization and Adversarial Regularization Segmentation (InMARS).
Ranked #2 on
Unsupervised Semantic Segmentation
on COCO-Stuff-15
JRDB-Act: A Large-scale Dataset for Spatio-temporal Action, Social Group and Activity Detection
However, learning to recognise human actions and their social interactions in an unconstrained real-world environment comprising numerous people, with potentially highly unbalanced and long-tailed distributed action labels from a stream of sensory data captured from a mobile robot platform remains a significant challenge, not least owing to the lack of a reflective large-scale dataset.
TRiPOD: Human Trajectory and Pose Dynamics Forecasting in the Wild
Joint forecasting of human trajectory and pose dynamics is a fundamental building block of various applications ranging from robotics and autonomous driving to surveillance systems.
Looking Beyond Two Frames: End-to-End Multi-Object Tracking Using Spatial and Temporal Transformers
Tracking a time-varying indefinite number of objects in a video sequence over time remains a challenge despite recent advances in the field.
MOLTR: Multiple Object Localisation, Tracking, and Reconstruction from Monocular RGB Videos
Given a new RGB frame, MOLTR firstly applies a monocular 3D detector to localise objects of interest and extract their shape codes that represent the object shapes in a learned embedding space.
Probabilistic Tracklet Scoring and Inpainting for Multiple Object Tracking
Despite the recent advances in multiple object tracking (MOT), achieved by joint detection and tracking, dealing with long occlusions remains a challenge.
How Trustworthy are Performance Evaluations for Basic Vision Tasks?
This paper examines performance evaluation criteria for basic vision tasks involving sets of objects namely, object detection, instance-level segmentation and multi-object tracking.
Socially and Contextually Aware Human Motion and Pose Forecasting
In this paper, we propose a novel framework to tackle both tasks of human motion (or trajectory) and body skeleton pose forecasting in a unified end-to-end pipeline.
Attend And Discriminate: Beyond the State-of-the-Art for Human Activity Recognition using Wearable Sensors
Wearables are fundamental to improving our understanding of human activities, especially for an increasing number of healthcare applications from rehabilitation to fine-grained gait analysis.
Joint Learning of Social Groups, Individuals Action and Sub-group Activities in Videos
In this paper, we solve the problem of simultaneously grouping people by their social interactions, predicting their individual actions and the social activity of each social group, which we call the social task.
MOT20: A benchmark for multi object tracking in crowded scenes
The benchmark for Multiple Object Tracking, MOTChallenge, was launched with the goal to establish a standardized evaluation of multiple object tracking methods.
Multi-Object Tracking
Multiple Object Tracking with Transformer
+1
JRMOT: A Real-Time 3D Multi-Object Tracker and a New Large-Scale Dataset
In this work we present JRMOT, a novel 3D MOT system that integrates information from RGB images and 3D point clouds to achieve real-time, state-of-the-art tracking performance.
Ranked #7 on
Multiple Object Tracking
on KITTI Tracking test
Learn to Predict Sets Using Feed-Forward Neural Networks
In our formulation we define a likelihood for a set distribution represented by a) two discrete distributions defining the set cardinally and permutation variables, and b) a joint distribution over set elements with a fixed cardinality.
Approximating the Permanent by Sampling from Adaptive Partitions
Computing the permanent of a non-negative matrix is a core problem with practical applications ranging from target tracking to statistical thermodynamics.
JRDB: A Dataset and Benchmark of Egocentric Robot Visual Perception of Humans in Built Environments
We present JRDB, a novel egocentric dataset collected from our social mobile manipulator JackRabbot.
Meta Learning with Differentiable Closed-form Solver for Fast Video Object Segmentation
This paper tackles the problem of video object segmentation.
CVPR19 Tracking and Detection Challenge: How crowded can it get?
Standardized benchmarks are crucial for the majority of computer vision applications.
Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regression
By incorporating this generalized $IoU$ ($GIoU$) as a loss into the state-of-the art object detection frameworks, we show a consistent improvement on their performance using both the standard, $IoU$ based, and new, $GIoU$ based, performance measures on popular object detection benchmarks such as PASCAL VOC and MS COCO.
Learning Pairwise Relationship for Multi-object Detection in Crowded Scenes
As the post-processing step for object detection, non-maximum suppression (GreedyNMS) is widely used in most of the detectors for many years.
TrackerBots: Software in the Loop Study of Quad-Copter Robots for Locating Radio-tags in a 3D Space
We investigate the problem of tracking and planning for a UAV in a task to locate multiple radio-tagged wildlife in a three-dimensional (3D) setting in the context of our TrackerBots research project.
Deep Auto-Set: A Deep Auto-Encoder-Set Network for Activity Recognition Using Wearables
Automatic recognition of human activities from time-series sensor data (referred to as HAR) is a growing area of research in ubiquitous computing.
