Search Results for author:
Found 123 papers, 37 papers with code
DocTime: A Document-level Temporal Dependency Graph Parser
We introduce DocTime - a novel temporal dependency graph (TDG) parser that takes as input a text document and produces a temporal dependency graph.
Dynamic EM Ray Tracing for Large Urban Scenes with Multiple Receivers
We present a novel ray tracing-based radio propagation algorithm that can handle large urban scenes with hundreds or thousands of dynamic objects and receivers.
Synthetic-to-Real Domain Adaptation for Action Recognition: A Dataset and Baseline Performances
The dataset is composed of both real and synthetic videos from seven gesture classes, and is intended to support the study of synthetic-to-real domain shift for video-based action recognition.
Aerial Diffusion: Text Guided Ground-to-Aerial View Translation from a Single Image using Diffusion Models
Aerial Diffusion leverages a pretrained text-image diffusion model for prior knowledge.
RE-MOVE: An Adaptive Policy Design Approach for Dynamic Environments via Language-Based Feedback
Reinforcement learning-based policies for continuous control robotic navigation tasks often fail to adapt to changes in the environment during real-time deployment, which may result in catastrophic failures.
UNFUSED: UNsupervised Finetuning Using SElf supervised Distillation
Unlike prior works, which directly fine-tune a self-supervised pre-trained encoder on a target dataset, we use the encoder to generate pseudo-labels for unsupervised fine-tuning before the actual fine-tuning step.
Can an Embodied Agent Find Your "Cat-shaped Mug"? LLM-Based Zero-Shot Object Navigation
We present LGX, a novel algorithm for Object Goal Navigation in a "language-driven, zero-shot manner", where an embodied agent navigates to an arbitrarily described target object in a previously unexplored environment.
MITFAS: Mutual Information based Temporal Feature Alignment and Sampling for Aerial Video Action Recognition
We present a novel approach for action recognition in UAV videos.
CoSyn: Detecting Implicit Hate Speech in Online Conversations Using a Context Synergized Hyperbolic Network
The tremendous growth of social media users interacting in online conversations has also led to significant growth in hate speech.
AZTR: Aerial Video Action Recognition with Auto Zoom and Temporal Reasoning
We propose a novel approach for aerial video action recognition.
Scene2BIR: Material-aware learning-based binaural impulse response generator for reconstructed real-world 3D scenes
We present an end-to-end binaural impulse response generator (BIR) to generate plausible sounds in real-time for real-world models.
Beyond Exponentially Fast Mixing in Average-Reward Reinforcement Learning via Multi-Level Monte Carlo Actor-Critic
Many existing reinforcement learning (RL) methods employ stochastic gradient iteration on the back end, whose stability hinges upon a hypothesis that the data-generating process mixes exponentially fast with a rate parameter that appears in the step-size selection.
STEERING: Stein Information Directed Exploration for Model-Based Reinforcement Learning
Directed Exploration is a crucial challenge in reinforcement learning (RL), especially when rewards are sparse.
Model-based Reinforcement Learning
reinforcement-learning
+1
Synthetic Wave-Geometric Impulse Responses for Improved Speech Dereverberation
We present a novel approach to improve the performance of learning-based speech dereverberation using accurate synthetic datasets.
Towards Improved Room Impulse Response Estimation for Speech Recognition
We propose a novel approach for blind room impulse response (RIR) estimation systems in the context of a downstream application scenario, far-field automatic speech recognition (ASR).
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+1
MAST: Multiscale Audio Spectrogram Transformers
We present Multiscale Audio Spectrogram Transformer (MAST) for audio classification, which brings the concept of multiscale feature hierarchies to the Audio Spectrogram Transformer (AST).
SLICER: Learning universal audio representations using low-resource self-supervised pre-training
We present a new Self-Supervised Learning (SSL) approach to pre-train encoders on unlabeled audio data that reduces the need for large amounts of labeled data for audio and speech classification.
MSVIPER: Improved Policy Distillation for Reinforcement-Learning-Based Robot Navigation
Moreover, we present efficient policy distillation and tree-modification techniques that take advantage of the decision tree structure to allow improvements to a policy without retraining.
Differentiable Frequency-based Disentanglement for Aerial Video Action Recognition
We build a differentiable static-dynamic frequency mask prior to model the salient static and dynamic pixels in the video, crucial for the underlying task of action recognition.
Placing Human Animations into 3D Scenes by Learning Interaction- and Geometry-Driven Keyframes
We compare our method, which we call PAAK, with prior approaches, including POSA, PROX ground truth, and a motion synthesis method, and highlight the benefits of our method with a perceptual study.
DC-MRTA: Decentralized Multi-Robot Task Allocation and Navigation in Complex Environments
At the higher level, we solve the task allocation by formulating it in terms of Markov Decision Processes and choosing the appropriate rewards to minimize the Total Travel Delay (TTD).
Vision-Centric BEV Perception: A Survey
To stimulate its future research, this paper presents a comprehensive survey of recent progress of vision-centric BEV perception and its extensions.
A Repulsive Force Unit for Garment Collision Handling in Neural Networks
Despite recent success, deep learning-based methods for predicting 3D garment deformation under body motion suffer from interpenetration problems between the garment and the body.
Video Manipulations Beyond Faces: A Dataset with Human-Machine Analysis
To this end, we present VideoSham, a dataset consisting of 826 videos (413 real and 413 manipulated).
Human Trajectory Prediction via Neural Social Physics
Our new model (Neural Social Physics or NSP) is a deep neural network within which we use an explicit physics model with learnable parameters.
Ranked #1 on
Trajectory Prediction
on Stanford Drone
D2-TPred: Discontinuous Dependency for Trajectory Prediction under Traffic Lights
We present a trajectory prediction approach with respect to traffic lights, D2-TPred, which uses a spatial dynamic interaction graph (SDG) and a behavior dependency graph (BDG) to handle the problem of discontinuous dependency in the spatial-temporal space.
Show Me What I Like: Detecting User-Specific Video Highlights Using Content-Based Multi-Head Attention
We propose a method to detect individualized highlights for users on given target videos based on their preferred highlight clips marked on previous videos they have watched.
FedBC: Calibrating Global and Local Models via Federated Learning Beyond Consensus
In this work, we quantitatively calibrate the performance of global and local models in federated learning through a multi-criterion optimization-based framework, which we cast as a constrained program.
Dealing with Sparse Rewards in Continuous Control Robotics via Heavy-Tailed Policies
In this paper, we present a novel Heavy-Tailed Stochastic Policy Gradient (HT-PSG) algorithm to deal with the challenges of sparse rewards in continuous control problems.
Posterior Coreset Construction with Kernelized Stein Discrepancy for Model-Based Reinforcement Learning
In this work, we propose a novel ${\bf K}$ernelized ${\bf S}$tein Discrepancy-based Posterior Sampling for ${\bf RL}$ algorithm (named $\texttt{KSRL}$) which extends model-based RL based upon posterior sampling (PSRL) in several ways: we (i) relax the need for any smoothness or Gaussian assumptions, allowing for complex mixture models; (ii) ensure it is applicable to large-scale training by incorporating a compression step such that the posterior consists of a \emph{Bayesian coreset} of only statistically significant past state-action pairs; and (iii) develop a novel regret analysis of PSRL based upon integral probability metrics, which, under a smoothness condition on the constructed posterior, can be evaluated in closed form as the kernelized Stein discrepancy (KSD).
SALAD: Source-free Active Label-Agnostic Domain Adaptation for Classification, Segmentation and Detection
SALAD has three key benefits: (i) it is task-agnostic, and can be applied across various visual tasks such as classification, segmentation and detection; (ii) it can handle shifts in output label space from the pre-trained source network to the target domain; (iii) it does not require access to source data for adaptation.
MESH2IR: Neural Acoustic Impulse Response Generator for Complex 3D Scenes
We show that the acoustic metrics of the IRs predicted from our MESH2IR match the ground truth with less than 10% error.
Predicting Loose-Fitting Garment Deformations Using Bone-Driven Motion Networks
We present a learning algorithm that uses bone-driven motion networks to predict the deformation of loose-fitting garment meshes at interactive rates.
STCrowd: A Multimodal Dataset for Pedestrian Perception in Crowded Scenes
In addition, considering the property of sparse global distribution and density-varying local distribution of pedestrians, we further propose a novel method, Density-aware Hierarchical heatmap Aggregation (DHA), to enhance pedestrian perception in crowded scenes.
M-MELD: A Multilingual Multi-Party Dataset for Emotion Recognition in Conversations
Expression of emotions is a crucial part of daily human communication.
3MASSIV: Multilingual, Multimodal and Multi-Aspect dataset of Social Media Short Videos
We present 3MASSIV, a multilingual, multimodal and multi-aspect, expertly-annotated dataset of diverse short videos extracted from short-video social media platform - Moj.
FAR: Fourier Aerial Video Recognition
Our formulation uses a novel Fourier object disentanglement method to innately separate out the human agent (which is typically small) from the background.
SelfTune: Metrically Scaled Monocular Depth Estimation through Self-Supervised Learning
Given these metric poses and monocular sequences, we propose a self-supervised learning method for the pre-trained supervised monocular depth networks to enable metrically scaled depth estimation.
Multimodal Emotion Recognition using Transfer Learning from Speaker Recognition and BERT-based models
Experimental results indicate that both audio and text-based models improve the emotion recognition performance and that the proposed multimodal solution achieves state-of-the-art results on the IEMOCAP benchmark.
An Intelligent Self-driving Truck System For Highway Transportation
Recently, there have been many advances in autonomous driving society, attracting a lot of attention from academia and industry.
N-Cloth: Predicting 3D Cloth Deformation with Mesh-Based Networks
We present a novel mesh-based learning approach (N-Cloth) for plausible 3D cloth deformation prediction.
Active Learning of Neural Collision Handler for Complex 3D Mesh Deformations
We present a robust learning algorithm to detect and handle collisions in 3D deforming meshes.
FAST-RIR: Fast neural diffuse room impulse response generator
We present a neural-network-based fast diffuse room impulse response generator (FAST-RIR) for generating room impulse responses (RIRs) for a given acoustic environment.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+1
HighlightMe: Detecting Highlights from Human-Centric Videos
We train our network to map the activity- and interaction-based latent structural representations of the different modalities to per-frame highlight scores based on the representativeness of the frames.
METEOR:A Dense, Heterogeneous, and Unstructured Traffic Dataset With Rare Behaviors
We present a new traffic dataset, METEOR, which captures traffic patterns and multi-agent driving behaviors in unstructured scenarios.
MotionHint: Self-Supervised Monocular Visual Odometry with Motion Constraints
A key aspect of our approach is to use an appropriate motion model that can help existing self-supervised monocular VO (SSM-VO) algorithms to overcome issues related to the local minima within their self-supervised loss functions.
DnD: Dense Depth Estimation in Crowded Dynamic Indoor Scenes
We present a novel approach for estimating depth from a monocular camera as it moves through complex and crowded indoor environments, e. g., a department store or a metro station.
Improved Speech Emotion Recognition using Transfer Learning and Spectrogram Augmentation
Automatic speech emotion recognition (SER) is a challenging task that plays a crucial role in natural human-computer interaction.
TIMERS: Document-level Temporal Relation Extraction
We present TIMERS - a TIME, Rhetorical and Syntactic-aware model for document-level temporal relation classification in the English language.
Ranked #3 on
Temporal Relation Classification
on TB-Dense
Speech2AffectiveGestures: Synthesizing Co-Speech Gestures with Generative Adversarial Affective Expression Learning
Our network consists of two components: a generator to synthesize gestures from a joint embedding space of features encoded from the input speech and the seed poses, and a discriminator to distinguish between the synthesized pose sequences and real 3D pose sequences.
Ranked #3 on
Gesture Generation
on TED Gesture Dataset
Improving Reverberant Speech Separation with Multi-stage Training and Curriculum Learning
We present a novel approach that improves the performance of reverberant speech separation.
M3DeTR: Multi-representation, Multi-scale, Mutual-relation 3D Object Detection with Transformers
We present a novel architecture for 3D object detection, M3DeTR, which combines different point cloud representations (raw, voxels, bird-eye view) with different feature scales based on multi-scale feature pyramids.
Ranked #1 on
3D Object Detection
on KITTI Cars Hard val
XAI-N: Sensor-based Robot Navigation using Expert Policies and Decision Trees
In order to increase the reliability and handle the failure cases of the expert policy, we combine with a policy extraction technique to transform the resulting policy into a decision tree format.
Scene-aware Far-field Automatic Speech Recognition
We use a deep learning-based estimator to non-intrusively compute the sub-band reverberation time of an environment from its speech samples.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+1
Robust 2D/3D Vehicle Parsing in CVIS
We combine these novel algorithms and datasets to develop a robust approach for 2D/3D vehicle parsing for CVIS.
Affect2MM: Affective Analysis of Multimedia Content Using Emotion Causality
We use an LSTM-based learning model for emotion perception.
GANav: Efficient Terrain Segmentation for Robot Navigation in Unstructured Outdoor Environments
We interface GANav with a deep reinforcement learning-based navigation algorithm and highlight its benefits in terms of navigation in real-world unstructured terrains.
Ranked #1 on
Semantic Segmentation
on RELLIS-3D Dataset
Dynamic Graph Modeling of Simultaneous EEG and Eye-tracking Data for Reading Task Identification
We present a new approach, that we call AdaGTCN, for identifying human reader intent from Electroencephalogram~(EEG) and Eye movement~(EM) data in order to help differentiate between normal reading and task-oriented reading.
Example-based Real-time Clothing Synthesis for Virtual Agents
Given a query shape and pose of the virtual agent, we synthesize the resulting clothing deformation by blending the Taylor expansion results of nearby anchoring points.
Graphics
Robust 2D/3D Vehicle Parsing in Arbitrary Camera Views for CVIS
We combine these novel algorithms and datasets to develop a robust approach for 2D/3D vehicle parsing for CVIS.
Fast 3D Acoustic Scattering via Discrete Laplacian Based Implicit Function Encoders
Acoustic properties of objects corresponding to scattering characteristics are frequently used for 3D audio content creation, environmental acoustic effects, localization and acoustic scene analysis, etc.
Fine-Grained Vehicle Perception via 3D Part-Guided Visual Data Augmentation
For autonomous driving, the dynamics and states of vehicle parts such as doors, the trunk, and the bonnet can provide meaningful semantic information and interaction states, which are essential to ensuring the safety of the self-driving vehicle.
SS-SFDA : Self-Supervised Source-Free Domain Adaptation for Road Segmentation in Hazardous Environments
We present a novel approach for unsupervised road segmentation in adverse weather conditions such as rain or fog.
Developing an Effective and Automated Patient Engagement Estimator for Telehealth: A Machine Learning Approach
We discuss MET, a learning-based algorithm proposed for perceiving a patient's level of engagement during telehealth sessions.
Sound Synthesis, Propagation, and Rendering: A Survey
To the best of our knowledge, this is the first attempt to provide a comprehensive summary of sound research in the field of computer graphics.
Sound Graphics
SelfDeco: Self-Supervised Monocular Depth Completion in Challenging Indoor Environments
We present a novel algorithm for self-supervised monocular depth completion.
B-GAP: Behavior-Rich Simulation and Navigation for Autonomous Driving
We address the problem of ego-vehicle navigation in dense simulated traffic environments populated by road agents with varying driver behaviors.
Robotics
Multi-Window Data Augmentation Approach for Speech Emotion Recognition
MWA-SER is a unimodal approach that focuses on two key concepts; designing the speech augmentation method and building the deep learning model to recognize the underlying emotion of an audio signal.
BoMuDANet: Unsupervised Adaptation for Visual Scene Understanding in Unstructured Driving Environments
We present an unsupervised adaptation approach for visual scene understanding in unstructured traffic environments.
Multi-Agent Coverage in Urban Environments
We study multi-agent coverage algorithms for autonomous monitoring and patrol in urban environments.
Robotics
PerMO: Perceiving More at Once from a Single Image for Autonomous Driving
We present a novel approach to detect, segment, and reconstruct complete textured 3D models of vehicles from a single image for autonomous driving.
AutoTrajectory: Label-free Trajectory Extraction and Prediction from Videos using Dynamic Points
Then we aggregate dynamic points to instance points, which stand for moving objects such as pedestrians in videos.
MCQA: Multimodal Co-attention Based Network for Question Answering
We present MCQA, a learning-based algorithm for multimodal question answering.
OF-VO: Efficient Navigation among Pedestrians Using Commodity Sensors
Overall, our OF-VO algorithm using learning-based perception and model-based planning methods offers better performance than prior algorithms in terms of navigation time and success rate of collision avoidance.
Robotics
Emotions Don't Lie: An Audio-Visual Deepfake Detection Method Using Affective Cues
Additionally, we extract and compare affective cues corresponding to perceived emotion from the two modalities within a video to infer whether the input video is "real" or "fake".
EmotiCon: Context-Aware Multimodal Emotion Recognition using Frege's Principle
We report an AP of 65. 83 across 4 categories on GroupWalk, which is also an improvement over prior methods.
Ranked #1 on
Emotion Recognition in Context
on EMOTIC
Emotion Recognition in Context
Multimodal Emotion Recognition
ProxEmo: Gait-based Emotion Learning and Multi-view Proxemic Fusion for Socially-Aware Robot Navigation
Our approach predicts the perceived emotions of a pedestrian from walking gaits, which is then used for emotion-guided navigation taking into account social and proxemic constraints.
Ranked #1 on
Emotion Classification
on EWALK
SPA: Verbal Interactions between Agents and Avatars in Shared Virtual Environments using Propositional Planning
We present a novel approach for generating plausible verbal interactions between virtual human-like agents and user avatars in shared virtual environments.
Deep Differentiable Grasp Planner for High-DOF Grippers
We present an end-to-end algorithm for training deep neural networks to grasp novel objects.
Robotics
The Liar's Walk: Detecting Deception with Gait and Gesture
We present a data-driven deep neural algorithm for detecting deceptive walking behavior using nonverbal cues like gaits and gestures.
Reinforcement Learning-based Visual Navigation with Information-Theoretic Regularization
The regularization maximizes the mutual information between navigation actions and visual observation transforms of an agent, thus promoting more informed navigation decisions.
Robotics
Forecasting Trajectory and Behavior of Road-Agents Using Spectral Clustering in Graph-LSTMs
In practice, our approach reduces the average prediction error by more than 54% over prior algorithms and achieves a weighted average accuracy of 91. 2% for behavior prediction.
Ranked #1 on
Trajectory Prediction
on ApolloScape
Robotics
Take an Emotion Walk: Perceiving Emotions from Gaits Using Hierarchical Attention Pooling and Affective Mapping
For the annotated data, we also train a classifier to map the latent embeddings to emotion labels.
Scene-Aware Audio Rendering via Deep Acoustic Analysis
We present a new method to capture the acoustic characteristics of real-world rooms using commodity devices, and use the captured characteristics to generate similar sounding sources with virtual models.
Sound Graphics Multimedia Audio and Speech Processing
M3ER: Multiplicative Multimodal Emotion Recognition Using Facial, Textual, and Speech Cues
Our approach combines cues from multiple co-occurring modalities (such as face, text, and speech) and also is more robust than other methods to sensor noise in any of the individual modalities.
Personality-Aware Probabilistic Map for Trajectory Prediction of Pedestrians
We update this map dynamically based on the agents in the environment and prior trajectory of a pedestrian.
STEP: Spatial Temporal Graph Convolutional Networks for Emotion Perception from Gaits
We use hundreds of annotated real-world gait videos and augment them with thousands of annotated synthetic gaits generated using a novel generative network called STEP-Gen, built on an ST-GCN based Conditional Variational Autoencoder (CVAE).
Learning Resilient Behaviors for Navigation Under Uncertainty
Deep reinforcement learning has great potential to acquire complex, adaptive behaviors for autonomous agents automatically.
DeepMNavigate: Deep Reinforced Multi-Robot Navigation Unifying Local & Global Collision Avoidance
We present a novel algorithm (DeepMNavigate) for global multi-agent navigation in dense scenarios using deep reinforcement learning (DRL).
Realtime Simulation of Thin-Shell Deformable Materials using CNN-Based Mesh Embedding
We present a new algorithm to embed a high-dimensional configuration space of deformable objects in a low-dimensional feature space, where the configurations of objects and feature points have approximate one-to-one mapping.
Training a Constrained Natural Media Painting Agent using Reinforcement Learning
We present a novel approach to train a natural media painting using reinforcement learning.
RobustTP: End-to-End Trajectory Prediction for Heterogeneous Road-Agents in Dense Traffic with Noisy Sensor Inputs
RobustTP is an approach that first computes trajectories using a combination of a non-linear motion model and a deep learning-based instance segmentation algorithm.
Robotics
Improving Reverberant Speech Training Using Diffuse Acoustic Simulation
We present an efficient and realistic geometric acoustic simulation approach for generating and augmenting training data in speech-related machine learning tasks.
FVA: Modeling Perceived Friendliness of Virtual Agents Using Movement Characteristics
We also investigate the perception of a user in an AR setting and observe that an FVA has a statistically significant improvement in terms of the perceived friendliness and social presence of a user compared to an agent without the friendliness modeling.
RoadTrack: Realtime Tracking of Road Agents in Dense and Heterogeneous Environments
We present a realtime tracking algorithm, RoadTrack, to track heterogeneous road-agents in dense traffic videos.
Robotics
NeoNav: Improving the Generalization of Visual Navigation via Generating Next Expected Observations
First, the latent distribution is conditioned on current observations and the target view, leading to a model-based, target-driven navigation.
LPaintB: Learning to Paint from Self-Supervision
We present a novel reinforcement learning-based natural media painting algorithm.
Identifying Emotions from Walking using Affective and Deep Features
We also present an EWalk (Emotion Walk) dataset that consists of videos of walking individuals with gaits and labeled emotions.
Regression and Classification for Direction-of-Arrival Estimation with Convolutional Recurrent Neural Networks
We present a novel learning-based approach to estimate the direction-of-arrival (DOA) of a sound source using a convolutional recurrent neural network (CRNN) trained via regression on synthetic data and Cartesian labels.
Ranked #1 on
Direction of Arrival Estimation
on SOFA
(using extra training data)
PaintBot: A Reinforcement Learning Approach for Natural Media Painting
Action selection is guided by a given reference image, which the agent attempts to replicate subject to the limitations of the action space and the agent's learned policy.
Generating Grasp Poses for a High-DOF Gripper Using Neural Networks
The quality of the grasp poses is on par with the groundtruth poses in the dataset.
Robotics
AADS: Augmented Autonomous Driving Simulation using Data-driven Algorithms
Our augmented approach combines the flexibility in a virtual environment (e. g., vehicle movements) with the richness of the real world to allow effective simulation of anywhere on earth.
TraPHic: Trajectory Prediction in Dense and Heterogeneous Traffic Using Weighted Interactions
We evaluate the performance of our prediction algorithm, TraPHic, on the standard datasets and also introduce a new dense, heterogeneous traffic dataset corresponding to urban Asian videos and agent trajectories.
Ranked #1 on
Trajectory Prediction
on NGSIM
(RMSE metric)
Robotics
VV-Net: Voxel VAE Net with Group Convolutions for Point Cloud Segmentation
Our approach results in a good volumetric representation that effectively tackles noisy point cloud datasets and is more robust for learning.
Graphics
TrafficPredict: Trajectory Prediction for Heterogeneous Traffic-Agents
To safely and efficiently navigate in complex urban traffic, autonomous vehicles must make responsible predictions in relation to surrounding traffic-agents (vehicles, bicycles, pedestrians, etc.).
Ranked #1 on
Trajectory Prediction
on Apolloscape Trajectory
Pedestrian Dominance Modeling for Socially-Aware Robot Navigation
We present a Pedestrian Dominance Model (PDM) to identify the dominance characteristics of pedestrians for robot navigation.
Robotics
TZC: Efficient Inter-Process Communication for Robotics Middleware with Partial Serialization
We show that by using TZC, the braking distance can be shortened by 16% than ROS.
Robotics
Data-Driven Modeling of Group Entitativity in Virtual Environments
We also present a novel interactive multi-agent simulation algorithm to model entitative groups and conduct a VR user study to validate the socio-emotional predictive power of our algorithm.
Graphics Human-Computer Interaction
Safe Navigation with Human Instructions in Complex Scenes
In this paper, we present a robotic navigation algorithm with natural language interfaces, which enables a robot to safely walk through a changing environment with moving persons by following human instructions such as "go to the restaurant and keep away from people".
Transferring Grasp Configurations using Active Learning and Local Replanning
We compute a grasp space for each part of the example object using active learning.
Robotics
PORCA: Modeling and Planning for Autonomous Driving among Many Pedestrians
Our planning system combines a POMDP algorithm with the pedestrian motion model and runs in near real time.
Robotics
Efficient Reciprocal Collision Avoidance between Heterogeneous Agents Using CTMAT
We present a novel algorithm for reciprocal collision avoidance between heterogeneous agents of different shapes and sizes.
Identifying Driver Behaviors using Trajectory Features for Vehicle Navigation
We present a novel approach to automatically identify driver behaviors from vehicle trajectories and use them for safe navigation of autonomous vehicles.
Robotics
MixedPeds: Pedestrian Detection in Unannotated Videos using Synthetically Generated Human-agents for Training
We present a new method for training pedestrian detectors on an unannotated set of images.
Efficient Generation of Motion Plans from Attribute-Based Natural Language Instructions Using Dynamic Constraint Mapping
We generate a factor graph from natural language instructions called the Dynamic Grounding Graph (DGG), which takes latent parameters into account.
Robotics
Recurrent 3D Attentional Networks for End-to-End Active Object Recognition
Active vision is inherently attention-driven: The agent actively selects views to attend in order to fast achieve the vision task while improving its internal representation of the scene being observed.
LCrowdV: Generating Labeled Videos for Simulation-based Crowd Behavior Learning
We present a novel procedural framework to generate an arbitrary number of labeled crowd videos (LCrowdV).
Exemplar-AMMs: Recognizing Crowd Movements from Pedestrian Trajectories
Specifically, we propose an optimization framework that filters out the unknown noise in the crowd trajectories and measures their similarity to the exemplar-AMMs to produce a crowd motion feature.
3D Reconstruction in the Presence of Glasses by Acoustic and Stereo Fusion
We present a novel sensor fusion algorithm that first segments the depth map into different categories such as opaque/transparent/infinity (e. g., too far to measure) and then updates the depth map based on the segmentation outcome.
Real-time Crowd Tracking using Parameter Optimized Mixture of Motion Models
We automatically compute the optimal parameters for each of these different models based on prior tracked data and use the best model as motion prior for our particle-filter based tracking algorithm.
Spoke-Darts for High-Dimensional Blue-Noise Sampling
Blue noise sampling has proved useful for many graphics applications, but remains underexplored in high-dimensional spaces due to the difficulty of generating distributions and proving properties about them.
Graphics
Realtime Multilevel Crowd Tracking using Reciprocal Velocity Obstacles
We present a novel, realtime algorithm to compute the trajectory of each pedestrian in moderately dense crowd scenes.
Leveraging Long-Term Predictions and Online-Learning in Agent-based Multiple Person Tracking
We present a multiple-person tracking algorithm, based on combining particle filters and RVO, an agent-based crowd model that infers collision-free velocities so as to predict pedestrian's motion.
