Search Results for author:
Found 31 papers, 10 papers with code
Laplace-Beltrami Operator for Gaussian Splatting
With the rising popularity of 3D Gaussian splatting and the expanse of applications from rendering to 3D reconstruction, there comes also a need for geometry processing applications directly on this new representation.
Exploring Code Language Models for Automated HLS-based Hardware Generation: Benchmark, Infrastructure and Analysis
First, the volume of available HDL training data is substantially smaller compared to that for software programming languages.
Step-Audio: Unified Understanding and Generation in Intelligent Speech Interaction
Based on our new StepEval-Audio-360 evaluation benchmark, Step-Audio achieves state-of-the-art performance in human evaluations, especially in terms of instruction following.
Bayesian Optimization by Kernel Regression and Density-based Exploration
Bayesian optimization is highly effective for optimizing expensive-to-evaluate black-box functions, but it faces significant computational challenges due to the high computational complexity of Gaussian processes, which results in a total time complexity that is quartic with respect to the number of iterations.
HUGSIM: A Real-Time, Photo-Realistic and Closed-Loop Simulator for Autonomous Driving
In the past few decades, autonomous driving algorithms have made significant progress in perception, planning, and control.
UrbanCAD: Towards Highly Controllable and Photorealistic 3D Vehicles for Urban Scene Simulation
In this work, we introduce UrbanCAD, a framework that pushes the frontier of the photorealism-controllability trade-off by generating highly controllable and photorealistic 3D vehicle digital twins from a single urban image and a collection of free 3D CAD models and handcrafted materials.
Biomass phenotyping of oilseed rape through UAV multi-view oblique imaging with 3DGS and SAM model
The SAM module achieved high segmentation accuracy, with a mean intersection over union (mIoU) of 0. 961 and an F1-score of 0. 980.
Enhancing Dropout-based Bayesian Neural Networks with Multi-Exit on FPGA
Reliable uncertainty estimation plays a crucial role in various safety-critical applications such as medical diagnosis and autonomous driving.
Learning Temporally Consistent Video Depth from Video Diffusion Priors
Moreover, we design an effective training strategy to provide context within a clip.
OpenStreetView-5M: The Many Roads to Global Visual Geolocation
Determining the location of an image anywhere on Earth is a complex visual task, which makes it particularly relevant for evaluating computer vision algorithms.
Ranked #2 on
Photo geolocation estimation
on OpenStreetView-5M
HUGS: Holistic Urban 3D Scene Understanding via Gaussian Splatting
Holistic understanding of urban scenes based on RGB images is a challenging yet important problem.
Safe Non-Stochastic Control of Control-Affine Systems: An Online Convex Optimization Approach
We study how to safely control nonlinear control-affine systems that are corrupted with bounded non-stochastic noise, i. e., noise that is unknown a priori and that is not necessarily governed by a stochastic model.
DreamLLM: Synergistic Multimodal Comprehension and Creation
This paper presents DreamLLM, a learning framework that first achieves versatile Multimodal Large Language Models (MLLMs) empowered with frequently overlooked synergy between multimodal comprehension and creation.
Ranked #5 on
Visual Question Answering
on MMBench
Safe Non-Stochastic Control of Linear Dynamical Systems
We study the problem of \textit{safe control of linear dynamical systems corrupted with non-stochastic noise}, and provide an algorithm that guarantees (i) zero constraint violation of convex time-varying constraints, and (ii) bounded dynamic regret, \ie bounded suboptimality against an optimal clairvoyant controller that knows the future noise a priori.
ChatSpot: Bootstrapping Multimodal LLMs via Precise Referring Instruction Tuning
Based on precise referring instruction, we propose ChatSpot, a unified end-to-end multimodal large language model that supports diverse forms of interactivity including mouse clicks, drag-and-drop, and drawing boxes, which provides a more flexible and seamless interactive experience.
GMM: Delving into Gradient Aware and Model Perceive Depth Mining for Monocular 3D Detection
In light of the success of sample mining techniques in 2D object detection, we propose a simple yet effective mining strategy for improving depth perception in 3D object detection.
Exploring Recurrent Long-term Temporal Fusion for Multi-view 3D Perception
In this paper, we explore an embarrassingly simple long-term recurrent fusion strategy built upon the LSS-based methods and find it already able to enjoy the merits from both sides, i. e., rich long-term information and efficient fusion pipeline.
A Comprehensive Survey on Multimodal Recommender Systems: Taxonomy, Evaluation, and Future Directions
Recommendation systems have become popular and effective tools to help users discover their interesting items by modeling the user preference and item property based on implicit interactions (e. g., purchasing and clicking).
Enhancing Dyadic Relations with Homogeneous Graphs for Multimodal Recommendation
On top of the finding, we propose a model that enhances the dyadic relations by learning Dual RepresentAtions of both users and items via constructing homogeneous Graphs for multimOdal recommeNdation.
Efficient Online Learning with Memory via Frank-Wolfe Optimization: Algorithms with Bounded Dynamic Regret and Applications to Control
In this paper, we enable projection-free online learning within the framework of Online Convex Optimization with Memory (OCO-M) -- OCO-M captures how the history of decisions affects the current outcome by allowing the online learning loss functions to depend on both current and past decisions.
MatrixVT: Efficient Multi-Camera to BEV Transformation for 3D Perception
This paper proposes an efficient multi-camera to Bird's-Eye-View (BEV) view transformation method for 3D perception, dubbed MatrixVT.
Ranked #2 on
Bird's-Eye View Semantic Segmentation
on nuScenes
(IoU lane - 224x480 - 100x100 at 0.5 metric)
Online Submodular Coordination with Bounded Tracking Regret: Theory, Algorithm, and Applications to Multi-Robot Coordination
We are motivated by the future of autonomy that involves multiple robots coordinating in dynamic, unstructured, and adversarial environments to complete complex tasks such as target tracking, environmental mapping, and area monitoring.
PersDet: Monocular 3D Detection in Perspective Bird's-Eye-View
To address this problem, we revisit the generation of BEV representation and propose detecting objects in perspective BEV -- a new BEV representation that does not require feature sampling.
Safe Control of Partially-Observed Linear Time-Varying Systems with Minimal Worst-Case Dynamic Regret
We present safe control of partially-observed linear time-varying systems in the presence of unknown and unpredictable process and measurement noise.
Bootstrap Latent Representations for Multi-modal Recommendation
Besides the user-item interaction graph, existing state-of-the-art methods usually use auxiliary graphs (e. g., user-user or item-item relation graph) to augment the learned representations of users and/or items.
Dense Teacher: Dense Pseudo-Labels for Semi-supervised Object Detection
To date, the most powerful semi-supervised object detectors (SS-OD) are based on pseudo-boxes, which need a sequence of post-processing with fine-tuned hyper-parameters.
Transformer for Polyp Detection
In recent years, as the Transformer has performed increasingly well on NLP tasks, many researchers have ported the Transformer structure to vision tasks , bridging the gap between NLP and CV tasks.
Grouptron: Dynamic Multi-Scale Graph Convolutional Networks for Group-Aware Dense Crowd Trajectory Forecasting
Accurate, long-term forecasting of pedestrian trajectories in highly dynamic and interactive scenes is a long-standing challenge.
RECIST-Net: Lesion detection via grouping keypoints on RECIST-based annotation
Universal lesion detection in computed tomography (CT) images is an important yet challenging task due to the large variations in lesion type, size, shape, and appearance.
A Guidance and Maneuvering Control System Design with Anti-collision Using Stream Functions with Vortex Flows for Autonomous Marine Vessels
Autonomous marine vessels are expected to avoid inter-vessel collisions and comply with the international regulations for safe voyages.
High-Performance FPGA-based Accelerator for Bayesian Neural Networks
Neural networks (NNs) have demonstrated their potential in a wide range of applications such as image recognition, decision making or recommendation systems.
