Search Results for author:
Found 35 papers, 6 papers with code
A Large-scale Annotated Mechanical Components Benchmark for Classification and Retrieval Tasks with Deep Neural Networks
We introduce a large-scale annotated mechanical components benchmark for classification and retrieval tasks named MechanicalComponents Benchmark (MCB): a large-scale dataset of 3D objects of mechanical components.
3D Occupancy Prediction with Low-Resolution Queries via Prototype-aware View Transformation
The resolution of voxel queries significantly influences the quality of view transformation in camera-based 3D occupancy prediction.
CompMarkGS: Robust Watermarking for Compressed 3D Gaussian Splatting
3D Gaussian Splatting (3DGS) enables rapid differentiable rendering for 3D reconstruction and novel view synthesis, leading to its widespread commercial use.
AV-Surf: Surface-Enhanced Geometry-Aware Novel-View Acoustic Synthesis
Accurately modeling sound propagation with complex real-world environments is essential for Novel View Acoustic Synthesis (NVAS).
CATSplat: Context-Aware Transformer with Spatial Guidance for Generalizable 3D Gaussian Splatting from A Single-View Image
Recently, generalizable feed-forward methods based on 3D Gaussian Splatting have gained significant attention for their potential to reconstruct 3D scenes using finite resources.
EditSplat: Multi-View Fusion and Attention-Guided Optimization for View-Consistent 3D Scene Editing with 3D Gaussian Splatting
Recent advancements in 3D editing have highlighted the potential of text-driven methods in real-time, user-friendly AR/VR applications.
FaceShield: Defending Facial Image against Deepfake Threats
The rising use of deepfakes in criminal activities presents a significant issue, inciting widespread controversy.
LVMark: Robust Watermark for Latent Video Diffusion Models
We optimize both the watermark decoder and the latent decoder of diffusion model, effectively balancing the trade-off between visual quality and bit accuracy.
SelfSplat: Pose-Free and 3D Prior-Free Generalizable 3D Gaussian Splatting
Our model addresses these challenges by effectively integrating explicit 3D representations with self-supervised depth and pose estimation techniques, resulting in reciprocal improvements in both pose accuracy and 3D reconstruction quality.
Posture-Informed Muscular Force Learning for Robust Hand Pressure Estimation
We present PiMForce, a novel framework that enhances hand pressure estimation by leveraging 3D hand posture information to augment forearm surface electromyography (sEMG) signals.
Unified Domain Generalization and Adaptation for Multi-View 3D Object Detection
However, typical supervised learning approaches face challenges in achieving satisfactory adaptation toward unseen and unlabeled target datasets (\ie, direct transfer) due to the inevitable geometric misalignment between the source and target domains.
3D-GSW: 3D Gaussian Splatting for Robust Watermarking
In this paper, we introduce a robust watermarking method for 3D-GS that secures copyright of both the model and its rendered images.
Cropper: Vision-Language Model for Image Cropping through In-Context Learning
The goal of image cropping is to identify visually appealing crops in an image.
VisionTrap: Vision-Augmented Trajectory Prediction Guided by Textual Descriptions
In this work, we propose a novel method that also incorporates visual input from surround-view cameras, allowing the model to utilize visual cues such as human gazes and gestures, road conditions, vehicle turn signals, etc, which are typically hidden from the model in prior methods.
WateRF: Robust Watermarks in Radiance Fields for Protection of Copyrights
The advances in the Neural Radiance Fields (NeRF) research offer extensive applications in diverse domains, but protecting their copyrights has not yet been researched in depth.
CMDA: Cross-Modal and Domain Adversarial Adaptation for LiDAR-Based 3D Object Detection
Recent LiDAR-based 3D Object Detection (3DOD) methods show promising results, but they often do not generalize well to target domains outside the source (or training) data distribution.
Parrot: Pareto-optimal Multi-Reward Reinforcement Learning Framework for Text-to-Image Generation
We use the novel multi-reward optimization algorithm to jointly optimize the T2I model and a prompt expansion network, resulting in significant improvement of image quality and also allow to control the trade-off of different rewards using a reward related prompt during inference.
Higher-order Relational Reasoning for Pedestrian Trajectory Prediction
Social relations have substantial impacts on the potential trajectories of each individual.
Edge-Aware 3D Instance Segmentation Network with Intelligent Semantic Prior
While recent 3D instance segmentation approaches show promising results based on transformer architectures they often fail to correctly identify instances with similar appearances.
Ranked #1 on
3D Instance Segmentation
on STPLS3D
MEVG: Multi-event Video Generation with Text-to-Video Models
We introduce a novel diffusion-based video generation method, generating a video showing multiple events given multiple individual sentences from the user.
Clustering-based Image-Text Graph Matching for Domain Generalization
However, they use pivot embedding in a global manner (i. e., aligning an image embedding with sentence-level text embedding), which does not fully utilize the semantic cues of given text description.
The Power of Sound (TPoS): Audio Reactive Video Generation with Stable Diffusion
Hence, we propose The Power of Sound (TPoS) model to incorporate audio input that includes both changeable temporal semantics and magnitude.
Soundini: Sound-Guided Diffusion for Natural Video Editing
We propose a method for adding sound-guided visual effects to specific regions of videos with a zero-shot setting.
Event Fusion Photometric Stereo Network
We present a novel method to estimate the surface normal of an object in an ambient light environment using RGB and event cameras.
Dual Policy Learning for Aggregation Optimization in Graph Neural Network-based Recommender Systems
This framework adaptively determines high-order connectivity to aggregate users and items using dual policy learning.
FPANet: Frequency-based Video Demoireing using Frame-level Post Alignment
Moire patterns, created by the interference between overlapping grid patterns in the pixel space, degrade the visual quality of images and videos.
LISA: Localized Image Stylization with Audio via Implicit Neural Representation
We present a novel framework, Localized Image Stylization with Audio (LISA) which performs audio-driven localized image stylization.
Robust Sound-Guided Image Manipulation
Our extensive experiments show that our sound-guided image manipulation approach produces semantically and visually more plausible manipulation results than the state-of-the-art text and sound-guided image manipulation methods, which are further confirmed by our human evaluations.
ORA3D: Overlap Region Aware Multi-view 3D Object Detection
Current multi-view 3D object detection methods often fail to detect objects in the overlap region properly, and the networks' understanding of the scene is often limited to that of a monocular detection network.
Ranked #6 on
Robust Camera Only 3D Object Detection
on nuScenes-C
Sound-Guided Semantic Video Generation
The recent success in StyleGAN demonstrates that pre-trained StyleGAN latent space is useful for realistic video generation.
Sound-Guided Semantic Image Manipulation
Our audio encoder is trained to produce a latent representation from an audio input, which is forced to be aligned with image and text representations in the multi-modal embedding space.
Egocentric View Hand Action Recognition by Leveraging Hand Surface and Hand Grasp Type
We introduce a multi-stage framework that uses mean curvature on a hand surface and focuses on learning interaction between hand and object by analyzing hand grasp type for hand action recognition in egocentric videos.
Latent Transformations for Object View Points Synthesis
We propose a fully-convolutional conditional generative model, the latent transformation neural network (LTNN), capable of view synthesis using a light-weight neural network suited for real-time applications.
Learning Hand Articulations by Hallucinating Heat Distribution
As an additional modality to depth data, we present a function of geometric properties on the surface of the hand described by heat diffusion.
ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentation
The ability to perform pixel-wise semantic segmentation in real-time is of paramount importance in mobile applications.
Ranked #10 on
Semantic Segmentation
on ScanNetV2
