Search Results for author:
Found 31 papers, 1 papers with code
Anatomy-Aware Conditional Image-Text Retrieval
In this paper, we propose an Anatomical Location-Conditioned Image-Text Retrieval (ALC-ITR) framework, which, given a query image and the associated suspicious anatomical region(s), aims to retrieve similar patient cases exhibiting the same disease or symptoms in the same anatomical region.
Neural Finite-State Machines for Surgical Phase Recognition
Surgical phase recognition (SPR) is crucial for applications in workflow optimization, performance evaluation, and real-time intervention guidance.
Seq2Time: Sequential Knowledge Transfer for Video LLM Temporal Grounding
Temporal awareness is essential for video large language models (LLMs) to understand and reason about events within long videos, enabling applications like dense video captioning and temporal video grounding in a unified system.
DaRePlane: Direction-aware Representations for Dynamic Scene Reconstruction
Numerous recent approaches to modeling and re-rendering dynamic scenes leverage plane-based explicit representations, addressing slow training times associated with models like neural radiance fields (NeRF) and Gaussian splatting (GS).
Order-aware Interactive Segmentation
However, current methods often fail to accurately separate target objects from the background, due to a limited understanding of order, the relative depth between objects in a scene.
3D Vision-Language Gaussian Splatting
Recent advancements in 3D reconstruction methods and vision-language models have propelled the development of multi-modal 3D scene understanding, which has vital applications in robotics, autonomous driving, and virtual/augmented reality.
Few-Shot 3D Volumetric Segmentation with Multi-Surrogate Fusion
Conventional 3D medical image segmentation methods typically require learning heavy 3D networks (e. g., 3D-UNet), as well as large amounts of in-domain data with accurate pixel/voxel-level labels to avoid overfitting.
Automated Patient Positioning with Learned 3D Hand Gestures
In this work, we propose an automated patient positioning system that utilizes a camera to detect specific hand gestures from technicians, allowing users to indicate the target patient region to the system and initiate automated positioning.
Divide and Fuse: Body Part Mesh Recovery from Partially Visible Human Images
Traditional top-down methods, relying on whole-body parametric models like SMPL, falter when only a small part of the human is visible, as they require visibility of most of the human body for accurate mesh reconstruction.
DDGS-CT: Direction-Disentangled Gaussian Splatting for Realistic Volume Rendering
Digitally reconstructed radiographs (DRRs) are simulated 2D X-ray images generated from 3D CT volumes, widely used in preoperative settings but limited in intraoperative applications due to computational bottlenecks, especially for accurate but heavy physics-based Monte Carlo methods.
Automating Catheterization Labs with Real-Time Perception
For decades, three-dimensional C-arm Cone-Beam Computed Tomography (CBCT) imaging system has been a critical component for complex vascular and nonvascular interventional procedures.
Self-supervised 3D Patient Modeling with Multi-modal Attentive Fusion
3D patient body modeling is critical to the success of automated patient positioning for smart medical scanning and operating rooms.
DaReNeRF: Direction-aware Representation for Dynamic Scenes
However, the straightforward decomposition of 4D dynamic scenes into multiple 2D plane-based representations proves insufficient for re-rendering high-fidelity scenes with complex motions.
PBADet: A One-Stage Anchor-Free Approach for Part-Body Association
The detection of human parts (e. g., hands, face) and their correct association with individuals is an essential task, e. g., for ubiquitous human-machine interfaces and action recognition.
Implicit Modeling of Non-rigid Objects with Cross-Category Signals
To effectively capture the interrelation between these entities and ensure precise, collision-free representations, our approach facilitates signaling between category-specific fields to adequately rectify shapes.
Disguise without Disruption: Utility-Preserving Face De-Identification
We extensively evaluate our method using multiple datasets, demonstrating a higher de-identification rate and superior consistency compared to prior approaches in various downstream tasks.
Exploring Cycle Consistency Learning in Interactive Volume Segmentation
Given a medical volume, a user first segments a slice (or several slices) via the interaction module and then propagates the segmentation(s) to the remaining slices.
Progressive Multi-view Human Mesh Recovery with Self-Supervision
To date, little attention has been given to multi-view 3D human mesh estimation, despite real-life applicability (e. g., motion capture, sport analysis) and robustness to single-view ambiguities.
Federated Learning with Privacy-Preserving Ensemble Attention Distillation
We propose a privacy-preserving FL framework leveraging unlabeled public data for one-way offline knowledge distillation in this work.
PREF: Predictability Regularized Neural Motion Fields
We propose to regularize the estimated motion to be predictable.
Self-supervised Human Mesh Recovery with Cross-Representation Alignment
However, on synthetic dense correspondence maps (i. e., IUV) few have been explored since the domain gap between synthetic training data and real testing data is hard to address for 2D dense representation.
PseudoClick: Interactive Image Segmentation with Click Imitation
The goal of click-based interactive image segmentation is to obtain precise object segmentation masks with limited user interaction, i. e., by a minimal number of user clicks.
SMPL-A: Modeling Person-Specific Deformable Anatomy
In order to obtain accurate target location information, clinicians have to either conduct frequent intraoperative scans, resulting in higher exposition of patients to radiations, or adopt proxy procedures (e. g., creating and using custom molds to keep patients in the exact same pose during both preoperative organ scanning and subsequent treatment.
Physics-based Differentiable Depth Sensor Simulation
Gradient-based algorithms are crucial to modern computer-vision and graphics applications, enabling learning-based optimization and inverse problems.
AI on the Bog: Monitoring and Evaluating Cranberry Crop Risk
Toward this goal, we propose two main deep learning-based modules for: 1) cranberry fruit segmentation to delineate the exact fruit regions in the cranberry field image that are exposed to sun, 2) prediction of cloud coverage conditions and sun irradiance to estimate the inner temperature of exposed cranberries.
3D Object Instance Recognition and Pose Estimation Using Triplet Loss with Dynamic Margin
In this paper, we address the problem of 3D object instance recognition and pose estimation of localized objects in cluttered environments using convolutional neural networks.
Incremental Scene Synthesis
We present a method to incrementally generate complete 2D or 3D scenes with the following properties: (a) it is globally consistent at each step according to a learned scene prior, (b) real observations of a scene can be incorporated while observing global consistency, (c) unobserved regions can be hallucinated locally in consistence with previous observations, hallucinations and global priors, and (d) hallucinations are statistical in nature, i. e., different scenes can be generated from the same observations.
Seeing Beyond Appearance - Mapping Real Images into Geometrical Domains for Unsupervised CAD-based Recognition
Applying our approach to object recognition from texture-less CAD data, we present a custom generative network which fully utilizes the purely geometrical information to learn robust features and achieve a more refined mapping for unseen color images.
Keep it Unreal: Bridging the Realism Gap for 2.5D Recognition with Geometry Priors Only
With the increasing availability of large databases of 3D CAD models, depth-based recognition methods can be trained on an uncountable number of synthetically rendered images.
DepthSynth: Real-Time Realistic Synthetic Data Generation from CAD Models for 2.5D Recognition
Recent progress in computer vision has been dominated by deep neural networks trained over large amounts of labeled data.
