Search Results for author:
Found 39 papers, 12 papers with code
Wonderland: Navigating 3D Scenes from a Single Image
Specifically, we introduce a large-scale reconstruction model that uses latents from a video diffusion model to predict 3D Gaussian Splattings for the scenes in a feed-forward manner.
TeamCraft: A Benchmark for Multi-Modal Multi-Agent Systems in Minecraft
Collaboration is a cornerstone of society.
Inverse Attention Agent for Multi-Agent System
The network infers the attentional states of other agents, thereby refining the attention weights to adjust the agent's final action.
Prompting Medical Large Vision-Language Models to Diagnose Pathologies by Visual Question Answering
We propose two prompting strategies for MLVLMs that reduce hallucination and improve VQA performance.
Cross-Slice Attention and Evidential Critical Loss for Uncertainty-Aware Prostate Cancer Detection
Current deep learning-based models typically analyze medical images in either 2D or 3D albeit disregarding volumetric information or suffering sub-optimal performance due to the anisotropic resolution of MR data.
Position Paper: Agent AI Towards a Holistic Intelligence
Recent advancements in large foundation models have remarkably enhanced our understanding of sensory information in open-world environments.
An Interactive Agent Foundation Model
We propose an Interactive Agent Foundation Model that uses a novel multi-task agent training paradigm for training AI agents across a wide range of domains, datasets, and tasks.
Agent AI: Surveying the Horizons of Multimodal Interaction
To accelerate research on agent-based multimodal intelligence, we define "Agent AI" as a class of interactive systems that can perceive visual stimuli, language inputs, and other environmentally-grounded data, and can produce meaningful embodied actions.
Aligner: One Global Token is Worth Millions of Parameters When Aligning Large Language Models
We introduce Aligner, a novel Parameter-Efficient Fine-Tuning (PEFT) method for aligning multi-billion-parameter-sized Large Language Models (LLMs).
CSAM: A 2.5D Cross-Slice Attention Module for Anisotropic Volumetric Medical Image Segmentation
Both 3D and purely 2D deep learning-based segmentation methods are deficient in dealing with such volumetric data since the performance of 3D methods suffers when confronting anisotropic data, and 2D methods disregard crucial volumetric information.
MindAgent: Emergent Gaming Interaction
Large Language Models (LLMs) have the capacity of performing complex scheduling in a multi-agent system and can coordinate these agents into completing sophisticated tasks that require extensive collaboration.
Semi-Supervised Relational Contrastive Learning
Disease diagnosis from medical images via supervised learning is usually dependent on tedious, error-prone, and costly image labeling by medical experts.
ARNOLD: A Benchmark for Language-Grounded Task Learning With Continuous States in Realistic 3D Scenes
To tackle these challenges, we present ARNOLD, a benchmark that evaluates language-grounded task learning with continuous states in realistic 3D scenes.
A Mobility-Aware Deep Learning Model for Long-Term COVID-19 Pandemic Prediction and Policy Impact Analysis
Hence, those models are unable to predict further future.
CAT-Net: A Cross-Slice Attention Transformer Model for Prostate Zonal Segmentation in MRI
However, state-of-the-art automatic segmentation methods often fail to produce well-contained volumetric segmentation of the prostate zones since certain slices of prostate MRI, such as base and apex slices, are harder to segment than other slices.
RAVIR: A Dataset and Methodology for the Semantic Segmentation and Quantitative Analysis of Retinal Arteries and Veins in Infrared Reflectance Imaging
In this paper, we present a novel dataset, dubbed RAVIR, for the semantic segmentation of Retinal Arteries and Veins in Infrared Reflectance (IR) imaging.
Neuromuscular Control of the Face-Head-Neck Biomechanical Complex With Learning-Based Expression Transfer From Images and Videos
The success of our approach is demonstrated through experiments involving the transfer onto our face-head-neck model of facial expressions and head poses from a range of facial images and videos.
Generalized Multi-Task Learning from Substantially Unlabeled Multi-Source Medical Image Data
Semi-supervised learning from limited quantities of labeled data has shown promise as an alternative.
A Location-Sensitive Local Prototype Network for Few-Shot Medical Image Segmentation
Despite the tremendous success of deep neural networks in medical image segmentation, they typically require a large amount of costly, expert-level annotated data.
MultiMix: Sparingly Supervised, Extreme Multitask Learning From Medical Images
Our extensive experimentation with varied quantities of labeled data in the training sets justify the effectiveness of our multitasking model for the classification of pneumonia and segmentation of lungs from chest X-ray images.
End-to-End Trainable Deep Active Contour Models for Automated Image Segmentation: Delineating Buildings in Aerial Imagery
The automated segmentation of buildings in remote sensing imagery is a challenging task that requires the accurate delineation of multiple building instances over typically large image areas.
Bipartite Distance for Shape-Aware Landmark Detection in Spinal X-Ray Images
Scoliosis is a congenital disease that causes lateral curvature in the spine.
Progressive Adversarial Semantic Segmentation
Medical image computing has advanced rapidly with the advent of deep learning techniques such as convolutional neural networks.
Partly Supervised Multitask Learning
Leveraging self-supervision and adversarial training, we propose a novel general purpose semi-supervised, multiple-task model---namely, self-supervised, semi-supervised, multitask learning (S$^4$MTL)---for accomplishing two important tasks in medical imaging, segmentation and diagnostic classification.
Analysis of Scoliosis From Spinal X-Ray Images
Leveraging a carefully-adjusted U-Net model with progressive side outputs, we propose an end-to-end segmentation model that provides a fully automatic and reliable segmentation of the vertebrae associated with scoliosis measurement.
Edge-Gated CNNs for Volumetric Semantic Segmentation of Medical Images
Textures and edges contribute different information to image recognition.
Image Segmentation Using Deep Learning: A Survey
Image segmentation is a key topic in image processing and computer vision with applications such as scene understanding, medical image analysis, robotic perception, video surveillance, augmented reality, and image compression, among many others.
End-to-End Deep Convolutional Active Contours for Image Segmentation
The Active Contour Model (ACM) is a standard image analysis technique whose numerous variants have attracted an enormous amount of research attention across multiple fields.
End-to-End Boundary Aware Networks for Medical Image Segmentation
Fully convolutional neural networks (CNNs) have proven to be effective at representing and classifying textural information, thus transforming image intensity into output class masks that achieve semantic image segmentation.
Deep Active Lesion Segmentation
Lesion segmentation is an important problem in computer-assisted diagnosis that remains challenging due to the prevalence of low contrast, irregular boundaries that are unamenable to shape priors.
Semi-Supervised Multi-Task Learning With Chest X-Ray Images
Discriminative models that require full supervision are inefficacious in the medical imaging domain when large labeled datasets are unavailable.
Multi-Adversarial Variational Autoencoder Networks
The unsupervised training of GANs and VAEs has enabled them to generate realistic images mimicking real-world distributions and perform image-based unsupervised clustering or semi-supervised classification.
Deep Dilated Convolutional Nets for the Automatic Segmentation of Retinal Vessels
The reliable segmentation of retinal vasculature can provide the means to diagnose and monitor the progression of a variety of diseases affecting the blood vessel network, including diabetes and hypertension.
Automatic Segmentation of Pulmonary Lobes Using a Progressive Dense V-Network
We evaluated our model using 84 chest CT scans from the LIDC and 154 pathological cases from the LTRC datasets.
Surrogate Supervision for Medical Image Analysis: Effective Deep Learning From Limited Quantities of Labeled Data
We investigate the effectiveness of a simple solution to the common problem of deep learning in medical image analysis with limited quantities of labeled training data.
Learning to Sketch with Deep Q Networks and Demonstrated Strokes
Doodling is a useful and common intelligent skill that people can learn and master.
Attention-based Natural Language Person Retrieval
Following the recent progress in image classification and captioning using deep learning, we develop a novel natural language person retrieval system based on an attention mechanism.
Configurable 3D Scene Synthesis and 2D Image Rendering with Per-Pixel Ground Truth using Stochastic Grammars
We propose a systematic learning-based approach to the generation of massive quantities of synthetic 3D scenes and arbitrary numbers of photorealistic 2D images thereof, with associated ground truth information, for the purposes of training, benchmarking, and diagnosing learning-based computer vision and robotics algorithms.
Inferring Forces and Learning Human Utilities From Videos
We propose a notion of affordance that takes into account physical quantities generated when the human body interacts with real-world objects, and introduce a learning framework that incorporates the concept of human utilities, which in our opinion provides a deeper and finer-grained account not only of object affordance but also of people's interaction with objects.
