Search Results for author:
Found 49 papers, 24 papers with code
Does a Rising Tide Lift All Boats? Bias Mitigation for AI-based CMR Segmentation
We aim to investigate the impact of common bias mitigation methods to address bias between Black and White subjects in AI-based CMR segmentation models.
Enhancing Generalized Few-Shot Semantic Segmentation via Effective Knowledge Transfer
Furthermore, existing GFSS approaches suffer from a lack of contextual information for novel classes due to their limited samples, we thereby introduce a context consistency learning scheme to transfer the contextual knowledge from base to novel classes.
Classifier calibration
Generalized Few-Shot Semantic Segmentation
+2
SEG-SAM: Semantic-Guided SAM for Unified Medical Image Segmentation
First, to avoid the potential conflict between binary and semantic predictions, we introduce a semantic-aware decoder independent of SAM's original decoder, specialized for both semantic segmentation on the prompted object and classification on unprompted objects in images.
Learning Flow Fields in Attention for Controllable Person Image Generation
Additionally, we show that our loss is model-agnostic and can be used to improve the performance of other diffusion models.
Ranked #1 on
Pose Transfer
on Deep-Fashion
(FID metric)
Optimizing Dense Visual Predictions Through Multi-Task Coherence and Prioritization
To enhance cross-task coherence, we introduce a trace-back method that improves both cross-task geometric and predictive features.
Aligning Few-Step Diffusion Models with Dense Reward Difference Learning
Experimental results demonstrate that SDPO consistently outperforms prior methods in reward-based alignment across diverse step configurations, underscoring its robust step generalization capabilities.
OpenPSG: Open-set Panoptic Scene Graph Generation via Large Multimodal Models
In this paper, we focus on the task of open-set relation prediction integrated with a pretrained open-set panoptic segmentation model to achieve true open-set panoptic scene graph generation (OpenPSG).
Bootstrapping Vision-language Models for Self-supervised Remote Physiological Measurement
Next, we introduce a frequency-oriented vision-text pair generation method by carefully creating contrastive spatio-temporal maps from positive and negative samples and designing proper text prompts to describe their relative ratios of signal frequencies.
CholecInstanceSeg: A Tool Instance Segmentation Dataset for Laparoscopic Surgery
Derived from the existing CholecT50 and Cholec80 datasets, CholecInstanceSeg provides novel annotations for laparoscopic cholecystectomy procedures in patients.
Memory-guided Network with Uncertainty-based Feature Augmentation for Few-shot Semantic Segmentation
To alleviate this dependence, few-shot semantic segmentation (FSS) is introduced to leverage the model trained on base classes with sufficient data into the segmentation of novel classes with few data.
Enhancing surgical instrument segmentation: integrating vision transformer insights with adapter
Given the scarcity of annotated data in this field, our work aims to develop a model that achieves competitive performance with training on limited datasets, while also enhancing model robustness in various surgical scenarios.
Ranked #3 on
Medical Image Segmentation
on ROBUST-MIS
Large Model driven Radiology Report Generation with Clinical Quality Reinforcement Learning
Finally, to better reflect the clinical significant and insignificant errors that radiologists would normally assign in the report, we introduce a novel clinical quality reinforcement learning strategy.
AdaTreeFormer: Few Shot Domain Adaptation for Tree Counting from a Single High-Resolution Image
Experimental results show that AdaTreeFormer significantly surpasses the state of the art, \eg in the cross domain from the Yosemite to Jiangsu dataset, it achieves a reduction of 15. 9 points in terms of the absolute counting errors and an increase of 10. 8\% in the accuracy of the detected trees' locations.
Multitask Learning in Minimally Invasive Surgical Vision: A Review
Recent advancements in machine learning and computer vision have led to successful applications in analyzing videos obtained from MIS with the promise of alleviating challenges in MIS videos.
Boosting Object Detection with Zero-Shot Day-Night Domain Adaptation
Previous methods mitigate this issue by exploring image enhancement or object detection techniques with real low-light image datasets.
VLPrompt: Vision-Language Prompting for Panoptic Scene Graph Generation
Leveraging the recent progress in Large Language Models (LLMs), we propose to use language information to assist relation prediction, particularly for rare relations.
Ranked #1 on
Panoptic Scene Graph Generation
on PSG Dataset
IMITATE: Clinical Prior Guided Hierarchical Vision-Language Pre-training
The framework derives multi-level visual features from the chest X-ray (CXR) images and separately aligns these features with the descriptive and the conclusive text encoded in the hierarchical medical report.
An investigation into the impact of deep learning model choice on sex and race bias in cardiac MR segmentation
However, the severity and nature of the bias varies between the models, highlighting the importance of model choice when attempting to train fair AI-based segmentation models for medical imaging tasks.
SegMatch: A semi-supervised learning method for surgical instrument segmentation
Surgical instrument segmentation is recognised as a key enabler to provide advanced surgical assistance and improve computer assisted interventions.
Ranked #4 on
Medical Image Segmentation
on ROBUST-MIS
(using extra training data)
When Multi-Task Learning Meets Partial Supervision: A Computer Vision Review
Second, it presents the different challenges arising from such a multi-objective optimisation scheme.
TreeFormer: a Semi-Supervised Transformer-based Framework for Tree Counting from a Single High Resolution Image
Automatic tree density estimation and counting using single aerial and satellite images is a challenging task in photogrammetry and remote sensing, yet has an important role in forest management.
LoSh: Long-Short Text Joint Prediction Network for Referring Video Object Segmentation
Referring video object segmentation (RVOS) aims to segment the target instance referred by a given text expression in a video clip.
Ranked #6 on
Referring Video Object Segmentation
on Ref-DAVIS17
Referring Expression Segmentation
Referring Video Object Segmentation
+2
HiLo: Exploiting High Low Frequency Relations for Unbiased Panoptic Scene Graph Generation
Existing unbiased methods tackle the long-tail problem by data/loss rebalancing to favor low-frequency relations.
Ranked #2 on
Panoptic Scene Graph Generation
on PSG Dataset
Multi-modal Large Language Model Enhanced Pseudo 3D Perception Framework for Visual Commonsense Reasoning
On the other hand, BLIP-2 as an MLLM is employed to process images and texts, and the referring expressions in texts involving specific visual objects are modified with linguistic object labels to serve as comprehensible MLLM inputs.
Domain-General Crowd Counting in Unseen Scenarios
In this paper, we aim to train a model based on a single source domain which can generalize well on any unseen domain.
Exploring and Eliciting Needs and Preferences from Editors for Wikidata Recommendations
Our aim with this paper is to elicit the user requirements for a Wikidata recommendations system.
$α$ DARTS Once More: Enhancing Differentiable Architecture Search by Masked Image Modeling
Differentiable architecture search (DARTS) has been a mainstream direction in automatic machine learning.
Facial Video-based Remote Physiological Measurement via Self-supervised Learning
Facial video-based remote physiological measurement aims to estimate remote photoplethysmography (rPPG) signals from human face videos and then measure multiple vital signs (e. g. heart rate, respiration frequency) from rPPG signals.
A systematic study of race and sex bias in CNN-based cardiac MR segmentation
We present the first systematic study of the impact of training set imbalance on race and sex bias in CNN-based segmentation.
Redesigning Multi-Scale Neural Network for Crowd Counting
In this work, we redesign the multi-scale neural network by introducing a hierarchical mixture of density experts, which hierarchically merges multi-scale density maps for crowd counting.
Enhancing Space-time Video Super-resolution via Spatial-temporal Feature Interaction
A popular solution is to first increase the frame rate of the video; then perform feature refinement among different frame features; and last increase the spatial resolutions of these features.
Dam reservoir extraction from remote sensing imagery using tailored metric learning strategies
Extensive experiments were conducted on this benchmark in the water body segmentation task, dam reservoir recognition task, and the joint dam reservoir extraction task.
Boosting Zero-shot Learning via Contrastive Optimization of Attribute Representations
In this paper, we propose a new framework to boost ZSL by explicitly learning attribute prototypes beyond images and contrastively optimizing them with attribute-level features within images.
Learning to Prompt for Open-Vocabulary Object Detection with Vision-Language Model
In this paper, we introduce a novel method, detection prompt (DetPro), to learn continuous prompt representations for open-vocabulary object detection based on the pre-trained vision-language model.
MFNet: Multi-class Few-shot Segmentation Network with Pixel-wise Metric Learning
Last, to enhance the embedding space learning, an additional pixel-wise metric learning module is introduced with triplet loss formulated on the pixel-level embedding of the input image.
Learning to Recommend Items to Wikidata Editors
The system uses a hybrid of content-based and collaborative filtering techniques to rank items for editors relying on both item features and item-editor previous interaction.
Detecting Human-Object Interaction with Mixed Supervision
Human object interaction (HOI) detection is an important task in image understanding and reasoning.
Fast Fourier Intrinsic Network
We address the problem of decomposing an image into albedo and shading.
Restoring Negative Information in Few-Shot Object Detection
In this paper, we restore the negative information in few-shot object detection by introducing a new negative- and positive-representative based metric learning framework and a new inference scheme with negative and positive representatives.
Defending Adversarial Examples via DNN Bottleneck Reinforcement
This paper presents a DNN bottleneck reinforcement scheme to alleviate the vulnerability of Deep Neural Networks (DNN) against adversarial attacks.
Towards Unsupervised Crowd Counting via Regression-Detection Bi-knowledge Transfer
We formulate the mutual transformations between the outputs of regression- and detection-based models as two scene-agnostic transformers which enable knowledge distillation between the two models.
Active Crowd Counting with Limited Supervision
To learn a reliable people counter from crowd images, head center annotations are normally required.
Training Object Detectors from Few Weakly-Labeled and Many Unlabeled Images
Weakly-supervised object detection attempts to limit the amount of supervision by dispensing the need for bounding boxes, but still assumes image-level labels on the entire training set.
Ranked #29 on
Weakly Supervised Object Detection
on PASCAL VOC 2012 test
(using extra training data)
Point in, Box out: Beyond Counting Persons in Crowds
In the end, we propose a curriculum learning strategy to train the network from images of relatively accurate and easy pseudo ground truth first.
Revisiting Perspective Information for Efficient Crowd Counting
Modern crowd counting methods employ deep neural networks to estimate crowd counts via crowd density regressions.
Crowd counting via scale-adaptive convolutional neural network
The task of crowd counting is to automatically estimate the pedestrian number in crowd images.
Weakly Supervised Object Localization Using Things and Stuff Transfer
We propose to help weakly supervised object localization for classes where location annotations are not available, by transferring things and stuff knowledge from a source set with available annotations.
Weakly Supervised Object Localization Using Size Estimates
We present a technique for weakly supervised object localization (WSOL), building on the observation that WSOL algorithms usually work better on images with bigger objects.
Early Burst Detection for Memory-Efficient Image Retrieval
Then, we show the interest of using this strategy in an asymmetrical manner, with only the database features being aggregated but not those of the query.
