Search Results for author:
Found 66 papers, 15 papers with code
Conformal Prediction and Human Decision Making
We identify ways in which conformal prediction sets and posthoc predictive uncertainty quantification more broadly are in tension with common goals and needs in human-AI decision making.
AskChart: Universal Chart Understanding through Textual Enhancement
To effectively train AskChart, we design a three-stage training strategy to align visual and textual modalities for learning robust visual-textual representations and optimizing the learning of the MoE layer.
Optimized Gradient Clipping for Noisy Label Learning
Previous research has shown that constraining the gradient of loss function with respect to model-predicted probabilities can enhance the model robustness against noisy labels.
Revisiting Energy-Based Model for Out-of-Distribution Detection
We recognize the "energy barrier" in OOD detection, which characterizes the energy difference between in-distribution (ID) and OOD samples and eases detection.
Out-of-Distribution Detection
Out of Distribution (OOD) Detection
Active Negative Loss: A Robust Framework for Learning with Noisy Labels
By replacing MAE in APL with our proposed NNLFs, we enhance APL and present a new framework called Active Negative Loss (ANL).
SIMS: Simulating Stylized Human-Scene Interactions with Retrieval-Augmented Script Generation
Simulating stylized human-scene interactions (HSI) in physical environments is a challenging yet fascinating task.
MolMetaLM: a Physicochemical Knowledge-Guided Molecular Meta Language Model
Most current molecular language models transfer the masked language model or image-text generation model from natural language processing to molecular field.
StreetviewLLM: Extracting Geographic Information Using a Chain-of-Thought Multimodal Large Language Model
Geospatial predictions are crucial for diverse fields such as disaster management, urban planning, and public health.
Unexploited Information Value in Human-AI Collaboration
Humans and AIs are often paired on decision tasks with the expectation of achieving complementary performance -- where the combination of human and AI outperforms either one alone.
Autoformalize Mathematical Statements by Symbolic Equivalence and Semantic Consistency
Autoformalization, the task of automatically translating natural language descriptions into a formal language, poses a significant challenge across various domains, especially in mathematics.
LinFormer: A Linear-based Lightweight Transformer Architecture For Time-Aware MIMO Channel Prediction
The emergence of 6th generation (6G) mobile networks brings new challenges in supporting high-mobility communications, particularly in addressing the issue of channel aging.
Weighted Diversified Sampling for Efficient Data-Driven Single-Cell Gene-Gene Interaction Discovery
Gene-gene interactions play a crucial role in the manifestation of complex human diseases.
CPFD: Confidence-aware Privileged Feature Distillation for Short Video Classification
To integrate both features while maintaining efficiency and manageable resource costs, we present Confidence-aware Privileged Feature Distillation (CPFD), which empowers features of an end-to-end multi-modal model by adaptively distilling privileged features during training.
FBINeRF: Feature-Based Integrated Recurrent Network for Pinhole and Fisheye Neural Radiance Fields
Furthermore, inaccurate depth initialization in DBARF results in erroneous geometric information affecting the overall convergence and quality of results.
ElicitationGPT: Text Elicitation Mechanisms via Language Models
Scoring rules evaluate probabilistic forecasts of an unknown state against the realized state and are a fundamental building block in the incentivized elicitation of information and the training of machine learning models.
A Textbook Remedy for Domain Shifts: Knowledge Priors for Medical Image Analysis
KnoBo uses retrieval-augmented language models to design an appropriate concept space paired with an automatic training procedure for recognizing the concept.
ChartInsights: Evaluating Multimodal Large Language Models for Low-Level Chart Question Answering
To further explore the limitations of MLLMs in low-level ChartQA, we conduct experiments that alter visual elements of charts (e. g., changing color schemes, adding image noise) to assess their impact on the task effectiveness.
Calibration Error for Decision Making
Calibration allows predictions to be reliably interpreted as probabilities by decision makers.
Neural Ordinary Differential Equation based Sequential Image Registration for Dynamic Characterization
Leveraging Neural Ordinary Differential Equations (ODE) for registration, this extension work discusses how this framework can aid in the characterization of sequential biological processes.
DD-RobustBench: An Adversarial Robustness Benchmark for Dataset Distillation
Dataset distillation is an advanced technique aimed at compressing datasets into significantly smaller counterparts, while preserving formidable training performance.
A Concept-based Interpretable Model for the Diagnosis of Choroid Neoplasias using Multimodal Data
Diagnosing rare diseases presents a common challenge in clinical practice, necessitating the expertise of specialists for accurate identification.
Ten computational challenges in human virome studies
In recent years, substantial advancements have been achieved in understanding the diversity of the human virome and its intricate roles in human health and diseases.
Robust Analysis of Multi-Task Learning Efficiency: New Benchmarks on Light-Weighed Backbones and Effective Measurement of Multi-Task Learning Challenges by Feature Disentanglement
One of the main motivations of MTL is to develop neural networks capable of inferring multiple tasks simultaneously.
An objective comparison of methods for augmented reality in laparoscopic liver resection by preoperative-to-intraoperative image fusion
A total of 6 teams from 4 countries participated, whose proposed methods were evaluated on 16 images and two preoperative 3D models from two patients.
A Decision Theoretic Framework for Measuring AI Reliance
We argue that the current definition of appropriate reliance used in such research lacks formal statistical grounding and can lead to contradictions.
Non-uniform Array and Frequency Spacing for Regularization-free Gridless DOA
The DOA is retrieved using a Vandermonde decomposition on the Toeplitz matrix obtained from the solution of the SDP.
Generating and Reweighting Dense Contrastive Patterns for Unsupervised Anomaly Detection
Recent unsupervised anomaly detection methods often rely on feature extractors pretrained with auxiliary datasets or on well-crafted anomaly-simulated samples.
Ranked #16 on
Anomaly Detection
on MVTec LOCO AD
Towards Establishing Dense Correspondence on Multiview Coronary Angiography: From Point-to-Point to Curve-to-Curve Query Matching
Coronary angiography is the gold standard imaging technique for studying and diagnosing coronary artery disease.
COVIDx CXR-4: An Expanded Multi-Institutional Open-Source Benchmark Dataset for Chest X-ray Image-Based Computer-Aided COVID-19 Diagnostics
The global ramifications of the COVID-19 pandemic remain significant, exerting persistent pressure on nations even three years after its initial outbreak.
Self-guided Few-shot Semantic Segmentation for Remote Sensing Imagery Based on Large Vision Models
The Segment Anything Model (SAM) exhibits remarkable versatility and zero-shot learning abilities, owing largely to its extensive training data (SA-1B).
NutritionVerse-Real: An Open Access Manually Collected 2D Food Scene Dataset for Dietary Intake Estimation
Dietary intake estimation plays a crucial role in understanding the nutritional habits of individuals and populations, aiding in the prevention and management of diet-related health issues.
The Role of Chain-of-Thought in Complex Vision-Language Reasoning Task
The study explores the effectiveness of the Chain-of-Thought approach, known for its proficiency in language tasks by breaking them down into sub-tasks and intermediate steps, in improving vision-language tasks that demand sophisticated perception and reasoning.
Ranked #1 on
Visual Reasoning
on Winoground
CoCA: Fusing Position Embedding with Collinear Constrained Attention in Transformers for Long Context Window Extending
In fact, anomalous behaviors harming long context extrapolation exist between Rotary Position Embedding (RoPE) and vanilla self-attention unveiled by our work.
NutritionVerse: Empirical Study of Various Dietary Intake Estimation Approaches
Recent work has focused on using computer vision and machine learning to automatically estimate dietary intake from food images, but the lack of comprehensive datasets with diverse viewpoints, modalities and food annotations hinders the accuracy and realism of such methods.
Fast GraspNeXt: A Fast Self-Attention Neural Network Architecture for Multi-task Learning in Computer Vision Tasks for Robotic Grasping on the Edge
As such, the design of highly efficient multi-task deep neural network architectures tailored for computer vision tasks for robotic grasping on the edge is highly desired for widespread adoption in manufacturing environments.
Learning to Incentivize Information Acquisition: Proper Scoring Rules Meet Principal-Agent Model
Such a problem is modeled as a Stackelberg game between the principal and the agent, where the principal announces a scoring rule that specifies the payment, and then the agent then chooses an effort level that maximizes her own profit and reports the information.
Gridless DOA Estimation with Multiple Frequencies
Direction-of-arrival (DOA) estimation is widely applied in acoustic source localization.
Mixture Proportion Estimation and PU Learning: A Modern Approach
Formally, this task is broken down into two subtasks: (i) Mixture Proportion Estimation (MPE) -- determining the fraction of positive examples in the unlabeled data; and (ii) PU-learning -- given such an estimate, learning the desired positive-versus-negative classifier.
On the Fairness of Swarm Learning in Skin Lesion Classification
Distributed and collaborative learning is an approach to involve training models in massive, heterogeneous, and distributed data sources, also known as nodes.
NODEO: A Neural Ordinary Differential Equation Based Optimization Framework for Deformable Image Registration
Deformable image registration (DIR), aiming to find spatial correspondence between images, is one of the most critical problems in the domain of medical image analysis.
A Pseudo Label-wise Attention Network for Automatic ICD Coding
The label-wise attention mechanism is widely used in automatic ICD coding because it can assign weights to every word in full Electronic Medical Records (EMR) for different ICD codes.
Mixture Proportion Estimation and PU Learning:A Modern Approach
Formally, this task is broken down into two subtasks: (i) Mixture Proportion Estimation (MPE)---determining the fraction of positive examples in the unlabeled data; and (ii) PU-learning---given such an estimate, learning the desired positive-versus-negative classifier.
Unsupervised Learning of Multi-level Structures for Anomaly Detection
This paper first introduces a novel method to generate anomalous data by breaking up global structures while preserving local structures of normal data at multiple levels.
On the Optimality of Batch Policy Optimization Algorithms
First, we introduce a class of confidence-adjusted index algorithms that unifies optimistic and pessimistic principles in a common framework, which enables a general analysis.
Instabilities of Offline RL with Pre-Trained Neural Representation
In offline reinforcement learning (RL), we seek to utilize offline data to evaluate (or learn) policies in scenarios where the data are collected from a distribution that substantially differs from that of the target policy to be evaluated.
Estimating and Improving Fairness with Adversarial Learning
To tackle this issue, we propose an adversarial multi-task training strategy to simultaneously mitigate and detect bias in the deep learning-based medical image analysis system.
Pre-trained Deep Convolution Neural Network Model With Attention for Speech Emotion Recognition
To establish an effective features extracting and classification model is still a challenging task.
BridgeDPI: A Novel Graph Neural Network for Predicting Drug-Protein Interactions
Therefore, we hope to develop a novel supervised learning method to learn the PPAs and DDAs effectively and thereby improve the prediction performance of the specific task of DPI.
SSLIDE: Sound Source Localization for Indoors based on Deep Learning
This paper presents SSLIDE, Sound Source Localization for Indoors using DEep learning, which applies deep neural networks (DNNs) with encoder-decoder structure to localize sound sources with random positions in a continuous space.
Quantization in Relative Gradient Angle Domain For Building Polygon Estimation
In this paper, we leverage the performance of CNNs, and propose a module that uses prior knowledge of building corners to create angular and concise building polygons from CNN segmentation outputs.
A Unified View of Label Shift Estimation
Our contributions include (i) consistency conditions for MLLS, which include calibration of the classifier and a confusion matrix invertibility condition that BBSE also requires; (ii) a unified framework, casting BBSE as roughly equivalent to MLLS for a particular choice of calibration method; and (iii) a decomposition of MLLS's finite-sample error into terms reflecting miscalibration and estimation error.
Learning to Combat Compounding-Error in Model-Based Reinforcement Learning
Despite its potential to improve sample complexity versus model-free approaches, model-based reinforcement learning can fail catastrophically if the model is inaccurate.
Model-based Reinforcement Learning
reinforcement-learning
+2
Game Design for Eliciting Distinguishable Behavior
The ability to inferring latent psychological traits from human behavior is key to developing personalized human-interacting machine learning systems.
Behavior Regularized Offline Reinforcement Learning
In reinforcement learning (RL) research, it is common to assume access to direct online interactions with the environment.
Enhanced generative adversarial network for 3D brain MRI super-resolution
Single image super-resolution (SISR) reconstruction for magnetic resonance imaging (MRI) has generated significant interest because of its potential to not only speed up imaging but to improve quantitative processing and analysis of available image data.
Stochastic Learning of Additive Second-Order Penalties with Applications to Fairness
In non-convex settings, the resulting problem may be difficult to solve as the Lagrangian is not guaranteed to have a deterministic saddle-point equilibrium.
Domain Adaptation with Asymmetrically-Relaxed Distribution Alignment
Domain adaptation addresses the common problem when the target distribution generating our test data drifts from the source (training) distribution.
Repetitive Motion Estimation Network: Recover cardiac and respiratory signal from thoracic imaging
Tracking organ motion is important in image-guided interventions, but motion annotations are not always easily available.
The Laplacian in RL: Learning Representations with Efficient Approximations
In this paper, we present a fully general and scalable method for approximating the eigenvectors of the Laplacian in a model-free RL context.
Aerial Imagery for Roof Segmentation: A Large-Scale Dataset towards Automatic Mapping of Buildings
In this paper, we present a new large-scale benchmark dataset termed Aerial Imagery for Roof Segmentation (AIRS).
Privacy-Protective-GAN for Face De-identification
In this paper, we propose a new framework called Privacy-Protective-GAN (PP-GAN) that adapts GAN with novel verificator and regulator modules specially designed for the face de-identification problem to ensure generating de-identified output with retained structure similarity according to a single input.
Generating Synthetic X-ray Images of a Person from the Surface Geometry
Furthermore, the synthetic X-ray image is parametrized and can be manipulated by adjusting a set of body markers which are also generated during the X-ray image prediction.
Towards Understanding the Generalization Bias of Two Layer Convolutional Linear Classifiers with Gradient Descent
A major challenge in understanding the generalization of deep learning is to explain why (stochastic) gradient descent can exploit the network architecture to find solutions that have good generalization performance when using high capacity models.
Planar Object Tracking in the Wild: A Benchmark
In this paper, we present a carefully designed planar object tracking benchmark containing 210 videos of 30 planar objects sampled in the natural environment.
Conservative Bandits
We consider both the stochastic and the adversarial settings, where we propose, natural, yet novel strategies and analyze the price for maintaining the constraints.
Online Learning with Gaussian Payoffs and Side Observations
For the first time in the literature, we provide non-asymptotic problem-dependent lower bounds on the regret of any algorithm, which recover existing asymptotic problem-dependent lower bounds and finite-time minimax lower bounds available in the literature.
