Search Results for author:
Found 78 papers, 30 papers with code
Federated Continual Learning for Edge-AI: A Comprehensive Survey
Edge-AI, the convergence of edge computing and artificial intelligence (AI), has become a promising paradigm that enables the deployment of advanced AI models at the network edge, close to users.
Functional Homotopy: Smoothing Discrete Optimization via Continuous Parameters for LLM Jailbreak Attacks
Optimization methods are widely employed in deep learning to identify and mitigate undesired model responses.
Autonomous Character-Scene Interaction Synthesis from Text Instruction
Synthesizing human motions in 3D environments, particularly those with complex activities such as locomotion, hand-reaching, and human-object interaction, presents substantial demands for user-defined waypoints and stage transitions.
Optimal Trade and Industrial Policies in the Global Economy: A Deep Learning Framework
We propose a deep learning framework, DL-opt, designed to efficiently solve for optimal policies in quantifiable general equilibrium trade models.
Small Aerial Target Detection for Airborne Infrared Detection Systems using LightGBM and Trajectory Constraints
A simple and effective small aerial target detection method for airborne infrared detection system using light gradient boosting model (LightGBM) and trajectory constraints is proposed in this article.
CMRxRecon2024: A Multi-Modality, Multi-View K-Space Dataset Boosting Universal Machine Learning for Accelerated Cardiac MRI
To the best of our knowledge, the CMRxRecon2024 dataset is the largest and most diverse publicly available cardiac k-space dataset.
Simultaneous Deep Learning of Myocardium Segmentation and T2 Quantification for Acute Myocardial Infarction MRI
A tight coupling module aligns and fuses CNN and Transformer branch features, enabling SQNet to focus on myocardium regions.
TD-NeRF: Novel Truncated Depth Prior for Joint Camera Pose and Neural Radiance Field Optimization
Our approach explicitly utilizes monocular depth priors through three key advancements: 1) we propose a novel depth-based ray sampling strategy based on the truncated normal distribution, which improves the convergence speed and accuracy of pose estimation; 2) to circumvent local minima and refine depth geometry, we introduce a coarse-to-fine training strategy that progressively improves the depth precision; 3) we propose a more robust inter-frame point constraint that enhances robustness against depth noise during training.
The state-of-the-art in Cardiac MRI Reconstruction: Results of the CMRxRecon Challenge in MICCAI 2023
To address this issue, we organized the Cardiac MRI Reconstruction Challenge (CMRxRecon) in 2023, in collaboration with the 26th International Conference on MICCAI.
Deep Separable Spatiotemporal Learning for Fast Dynamic Cardiac MRI
This challenge necessitates extensive training data in deep learning reconstruction methods.
Editable Scene Simulation for Autonomous Driving via Collaborative LLM-Agents
Furthermore, to unleash the potential of extensive high-quality digital assets, ChatSim employs a novel multi-camera lighting estimation method to achieve scene-consistent assets' rendering.
REDUCR: Robust Data Downsampling Using Class Priority Reweighting
REDUCR reduces the training data while preserving worst-class generalization performance.
Transfer Learning for Bayesian Optimization on Heterogeneous Search Spaces
Bayesian optimization (BO) is a popular black-box function optimization method, which makes sequential decisions based on a Bayesian model, typically a Gaussian process (GP), of the function.
A plug-and-play synthetic data deep learning for undersampled magnetic resonance image reconstruction
Magnetic resonance imaging (MRI) plays an important role in modern medical diagnostic but suffers from prolonged scan time.
One for Multiple: Physics-informed Synthetic Data Boosts Generalizable Deep Learning for Fast MRI Reconstruction
We demonstrate that training DL models on synthetic data, coupled with enhanced learning techniques, yields in vivo MRI reconstructions comparable to or surpassing those of models trained on matched realistic datasets, reducing the reliance on real-world MRI data by up to 96%.
Towards Heterogeneous Long-tailed Learning: Benchmarking, Metrics, and Toolbox
Long-tailed data distributions pose challenges for a variety of domains like e-commerce, finance, biomedical science, and cyber security, where the performance of machine learning models is often dominated by head categories while tail categories are inadequately learned.
On Evaluating Multilingual Compositional Generalization with Translated Datasets
To address this limitation, we craft a faithful rule-based translation of the MCWQ dataset from English to Chinese and Japanese.
Grammar Prompting for Domain-Specific Language Generation with Large Language Models
Large language models (LLMs) can learn to perform a wide range of natural language tasks from just a handful of in-context examples.
Dynamic Enhancement Network for Partial Multi-modality Person Re-identification
Many existing multi-modality studies are based on the assumption of modality integrity.
Rethinking Diversity in Deep Neural Network Testing
We note that the objective of testing DNNs is specific and well-defined: identifying inputs that lead to misclassifications.
Flare-Aware Cross-modal Enhancement Network for Multi-spectral Vehicle Re-identification
Finally, to evaluate the proposed FACENet in handling intense flare, we introduce a new multi-spectral vehicle re-ID dataset, called WMVEID863, with additional challenges such as motion blur, significant background changes, and particularly intense flare degradation.
Interruption-Aware Cooperative Perception for V2X Communication-Aided Autonomous Driving
To achieve comprehensive recovery, we design a communication-adaptive multi-scale spatial-temporal prediction model to extract multi-scale spatial-temporal features based on V2X communication conditions and capture the most significant information for the prediction of the missing information.
Efficient Symbolic Reasoning for Neural-Network Verification
They allow us to encode many verification problems for neural networks as quadratic programs.
TBP-Former: Learning Temporal Bird's-Eye-View Pyramid for Joint Perception and Prediction in Vision-Centric Autonomous Driving
Second, a spatial-temporal pyramid transformer is introduced to comprehensively extract multi-scale BEV features and predict future BEV states with the support of spatial-temporal priors.
Ranked #2 on
Bird's-Eye View Semantic Segmentation
on nuScenes
(IoU ped - 224x480 - Vis filter. - 100x100 at 0.5 metric)
Oriented Object Detection in Optical Remote Sensing Images using Deep Learning: A Survey
Given the rapid development of this field, this paper aims to provide a comprehensive survey of recent advances in oriented object detection.
Enhancing Non-line-of-sight Imaging via Learnable Inverse Kernel and Attention Mechanisms
Recovering information from non-line-of-sight (NLOS) imaging is a computationally-intensive inverse problem.
Bridging the Domain Gap in Satellite Pose Estimation: a Self-Training Approach based on Geometrical Constraints
Recently, unsupervised domain adaptation in satellite pose estimation has gained increasing attention, aiming at alleviating the annotation cost for training deep models.
HyperBO+: Pre-training a universal prior for Bayesian optimization with hierarchical Gaussian processes
However, those prior learning methods typically assume that the input domains are the same for all tasks, weakening their ability to use observations on functions with different domains or generalize the learned priors to BO on different search spaces.
CloudBrain-ReconAI: An Online Platform for MRI Reconstruction and Image Quality Evaluation
Efficient collaboration between engineers and radiologists is important for image reconstruction algorithm development and image quality evaluation in magnetic resonance imaging (MRI).
Alternating Deep Low-Rank Approach for Exponential Function Reconstruction and Its Biomedical Magnetic Resonance Applications
Undersampling can accelerate the signal acquisition but at the cost of bringing in artifacts.
A Faithful Deep Sensitivity Estimation for Accelerated Magnetic Resonance Imaging
To understand the behavior of the network, the mutual promotion of sensitivity estimation and image reconstruction is revealed through the visualization of network intermediate results.
Physics-informed Deep Diffusion MRI Reconstruction with Synthetic Data: Break Training Data Bottleneck in Artificial Intelligence
In conclusion, PIDD presents a novel deep learning framework by exploiting the power of MRI physics, providing a cost-effective and explainable way to break the data bottleneck in deep learning medical imaging.
Parallel Augmentation and Dual Enhancement for Occluded Person Re-identification
To alleviate these two issues, we propose a simple yet effective method with Parallel Augmentation and Dual Enhancement (PADE), which is robust on both occluded and non-occluded data and does not require any auxiliary clues.
Plex: Towards Reliability using Pretrained Large Model Extensions
A recent trend in artificial intelligence is the use of pretrained models for language and vision tasks, which have achieved extraordinary performance but also puzzling failures.
Pre-training helps Bayesian optimization too
Contrary to a common belief that BO is suited to optimizing black-box functions, it actually requires domain knowledge on characteristics of those functions to deploy BO successfully.
Towards Learning Universal Hyperparameter Optimizers with Transformers
Meta-learning hyperparameter optimization (HPO) algorithms from prior experiments is a promising approach to improve optimization efficiency over objective functions from a similar distribution.
A Paired Phase and Magnitude Reconstruction for Advanced Diffusion-Weighted Imaging
Conclusion: The explicit phase model PAIR with complementary priors has a good performance on challenging reconstructions under inter-shot motions between shots and a low signal-to-noise ratio.
Physics-driven Synthetic Data Learning for Biomedical Magnetic Resonance
Deep learning has innovated the field of computational imaging.
DialogueNeRF: Towards Realistic Avatar Face-to-Face Conversation Video Generation
In this paper, we propose a novel unified framework based on neural radiance field (NeRF) to address this task.
A Quantitative Geometric Approach to Neural-Network Smoothness
In this work, we provide a unified theoretical framework, a quantitative geometric approach, to address the Lipschitz constant estimation.
Onsite Non-Line-of-Sight Imaging via Online Calibrations
There has been an increasing interest in deploying non-line-of-sight (NLOS) imaging systems for recovering objects behind an obstacle.
One-dimensional Deep Low-rank and Sparse Network for Accelerated MRI
Deep learning has shown astonishing performance in accelerated magnetic resonance imaging (MRI).
Pre-trained Gaussian Processes for Bayesian Optimization
Contrary to a common expectation that BO is suited to optimizing black-box functions, it actually requires domain knowledge about those functions to deploy BO successfully.
Zero-Shot Knowledge Distillation from a Decision-Based Black-Box Model
Here we propose the concept of decision-based black-box (DB3) knowledge distillation, with which the student is trained by distilling the knowledge from a black-box teacher (parameters are not accessible) that only returns classes rather than softmax outputs.
XCloud-pFISTA: A Medical Intelligence Cloud for Accelerated MRI
Machine learning and artificial intelligence have shown remarkable performance in accelerated magnetic resonance imaging (MRI).
Data-Free Knowledge Distillation with Soft Targeted Transfer Set Synthesis
Knowledge distillation (KD) has proved to be an effective approach for deep neural network compression, which learns a compact network (student) by transferring the knowledge from a pre-trained, over-parameterized network (teacher).
Convolutional Neural Network Pruning with Structural Redundancy Reduction
Based on this finding, we then propose a network pruning approach that identifies structural redundancy of a CNN and prunes filters in the selected layer(s) with the most redundancy.
Engineering the light coupling between metalens and photonic crystal resonators for robust on-chip microsystems
We designed an on-chip transformative optic system of a metalens-photonic crystal resonator metasystem on a foundry compatible silicon photonic platform.
Optics
Exploring Adversarial Robustness of Deep Metric Learning
Deep Metric Learning (DML), a widely-used technique, involves learning a distance metric between pairs of samples.
Magnetic Resonance Spectroscopy Deep Learning Denoising Using Few In Vivo Data
A deep learning model, Refusion Long Short-Term Memory (ReLSTM), was designed to learn the mapping from the low SNR time-domain data (24 SA) to the high SNR one (128 SA).
Non-line-of-Sight Imaging via Neural Transient Fields
We present a neural modeling framework for Non-Line-of-Sight (NLOS) imaging.
Adversarial Deep Metric Learning
To the best of our knowledge, we are the first to systematically analyze this dependence effect and propose a principled approach for robust training of deep metric learning networks that accounts for the nuances of metric losses.
Generalized Universal Approximation for Certified Networks
To certify safety and robustness of neural networks, researchers have successfully applied abstract interpretation, primarily using interval bound propagation.
A Sparse Model-inspired Deep Thresholding Network for Exponential Signal Reconstruction -- Application in Fast Biological Spectroscopy
The non-uniform sampling is a powerful approach to enable fast acquisition but requires sophisticated reconstruction algorithms.
Exponential Signal Reconstruction with Deep Hankel Matrix Factorization
Exponential is a basic signal form, and how to fast acquire this signal is one of the fundamental problems and frontiers in signal processing.
Interval Universal Approximation for Neural Networks
This is a crucial question, as our constructive proof of IUA is exponential in the size of the approximation domain.
Learning compositional models of robot skills for task and motion planning
We use, and develop novel improvements on, state-of-the-art methods for active learning and sampling.
TOFU: Target-Oriented FUzzer
TOFU is also input-structure aware (i. e., the search makes use of a specification of a superset of the program's allowed inputs).
Software Engineering
Semantic Robustness of Models of Source Code
Deep neural networks are vulnerable to adversarial examples - small input perturbations that result in incorrect predictions.
Review and Prospect: Deep Learning in Nuclear Magnetic Resonance Spectroscopy
In this Minireview, we summarize applications of DL in Nuclear Magnetic Resonance (NMR) spectroscopy and outline a perspective for DL as entirely new approaches that are likely to transform NMR spectroscopy into a much more efficient and powerful technique in chemistry and life science.
Investigating Channel Pruning through Structural Redundancy Reduction -- A Statistical Study
Most existing channel pruning methods formulate the pruning task from a perspective of inefficiency reduction which iteratively rank and remove the least important filters, or find the set of filters that minimizes some reconstruction errors after pruning.
Single-shot Channel Pruning Based on Alternating Direction Method of Multipliers
In this work, we propose a novel single-shot channel pruning approach based on alternating direction methods of multipliers (ADMM), which can eliminate the need for complex iterative pruning and fine-tuning procedure and achieve a target compression ratio with only one run of pruning and fine-tuning.
Speeding up convolutional networks pruning with coarse ranking
In specific, with the proposed method, 75% and 54% of the total computation time for the whole pruning procedure can be reduced for AlexNet on CIFAR-10, and for VGG-16 on ImageNet, respectively.
Regret bounds for meta Bayesian optimization with an unknown Gaussian process prior
Bayesian optimization usually assumes that a Bayesian prior is given.
Learning sparse relational transition models
For any action, a rule selects a set of relevant objects and computes a distribution over properties of just those objects in the resulting state given their properties in the previous state.
Learning to guide task and motion planning using score-space representation
In this paper, we propose a learning algorithm that speeds up the search in task and motion planning problems.
Fast-converging Conditional Generative Adversarial Networks for Image Synthesis
Building on top of the success of generative adversarial networks (GANs), conditional GANs attempt to better direct the data generation process by conditioning with certain additional information.
Active model learning and diverse action sampling for task and motion planning
Solving long-horizon problems in complex domains requires flexible generative planning that can combine primitive abilities in novel combinations to solve problems as they arise in the world.
Deep Reinforcement Learning of Cell Movement in the Early Stage of C. elegans Embryogenesis
However, the application of these systems to model cell movement is still challenging and requires a comprehensive understanding of regulation networks at the right scales.
Batched Large-scale Bayesian Optimization in High-dimensional Spaces
Bayesian optimization (BO) has become an effective approach for black-box function optimization problems when function evaluations are expensive and the optimum can be achieved within a relatively small number of queries.
Max-value Entropy Search for Efficient Bayesian Optimization
We propose a new criterion, Max-value Entropy Search (MES), that instead uses the information about the maximum function value.
Batched High-dimensional Bayesian Optimization via Structural Kernel Learning
Optimization of high-dimensional black-box functions is an extremely challenging problem.
Focused Model-Learning and Planning for Non-Gaussian Continuous State-Action Systems
We introduce a framework for model learning and planning in stochastic domains with continuous state and action spaces and non-Gaussian transition models.
Studying the brain from adolescence to adulthood through sparse multi-view matrix factorisations
These latent factors can be used to produce low-dimensional visualisations of the data that emphasise age-specific effects once the shared effects have been accounted for.
Optimization as Estimation with Gaussian Processes in Bandit Settings
Recently, there has been rising interest in Bayesian optimization -- the optimization of an unknown function with assumptions usually expressed by a Gaussian Process (GP) prior.
Sparse multi-view matrix factorisation: a multivariate approach to multiple tissue comparisons
The proposed methodology can be interpreted as an extension of principal component analysis in that it provides the means to decompose the total sample variance in each tissue into the sum of two components: one capturing the variance that is shared across tissues, and one isolating the tissue-specific variances.
An Asynchronous Distributed Proximal Gradient Method for Composite Convex Optimization
We propose a distributed first-order augmented Lagrangian (DFAL) algorithm to minimize the sum of composite convex functions, where each term in the sum is a private cost function belonging to a node, and only nodes connected by an edge can directly communicate with each other.
Optimization and Control
Scalable Inference for Logistic-Normal Topic Models
Logistic-normal topic models can effectively discover correlation structures among latent topics.
