Search Results for author:
Found 182 papers, 46 papers with code
Max-Margin based Discriminative Feature Learning
In this paper, we propose a new max-margin based discriminative feature learning method.
Dynamic Structure Embedded Online Multiple-Output Regression for Stream Data
MORES can \emph{dynamically} learn the structure of the coefficients change in each update step to facilitate the model's continuous refinement.
Fingertip in the Eye: A cascaded CNN pipeline for the real-time fingertip detection in egocentric videos
We introduce a new pipeline for hand localization and fingertip detection.
End to End Learning for Self-Driving Cars
The system automatically learns internal representations of the necessary processing steps such as detecting useful road features with only the human steering angle as the training signal.
Blocking Collapsed Gibbs Sampler for Latent Dirichlet Allocation Models
In this article, we introduce a blocking scheme to the collapsed Gibbs sampler for the LDA model which can, with a theoretical guarantee, improve chain mixing efficiency.
Learning Multi-level Features For Sensor-based Human Action Recognition
This paper proposes a multi-level feature learning framework for human action recognition using a single body-worn inertial sensor.
FuRongWang at SemEval-2017 Task 3: Deep Neural Networks for Selecting Relevant Answers in Community Question Answering
We describes deep neural networks frameworks in this paper to address the community question answering (cQA) ranking task (SemEval-2017 task 3).
Sleep Stage Classification Based on Multi-level Feature Learning and Recurrent Neural Networks via Wearable Device
The feature learning framework is designed to extract low- and mid-level features.
Automatic Sleep Stage Classification
General Classification
+1
Aspect-level Sentiment Classification with HEAT (HiErarchical ATtention) Network
However, the prior work only attends to the sentiment information and ignores the aspect-related information in the text, which may cause mismatching between the sentiment words and the aspects when an unrelated sentiment word is semantically meaningful for the given aspect.
Interpreting Neural Network Judgments via Minimal, Stable, and Symbolic Corrections
We argue that such a correction is a useful way to provide feedback to a user when the network's output is different from a desired output.
Land use mapping in the Three Gorges Reservoir Area based on semantic segmentation deep learning method
In this paper, we first test the state of the art semantic segmentation deep learning classifiers for LUCC mapping with 7 categories in the TGRA area with rapideye 5m resolution data.
Taming Convergence for Asynchronous Stochastic Gradient Descent with Unbounded Delay in Non-Convex Learning
Understanding the convergence performance of asynchronous stochastic gradient descent method (Async-SGD) has received increasing attention in recent years due to their foundational role in machine learning.
Skeleton-based Gesture Recognition Using Several Fully Connected Layers with Path Signature Features and Temporal Transformer Module
In this paper, we first leverage a robust feature descriptor, path signature (PS), and propose three PS features to explicitly represent the spatial and temporal motion characteristics, i. e., spatial PS (S_PS), temporal PS (T_PS) and temporal spatial PS (T_S_PS).
Ranked #1 on
Gesture Recognition
on ChaLearn 2013
Watermark Retrieval from 3D Printed Objects via Convolutional Neural Networks
We present a method for reading digital data embedded in planar 3D printed surfaces.
Probabilistic Verification of Fairness Properties via Concentration
As machine learning systems are increasingly used to make real world legal and financial decisions, it is of paramount importance that we develop algorithms to verify that these systems do not discriminate against minorities.
On-line Search History-assisted Restart Strategy for Covariance Matrix Adaptation Evolution Strategy
The entire on-line search history of cNrGA is stored in a binary space partitioning (BSP) tree, which is effective for performing local search.
The Random Conditional Distribution for Higher-Order Probabilistic Inference
The need to condition distributional properties such as expectation, variance, and entropy arises in algorithmic fairness, model simplification, robustness and many other areas.
Spatial CUSUM for Signal Region Detection
We develop theoretical properties of the method which indicates that asymptotically SCUSUM can reach high classification accuracy.
Watermark retrieval from 3D printed objects via synthetic data training
We conclude that in our application domain of information retrieval from 3D printed objects, where access to the exact CAD files of the printed objects can be assumed, one can use inexpensive synthetic data to enhance neural network training, reducing the need for the labour intensive process of creating large amounts of hand labelled real data or the need to generate photorealistic synthetic data.
Distributed Linear Model Clustering over Networks: A Tree-Based Fused-Lasso ADMM Approach
In this work, we consider to improve the model estimation efficiency by aggregating the neighbors' information as well as identify the subgroup membership for each node in the network.
Machine Reading Comprehension: a Literature Review
Machine reading comprehension aims to teach machines to understand a text like a human and is a new challenging direction in Artificial Intelligence.
Neural Machine Reading Comprehension: Methods and Trends
Machine reading comprehension (MRC), which requires a machine to answer questions based on a given context, has attracted increasing attention with the incorporation of various deep-learning techniques over the past few years.
Byzantine-Resilient Stochastic Gradient Descent for Distributed Learning: A Lipschitz-Inspired Coordinate-wise Median Approach
In this work, we consider the resilience of distributed algorithms based on stochastic gradient descent (SGD) in distributed learning with potentially Byzantine attackers, who could send arbitrary information to the parameter server to disrupt the training process.
PolSAR Image Classification Based on Dilated Convolution and Pixel-Refining Parallel Mapping network in the Complex Domain
For general supervised deep learning classification algorithms, the pixel-by-pixel algorithm achieves precise yet inefficient classification with a small number of labeled pixels, whereas the pixel mapping algorithm achieves efficient yet edge-rough classification with more prior labels required.
ASYNCHRONOUS MULTI-AGENT GENERATIVE ADVERSARIAL IMITATION LEARNING
Imitation learning aims to inversely learn a policy from expert demonstrations, which has been extensively studied in the literature for both single-agent setting with Markov decision process (MDP) model, and multi-agent setting with Markov game (MG) model.
Air-Writing Translater: A Novel Unsupervised Domain Adaptation Method for Inertia-Trajectory Translation of In-air Handwriting
As a new way of human-computer interaction, inertial sensor based in-air handwriting can provide a natural and unconstrained interaction to express more complex and richer information in 3D space.
Spectrogram-frame linear network and continuous frame sequence for bird sound classification
Inspired by that bird sound has various frequency distributions and continuous time-varying properties, a novel method is proposed for the classification of bird sound based on continuous frame sequence and spectrogram-frame linear network (SFLN).
Blockchain for Future Smart Grid: A Comprehensive Survey
In this paper, we aim to provide a comprehensive survey on application of blockchain in smart grid.
Cryptography and Security Distributed, Parallel, and Cluster Computing Networking and Internet Architecture Social and Information Networks Systems and Control Systems and Control
Finite-Time 4-Expert Prediction Problem
We explicitly solve the nonlinear PDE that is the continuous limit of dynamic programming of \emph{expert prediction problem} in finite horizon setting with $N=4$ experts.
ResNetX: a more disordered and deeper network architecture
Our architecture is a natural extension to ResNet, and can be integrated with existing state-of-the-art methods with little effort.
Private and Communication-Efficient Edge Learning: A Sparse Differential Gaussian-Masking Distributed SGD Approach
In this paper, we consider the problem of jointly improving data privacy and communication efficiency of distributed edge learning, both of which are critical performance metrics in wireless edge network computing.
Complexity of tree-coloring interval graphs equitably
An equitable tree-$k$-coloring of a graph is a vertex $k$-coloring such that each color class induces a forest and the size of any two color classes differ by at most one.
Combinatorics Discrete Mathematics
Malicious Experts versus the multiplicative weights algorithm in online prediction
We assume that one of the experts is honest and makes correct prediction with probability $\mu$ at each round.
HF-UNet: Learning Hierarchically Inter-Task Relevance in Multi-Task U-Net for Accurate Prostate Segmentation
In this paper, we tackle the challenging task of prostate segmentation in CT images by a two-stage network with 1) the first stage to fast localize, and 2) the second stage to accurately segment the prostate.
Generalization Study of Quantum Neural Network
In this model, we mapped the feature data to a quantum state in Hilbert space firstly, and then implement unitary evolution on it, in the end, we can get the classification result by im-plement measurement on the quantum state.
A Computer Vision Aided Beamforming Scheme with EM Exposure Control in Outdoor LOS Scenarios
The proposed exposure avoidance method is validated in simulations, and the results show that the finer beam management granularity can guarantee communication quality while reducing the electromagnetic exposure.
A study of the effect of the illumination model on the generation of synthetic training datasets
Our results show that the effect of the illumination model is important, comparable in significance to the network architecture.
A Computer Vision Based Beamforming Scheme for Millimeter Wave Communication in LOS Scenarios
A novel location-aware beamforming scheme for millimeter wave communication is proposed for line of sight (LOS) and low mobility scenarios, in which computer vision is introduced to derive the required position or spatial angular information from the image or video captured by camera(s) co-located with mmWave antenna array at base stations.
An Explainable 3D Residual Self-Attention Deep Neural Network FOR Joint Atrophy Localization and Alzheimer's Disease Diagnosis using Structural MRI
Different from the existing approaches, the novelty of our approach is three-fold: 1) A Residual Self-Attention Deep Neural Network has been proposed to capture local, global and spatial information of MR images to improve diagnostic performance; 2) An explanation method using Gradient-based Localization Class Activation mapping (Grad-CAM) has been introduced to improve the explainable of the proposed method; 3) This work has provided a full end-to-end learning solution for automated disease diagnosis.
Worst-Case-Aware Curriculum Learning for Zero and Few Shot Transfer
Multi-task transfer learning based on pre-trained language encoders achieves state-of-the-art performance across a range of tasks.
$f$-GAIL: Learning $f$-Divergence for Generative Adversarial Imitation Learning
This naturally gives rise to the following question: Given a set of expert demonstrations, which divergence can recover the expert policy more accurately with higher data efficiency?
A Novel Semi-Supervised Data-Driven Method for Chiller Fault Diagnosis with Unlabeled Data
Usually, the number of labeled data is limited and most data available are unlabeled.
Prediction against a limited adversary
We study the problem of prediction with expert advice with adversarial corruption where the adversary can at most corrupt one expert.
f-GAIL: Learning f-Divergence for Generative Adversarial Imitation Learning
This naturally gives rise to the following question: Given a set of expert demonstrations, which divergence can recover the expert policy more accurately with higher data efficiency?
K-core in percolated dense graph sequences
Keeping an edge $(i, j)$ of $G_n$ with probability $\min \{ {a^n_{i, j}}/{n}, 1 \}$ independently, we obtain a sequence of random graphs $G_n(\frac{1}{n})$.
Probability Combinatorics
Super strong paramagnetism of aromatic peptides adsorbed with monovalent cations
We experimentally demonstrated that the AYFFF self-assemblies adsorbed with various monovalent cations (Na+, K+, and Li+) show unexpectedly super strong paramagnetism.
Biological Physics
Spectroscopic and Photometric Redshift Estimation by Neural Networks For the China Space Station Optical Survey (CSS-OS)
This indicates that the neural network method is feasible and powerful for spec-z and photo-z estimations in future cosmological surveys.
Photometric Redshift Estimation
Cosmology and Nongalactic Astrophysics
Designing 24-hour Electrical Power Generator: Thermoradiative Device for Harvesting Energy from Sun and Outer Space
Energy harvesting from sun and outer space using thermoradiative devices (TRD), despite being promising renewable energy sources, are limited only to daytime and nighttime period, respectively.
Applied Physics Mesoscale and Nanoscale Physics
Relieving the $H_0$ tension with a new interacting dark energy model
Here we explain this model as a scenario of vacuum energy interacting with matter and radiation.
Cosmology and Nongalactic Astrophysics General Relativity and Quantum Cosmology High Energy Physics - Phenomenology
Phantom Bethe roots in the integrable open spin $1/2$ $XXZ$ chain
Bethe eigenstates are described by two complementary sets of Bethe Ansatz equations for regular roots, one for each invariant subspace.
Statistical Mechanics Mathematical Physics Mathematical Physics Quantum Physics
Phantom Bethe excitations and spin helix eigenstates in integrable periodic and open spin chains
The phantom Bethe roots lead to degeneracies between different magnetization sectors in the periodic case and to the appearance of spin helix states (SHS), i. e. periodically modulated states of chiral nature in both open and closed systems.
Statistical Mechanics Mathematical Physics Mathematical Physics Quantum Physics
Constraints on interacting dark energy models from time-delay cosmography with seven lensed quasars
When the TD data are added to the CMB$+$BAO$+$SN$+H_0$ data, we find that: (i) the coupling parameter $\beta$ in all the considered IDE models is positive within 1$\sigma$ range, implying a mild preference for the case of cold dark matter decaying into dark energy; (ii) the IDE model with $Q = \beta H_{0} \rho_{\rm c}$ slightly relieves the $S_8$ tension, but the other considered IDE models further aggravate this tension; (iii) the Akaike information criteria of the IDE models with $Q \propto \rho_{\rm c}$ are lower than that of the $\Lambda$CDM model, indicating that these IDE models are more preferred by the current mainstream data.
Cosmology and Nongalactic Astrophysics General Relativity and Quantum Cosmology High Energy Physics - Phenomenology
Genetic Algorithm based hyper-parameters optimization for transfer Convolutional Neural Network
Decision of transfer layers and trainable layers is a major task for design of the transfer convolutional neural networks (CNN).
Constructing long-short stock portfolio with a new listwise learn-to-rank algorithm
Our loss function, motivated by the long-short strategy, is endogenously shift-invariant and can be viewed as a direct generalization of ListMLE.
GT-STORM: Taming Sample, Communication, and Memory Complexities in Decentralized Non-Convex Learning
Decentralized nonconvex optimization has received increasing attention in recent years in machine learning due to its advantages in system robustness, data privacy, and implementation simplicity.
Cross-Modality Brain Tumor Segmentation via Bidirectional Global-to-Local Unsupervised Domain Adaptation
Specifically, a bidirectional image synthesis and segmentation module is proposed to segment the brain tumor using the intermediate data distributions generated for the two domains, which includes an image-to-image translator and a shared-weighted segmentation network.
Crowdsourcing Learning as Domain Adaptation: A Case Study on Named Entity Recognition
Crowdsourcing is regarded as one prospective solution for effective supervised learning, aiming to build large-scale annotated training data by crowd workers.
Towards interpreting computer vision based on transformation invariant optimization
Interpreting how does deep neural networks (DNNs) make predictions is a vital field in artificial intelligence, which hinders wide applications of DNNs.
Anarchic Federated Learning
To satisfy the need for flexible worker participation, we consider a new FL paradigm called "Anarchic Federated Learning" (AFL) in this paper.
Stabilized Likelihood-based Imitation Learning via Denoising Continuous Normalizing Flow
State-of-the-art imitation learning (IL) approaches, e. g, GAIL, apply adversarial training to minimize the discrepancy between expert and learner behaviors, which is prone to unstable training and mode collapse.
Cellular Network Radio Propagation Modeling with Deep Convolutional Neural Networks
Deterministic models, such as ray tracing based on physical laws of wave propagation, are more accurate and site specific.
CXR-Net: An Encoder-Decoder-Encoder Multitask Deep Neural Network for Explainable and Accurate Diagnosis of COVID-19 pneumonia with Chest X-ray Images
The proposed method can provide more detailed high resolution visual explanation for the classification decision, compared to current state-of-the-art visual explanation methods and has a great potential to be used in clinical practice for COVID-19 pneumonia diagnosis.
The self-supervised spectral-spatial attention-based transformer network for automated, accurate prediction of crop nitrogen status from UAV imagery
In this work, we propose a novel deep learning framework: a self-supervised spectral-spatial attention-based vision transformer (SSVT).
Can depth-adaptive BERT perform better on binary classification tasks
In light of the success of transferring language models into NLP tasks, we ask whether the full BERT model is always the best and does it exist a simple but effective method to find the winning ticket in state-of-the-art deep neural networks without complex calculations.
CoDiM: Learning with Noisy Labels via Contrastive Semi-Supervised Learning
Labels are costly and sometimes unreliable.
Ranked #5 on
Image Classification
on mini WebVision 1.0
Domain Prompt Learning for Efficiently Adapting CLIP to Unseen Domains
We propose Domain Prompt Learning (DPL) as a novel approach for domain inference in the form of conditional prompt generation.
Ranked #4 on
Transfer Learning
on Office-Home
Taming Communication and Sample Complexities in Decentralized Policy Evaluation for Cooperative Multi-Agent Reinforcement Learning
To our knowledge, this paper is the first work that achieves both $\mathcal{O}(\epsilon^{-2})$ sample complexity and $\mathcal{O}(\epsilon^{-2})$ communication complexity in decentralized policy evaluation for cooperative MARL.
Multi-agent Reinforcement Learning
Reinforcement Learning (RL)
+1
Boundary Aware Learning for Out-of-distribution Detection
This paper focuses on the problem of detecting out-of-distribution (ood) samples with neural nets.
Out-of-Distribution Detection
Out of Distribution (OOD) Detection
TR-MISR: Multiimage Super-Resolution Based on Feature Fusion With Transformers
In addition, TR-MISR adopts an additional learnable embedding vector that fuses these vectors to restore the details to the greatest extent. TR-MISR has successfully applied the transformer to MISR tasks for the first time, notably reducing the difficulty of training the transformer by ignoring the spatial relations of image patches.
Ranked #1 on
Multi-Frame Super-Resolution
on PROBA-V
Fast and Robust Sparsity Learning over Networks: A Decentralized Surrogate Median Regression Approach
Decentralized sparsity learning has attracted a significant amount of attention recently due to its rapidly growing applications.
Adaptive Graph Convolutional Networks for Weakly Supervised Anomaly Detection in Videos
For weakly supervised anomaly detection, most existing work is limited to the problem of inadequate video representation due to the inability of modeling long-term contextual information.
Priming Cross-Session Motor Imagery Classification with A Universal Deep Domain Adaptation Framework
Compared to the vanilla EEGNet and ConvNet, the proposed SDDA framework was able to boost the MI classification accuracy by 15. 2%, 10. 2% respectively in IIA dataset, and 5. 5%, 4. 2% in IIB dataset.
Contrastive-mixup learning for improved speaker verification
In this work, we propose contrastive-mixup, a novel augmentation strategy that learns distinguishing representations based on a distance metric.
Identifying Chinese Opinion Expressions with Extremely-Noisy Crowdsourcing Annotations
Recent works of opinion expression identification (OEI) rely heavily on the quality and scale of the manually-constructed training corpus, which could be extremely difficult to satisfy.
Cross-Camera Trajectories Help Person Retrieval in a Camera Network
To address this issue, we propose a pedestrian retrieval framework based on cross-camera trajectory generation, which integrates both temporal and spatial information.
A Coupling Enhancement Algorithm for ZrO2 Ceramic Bearing Ball Surface Defect Detection Based on Cartoon-texture Decomposition Model and Multi-Scale Filtering Method
The experimental results show that the image denoising method of ZrO2 ceramic bearing ball surface defect based on cartoon-texture decomposition model can denoise while retaining the image details.
Gigapixel Whole-Slide Images Classification using Locally Supervised Learning
Histopathology whole slide images (WSIs) play a very important role in clinical studies and serve as the gold standard for many cancer diagnoses.
Deep Learning for Unsupervised Anomaly Localization in Industrial Images: A Survey
This paper aims to help researchers in this field by comprehensively surveying recent achievements in unsupervised anomaly localization in industrial images using deep learning.
Layer-Wise Partitioning and Merging for Efficient and Scalable Deep Learning
Deep Neural Network (DNN) models are usually trained sequentially from one layer to another, which causes forward, backward and update locking's problems, leading to poor performance in terms of training time.
INTERACT: Achieving Low Sample and Communication Complexities in Decentralized Bilevel Learning over Networks
Our main contributions in this paper are two-fold: i) We first propose a deterministic algorithm called INTERACT (inner-gradient-descent-outer-tracked-gradient) that requires the sample complexity of $\mathcal{O}(n \epsilon^{-1})$ and communication complexity of $\mathcal{O}(\epsilon^{-1})$ to solve the bilevel optimization problem, where $n$ and $\epsilon > 0$ are the number of samples at each agent and the desired stationarity gap, respectively.
Adaptive Domain Generalization via Online Disagreement Minimization
Domain Generalization (DG) aims to safely transfer a model to unseen target domains by only relying on a set of source domains.
NET-FLEET: Achieving Linear Convergence Speedup for Fully Decentralized Federated Learning with Heterogeneous Data
Moreover, whether or not the linear speedup for convergence is achievable under fully decentralized FL with data heterogeneity remains an open question.
SYNTHESIS: A Semi-Asynchronous Path-Integrated Stochastic Gradient Method for Distributed Learning in Computing Clusters
To increase the training speed of distributed learning, recent years have witnessed a significant amount of interest in developing both synchronous and asynchronous distributed stochastic variance-reduced optimization methods.
PLMCL: Partial-Label Momentum Curriculum Learning for Multi-Label Image Classification
A special case is to annotate only one positive label in each training image.
Multi-Label Classification
Multi-Label Image Classification
+1
Domain-Specific NER via Retrieving Correlated Samples
Successful Machine Learning based Named Entity Recognition models could fail on texts from some special domains, for instance, Chinese addresses and e-commerce titles, where requires adequate background knowledge.
Swin-transformer-yolov5 For Real-time Wine Grape Bunch Detection
Results showed that the proposed Swin-T-YOLOv5 outperformed all other studied models for grape bunch detection, with up to 97% of mean Average Precision (mAP) and 0. 89 of F1-score when the weather was cloudy.
A PDE approach for regret bounds under partial monitoring
In this paper, we study a learning problem in which a forecaster only observes partial information.
ReX: A Framework for Incorporating Temporal Information in Model-Agnostic Local Explanation Techniques
To address this limitation, we propose ReX, a general framework for adapting various explanation techniques to models that process variable-length inputs, expanding explanation coverage to data points of different lengths.
Graph Contrastive Learning with Personalized Augmentation
Thus, blindly augmenting all graphs without considering their individual characteristics may undermine the performance of GCL arts. To deal with this, we propose the first principled framework, termed as \textit{G}raph contrastive learning with \textit{P}ersonalized \textit{A}ugmentation (GPA), to advance conventional GCL by allowing each graph to choose its own suitable augmentation operations. In essence, GPA infers tailored augmentation strategies for each graph based on its topology and node attributes via a learnable augmentation selector, which is a plug-and-play module and can be effectively trained with downstream GCL models end-to-end.
Passive Non-line-of-sight Imaging for Moving Targets with an Event Camera
Non-line-of-sight (NLOS) imaging is an emerging technique for detecting objects behind obstacles or around corners.
SAGDA: Achieving $\mathcal{O}(ε^{-2})$ Communication Complexity in Federated Min-Max Learning
To lower the communication complexity of federated min-max learning, a natural approach is to utilize the idea of infrequent communications (through multiple local updates) same as in conventional federated learning.
FedMT: Federated Learning with Mixed-type Labels
In federated learning (FL), classifiers (e. g., deep networks) are trained on datasets from multiple data centers without exchanging data across them, which improves the sample efficiency.
G2NetPL: Generic Game-Theoretic Network for Partial-Label Image Classification
To effectively address partial-label classification, this paper proposes an end-to-end Generic Game-theoretic Network (G2NetPL) for partial-label learning, which can be applied to most partial-label settings, including a very challenging, but annotation-efficient case where only a subset of the training images are labeled, each with only one positive label, while the rest of the training images remain unlabeled.
Multi-Label Classification
Multi-Label Image Classification
+2
Extending Phrase Grounding with Pronouns in Visual Dialogues
First, we construct a dataset of phrase grounding with both noun phrases and pronouns to image regions.
Depth Monocular Estimation with Attention-based Encoder-Decoder Network from Single Image
Depth information is the foundation of perception, essential for autonomous driving, robotics, and other source-constrained applications.
An Effective Approach for Multi-label Classification with Missing Labels
Through comprehensive experiments on three large-scale multi-label image datasets, i. e. MS-COCO, NUS-WIDE, and Pascal VOC12, we show that our method can handle the imbalance between positive labels and negative labels, while still outperforming existing missing-label learning approaches in most cases, and in some cases even approaches with fully labeled datasets.
Stutter-TTS: Controlled Synthesis and Improved Recognition of Stuttered Speech
By fine-tuning an ASR model on synthetic stuttered speech we are able to reduce word error by 5. 7% relative on stuttered utterances, with only minor (<0. 2% relative) degradation for fluent utterances.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+1
Weakly Supervised Video Anomaly Detection Based on Cross-Batch Clustering Guidance
To enhance the discriminative power of features, we propose a batch clustering based loss to encourage a clustering branch to generate distinct normal and abnormal clusters based on a batch of data.
Bring Your Own View: Graph Neural Networks for Link Prediction with Personalized Subgraph Selection
To bridge the gap, we introduce a Personalized Subgraph Selector (PS2) as a plug-and-play framework to automatically, personally, and inductively identify optimal subgraphs for different edges when performing GNNLP.
Ordinal Label Distribution Learning
Therefore, we propose a new paradigm, termed ordinal label distribution learning (OLDL).
How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detection
We call the collected dataset the Human ChatGPT Comparison Corpus (HC3).
sMRI-PatchNet: A novel explainable patch-based deep learning network for Alzheimer's disease diagnosis and discriminative atrophy localisation with Structural MRI
Specifically, it consists of two primary components: 1) A fast and efficient explainable patch selection mechanism for determining the most discriminative patches based on computing the SHapley Additive exPlanations (SHAP) contribution to a transfer learning model for AD diagnosis on massive medical data; and 2) A novel patch-based network for extracting deep features and AD classfication from the selected patches with position embeddings to retain position information, capable of capturing the global and local information of inter- and intra-patches.
Zero-Shot Information Extraction via Chatting with ChatGPT
Zero-shot information extraction (IE) aims to build IE systems from the unannotated text.
Knowledge-infused Contrastive Learning for Urban Imagery-based Socioeconomic Prediction
To address such issues, in this paper, we propose a Knowledge-infused Contrastive Learning (KnowCL) model for urban imagery-based socioeconomic prediction.
PRECISION: Decentralized Constrained Min-Max Learning with Low Communication and Sample Complexities
Decentralized min-max optimization problems with domain constraints underpins many important ML applications, including multi-agent ML fairness assurance, and policy evaluations in multi-agent reinforcement learning.
Co-Occurrence Matters: Learning Action Relation for Temporal Action Localization
Existing works in this field mainly suffer from two weaknesses: (1) They often neglect the multi-label case and only focus on temporal modeling.
Machine Learning Automated Approach for Enormous Synchrotron X-Ray Diffraction Data Interpretation
This study highlighted the importance of labeled experimental patterns on the training of DNN models to solve u-XRD mapping data from in-situ experiments involving liquid phase.
Distribution-restrained Softmax Loss for the Model Robustness
Recently, the robustness of deep learning models has received widespread attention, and various methods for improving model robustness have been proposed, including adversarial training, model architecture modification, design of loss functions, certified defenses, and so on.
A Heterogeneous Parallel Non-von Neumann Architecture System for Accurate and Efficient Machine Learning Molecular Dynamics
This paper proposes a special-purpose system to achieve high-accuracy and high-efficiency machine learning (ML) molecular dynamics (MD) calculations.
LMDA-Net:A lightweight multi-dimensional attention network for general EEG-based brain-computer interface paradigms and interpretability
By incorporating two novel attention modules designed specifically for EEG signals, the channel attention module and the depth attention module, LMDA-Net can effectively integrate features from multiple dimensions, resulting in improved classification performance across various BCI tasks.
D-Score: A White-Box Diagnosis Score for CNNs Based on Mutation Operators
However, concerns have been raised with respect to the trustworthiness of these models: The standard testing method evaluates the performance of a model on a test set, while low-quality and insufficient test sets can lead to unreliable evaluation results, which can have unforeseeable consequences.
RFAConv: Innovating Spatial Attention and Standard Convolutional Operation
In this paper, we propose a new perspective on the effectiveness of spatial attention, which is that the spatial attention mechanism essentially solves the problem of convolutional kernel parameter sharing.
SpeechGPT: Empowering Large Language Models with Intrinsic Cross-Modal Conversational Abilities
Multi-modal large language models are regarded as a crucial step towards Artificial General Intelligence (AGI) and have garnered significant interest with the emergence of ChatGPT.
GDA: Generative Data Augmentation Techniques for Relation Extraction Tasks
These techniques neither preserve the semantic consistency of the original sentences when rule-based augmentations are adopted, nor preserve the syntax structure of sentences when expressing relations using seq2seq models, resulting in less diverse augmentations.
ELSA: Efficient Label Shift Adaptation through the Lens of Semiparametric Models
We study the domain adaptation problem with label shift in this work.
Paste, Inpaint and Harmonize via Denoising: Subject-Driven Image Editing with Pre-Trained Diffusion Model
To guarantee the visual coherence of the generated or edited image, we introduce an inpainting and harmonizing module to guide the pre-trained diffusion model to seamlessly blend the inserted subject into the scene naturally.
Deep learning radiomics for assessment of gastroesophageal varices in people with compensated advanced chronic liver disease
Validation analysis revealed that the AUCs of DLRP were 0. 91 for GEV (95% CI 0. 90 to 0. 93, p < 0. 05) and 0. 88 for HRV (95% CI 0. 86 to 0. 89, p < 0. 01), which were significantly and robustly better than canonical risk indicators, including the value of LSM and SSM.
Attention Hybrid Variational Net for Accelerated MRI Reconstruction
However, the drawback of these structures is that they are not fully utilizing the information from both domains (k-space and image).
SHISRCNet: Super-resolution And Classification Network For Low-resolution Breast Cancer Histopathology Image
CF module extracts and fuses the multi-scale features of SR images for classification.
Histopathological Image Classification
Image Classification
+1
A generic self-supervised learning (SSL) framework for representation learning from spectra-spatial feature of unlabeled remote sensing imagery
The success of SSL is heavily dependent on a pre-designed pretext task, which introduces an inductive bias into the model from a large amount of unlabelled data.
Early Autism Diagnosis based on Path Signature and Siamese Unsupervised Feature Compressor
Specifically, we propose a Siamese verification framework to extend the scarce data, and an unsupervised compressor to alleviate data imbalance by extracting key features.
Joint Service Caching, Communication and Computing Resource Allocation in Collaborative MEC Systems: A DRL-based Two-timescale Approach
Meeting the strict Quality of Service (QoS) requirements of terminals has imposed a signiffcant challenge on Multiaccess Edge Computing (MEC) systems, due to the limited multidimensional resources.
PPN: Parallel Pointer-based Network for Key Information Extraction with Complex Layouts
Firstly, the layout of existing datasets is relatively fixed and limited in the number of semantic entity categories, creating a significant gap between these datasets and the complex real-world scenarios.
Collaborative Graph Neural Networks for Attributed Network Embedding
Graph neural networks (GNNs) have shown prominent performance on attributed network embedding.
Holistic Exploration on Universal Decompositional Semantic Parsing: Architecture, Data Augmentation, and LLM Paradigm
In this paper, we conduct a holistic exploration of the Universal Decompositional Semantic (UDS) Parsing.
Evaluating Large Language Models for Radiology Natural Language Processing
The rise of large language models (LLMs) has marked a pivotal shift in the field of natural language processing (NLP).
Data-Driven Modeling with Experimental Augmentation for the Modulation Strategy of the Dual-Active-Bridge Converter
The D2EA approach is instantiated for the efficiency optimization of a hybrid modulation for neutral-point-clamped dual-active-bridge (NPC-DAB) converter.
Towards Imbalanced Large Scale Multi-label Classification with Partially Annotated Labels
In this work, we address the issue of label imbalance and investigate how to train classifiers using partial labels in large labeling spaces.
Artificial-Intelligence-Based Hybrid Extended Phase Shift Modulation for the Dual Active Bridge Converter with Full ZVS Range and Optimal Efficiency
ZVS range and efficiency are two significant performance indicators for DAB converter.
Artificial-Intelligence-Based Triple Phase Shift Modulation for Dual Active Bridge Converter with Minimized Current Stress
However, to minimize the current stress when the DAB converter is under TPS modulation, two difficulties exist in analysis process and realization process, respectively.
Particle swarm optimization with state-based adaptive velocity limit strategy
Several adaptive VL strategies have been introduced with which the performance of PSO can be improved.
Towards General Text Embeddings with Multi-stage Contrastive Learning
We present GTE, a general-purpose text embedding model trained with multi-stage contrastive learning.
Real-time Strawberry Detection Based on Improved YOLOv5s Architecture for Robotic Harvesting in open-field environment
This study proposed a YOLOv5-based custom object detection model to detect strawberries in an outdoor environment.
MRI Field-transfer Reconstruction with Limited Data: Regularization by Neural Style Transfer
This enables RNST to reconstruct a high-quality image from a noisy low-quality image with different image styles and limited data.
SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models
Therefore, we propose SpeechTokenizer, a unified speech tokenizer for speech large language models.
ChatRadio-Valuer: A Chat Large Language Model for Generalizable Radiology Report Generation Based on Multi-institution and Multi-system Data
Radiology report generation, as a key step in medical image analysis, is critical to the quantitative analysis of clinically informed decision-making levels.
Language Models are Universal Embedders
As such cases span from English to other natural or programming languages, from retrieval to classification and beyond, it is desirable to build a unified embedding model rather than dedicated ones for each scenario.
Self-supervised Fetal MRI 3D Reconstruction Based on Radiation Diffusion Generation Model
Finally, the experimental results on real-world fetal brain MRI stacks demonstrate the state-of-the-art performance of our method.
TBDLNet: a network for classifying multidrug-resistant and drug-sensitive tuberculosis
Five indexes are selected in this paper, which are accuracy, sensitivity, precision, F1-score, and specificity.
Map-assisted TDOA Localization Enhancement Based On CNN
For signal processing related to localization technologies, non line of sight (NLOS) multipaths have a significant impact on the localization error level.
Reconfigurable Intelligent Surface & Edge -- An Introduction of an EM manipulation structure on obstacles' edge
In this paper, Reconfigurable Intelligent Surface & Edge (RISE) is proposed to extend RIS' abilities of reflection and refraction over surfaces to diffraction around obstacles' edge for better adaptation to specific coverage scenarios.
Image Recognition of Oil Leakage Area Based on Logical Semantic Discrimination
The process begins with histogram equalization to enhance the original image, followed by the use of Mask RCNN to identify the preliminary positions and outlines of oil tanks, the ground, and areas of potential oil contamination.
Holistic Evaluation of GPT-4V for Biomedical Imaging
GPT-4V represents a breakthrough in artificial general intelligence (AGI) for computer vision, with applications in the biomedical domain.
Rankitect: Ranking Architecture Search Battling World-class Engineers at Meta Scale
In industry system, such as ranking system in Meta, it is unclear whether NAS algorithms from the literature can outperform production baselines because of: (1) scale - Meta ranking systems serve billions of users, (2) strong baselines - the baselines are production models optimized by hundreds to thousands of world-class engineers for years since the rise of deep learning, (3) dynamic baselines - engineers may have established new and stronger baselines during NAS search, and (4) efficiency - the search pipeline must yield results quickly in alignment with the productionization life cycle.
K-space Cold Diffusion: Learning to Reconstruct Accelerated MRI without Noise
In this paper, we propose a k-space cold diffusion model that performs image degradation and restoration in k-space without the need for Gaussian noise.
AKConv: Convolutional Kernel with Arbitrary Sampled Shapes and Arbitrary Number of Parameters
In response to the above questions, the Alterable Kernel Convolution (AKConv) is explored in this work, which gives the convolution kernel an arbitrary number of parameters and arbitrary sampled shapes to provide richer options for the trade-off between network overhead and performance.
SiGeo: Sub-One-Shot NAS via Information Theory and Geometry of Loss Landscape
Neural Architecture Search (NAS) has become a widely used tool for automating neural network design.
Spanning Training Progress: Temporal Dual-Depth Scoring (TDDS) for Enhanced Dataset Pruning
Dataset pruning aims to construct a coreset capable of achieving performance comparable to the original, full dataset.
CLIPC8: Face liveness detection algorithm based on image-text pairs and contrastive learning
To tackle this issue, we propose a face liveness detection method based on image-text pairs and contrastive learning, dividing liveness attack problems in the financial field into eight categories and using text information to describe the images of these eight types of attacks.
Automated interpretation of congenital heart disease from multi-view echocardiograms
Our video-based model can diagnose with an accuracy of 93. 9\% (binary classification), and 92. 1\% (3-class classification) in a collected 2D video testing set, which does not need key-frame selection and view annotation in testing.
Physics Inspired Criterion for Pruning-Quantization Joint Learning
Pruning-quantization joint learning always facilitates the deployment of deep neural networks (DNNs) on resource-constrained edge devices.
TMID: A Comprehensive Real-world Dataset for Trademark Infringement Detection in E-Commerce
Annually, e-commerce platforms incur substantial financial losses due to trademark infringements, making it crucial to identify and mitigate potential legal risks tied to merchant information registered to the platforms.
WaveCoder: Widespread And Versatile Enhanced Instruction Tuning with Refined Data Generation
This paper thus offers a significant contribution to the field of instruction data generation and fine-tuning models, providing new insights and tools for enhancing performance in code-related tasks.
HEAP: Unsupervised Object Discovery and Localization with Contrastive Grouping
Further, to ensure the distinguishability among various regions, we introduce a region-level contrastive clustering loss to pull closer similar regions across images.
Efficient Sparse Least Absolute Deviation Regression with Differential Privacy
To fast solve the non-smooth loss under a given privacy budget, we develop a Fast Robust And Privacy-Preserving Estimation (FRAPPE) algorithm for least absolute deviation regression.
Understanding LLMs: A Comprehensive Overview from Training to Inference
Low-cost training and deployment of LLMs represent the future development trend.
TRLS: A Time Series Representation Learning Framework via Spectrogram for Medical Signal Processing
Representation learning frameworks in unlabeled time series have been proposed for medical signal processing.
SpeechAgents: Human-Communication Simulation with Multi-Modal Multi-Agent Systems
In this paper, we propose SpeechAgents, a multi-modal LLM based multi-agent system designed for simulating human communication.
Weiss-Weinstein bound of frequency estimation error for very weak GNSS signals
Tightness remains the center quest in all modern estimation bounds.
UV-SAM: Adapting Segment Anything Model for Urban Village Identification
Urban villages, defined as informal residential areas in or around urban centers, are characterized by inadequate infrastructures and poor living conditions, closely related to the Sustainable Development Goals (SDGs) on poverty, adequate housing, and sustainable cities.
CLIP Model for Images to Textual Prompts Based on Top-k Neighbors
Text-to-image synthesis, a subfield of multimodal generation, has gained significant attention in recent years.
SpeechGPT-Gen: Scaling Chain-of-Information Speech Generation
It comprises an autoregressive model based on LLM for semantic information modeling and a non-autoregressive model employing flow matching for perceptual information modeling.
ReTaSA: A Nonparametric Functional Estimation Approach for Addressing Continuous Target Shift
This work focuses on the target shift problem in a regression setting (Zhang et al., 2013; Nguyen et al., 2016).
Partially Recentralization Softmax Loss for Vision-Language Models Robustness
However, it has been shown that multimodal NLP are vulnerable to adversarial attacks, where the outputs of a model can be dramatically changed by a perturbation to the input.
ICDPO: Effectively Borrowing Alignment Capability of Others via In-context Direct Preference Optimization
Large Language Models (LLMs) rely on Human Preference Alignment (HPA) to ensure the generation of safe content.
Dynamic Patch-aware Enrichment Transformer for Occluded Person Re-Identification
To facilitate the seamless integration of global classification features with the finely detailed local features selected by DPSM, we introduce a novel feature blending module (FBM).
Knowledge Graph Assisted Automatic Sports News Writing
In this paper, we present a novel method for automatically generating sports news, which employs a unique algorithm that extracts pivotal moments from live text broadcasts and uses them to create an initial draft of the news.
AnyGPT: Unified Multimodal LLM with Discrete Sequence Modeling
We introduce AnyGPT, an any-to-any multimodal language model that utilizes discrete representations for the unified processing of various modalities, including speech, text, images, and music.
A Literature Review of Literature Reviews in Pattern Analysis and Machine Intelligence
To improve efficiency, this paper aims to provide a thorough review of reviews in the PAMI field from diverse perspectives.
Explicit Motion Handling and Interactive Prompting for Video Camouflaged Object Detection
The prompt fed to the motion stream is learned by supervising optical flow in a self-supervised manner.
PromptKD: Unsupervised Prompt Distillation for Vision-Language Models
To our best knowledge, we are the first to (1) perform unsupervised domain-specific prompt-driven knowledge distillation for CLIP, and (2) establish a practical pre-storing mechanism of text features as shared class vectors between teacher and student.
Ranked #1 on
Prompt Engineering
on Oxford-IIIT Pet Dataset
ArgMed-Agents: Explainable Clinical Decision Reasoning with Large Language Models via Argumentation Schemes
There are two main barriers to using large language models (LLMs) in clinical reasoning.
Fine-grainedly Synthesize Streaming Data Based On Large Language Models With Graph Structure Understanding For Data Sparsity
Due to the sparsity of user data, sentiment analysis on user reviews in e-commerce platforms often suffers from poor performance, especially when faced with extremely sparse user data or long-tail labels.
Two-sided Acoustic Metascreen for Broadband and Individual Reflection and Transmission Control
Acoustic wave modulation plays a pivotal role in various applications, including sound-field reconstruction, wireless communication, and particle manipulation, among others.
Accurate and Data-Efficient Micro-XRD Phase Identification Using Multi-Task Learning: Application to Hydrothermal Fluids
Traditional analysis of highly distorted micro-X-ray diffraction ({\mu}-XRD) patterns from hydrothermal fluid environments is a time-consuming process, often requiring substantial data preprocessing and labeled experimental data.
PE-GPT: A Physics-Informed Interactive Large Language Model for Power Converter Modulation Design
This paper proposes PE-GPT, a custom-tailored large language model uniquely adapted for power converter modulation design.
GCN-DevLSTM: Path Development for Skeleton-Based Action Recognition
Skeleton-based action recognition (SAR) in videos is an important but challenging task in computer vision.
LLMs Instruct LLMs:An Extraction and Editing Method
The interest in updating Large Language Models (LLMs) without retraining from scratch is substantial, yet it comes with some challenges. This is especially true for situations demanding complex reasoning with limited samples, a scenario we refer to as the Paucity-Constrained Complex Reasoning Adaptation for LLMs (PCRA-LLM). Traditional methods like Low-Rank Adaptation (LoRA) and Retrieval-Augmented Generation (RAG) are inadequate for this critical issue, particularly evident in our exploration of a specific medical context that epitomize the PCRA-LLM's distinct needs. To address the issue, we propose a Sequential Fusion method to incorporate knowledge from complex context into LLMs.
CSST Strong Lensing Preparation: a Framework for Detecting Strong Lenses in the Multi-color Imaging Survey by the China Survey Space Telescope (CSST)
To overcome these challenges, we have developed a framework based on a hierarchical visual Transformer with a sliding window technique to search for strong lensing systems within entire images.
DSGNN: A Dual-View Supergrid-Aware Graph Neural Network for Regional Air Quality Estimation
To this end, we propose a Dual-view Supergrid-aware Graph Neural Network (DSGNN) for regional air quality estimation, which can model the spatial dependencies of distant grid regions from dual views (i. e., satellite-derived aerosol optical depth (AOD) and meteorology).
SpeechAlign: Aligning Speech Generation to Human Preferences
However, the integration of human feedback to align speech outputs to human preferences is often neglected.
Sociolectal Analysis of Pretrained Language Models
Using data from English cloze tests, in which subjects also self-reported their gender, age, education, and race, we examine performance differences of pretrained language models across demographic groups, defined by these (protected) attributes.
