Search Results for author: Lei Gao

Found 30 papers, 5 papers with code

Ethos: Rectifying Language Models in Orthogonal Parameter Space

no code implementations13 Mar 2024 Lei Gao, Yue Niu, Tingting Tang, Salman Avestimehr, Murali Annavaram

Evaluations show Ethos is more effective in removing undesired knowledge and maintaining the overall model performance compared to current task arithmetic methods.

Memorization

Interpretability of Machine Learning: Recent Advances and Future Prospects

no code implementations30 Apr 2023 Lei Gao, Ling Guan

The proliferation of machine learning (ML) has drawn unprecedented interest in the study of various multimedia contents such as text, image, audio and video, among others.

Face Recognition Representation Learning

TimelyFL: Heterogeneity-aware Asynchronous Federated Learning with Adaptive Partial Training

no code implementations14 Apr 2023 Tuo Zhang, Lei Gao, Sunwoo Lee, Mi Zhang, Salman Avestimehr

However, we show empirically that this method can lead to a substantial drop in training accuracy as well as a slower convergence rate.

Federated Learning

Classification of Lung Pathologies in Neonates using Dual Tree Complex Wavelet Transform

no code implementations14 Feb 2023 Sagarjit Aujla, Adel Mohamed, Ryan Tan, Randy Tan, Lei Gao, Naimul Khan, Karthikeyan Umapathy

Likewise, the proposed method achieved a maximum per-subject classification accuracy of 81. 53% with 43 DTCWT features and 3 clinical features using the balanced dataset and 64. 97% with 13 DTCWT features and 3 clinical features using the unbalanced dataset.

Image Classification Respiratory Failure

A GPU-accelerated Algorithm for Distinct Discriminant Canonical Correlation Network

no code implementations26 Sep 2022 Kai Liu, Lei Gao, Ling Guan

In this paper, a GPU-based accelerated algorithm is proposed to further optimize the DDCCANet algorithm.

Image Classification

Vision Transformer with Convolutions Architecture Search

no code implementations20 Mar 2022 Haichao Zhang, Kuangrong Hao, Witold Pedrycz, Lei Gao, Xuesong Tang, Bing Wei

The high-performance backbone network searched by VTCAS introduces the desirable features of convolutional neural networks into the Transformer architecture while maintaining the benefits of the multi-head attention mechanism.

Image Classification object-detection +2

Federated Learning for Internet of Things: Applications, Challenges, and Opportunities

no code implementations15 Nov 2021 Tuo Zhang, Lei Gao, Chaoyang He, Mi Zhang, Bhaskar Krishnamachari, Salman Avestimehr

In this paper, we will discuss the opportunities and challenges of FL in IoT platforms, as well as how it can enable diverse IoT applications.

Federated Learning

ODMTCNet: An Interpretable Multi-view Deep Neural Network Architecture for Image Feature Representation

no code implementations28 Oct 2021 Lei Gao, Zheng Guo, Ling Guan

This work proposes an interpretable multi-view deep neural network architecture, namely optimal discriminant multi-view tensor convolutional network (ODMTCNet), by integrating statistical machine learning (SML) principles with the deep neural network (DNN) architecture.

BIG-bench Machine Learning

Visual Sensation and Perception Computational Models for Deep Learning: State of the art, Challenges and Prospects

no code implementations8 Sep 2021 Bing Wei, Yudi Zhao, Kuangrong Hao, Lei Gao

Visual sensation and perception refers to the process of sensing, organizing, identifying, and interpreting visual information in environmental awareness and understanding.

Federated Learning for Internet of Things: A Federated Learning Framework for On-device Anomaly Data Detection

1 code implementation15 Jun 2021 Tuo Zhang, Chaoyang He, Tianhao Ma, Lei Gao, Mark Ma, Salman Avestimehr

In this paper, to further push forward this direction with a comprehensive study in both algorithm and system design, we build FedIoT platform that contains FedDetect algorithm for on-device anomaly data detection and a system design for realistic evaluation of federated learning on IoT devices.

Anomaly Detection Federated Learning +2

Question-Driven Span Labeling Model for Aspect–Opinion Pair Extraction

no code implementations AAAI 2021 Lei Gao, Yulong Wang, Tongcun Liu, Jingyu Wang, Lei Zhang, Jianxin Liao

Specifically, we divide the AOPE task into aspect term extraction (ATE) and aspect-specified opinion extraction (ASOE) subtasks; we first extract all the candidate aspect terms and then the corresponding opinion words given the aspect term.

Aspect-Based Sentiment Analysis Aspect-Based Sentiment Analysis (ABSA) +3

Enhanced Gradient for Differentiable Architecture Search

no code implementations23 Mar 2021 Haichao Zhang, Kuangrong Hao, Lei Gao, Xuesong Tang, Bing Wei

At the stage of block-level search, a relaxation method based on the gradient is proposed, using an enhanced gradient to design high-performance and low-complexity blocks.

Classification General Classification +2

A Discriminative Vectorial Framework for Multi-modal Feature Representation

no code implementations9 Mar 2021 Lei Gao, Ling Guan

Due to the rapid advancements of sensory and computing technology, multi-modal data sources that represent the same pattern or phenomenon have attracted growing attention.

Audio Emotion Recognition Data Visualization +5

A Complete Discriminative Tensor Representation Learning for Two-Dimensional Correlation Analysis

no code implementations28 Feb 2021 Lei Gao, Ling Guan

This letter shows that the introduction of the complete discriminatory tensor representation strategy provides an effective vehicle for revealing, and extracting the discriminant representations across the 2D data sets, leading to improved results.

Representation Learning Vocal Bursts Valence Prediction

The Property of Frequency Shift in 2D-FRFT Domain with Application to Image Encryption

no code implementations28 Feb 2021 Lei Gao, Lin Qi, Ling Guan

The Fractional Fourier Transform (FRFT) has been playing a unique and increasingly important role in signal and image processing.

Image Reconstruction

Discriminative Multiple Canonical Correlation Analysis for Information Fusion

no code implementations28 Feb 2021 Lei Gao, Lin Qi, Enqing Chen, Ling Guan

In this paper, we propose the Discriminative Multiple Canonical Correlation Analysis (DMCCA) for multimodal information analysis and fusion.

Emotion Recognition Handwritten Digit Recognition

The Labeled Multiple Canonical Correlation Analysis for Information Fusion

no code implementations28 Feb 2021 Lei Gao, Rui Zhang, Lin Qi, Enqing Chen, Ling Guan

The objective of multimodal information fusion is to mathematically analyze information carried in different sources and create a new representation which will be more effectively utilized in pattern recognition and other multimedia information processing tasks.

Emotion Recognition Face Recognition +2

Online Behavioral Analysis with Application to Emotion State Identification

no code implementations27 Feb 2021 Lei Gao, Lin Qi, Ling Guan

In this paper, we propose a novel discriminative model for online behavioral analysis with application to emotion state identification.

MLMA-Net: multi-level multi-attentional learning for multi-label object detection in textile defect images

no code implementations31 Jan 2021 Bing Wei, Kuangrong Hao, Lei Gao

For the sake of recognizing and classifying textile defects, deep learning-based methods have been proposed and achieved remarkable success in single-label textile images.

object-detection Object Detection

Optimizing Deep Neural Networks through Neuroevolution with Stochastic Gradient Descent

no code implementations21 Dec 2020 Haichao Zhang, Kuangrong Hao, Lei Gao, Bing Wei, Xuesong Tang

Deep neural networks (DNNs) have achieved remarkable success in computer vision; however, training DNNs for satisfactory performance remains challenging and suffers from sensitivity to empirical selections of an optimization algorithm for training.

A hybrid deep-learning approach for complex biochemical named entity recognition

no code implementations20 Dec 2020 Jian Liu, Lei Gao, Sujie Guo, Rui Ding, Xin Huang, Long Ye, Qinghua Meng, Asef Nazari, Dhananjay Thiruvady

In this approach, the MHATT mechanism aims to improve the recognition accuracy of abbreviations to efficiently deal with the problem of inconsistency in full-text labels.

Attribute Attribute Extraction +4

Early systems change necessary for catalyzing long-term sustainability in a post-2030 agenda

no code implementations8 Dec 2020 Enayat A. Moallemi, Sibel Eker, Lei Gao, Michalis Hadjikakou, Qi Liu, Jan Kwakkel, Patrick M. Reed, Michael Obersteiner, Zhaoxia Guo, Brett A. Bryan

Progress to-date towards the Sustainable Development Goals (SDGs) has fallen short of expectations and is unlikely to fully meet 2030 targets.

Predicting Geographic Information with Neural Cellular Automata

1 code implementation20 Sep 2020 Mingxiang Chen, Qichang Chen, Lei Gao, Yilin Chen, Zhecheng Wang

This paper presents a novel framework using neural cellular automata (NCA) to regenerate and predict geographic information.

Dynamic Partial Removal: A Neural Network Heuristic for Large Neighborhood Search

1 code implementation19 May 2020 Mingxiang Chen, Lei Gao, Qichang Chen, Zhixin Liu

LNS consists of a destroy operator and a repair operator that specify a way to carry out the neighborhood search to solve the Combinatorial Optimization problems.

Combinatorial Optimization

Learn to Design the Heuristics for Vehicle Routing Problem

2 code implementations20 Feb 2020 Lei Gao, Mingxiang Chen, Qichang Chen, Ganzhong Luo, Nuoyi Zhu, Zhixin Liu

This paper presents an approach to learn the local-search heuristics that iteratively improves the solution of Vehicle Routing Problem (VRP).

Combinatorial Optimization Graph Attention

Superpixel-Based Background Recovery from Multiple Images

no code implementations4 Nov 2019 Lei Gao, Yixing Huang, Andreas Maier

Background candidate images are obtained from input raw images with the masks.

Clustering Superpixels

Modeling Document-level Causal Structures for Event Causal Relation Identification

no code implementations NAACL 2019 Lei Gao, Prafulla Kumar Choubey, Ruihong Huang

We aim to comprehensively identify all the event causal relations in a document, both within a sentence and across sentences, which is important for reconstructing pivotal event structures.

Relation Sentence

Cannot find the paper you are looking for? You can Submit a new open access paper.