Search Results for author: Lei Liu

Found 78 papers, 20 papers with code

Learning a Rotation Invariant Detector with Rotatable Bounding Box

4 code implementations26 Nov 2017 Lei Liu, Zongxu Pan, Bin Lei

The existing methods are not robust to angle varies of the objects because of the use of traditional bounding box, which is a rotation variant structure for locating rotated objects.

Prototype-based Cross-Modal Object Tracking

1 code implementation22 Dec 2023 Lei Liu, Chenglong Li, Futian Wang, Longfeng Shen, Jin Tang

In particular, we design a multi-modal prototype to represent target information by multi-kind samples, including a fixed sample from the first frame and two representative samples from different modalities.

Object Object Tracking

Cross-Modal Object Tracking via Modality-Aware Fusion Network and A Large-Scale Dataset

1 code implementation22 Dec 2023 Lei Liu, Mengya Zhang, Cheng Li, Chenglong Li, Jin Tang

Visual tracking often faces challenges such as invalid targets and decreased performance in low-light conditions when relying solely on RGB image sequences.

Object Tracking Visual Tracking

Reinforcement Learning with Prior Policy Guidance for Motion Planning of Dual-Arm Free-Floating Space Robot

1 code implementation3 Sep 2022 Yuxue Cao, Shengjie Wang, Xiang Zheng, Wenke Ma, Xinru Xie, Lei Liu

However, due to the increase in planning dimension and the intensification of system dynamics coupling, the motion planning of dual-arm free-floating space robots remains an open challenge.

Motion Planning Object

RJUA-QA: A Comprehensive QA Dataset for Urology

1 code implementation15 Dec 2023 Shiwei Lyu, Chenfei Chi, Hongbo Cai, Lei Shi, Xiaoyan Yang, Lei Liu, Xiang Chen, Deng Zhao, Zhiqiang Zhang, Xianguo Lyu, Ming Zhang, Fangzhou Li, Xiaowei Ma, Yue Shen, Jinjie Gu, Wei Xue, Yiran Huang

We introduce RJUA-QA, a novel medical dataset for question answering (QA) and reasoning with clinical evidence, contributing to bridge the gap between general large language models (LLMs) and medical-specific LLM applications.

Question Answering

AugmentedCode: Examining the Effects of Natural Language Resources in Code Retrieval Models

1 code implementation16 Oct 2021 Mehdi Bahrami, N. C. Shrikanth, Yuji Mizobuchi, Lei Liu, Masahiro Fukuyori, Wei-Peng Chen, Kazuki Munakata

Code retrieval is allowing software engineers to search codes through a natural language query, which relies on both natural language processing and software engineering techniques.

Retrieval

Attribute-Based Progressive Fusion Network for RGBT Tracking

2 code implementations AAAI2022 2022 Yun Xiao, Mengmeng Yang, Chenglong Li, Lei Liu, Jin Tang

RGBT tracking usually suffers from various challenging factors of fast motion, scale variation, illumination variation, thermal crossover and occlusion, to name a few.

Attribute Rgb-T Tracking

Adaptive Confidence Multi-View Hashing for Multimedia Retrieval

1 code implementation12 Dec 2023 Jian Zhu, Yu Cui, Zhangmin Huang, Xingyu Li, Lei Liu, Lingfang Zeng, Li-Rong Dai

Furthermore, an adaptive confidence multi-view network is employed to measure the confidence of each view and then fuse multi-view features through a weighted summation.

Retrieval

Memory AMP

2 code implementations20 Dec 2020 Lei Liu, Shunqi Huang, Brian M. Kurkoski

To asymptotically characterize the performance of BO-MAMP, a state evolution is derived.

Denoising

A Systematic Investigation of KB-Text Embedding Alignment at Scale

1 code implementation ACL 2021 Vardaan Pahuja, Yu Gu, Wenhu Chen, Mehdi Bahrami, Lei Liu, Wei-Peng Chen, Yu Su

Knowledge bases (KBs) and text often contain complementary knowledge: KBs store structured knowledge that can support long range reasoning, while text stores more comprehensive and timely knowledge in an unstructured way.

Link Prediction

BERT-Sort: A Zero-shot MLM Semantic Encoder on Ordinal Features for AutoML

1 code implementation AutoML'2022 2022 Mehdi Bahrami, Wei-Peng Chen, Lei Liu, Mukul Prasad

One of the common data pre-processing operations implemented in AutoML systems is to encode categorical features as numerical features.

AutoML

Optimal LED Spectral Multiplexing for NIR2RGB Translation

1 code implementation CVPR 2022 Lei Liu, Yuze Chen, Junchi Yan, Yinqiang Zheng

The industry practice for night video surveillance is to use auxiliary near-infrared (NIR) LED diodes, usually centered at 850nm or 940nm, for scene illumination.

Translation

Global Balanced Experts for Federated Long-Tailed Learning

1 code implementation ICCV 2023 Yaopei Zeng, Lei Liu, Li Liu, Li Shen, Shaoguo Liu, Baoyuan Wu

In particular, a proxy is derived from the accumulated gradients uploaded by the clients after local training, and is shared by all clients as the class prior for re-balance training.

Federated Learning Privacy Preserving

BadLabel: A Robust Perspective on Evaluating and Enhancing Label-noise Learning

1 code implementation28 May 2023 Jingfeng Zhang, Bo Song, Haohan Wang, Bo Han, Tongliang Liu, Lei Liu, Masashi Sugiyama

To address the challenge posed by BadLabel, we further propose a robust LNL method that perturbs the labels in an adversarial manner at each epoch to make the loss values of clean and noisy labels again distinguishable.

Investigate the Essence of Long-Tailed Recognition from a Unified Perspective

1 code implementation8 Jul 2021 Lei Liu, Li Liu

Specifically, we demonstrate that long-tailed recognition suffers from both sample number and category similarity.

Self-Supervised Learning

Graph Contrastive Topic Model

1 code implementation5 Jul 2023 Zheheng Luo, Lei Liu, Qianqian Xie, Sophia Ananiadou

Based on it, we propose the graph contrastive topic model (GCTM), which conducts graph contrastive learning (GCL) using informative positive and negative samples that are generated by the graph-based sampling strategy leveraging in-depth correlation and irrelevance among documents and words.

Contrastive Learning Representation Learning

Random Forests of Interaction Trees for Estimating Individualized Treatment Effects in Randomized Trials

no code implementations14 Sep 2017 Xiaogang Su, Annette T. Peña, Lei Liu, Richard A. Levine

Assessing heterogeneous treatment effects has become a growing interest in advancing precision medicine.

Hybrid Dirac Semimetal in CaAgBi Materials Family

no code implementations13 Jun 2017 Cong Chen, Shan-Shan Wang, Lei Liu, Zhi-Ming Yu, Xian-Lei Sheng, Ziyu Chen, Shengyuan A. Yang

Based on their formation mechanisms, Dirac points in three-dimensional systems can be classified as accidental or essential.

Materials Science

TreeGAN: Syntax-Aware Sequence Generation with Generative Adversarial Networks

no code implementations22 Aug 2018 Xinyue Liu, Xiangnan Kong, Lei Liu, Kuorong Chiang

To address these issues, we study the problem of syntax-aware sequence generation with GANs, in which a collection of real sequences and a set of pre-defined grammatical rules are given to both discriminator and generator.

Image Generation

Auto-tuning Neural Network Quantization Framework for Collaborative Inference Between the Cloud and Edge

no code implementations16 Dec 2018 Guangli Li, Lei Liu, Xueying Wang, Xiao Dong, Peng Zhao, Xiaobing Feng

By analyzing the characteristics of layers in DNNs, an auto-tuning neural network quantization framework for collaborative inference is proposed.

Collaborative Inference Quantization

The localization of single pulse in VLBI observation

1 code implementation21 Oct 2018 Lei Liu, Wu Jiang, Weimin Zheng, Zhen Yan, Juan Zhang, Maoli Ma, Wentao Luo

The combination of cross spectrum based detection and the localization proposed in this work then provide a thorough solution for searching single pulse in VLBI observation.

Instrumentation and Methods for Astrophysics

DENet: A Universal Network for Counting Crowd with Varying Densities and Scales

no code implementations17 Apr 2019 Lei Liu, Jie Jiang, Wenjing Jia, Saeed Amirgholipour, Michelle Zeibots, Xiangjian He

Counting people or objects with significantly varying scales and densities has attracted much interest from the research community and yet it remains an open problem.

Hyperspectral Image Classification Based on Adaptive Sparse Deep Network

no code implementations21 Oct 2019 Jingwen Yan, Zixin Xie, Jingyao Chen, Yinan Liu, Lei Liu

Sparse model is widely used in hyperspectral image classification. However, different of sparsity and regularization parameters has great influence on the classification results. In this paper, a novel adaptive sparse deep network based on deep architecture is proposed, which can construct the optimal sparse representation and regularization parameters by deep network. Firstly, a data flow graph is designed to represent each update iteration based on Alternating Direction Method of Multipliers (ADMM) algorithm. Forward network and Back-Propagation network are deduced. All parameters are updated by gradient descent in Back-Propagation. Then we proposed an Adaptive Sparse Deep Network. Comparing with several traditional classifiers or other algorithm for sparse model, experiment results indicate that our method achieves great improvement in HSI classification.

Classification General Classification +1

PDANet: Pyramid Density-aware Attention Net for Accurate Crowd Counting

no code implementations16 Jan 2020 Saeed Amirgholipour, Xiangjian He, Wenjing Jia, Dadong Wang, Lei Liu

For this purpose, a classifier evaluates the density level of the input features and then passes them to the corresponding high and low crowded DAD modules.

Crowd Counting

Identification of splicing edges in tampered image based on Dichromatic Reflection Model

no code implementations9 Apr 2020 Zhe Shen, Peng Sun, Yubo Lang, Lei Liu, Silong Peng

Therefore we present a novel optic-physical method to discriminate splicing edges from natural edges in a tampered image.

Person Re-Identification via Active Hard Sample Mining

no code implementations10 Apr 2020 Xin Xu, Lei Liu, Weifeng Liu, Meng Wang, Ruimin Hu

To alleviate such a problem, we present an active hard sample mining framework via training an effective re-ID model with the least labeling efforts.

Person Re-Identification

W-net: Simultaneous segmentation of multi-anatomical retinal structures using a multi-task deep neural network

no code implementations11 Jun 2020 Hongwei Zhao, Chengtao Peng, Lei Liu, Bin Li

To further prove the generalization property of the proposed method, we applied the trained model on the DRIONS-DB dataset for OD segmentation and on the MESSIDOR dataset for exudate segmentation.

Multi-Task Learning Segmentation

Challenge-Aware RGBT Tracking

no code implementations ECCV 2020 Chenglong Li, Lei Liu, Andong Lu, Qing Ji, Jin Tang

RGB and thermal source data suffer from both shared and specific challenges, and how to explore and exploit them plays a critical role to represent the target appearance in RGBT tracking.

Rgb-T Tracking

Fusion-Catalyzed Pruning for Optimizing Deep Learning on Intelligent Edge Devices

no code implementations30 Oct 2020 Guangli Li, Xiu Ma, Xueying Wang, Lei Liu, Jingling Xue, Xiaobing Feng

The increasing computational cost of deep neural network models limits the applicability of intelligent applications on resource-constrained edge devices.

Network Pruning

Topological Transformations in Pentagonal 2D Materials Induced by Stone-Wales Defects

no code implementations22 Dec 2020 Yu Zheng, Duyu Chen, Lei Liu, Houlong Zhuang, Yang Jiao

We discover two distinct topological pathways through which the pentagonal Cairo tiling (P5), a structural model for single-layer $AB_2$ pyrite materials, respectively transforms into a crystalline rhombus-hexagon (C46) tiling and random rhombus-pentagon-hexagon (R456) tilings, by continuously introducing the Stone-Wales (SW) topological defects.

Soft Condensed Matter Disordered Systems and Neural Networks Materials Science

A molecular dynamics simulation study on the frustrated Lewis pairs in ionic liquids

no code implementations21 Jan 2021 Xiaoqing Liu, XiaoJing Wang, Tianhao Yu, Weizhen Zhao, Lei Liu

Spatial distribution function (SDF) results show that toluene formed a continuum solvation shell, which hinders the interactions of (tBu)3P and B(C6F5)3 , while [Cnmim][NTf2] leave a relatively large empty space, which is accessible by (tBu3)P molecules, resulting in a higher probability of Lewis acids and bases interactions.

Chemical Physics

Efficient electrochemical reduction of CO2 to CO by soft functional materials

no code implementations9 Feb 2021 Yanjie Hu, Jiaqi Feng, Xiangping Zhang, Hongshuai Gao, Saimeng Jin, Lei Liu, Weifeng Shen

This work provides a new strategy to design novel ILs for high efficiency electrochemical reduction of CO2 to CO.

Materials Science

Theory of polymer diffusion in polymer-nanoparticle mixtures: effect of nanoparticle concentration and polymer length

no code implementations22 Nov 2020 Bokai Zhang, Jian Li, Juan-mei Hu, Lei Liu

The dynamics of polymer-nanoparticle (NP) mixtures, which involves multiple scales and system-specific variables, has posed a long-standing challenge on its theoretical description.

Soft Condensed Matter

An Interpretable Mapping from a Communication System to a Neural Network for Optimal Transceiver-Joint Equalization

no code implementations23 Mar 2021 Zhiqun Zhai, Hexun Jiang, Mengfan Fu, Lei Liu, Lilin Yi, Weisheng Hu, Qunbi Zhuge

In this paper, we propose a scheme that utilizes the optimization ability of artificial intelligence (AI) for optimal transceiver-joint equalization in compensating for the optical filtering impairments caused by wavelength selective switches (WSS).

Pinpointing the Memory Behaviors of DNN Training

no code implementations1 Apr 2021 Jiansong Li, Xiao Dong, Guangli Li, Peng Zhao, Xueying Wang, Xiaobing Chen, Xianzhi Yu, Yongxin Yang, Zihan Jiang, Wei Cao, Lei Liu, Xiaobing Feng

The training of deep neural networks (DNNs) is usually memory-hungry due to the limited device memory capacity of DNN accelerators.

An LSTM-Aided Hybrid Random Access Scheme for 6G Machine Type Communication Networks

no code implementations25 Dec 2020 Wenchao Zhai, Huimei Han, Lei Liu, Jun Zhao

In this paper, an LSTM-aided hybrid random access scheme (LSTMH-RA) is proposed to support diverse quality of service (QoS) requirements in 6G machine-type communication (MTC) networks, where massive MTC (mMTC) devices and ultra-reliable low latency communications (URLLC) devices coexist.

Extending Isolation Forest for Anomaly Detection in Big Data via K-Means

no code implementations27 Apr 2021 Md Tahmid Rahman Laskar, Jimmy Huang, Vladan Smetana, Chris Stewart, Kees Pouw, Aijun An, Stephen Chan, Lei Liu

Moreover, we evaluate our proposed model on the live streaming data and find that our proposed system can be used for real-time anomaly detection in the industrial setup.

Anomaly Detection Intrusion Detection

Few-Shot Partial-Label Learning

no code implementations2 Jun 2021 Yunfeng Zhao, Guoxian Yu, Lei Liu, Zhongmin Yan, Lizhen Cui, Carlotta Domeniconi

Partial-label learning (PLL) generally focuses on inducing a noise-tolerant multi-class classifier by training on overly-annotated samples, each of which is annotated with a set of labels, but only one is the valid label.

Few-Shot Learning Metric Learning +2

Memory Approximate Message Passing

no code implementations4 Jun 2021 Lei Liu, Shunqi Huang, Brian M. Kurkoski

Approximate message passing (AMP) is a low-cost iterative parameter-estimation technique for certain high-dimensional linear systems with non-Gaussian distributions.

A Dialogue-based Information Extraction System for Medical Insurance Assessment

no code implementations Findings (ACL) 2021 Shuang Peng, Mengdi Zhou, Minghui Yang, Haitao Mi, Shaosheng Cao, Zujie Wen, Teng Xu, Hongbin Wang, Lei Liu

In the Chinese medical insurance industry, the assessor's role is essential and requires significant efforts to converse with the claimant.

MetaMIML: Meta Multi-Instance Multi-Label Learning

no code implementations7 Nov 2021 Yuanlin Yang, Guoxian Yu, Jun Wang, Lei Liu, Carlotta Domeniconi, Maozu Guo

Multi-Instance Multi-Label learning (MIML) models complex objects (bags), each of which is associated with a set of interrelated labels and composed with a set of instances.

Meta-Learning Multi-Label Learning +1

Cross-modal Zero-shot Hashing by Label Attributes Embedding

no code implementations7 Nov 2021 Runmin Wang, Guoxian Yu, Lei Liu, Lizhen Cui, Carlotta Domeniconi, Xiangliang Zhang

Cross-modal hashing (CMH) is one of the most promising methods in cross-modal approximate nearest neighbor search.

Attribute

Cross-Modal Object Tracking: Modality-Aware Representations and A Unified Benchmark

no code implementations8 Nov 2021 Chenglong Li, Tianhao Zhu, Lei Liu, Xiaonan Si, Zilin Fan, Sulan Zhai

To promote the research and development of cross-modal object tracking, we propose a new algorithm, which learns the modality-aware target representation to mitigate the appearance gap between RGB and NIR modalities in the tracking process.

Object Tracking Visual Tracking

Open-Set Crowdsourcing using Multiple-Source Transfer Learning

no code implementations7 Nov 2021 Guangyang Han, Guoxian Yu, Lei Liu, Lizhen Cui, Carlotta Domeniconi, Xiangliang Zhang

First, OSCrowd integrates crowd theme related datasets into a large source domain to facilitate partial transfer learning to approximate the label space inference of these tasks.

Transfer Learning

Sufficient-Statistic Memory AMP

no code implementations31 Dec 2021 Lei Liu, Shunqi Huang, Yuzhi Yang, Zhaoyang Zhang, Brian M. Kurkoski

Given an arbitrary MAMP, we can construct an SS-MAMP by damping, which not only ensures the convergence of the state evolution, but also preserves the orthogonality, i. e., its dynamics can be correctly described by state evolution.

Space-Air-Ground Integrated Multi-domain Network Resource Orchestration based on Virtual Network Architecture: a DRL Method

no code implementations3 Feb 2022 Peiying Zhang, Chao Wang, Neeraj Kumar, Lei Liu

Based on virtual network architecture and deep reinforcement learning (DRL), we model SAGIN's heterogeneous resource orchestration as a multi-domain virtual network embedding (VNE) problem, and propose a SAGIN cross-domain VNE algorithm.

Network Embedding

Capacity Optimality of OAMP in Coded Large Unitarily Invariant Systems

no code implementations23 Jun 2022 Lei Liu, Shansuo Liang, Li Ping

Under the assumptions that the state evolution for joint OAMP and FEC decoding is correct and the replica method is reliable, we analyze the achievable rate of OAMP.

Sufficient Statistic Memory Approximate Message Passing

no code implementations23 Jun 2022 Lei Liu, Shunqi Huang, Brian M. Kurkoski

Approximate message passing (AMP) type algorithms have been widely used in the signal reconstruction of certain large random linear systems.

Vocal Bursts Type Prediction

High Speed Rotation Estimation with Dynamic Vision Sensors

no code implementations6 Sep 2022 Guangrong Zhao, Yiran Shen, Ning Chen, Pengfei Hu, Lei Liu, Hongkai Wen

By designing a series of signal processing algorithms bespoke for dynamic vision sensing on mobile devices, EV-Tach is able to extract the rotational speed accurately from the event stream produced by dynamic vision sensing on rotary targets.

Vocal Bursts Intensity Prediction

Multimodal Graph Learning for Deepfake Detection

no code implementations12 Sep 2022 Zhiyuan Yan, Peng Sun, Yubo Lang, Shuo Du, Shanzhuo Zhang, Wei Wang, Lei Liu

We evaluate the effectiveness of our method through extensive experiments on widely-used benchmarks and demonstrate that our method outperforms the state-of-the-art detectors in terms of generalization ability and robustness against unknown disturbances.

DeepFake Detection Face Swapping +2

Parameter-Efficient Transformer with Hybrid Axial-Attention for Medical Image Segmentation

no code implementations17 Nov 2022 Yiyue Hu, Lei Zhang, Nan Mu, Lei Liu

To this end, we propose a parameter-efficient transformer to explore intrinsic inductive bias via position information for medical image segmentation.

feature selection Image Segmentation +4

Mitigation of Spatial Nonstationarity with Vision Transformers

no code implementations9 Dec 2022 Lei Liu, Javier E. Santos, Maša Prodanović, Michael J. Pyrcz

However, there is a paucity of demonstrated best practice and general guidance on mitigation of spatial nonstationarity with deep learning in the geospatial context.

Algebra of L-banded Matrices

no code implementations20 Dec 2022 Shunqi Huang, Lei Liu, Brian M. Kurkoski

Damping is commonly employed to ensure the convergence of iterative algorithms.

Context Matters: A Strategy to Pre-train Language Model for Science Education

no code implementations27 Jan 2023 Zhengliang Liu, Xinyu He, Lei Liu, Tianming Liu, Xiaoming Zhai

However, the ideal type of data to contextualize pre-trained language model and improve the performance in automatically scoring student written responses remains unclear.

Language Modelling

Prescribed Time Time-varying Output Formation Tracking for Uncertain Heterogeneous Multi-agent Systems

no code implementations15 Feb 2023 Binghe An, Bo wang, Huijin Fan, Lei Liu, Yongji Wang

The time-varying output formation tracking for the heterogeneous multi-agent systems (MAS) is investigated in this paper.

Spatio-Temporal Structure Consistency for Semi-supervised Medical Image Classification

no code implementations3 Mar 2023 Wentao Lei, Lei Liu, Li Liu

Experiments on two medical image datasets (i. e., ISIC 2018 challenge and ChestX-ray14) show that our method outperforms state-of-the-art SSL methods.

Image Classification Medical Diagnosis +1

Low-Complexity Memory AMP Detector for High-Mobility MIMO-OTFS SCMA Systems

no code implementations15 Mar 2023 Yao Ge, Lei Liu, Shunqi Huang, David González G., Yong Liang Guan, Zhi Ding

Efficient signal detectors are rather important yet challenging to achieve satisfactory performance for large-scale communication systems.

Robust Computation Offloading and Trajectory Optimization for Multi-UAV-Assisted MEC: A Multi-Agent DRL Approach

no code implementations24 Aug 2023 Bin Li, Rongrong Yang, Lei Liu, Junyi Wang, Ning Zhang, Mianxiong Dong

For multiple Unmanned-Aerial-Vehicles (UAVs) assisted Mobile Edge Computing (MEC) networks, we study the problem of combined computation and communication for user equipments deployed with multi-type tasks.

Edge-computing Robust Design

Think-in-Memory: Recalling and Post-thinking Enable LLMs with Long-Term Memory

no code implementations15 Nov 2023 Lei Liu, Xiaoyan Yang, Yue Shen, Binbin Hu, Zhiqiang Zhang, Jinjie Gu, Guannan Zhang

Memory-augmented Large Language Models (LLMs) have demonstrated remarkable performance in long-term human-machine interactions, which basically relies on iterative recalling and reasoning of history to generate high-quality responses.

TransCDR: a deep learning model for enhancing the generalizability of cancer drug response prediction through transfer learning and multimodal data fusion for drug representation

1 code implementation17 Nov 2023 Xiaoqiong Xia, Chaoyu Zhu, Yuqi Shan, Fan Zhong, Lei Liu

Although many models have been developed to utilize the representations of drugs and cancer cell lines for predicting cancer drug responses (CDR), their performances can be improved by addressing issues such as insufficient data modality, suboptimal fusion algorithms, and poor generalizability for novel drugs or cell lines.

Drug Response Prediction Transfer Learning

Efficient Trigger Word Insertion

no code implementations23 Nov 2023 Yueqi Zeng, Ziqiang Li, Pengfei Xia, Lei Liu, Bin Li

With the boom in the natural language processing (NLP) field these years, backdoor attacks pose immense threats against deep neural network models.

text-classification Text Classification

From Beginner to Expert: Modeling Medical Knowledge into General LLMs

no code implementations2 Dec 2023 Qiang Li, Xiaoyan Yang, Haowen Wang, Qin Wang, Lei Liu, Junjie Wang, Yang Zhang, Mingyuan Chu, Sen Hu, Yicheng Chen, Yue Shen, Cong Fan, Wangshu Zhang, Teng Xu, Jinjie Gu, Jing Zheng, Guannan Zhang Ant Group

(3) Specifically for multi-choice questions in the medical domain, we propose a novel Verification-of-Choice approach for prompting engineering, which significantly enhances the reasoning ability of LLMs.

Language Modelling Large Language Model +3

Time-Series Contrastive Learning against False Negatives and Class Imbalance

no code implementations19 Dec 2023 Xiyuan Jin, Jing Wang, Lei Liu, Youfang Lin

As an exemplary self-supervised approach for representation learning, time-series contrastive learning has exhibited remarkable advancements in contemporary research.

Contrastive Learning Representation Learning +1

Channel Mapping Based on Interleaved Learning with Complex-Domain MLP-Mixer

no code implementations7 Jan 2024 Zirui Chen, Zhaoyang Zhang, Zhaohui Yang, Lei Liu

For such a channel mapping task, inspired by the intrinsic coupling across the space and frequency domains, this letter proposes to use interleaved learning with partial antenna and subcarrier characteristics to represent the whole MIMO-OFDM channel.

Representation Learning

How Can Large Language Models Understand Spatial-Temporal Data?

no code implementations25 Jan 2024 Lei Liu, Shuo Yu, Runze Wang, Zhenxun Ma, Yanming Shen

We tackle the data mismatch by proposing: 1) STG-Tokenizer: This spatial-temporal graph tokenizer transforms intricate graph data into concise tokens capturing both spatial and temporal relationships; 2) STG-Adapter: This minimalistic adapter, consisting of linear encoding and decoding layers, bridges the gap between tokenized data and LLM comprehension.

Natural Language Understanding

Computation and Parameter Efficient Multi-Modal Fusion Transformer for Cued Speech Recognition

no code implementations31 Jan 2024 Lei Liu, Li Liu, Haizhou Li

Cued Speech (CS) is a pure visual coding method used by hearing-impaired people that combines lip reading with several specific hand shapes to make the spoken language visible.

Lip Reading speech-recognition +1

Cannot find the paper you are looking for? You can Submit a new open access paper.