Search Results for author: Qi Liu

Found 208 papers, 82 papers with code

Towards Personalized Evaluation of Large Language Models with An Anonymous Crowd-Sourcing Platform

no code implementations13 Mar 2024 Mingyue Cheng, Hao Zhang, Jiqian Yang, Qi Liu, Li Li, Xin Huang, Liwei Song, Zhi Li, Zhenya Huang, Enhong Chen

Through this gateway, users have the opportunity to submit their questions, testing the models on a personalized and potentially broader range of capabilities.

Language Modelling Large Language Model

Clinically Feasible Diffusion Reconstruction for Highly-Accelerated Cardiac Cine MRI

no code implementations13 Mar 2024 Shihan Qiu, Shaoyan Pan, Yikang Liu, Lin Zhao, Jian Xu, Qi Liu, Terrence Chen, Eric Z. Chen, Xiao Chen, Shanhui Sun

The currently limited quality of accelerated cardiac cine reconstruction may potentially be improved by the emerging diffusion models, but the clinically unacceptable long processing time poses a challenge.

Spatiotemporal Diffusion Model with Paired Sampling for Accelerated Cardiac Cine MRI

no code implementations13 Mar 2024 Shihan Qiu, Shaoyan Pan, Yikang Liu, Lin Zhao, Jian Xu, Qi Liu, Terrence Chen, Eric Z. Chen, Xiao Chen, Shanhui Sun

Current deep learning reconstruction for accelerated cardiac cine MRI suffers from spatial and temporal blurring.

Towards Faithful Explanations: Boosting Rationalization with Shortcuts Discovery

1 code implementation12 Mar 2024 Linan Yue, Qi Liu, Yichao Du, Li Wang, Weibo Gao, Yanqing An

Since existing methods still suffer from adopting the shortcuts in data to compose rationales and limited large-scale annotated rationales by human, in this paper, we propose a Shortcuts-fused Selective Rationalization (SSR) method, which boosts the rationalization by discovering and exploiting potential shortcuts.

A Dataset for the Validation of Truth Inference Algorithms Suitable for Online Deployment

no code implementations10 Mar 2024 Fei Wang, Haoyu Liu, Haoyang Bi, Xiangzhuang Shen, Renyu Zhu, Runze Wu, Minmin Lin, Tangjie Lv, Changjie Fan, Qi Liu, Zhenya Huang, Enhong Chen

In this paper, we introduce a substantial crowdsourcing annotation dataset collected from a real-world crowdsourcing platform.

Cooperative Classification and Rationalization for Graph Generalization

1 code implementation10 Mar 2024 Linan Yue, Qi Liu, Ye Liu, Weibo Gao, Fangzhou Yao, Wenfeng Li

To address these challenges, in this paper, we propose a Cooperative Classification and Rationalization (C2R) method, consisting of the classification and the rationalization module.

Graph Classification Knowledge Distillation

ImgTrojan: Jailbreaking Vision-Language Models with ONE Image

1 code implementation5 Mar 2024 Xijia Tao, Shuai Zhong, Lei LI, Qi Liu, Lingpeng Kong

In this paper, we propose a novel jailbreaking attack against VLMs, aiming to bypass their safety barrier when a user inputs harmful instructions.

PointCore: Efficient Unsupervised Point Cloud Anomaly Detector Using Local-Global Features

1 code implementation4 Mar 2024 Baozhu Zhao, Qiwei Xiong, Xiaohan Zhang, Jingfeng Guo, Qi Liu, Xiaofen Xing, Xiangmin Xu

Three-dimensional point cloud anomaly detection that aims to detect anomaly data points from a training set serves as the foundation for a variety of applications, including industrial inspection and autonomous driving.

Anomaly Detection Autonomous Driving

FreeA: Human-object Interaction Detection using Free Annotation Labels

no code implementations4 Mar 2024 Yuxiao Wang, Zhenao Wei, Xinyu Jiang, Yu Lei, Weiying Xue, Jinxiu Liu, Qi Liu

Recent human-object interaction (HOI) detection approaches rely on high cost of manpower and require comprehensive annotated image datasets.

Human-Object Interaction Detection Object

ConvTimeNet: A Deep Hierarchical Fully Convolutional Model for Multivariate Time Series Analysis

no code implementations3 Mar 2024 Mingyue Cheng, Jiqian Yang, Tingyue Pan, Qi Liu, Zhi Li

This paper introduces ConvTimeNet, a novel deep hierarchical fully convolutional network designed to serve as a general-purpose model for time series analysis.

Time Series Time Series Forecasting

Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language Models

1 code implementation22 Feb 2024 Xudong Lu, Qi Liu, Yuhui Xu, Aojun Zhou, Siyuan Huang, Bo Zhang, Junchi Yan, Hongsheng Li

Specifically, we propose, for the first time to our best knowledge, post-training approaches for task-agnostic and task-specific expert pruning and skipping of MoE LLMs, tailored to improve deployment efficiency while maintaining model performance across a wide range of tasks.

SISSA: Real-time Monitoring of Hardware Functional Safety and Cybersecurity with In-vehicle SOME/IP Ethernet Traffic

1 code implementation21 Feb 2024 Qi Liu, Xingyu Li, Ke Sun, Yufeng Li, Yanchen Liu

Scalable service-Oriented Middleware over IP (SOME/IP) is an Ethernet communication standard protocol in the Automotive Open System Architecture (AUTOSAR), promoting ECU-to-ECU communication over the IP stack.

ViTree: Single-path Neural Tree for Step-wise Interpretable Fine-grained Visual Categorization

no code implementations30 Jan 2024 Danning Lao, Qi Liu, Jiazi Bu, Junchi Yan, Wei Shen

As computer vision continues to advance and finds widespread applications across various domains, the need for interpretability in deep learning models becomes paramount.

Decision Making Fine-Grained Visual Categorization

FedGT: Federated Node Classification with Scalable Graph Transformer

no code implementations26 Jan 2024 Zaixi Zhang, Qingyong Hu, Yang Yu, Weibo Gao, Qi Liu

However, existing methods have the following limitations: (1) The links between local subgraphs are missing in subgraph federated learning.

Classification Federated Learning +2

Red Teaming Visual Language Models

no code implementations23 Jan 2024 Mukai Li, Lei LI, Yuwei Yin, Masood Ahmed, Zhenguang Liu, Qi Liu

Additionally, we simply apply red teaming alignment to LLaVA-v1. 5 with Supervised Fine-tuning (SFT) using RTVLM, and this bolsters the models' performance with 10% in RTVLM test set, 13% in MM-Hal, and without noticeable decline in MM-Bench, overpassing other LLaVA-based models with regular alignment data.

Fairness

A locally statistical active contour model for SAR image segmentation can be solved by denoising algorithms

no code implementations10 Jan 2024 Guangming Liu, Quanying Sun, Jing Liang, Qi Liu

In this paper, we propose a novel locally statistical variational active contour model based on I-divergence-TV denoising model, which hybrides geodesic active contour (GAC) model with active contours without edges (ACWE) model, and can be used to segment images corrupted by multiplicative gamma noise.

Denoising Image Segmentation +1

LMaaS: Exploring Pricing Strategy of Large Model as a Service for Communication

no code implementations5 Jan 2024 Panlong Wu, Qi Liu, Yanjie Dong, Fangxin Wang

In the first step, we optimize the seller's pricing decision and propose an Iterative Model Pricing (IMP) algorithm that optimizes the prices of large models iteratively by reasoning customers' future rental decisions, which is able to achieve a near-optimal pricing solution.

Intelligent Communication

Unlocking the Potential of Large Language Models for Explainable Recommendations

1 code implementation25 Dec 2023 Yucong Luo, Mingyue Cheng, Hao Zhang, Junyu Lu, Qi Liu, Enhong Chen

In this study, we propose LLMXRec, a simple yet effective two-stage explainable recommendation framework aimed at further boosting the explanation quality by employing LLMs.

Decision Making Explainable Recommendation +2

Active contours driven by local and global intensity fitting energy with application to SAR image segmentation and its fast solvers

no code implementations19 Dec 2023 Guangming Liu, Qi Liu, Jing Liang, Quanying Sun

In this paper, we propose a novel variational active contour model based on Aubert-Aujol (AA) denoising model, which hybrides geodesic active contour (GAC) model with active contours without edges (ACWE) model and can be used to segment images corrupted by multiplicative gamma noise.

Denoising Image Segmentation +2

Random resistive memory-based deep extreme point learning machine for unified visual processing

no code implementations14 Dec 2023 Shaocong Wang, Yizhao Gao, Yi Li, Woyu Zhang, Yifei Yu, Bo wang, Ning Lin, Hegan Chen, Yue Zhang, Yang Jiang, Dingchen Wang, Jia Chen, Peng Dai, Hao Jiang, Peng Lin, Xumeng Zhang, Xiaojuan Qi, Xiaoxin Xu, Hayden So, Zhongrui Wang, Dashan Shang, Qi Liu, Kwang-Ting Cheng, Ming Liu

Our random resistive memory-based deep extreme point learning machine may pave the way for energy-efficient and training-friendly edge AI across various data modalities and tasks.

AT4CTR: Auxiliary Match Tasks for Enhancing Click-Through Rate Prediction

no code implementations9 Dec 2023 Qi Liu, Xuyang Hou, Defu Lian, Zhe Wang, Haoran Jin, Jia Cheng, Jun Lei

Most existing methods focus on the network architecture design of the CTR model for better accuracy and suffer from the data sparsity problem.

Click-Through Rate Prediction Collaborative Filtering +2

A global optimization SAR image segmentation model can be easily transformed to a general ROF denoising model

no code implementations8 Dec 2023 Guangming Liu, Qi Liu, Jing Liang

The second model is: we use a different splitting approach than one model to transform the global optimization model into a differentiable term and a general ROF model term, which can be solved by the same technique as the first model.

Denoising Image Segmentation +1

SigFormer: Sparse Signal-Guided Transformer for Multi-Modal Human Action Segmentation

1 code implementation29 Nov 2023 Qi Liu, Xinchen Liu, Kun Liu, Xiaoyan Gu, Wu Liu

Nowadays, the majority of approaches concentrate on the fusion of dense signals (i. e., RGB, optical flow, and depth maps).

Action Segmentation Optical Flow Estimation +1

DocPedia: Unleashing the Power of Large Multimodal Model in the Frequency Domain for Versatile Document Understanding

no code implementations20 Nov 2023 Hao Feng, Qi Liu, Hao liu, Wengang Zhou, Houqiang Li, Can Huang

This work presents DocPedia, a novel large multimodal model (LMM) for versatile OCR-free document understanding, capable of parsing images up to 2, 560$\times$2, 560 resolution.

document understanding Language Modelling +2

Deep Group Interest Modeling of Full Lifelong User Behaviors for CTR Prediction

no code implementations15 Nov 2023 Qi Liu, Xuyang Hou, Haoran Jin, Jin Chen, Zhe Wang, Defu Lian, Tan Qu, Jia Cheng, Jun Lei

The insights from this subset reveal the user's decision-making process related to the candidate item, improving prediction accuracy.

Click-Through Rate Prediction

Pruning random resistive memory for optimizing analogue AI

no code implementations13 Nov 2023 Yi Li, Songqi Wang, Yaping Zhao, Shaocong Wang, Woyu Zhang, Yangu He, Ning Lin, Binbin Cui, Xi Chen, Shiming Zhang, Hao Jiang, Peng Lin, Xumeng Zhang, Xiaojuan Qi, Zhongrui Wang, Xiaoxin Xu, Dashan Shang, Qi Liu, Kwang-Ting Cheng, Ming Liu

Here, we report a universal solution, software-hardware co-design using structural plasticity-inspired edge pruning to optimize the topology of a randomly weighted analogue resistive memory neural network.

Audio Classification Image Segmentation +1

Sparse Attention-Based Neural Networks for Code Classification

no code implementations11 Nov 2023 Ziyang Xiang, Zaixi Zhang, Qi Liu

We introduce an approach named the Sparse Attention-based neural network for Code Classification (SACC) in this paper.

Classification Code Classification

Towards Automatic Sampling of User Behaviors for Sequential Recommender Systems

no code implementations1 Nov 2023 Hao Zhang, Mingyue Cheng, Qi Liu, Zhiding Liu, Enhong Chen

Sequential recommender systems (SRS) have gained widespread popularity in recommendation due to their ability to effectively capture dynamic user preferences.

Future prediction Sequential Recommendation

SoulChat: Improving LLMs' Empathy, Listening, and Comfort Abilities through Fine-tuning with Multi-turn Empathy Conversations

no code implementations1 Nov 2023 YiRong Chen, Xiaofen Xing, Jingkai Lin, huimin zheng, Zhenyu Wang, Qi Liu, Xiangmin Xu

Large language models (LLMs) have been widely applied in various fields due to their excellent capability for memorizing knowledge and chain of thought (CoT).

BianQue: Balancing the Questioning and Suggestion Ability of Health LLMs with Multi-turn Health Conversations Polished by ChatGPT

1 code implementation24 Oct 2023 YiRong Chen, Zhenyu Wang, Xiaofen Xing, huimin zheng, Zhipei Xu, Kai Fang, Junhong Wang, Sihang Li, Jieling Wu, Qi Liu, Xiangmin Xu

Large language models (LLMs) have performed well in providing general and extensive health suggestions in single-turn conversations, exemplified by systems such as ChatGPT, ChatGLM, ChatDoctor, DoctorGLM, and etc.

AdaptSSR: Pre-training User Model with Augmentation-Adaptive Self-Supervised Ranking

1 code implementation NeurIPS 2023 Yang Yu, Qi Liu, Kai Zhang, Yuren Zhang, Chao Song, Min Hou, Yuqing Yuan, Zhihao Ye, Zaixi Zhang, Sanshi Lei Yu

Specifically, we adopt a multiple pairwise ranking loss which trains the user model to capture the similarity orders between the implicitly augmented view, the explicitly augmented view, and views from other users.

Contrastive Learning Data Augmentation

LRRU: Long-short Range Recurrent Updating Networks for Depth Completion

no code implementations ICCV 2023 YuFei Wang, Bo Li, Ge Zhang, Qi Liu, Tao Gao, Yuchao Dai

Existing deep learning-based depth completion methods generally employ massive stacked layers to predict the dense depth map from sparse input data.

Depth Completion

Full-Atom Protein Pocket Design via Iterative Refinement

1 code implementation NeurIPS 2023 Zaixi Zhang, Zepu Lu, Zhongkai Hao, Marinka Zitnik, Qi Liu

In the initial stage, the residue types and backbone coordinates are refined using a hierarchical context encoder, complemented by two structure refinement modules that capture both inter-residue and pocket-ligand interactions.

Synthetic Data Generation in Low-Resource Settings via Fine-Tuning of Large Language Models

1 code implementation2 Oct 2023 Jean Kaddour, Qi Liu

The in-context learning ability of large language models (LLMs) enables them to generalize to novel downstream tasks with relatively few labeled examples.

Data Augmentation In-Context Learning +4

Leveraging In-the-Wild Data for Effective Self-Supervised Pretraining in Speaker Recognition

1 code implementation21 Sep 2023 Shuai Wang, Qibing Bai, Qi Liu, Jianwei Yu, Zhengyang Chen, Bing Han, Yanmin Qian, Haizhou Li

Current speaker recognition systems primarily rely on supervised approaches, constrained by the scale of labeled datasets.

Speaker Recognition

Reformulating Sequential Recommendation: Learning Dynamic User Interest with Content-enriched Language Modeling

no code implementations19 Sep 2023 Junzhe Jiang, Shang Qu, Mingyue Cheng, Qi Liu

To address this issue, we adopt a new sequential recommendation paradigm and propose LANCER, which leverages the semantic understanding capabilities of pre-trained language models to generate personalized recommendations.

Language Modelling Sequential Recommendation

FedJudge: Federated Legal Large Language Model

1 code implementation15 Sep 2023 Linan Yue, Qi Liu, Yichao Du, Weibo Gao, Ye Liu, Fangzhou Yao

To this end, in this paper, we propose the first Federated Legal Large Language Model (FedJudge) framework, which fine-tunes Legal LLMs efficiently and effectively.

Continual Learning Federated Learning +2

Beyond Static Datasets: A Deep Interaction Approach to LLM Evaluation

no code implementations8 Sep 2023 Jiatong Li, Rui Li, Qi Liu

Existing LLM evaluation methods are mainly supervised signal-based which depends on static datasets and cannot evaluate the ability of LLMs in dynamic real-world scenarios where deep interaction widely exists.

Code Generation Machine Translation

Decomposed Guided Dynamic Filters for Efficient RGB-Guided Depth Completion

no code implementations5 Sep 2023 YuFei Wang, Yuxin Mao, Qi Liu, Yuchao Dai

The decomposed filters not only maintain the favorable properties of guided dynamic filters as being content-dependent and spatially-variant, but also reduce model parameters and hardware costs, as the learned adaptors are decoupled with the number of feature channels.

Depth Completion object-detection +2

Towards the Identifiability and Explainability for Personalized Learner Modeling: An Inductive Paradigm

no code implementations1 Sep 2023 Jiatong Li, Qi Liu, Fei Wang, Jiayu Liu, Zhenya Huang, Fangzhou Yao, Linbo Zhu, Yu Su

However, we notice that this paradigm leads to the inevitable non-identifiability and explainability overfitting problem, which is harmful to the quantification of learners' cognitive states and the quality of web learning services.

cognitive diagnosis

Asymmetric double-winged multi-view clustering network for exploring Diverse and Consistent Information

no code implementations1 Sep 2023 Qun Zheng, Xihong Yang, Siwei Wang, Xinru An, Qi Liu

In unsupervised scenarios, deep contrastive multi-view clustering (DCMVC) is becoming a hot research spot, which aims to mine the potential relationships between different views.

Clustering Pseudo Label

Research on Image Stitching Based on Invariant Features of Reconstructed Plane

no code implementations30 Aug 2023 Qi Liu, Xiyu Tang, Ju Huo

This paper proposes an image stitching method based on invariant planar features, which uses planar features as constraints to improve the overall effect of natural image stitching.

Image Stitching

Deep Task-specific Bottom Representation Network for Multi-Task Recommendation

no code implementations11 Aug 2023 Qi Liu, Zhilong Zhou, Gangwei Jiang, Tiezheng Ge, Defu Lian

In this paper, we focus on the bottom representation learning of MTL in RS and propose the Deep Task-specific Bottom Representation Network (DTRN) to alleviate the negative transfer problem.

Multi-Task Learning Recommendation Systems +1

FinPT: Financial Risk Prediction with Profile Tuning on Pretrained Foundation Models

1 code implementation22 Jul 2023 Yuwei Yin, Yazheng Yang, Jian Yang, Qi Liu

To tackle these issues, we propose FinPT and FinBench: the former is a novel approach for financial risk prediction that conduct Profile Tuning on large pretrained foundation models, and the latter is a set of high-quality datasets on financial risks such as default, fraud, and churn.

UniTabE: A Universal Pretraining Protocol for Tabular Foundation Model in Data Science

no code implementations18 Jul 2023 Yazheng Yang, Yuqi Wang, Guang Liu, Ledell Wu, Qi Liu

This research primarily centers on classification and regression tasks involving tabular data, and conducts rigorous experimental testing and analyses to validate the effectiveness of our methodology.

NS4AR: A new, focused on sampling areas sampling method in graphical recommendation Systems

no code implementations13 Jul 2023 Xiangqi Wang, Dilinuer Aishan, Qi Liu

The effectiveness of graphical recommender system depends on the quantity and quality of negative sampling.

Recommendation Systems

Feasibility of Universal Anomaly Detection without Knowing the Abnormality in Medical Images

no code implementations3 Jul 2023 Can Cui, Yaohong Wang, Shunxing Bao, Yucheng Tang, Ruining Deng, Lucas W. Remedios, Zuhayr Asad, Joseph T. Roland, Ken S. Lau, Qi Liu, Lori A. Coburn, Keith T. Wilson, Bennett A. Landman, Yuankai Huo

Many anomaly detection approaches, especially deep learning methods, have been recently developed to identify abnormal image morphology by only employing normal images during training.

Anomaly Detection

A Systematic Survey in Geometric Deep Learning for Structure-based Drug Design

1 code implementation20 Jun 2023 Zaixi Zhang, Jiaxian Yan, Qi Liu, Enhong Chen, Marinka Zitnik

Recent developments in geometric deep learning, focusing on the integration and processing of 3D geometric data, coupled with the availability of accurate protein 3D structure predictions from tools like AlphaFold, have greatly advanced the field of structure-based drug design.

Benchmarking Drug Discovery +1

Efficiently Measuring the Cognitive Ability of LLMs: An Adaptive Testing Perspective

1 code implementation18 Jun 2023 Yan Zhuang, Qi Liu, Yuting Ning, Weizhe Huang, Rui Lv, Zhenya Huang, Guanhao Zhao, Zheng Zhang, Qingyang Mao, Shijin Wang, Enhong Chen

Different tests for different models using efficient adaptive testing -- we believe this has the potential to become a new norm in evaluating large language models.

Mathematical Reasoning

Recognizing Unseen Objects via Multimodal Intensive Knowledge Graph Propagation

no code implementations14 Jun 2023 Likang Wu, Zhi Li, Hongke Zhao, Zhefeng Wang, Qi Liu, Baoxing Huai, Nicholas Jing Yuan, Enhong Chen

Zero-Shot Learning (ZSL), which aims at automatically recognizing unseen objects, is a promising learning paradigm to understand new real-world knowledge for machines continuously.

Attribute Knowledge Graphs +2

MSSRNet: Manipulating Sequential Style Representation for Unsupervised Text Style Transfer

1 code implementation12 Jun 2023 Yazheng Yang, Zhou Zhao, Qi Liu

Our proposed method addresses this issue by assigning individual style vector to each token in a text, allowing for fine-grained control and manipulation of the style strength.

Style Transfer Text Style Transfer +1

Multi-task Bioassay Pre-training for Protein-ligand Binding Affinity Prediction

1 code implementation8 Jun 2023 Jiaxian Yan, Zhaofeng Ye, ZiYi Yang, Chengqiang Lu, Shengyu Zhang, Qi Liu, Jiezhong Qiu

By introducing multi-task pre-training to treat the prediction of different affinity labels as different tasks and classifying relative rankings between samples from the same bioassay, MBP learns robust and transferrable structural knowledge from our new ChEMBL-Dock dataset with varied and noisy labels.

Drug Discovery

M$^3$IT: A Large-Scale Dataset towards Multi-Modal Multilingual Instruction Tuning

no code implementations7 Jun 2023 Lei LI, Yuwei Yin, Shicheng Li, Liang Chen, Peiyi Wang, Shuhuai Ren, Mukai Li, Yazheng Yang, Jingjing Xu, Xu sun, Lingpeng Kong, Qi Liu

To tackle this challenge and promote research in the vision-language field, we introduce the Multi-Modal, Multilingual Instruction Tuning (M$^3$IT) dataset, designed to optimize VLM alignment with human instructions.

World Knowledge

A Survey on Large Language Models for Recommendation

1 code implementation31 May 2023 Likang Wu, Zhi Zheng, Zhaopeng Qiu, Hao Wang, Hongchao Gu, Tingjia Shen, Chuan Qin, Chen Zhu, HengShu Zhu, Qi Liu, Hui Xiong, Enhong Chen

Large Language Models (LLMs) have emerged as powerful tools in the field of Natural Language Processing (NLP) and have recently gained significant attention in the domain of Recommendation Systems (RS).

Recommendation Systems Self-Supervised Learning

Large Language Models are not Fair Evaluators

2 code implementations29 May 2023 Peiyi Wang, Lei LI, Liang Chen, Zefan Cai, Dawei Zhu, Binghuai Lin, Yunbo Cao, Qi Liu, Tianyu Liu, Zhifang Sui

In this paper, we uncover a systematic bias in the evaluation paradigm of adopting large language models~(LLMs), e. g., GPT-4, as a referee to score and compare the quality of responses generated by candidate models.

Language Modelling Large Language Model +1

Can Language Models Understand Physical Concepts?

1 code implementation23 May 2023 Lei LI, Jingjing Xu, Qingxiu Dong, Ce Zheng, Qi Liu, Lingpeng Kong, Xu sun

Language models~(LMs) gradually become general-purpose interfaces in the interactive and embodied world, where the understanding of physical concepts is an essential prerequisite.

Rethinking Speech Recognition with A Multimodal Perspective via Acoustic and Semantic Cooperative Decoding

no code implementations23 May 2023 Tian-Hao Zhang, Hai-Bo Qin, Zhi-Hao Lai, Song-Lu Chen, Qi Liu, Feng Chen, Xinyuan Qian, Xu-Cheng Yin

The experimental results show that ASCD significantly improves the performance by leveraging both the acoustic and semantic information cooperatively.

speech-recognition Speech Recognition

Interactive Natural Language Processing

no code implementations22 May 2023 Zekun Wang, Ge Zhang, Kexin Yang, Ning Shi, Wangchunshu Zhou, Shaochun Hao, Guangzheng Xiong, Yizhi Li, Mong Yuan Sim, Xiuying Chen, Qingqing Zhu, Zhenzhu Yang, Adam Nik, Qi Liu, Chenghua Lin, Shi Wang, Ruibo Liu, Wenhu Chen, Ke Xu, Dayiheng Liu, Yike Guo, Jie Fu

Interactive Natural Language Processing (iNLP) has emerged as a novel paradigm within the field of NLP, aimed at addressing limitations in existing frameworks while aligning with the ultimate goals of artificial intelligence.

Decision Making

NIKI: Neural Inverse Kinematics with Invertible Neural Networks for 3D Human Pose and Shape Estimation

1 code implementation CVPR 2023 Jiefeng Li, Siyuan Bian, Qi Liu, Jiasheng Tang, Fan Wang, Cewu Lu

In this work, we present NIKI (Neural Inverse Kinematics with Invertible Neural Network), which models bi-directional errors to improve the robustness to occlusions and obtain pixel-aligned accuracy.

3D human pose and shape estimation

An Equivariant Generative Framework for Molecular Graph-Structure Co-Design

no code implementations12 Apr 2023 Zaixi Zhang, Qi Liu, Chee-Kong Lee, Chang-Yu Hsieh, Enhong Chen

Our extensive investigation reveals that the 2D topology and 3D geometry contain intrinsically complementary information in molecule design, and provide new insights into machine learning-based molecule representation and generation.

Drug Discovery Graph Generation +1

Quiz-based Knowledge Tracing

no code implementations5 Apr 2023 Shuanghong Shen, Enhong Chen, Bihan Xu, Qi Liu, Zhenya Huang, Linbo Zhu, Yu Su

In this paper, we present the Quiz-based Knowledge Tracing (QKT) model to monitor students' knowledge states according to their quiz-based learning interactions.

Decision Making Knowledge Tracing

Two Heads are Better than One: A Bio-inspired Method for Improving Classification on EEG-ET Data

no code implementations25 Mar 2023 Eric Modesitt, Ruiqi Yang, Qi Liu

Classifying EEG data is integral to the performance of Brain Computer Interfaces (BCI) and their applications.

EEG feature selection

Backdoor Defense via Deconfounded Representation Learning

1 code implementation CVPR 2023 Zaixi Zhang, Qi Liu, Zhicai Wang, Zepu Lu, Qingyong Hu

The other clean model dedicates to capturing the desired causal effects by minimizing the mutual information with the confounding representations from the backdoored model and employing a sample-wise re-weighting scheme.

Backdoor Attack backdoor defense +1

TimeMAE: Self-Supervised Representations of Time Series with Decoupled Masked Autoencoders

1 code implementation1 Mar 2023 Mingyue Cheng, Qi Liu, Zhiding Liu, Hao Zhang, Rujiao Zhang, Enhong Chen

In this work, we propose TimeMAE, a novel self-supervised paradigm for learning transferrable time series representations based on transformer networks.

Time Series Time Series Analysis +1

Retrieved Sequence Augmentation for Protein Representation Learning

1 code implementation24 Feb 2023 Chang Ma, Haiteng Zhao, Lin Zheng, Jiayi Xin, Qintong Li, Lijun Wu, Zhihong Deng, Yang Lu, Qi Liu, Lingpeng Kong

RSA links query protein sequences to a set of sequences with similar structures or properties in the database and combines these sequences for downstream prediction.

Property Prediction Representation Learning +1

FormerTime: Hierarchical Multi-Scale Representations for Multivariate Time Series Classification

no code implementations20 Feb 2023 Mingyue Cheng, Qi Liu, Zhiding Liu, Zhi Li, Yucong Luo, Enhong Chen

Deep learning-based algorithms, e. g., convolutional networks, have significantly facilitated multivariate time series classification (MTSC) task.

Time Series Time Series Analysis +1

Deep Vision in Analysis and Recognition of Radar Data: Achievements, Advancements and Challenges

no code implementations20 Feb 2023 Qi Liu, ZhiYun Yang, Ru Ji, Yonghong Zhang, Muhammad Bilal, Xiaodong Liu, S Vimal, Xiaolong Xu

Radars are widely used to obtain echo information for effective prediction, such as precipitation nowcasting.

Search-Engine-augmented Dialogue Response Generation with Cheaply Supervised Query Production

1 code implementation16 Feb 2023 Ante Wang, Linfeng Song, Qi Liu, Haitao Mi, Longyue Wang, Zhaopeng Tu, Jinsong Su, Dong Yu

We propose a dialogue model that can access the vast and dynamic information from any search engine for response generation.

Chatbot Response Generation

Learning by Applying: A General Framework for Mathematical Reasoning via Enhancing Explicit Knowledge Learning

no code implementations11 Feb 2023 Jiayu Liu, Zhenya Huang, ChengXiang Zhai, Qi Liu

In LeAp, we perform knowledge learning in a novel problem-knowledge-expression paradigm, with a Knowledge Encoder to acquire knowledge from problem data and a Knowledge Decoder to apply knowledge for expression reasoning.

Mathematical Reasoning

ShapeWordNet: An Interpretable Shapelet Neural Network for Physiological Signal Classification

no code implementations10 Feb 2023 Wenqiang He, Mingyue Cheng, Qi Liu, Zhi Li

Physiological signals are high-dimensional time series of great practical values in medical and healthcare applications.

Contrastive Learning Time Series +1

A Novel Approach for Auto-Formulation of Optimization Problems

no code implementations9 Feb 2023 Yuting Ning, Jiayu Liu, Longhu Qin, Tong Xiao, Shangzi Xue, Zhenya Huang, Qi Liu, Enhong Chen, Jinze Wu

In the Natural Language for Optimization (NL4Opt) NeurIPS 2022 competition, competitors focus on improving the accessibility and usability of optimization solvers, with the aim of subtask 1: recognizing the semantic entities that correspond to the components of the optimization problem; subtask 2: generating formulations for the optimization problem.

Ensemble Learning named-entity-recognition +2

N-Gram Nearest Neighbor Machine Translation

no code implementations30 Jan 2023 Rui Lv, Junliang Guo, Rui Wang, Xu Tan, Qi Liu, Tao Qin

Nearest neighbor machine translation augments the Autoregressive Translation~(AT) with $k$-nearest-neighbor retrieval, by comparing the similarity between the token-level context representations of the target tokens in the query and the datastore.

Domain Adaptation Machine Translation +2

Joint Appearance and Motion Learning for Efficient Rolling Shutter Correction

1 code implementation CVPR 2023 Bin Fan, Yuxin Mao, Yuchao Dai, Zhexiong Wan, Qi Liu

Rolling shutter correction (RSC) is becoming increasingly popular for RS cameras that are widely used in commercial and industrial applications.

Data Augmentation Rolling Shutter Correction

Untargeted Attack against Federated Recommendation Systems via Poisonous Item Embeddings and the Defense

1 code implementation11 Dec 2022 Yang Yu, Qi Liu, Likang Wu, Runlong Yu, Sanshi Lei Yu, Zaixi Zhang

Experiments on two public datasets show that ClusterAttack can effectively degrade the performance of FedRec systems while circumventing many defense methods, and UNION can improve the resistance of the system against various untargeted attacks, including our ClusterAttack.

Contrastive Learning Recommendation Systems

Progressive Knowledge Transfer Based on Human Visual Perception Mechanism for Perceptual Quality Assessment of Point Clouds

no code implementations30 Nov 2022 Qi Liu, Yiyun Liu, Honglei Su, Hui Yuan, Raouf Hamzaoui

In this paper, a progressive knowledge transfer based on human visual perception mechanism for perceptual quality assessment of point clouds (PKT-PCQA) is proposed.

Transfer Learning

Nested Named Entity Recognition from Medical Texts: An Adaptive Shared Network Architecture with Attentive CRF

no code implementations9 Nov 2022 Junzhe Jiang, Mingyue Cheng, Qi Liu, Zhi Li, Enhong Chen

Recognizing useful named entities plays a vital role in medical information processing, which helps drive the development of medical area research.

Medical Named Entity Recognition named-entity-recognition +3

One Person, One Model--Learning Compound Router for Sequential Recommendation

1 code implementation5 Nov 2022 Zhiding Liu, Mingyue Cheng, Zhi Li, Qi Liu, Enhong Chen

The core idea of CANet is to route the input user behaviors with a light-weighted router module.

Sequential Recommendation

Searching Dense Point Correspondences via Permutation Matrix Learning

no code implementations26 Oct 2022 Zhiyuan Zhang, Jiadai Sun, Yuchao Dai, Bin Fan, Qi Liu

In response, this paper presents a novel end-to-end learning-based method to estimate the dense correspondence of 3D point clouds, in which the problem of point matching is formulated as a zero-one assignment problem to achieve a permutation matching matrix to implement the one-to-one principle fundamentally.

CU-Net: LiDAR Depth-Only Completion With Coupled U-Net

1 code implementation26 Oct 2022 YuFei Wang, Yuchao Dai, Qi Liu, Peng Yang, Jiadai Sun, Bo Li

We find that existing depth-only methods can obtain satisfactory results in the areas where the measurement points are almost accurate and evenly distributed (denoted as normal areas), while the performance is limited in the areas where the foreground and background points are overlapped due to occlusion (denoted as overlap areas) and the areas where there are no measurement points around (denoted as blank areas) since the methods have no reliable input information in these areas.

Augmenting Multi-Turn Text-to-SQL Datasets with Self-Play

1 code implementation21 Oct 2022 Qi Liu, Zihuiwen Ye, Tao Yu, Phil Blunsom, Linfeng Song

We first design a SQL-to-text model conditioned on a sampled goal query, which represents a user's intent, that then converses with a text-to-SQL semantic parser to generate new interactions.

Domain Generalization SQL-to-Text +1

Hierarchical Graph Transformer with Adaptive Node Sampling

1 code implementation8 Oct 2022 Zaixi Zhang, Qi Liu, Qingyong Hu, Chee-Kong Lee

The Transformer architecture has achieved remarkable success in a number of domains including natural language processing and computer vision.

Model Inversion Attacks against Graph Neural Networks

no code implementations16 Sep 2022 Zaixi Zhang, Qi Liu, Zhenya Huang, Hao Wang, Chee-Kong Lee, Enhong Chen

One famous privacy attack against data analysis models is the model inversion attack, which aims to infer sensitive data in the training dataset and leads to great privacy concerns.

Reinforcement Learning (RL)

Cross-scale Attention Guided Multi-instance Learning for Crohn's Disease Diagnosis with Pathological Images

1 code implementation15 Aug 2022 Ruining Deng, Can Cui, Lucas W. Remedios, Shunxing Bao, R. Michael Womick, Sophie Chiron, Jia Li, Joseph T. Roland, Ken S. Lau, Qi Liu, Keith T. Wilson, Yaohong Wang, Lori A. Coburn, Bennett A. Landman, Yuankai Huo

Multi-instance learning (MIL) is widely used in the computer-aided interpretation of pathological Whole Slide Images (WSIs) to solve the lack of pixel-wise or patch-wise annotations.

whole slide images

Causal Machine Learning: A Survey and Open Problems

no code implementations30 Jun 2022 Jean Kaddour, Aengus Lynch, Qi Liu, Matt J. Kusner, Ricardo Silva

Causal Machine Learning (CausalML) is an umbrella term for machine learning methods that formalize the data-generation process as a structural causal model (SCM).

BIG-bench Machine Learning Fairness +1

Evaluating Self-Supervised Learning for Molecular Graph Embeddings

1 code implementation NeurIPS 2023 Hanchen Wang, Jean Kaddour, Shengchao Liu, Jian Tang, Joan Lasenby, Qi Liu

Graph Self-Supervised Learning (GSSL) provides a robust pathway for acquiring embeddings without expert labelling, a capability that carries profound implications for molecular graphs due to the staggering number of potential molecules and the high cost of obtaining labels.

Self-Supervised Learning

Context-Aware Video Reconstruction for Rolling Shutter Cameras

1 code implementation CVPR 2022 Bin Fan, Yuchao Dai, Zhiyuan Zhang, Qi Liu, Mingyi He

Then, a refinement scheme is proposed to guide the GS frame synthesis along with bilateral occlusion masks to produce high-fidelity GS video frames at arbitrary times.

Motion Compensation Video Reconstruction

Graph Adaptive Semantic Transfer for Cross-domain Sentiment Classification

no code implementations18 May 2022 Kai Zhang, Qi Liu, Zhenya Huang, Mingyue Cheng, Kun Zhang, Mengdi Zhang, Wei Wu, Enhong Chen

Existing studies in this task attach more attention to the sequence modeling of sentences while largely ignoring the rich domain-invariant semantics embedded in graph structures (i. e., the part-of-speech tags and dependency relations).

Classification Graph Attention +4

A Comparative Study of Deep Reinforcement Learning-based Transferable Energy Management Strategies for Hybrid Electric Vehicles

1 code implementation22 Feb 2022 Jingyi Xu, Zirui Li, Li Gao, Junyi Ma, Qi Liu, Yanan Zhao

Different exploration methods of DRL, including adding action space noise and parameter space noise, are compared against each other in the transfer learning process in this work.

energy management Management +3

Ligandformer: A Graph Neural Network for Predicting Compound Property with Robust Interpretation

no code implementations21 Feb 2022 Jinjiang Guo, Qi Liu, Han Guo, Xi Lu

Robust and efficient interpretation of QSAR methods is quite useful to validate AI prediction rationales with subjective opinion (chemist or biologist expertise), understand sophisticated chemical or biological process mechanisms, and provide heuristic ideas for structure optimization in pharmaceutical industry.

Low-Rank and Row-Sparse Decomposition for Joint DOA Estimation and Distorted Sensor Detection

no code implementations2 Feb 2022 Huiping Huang, Qi Liu, Hing Cheung So, Abdelhak M. Zoubir

Distorted sensors could occur randomly and may lead to the breakdown of a sensor array system.

Relational Memory Augmented Language Models

no code implementations24 Jan 2022 Qi Liu, Dani Yogatama, Phil Blunsom

We present a memory-augmented approach to condition an autoregressive language model on a knowledge graph.

Language Modelling Text Generation

Investigating Pose Representations and Motion Contexts Modeling for 3D Motion Prediction

1 code implementation30 Dec 2021 Zhenguang Liu, Shuang Wu, Shuyuan Jin, Shouling Ji, Qi Liu, Shijian Lu, Li Cheng

One aspect that has been obviated so far, is the fact that how we represent the skeletal pose has a critical impact on the prediction results.

motion prediction

ProtGNN: Towards Self-Explaining Graph Neural Networks

1 code implementation2 Dec 2021 Zaixi Zhang, Qi Liu, Hao Wang, Chengqiang Lu, Cheekong Lee

In this work, we propose Prototype Graph Neural Network (ProtGNN), which combines prototype learning with GNNs and provides a new perspective on the explanations of GNNs.

Contrastive Cross-domain Recommendation in Matching

1 code implementation2 Dec 2021 Ruobing Xie, Qi Liu, Liangdong Wang, Shukai Liu, Bo Zhang, Leyu Lin

Cross-domain recommendation (CDR) aims to provide better recommendation results in the target domain with the help of the source domain, which is widely used and explored in real-world systems.

Contrastive Learning Representation Learning +1

Tiny-NewsRec: Effective and Efficient PLM-based News Recommendation

1 code implementation2 Dec 2021 Yang Yu, Fangzhao Wu, Chuhan Wu, Jingwei Yi, Qi Liu

We further propose a two-stage knowledge distillation method to improve the efficiency of the large PLM-based news recommendation model while maintaining its performance.

Knowledge Distillation Natural Language Understanding +1

Nonlinear Tensor Ring Network

no code implementations12 Nov 2021 Xiao Peng Li, Qi Liu, Hing Cheung So

Experimental results demonstrate the effectiveness and superiority of the proposed NTRN for image classification using two basic neural networks, LeNet-5 and VGG-11 on three datasets, viz.

Image Classification

Perceptual Quality Assessment of Colored 3D Point Clouds

1 code implementation10 Nov 2021 Honglei Su, Qi Liu, Zhengfang Duanmu, Wentao Liu, Zhou Wang

In this work, we first build a large 3D point cloud database for subjective and objective quality assessment of point clouds.

Point Cloud Quality Assessment

Motif-based Graph Self-Supervised Learning for Molecular Property Prediction

1 code implementation NeurIPS 2021 Zaixi Zhang, Qi Liu, Hao Wang, Chengqiang Lu, Chee-Kong Lee

To bridge this gap, we propose Motif-based Graph Self-supervised Learning (MGSSL) by introducing a novel self-supervised motif generation framework for GNNs.

Molecular Property Prediction Property Prediction +2

DAE-GAN: Dynamic Aspect-aware GAN for Text-to-Image Synthesis

1 code implementation ICCV 2021 Shulan Ruan, Yong Zhang, Kun Zhang, Yanbo Fan, Fan Tang, Qi Liu, Enhong Chen

Text-to-image synthesis refers to generating an image from a given text description, the key goal of which lies in photo realism and semantic consistency.

Image Generation Sentence +2

SIFN: A Sentiment-aware Interactive Fusion Network for Review-based Item Recommendation

no code implementations18 Aug 2021 Kai Zhang, Hao Qian, Qi Liu, Zhiqiang Zhang, Jun Zhou, Jianhui Ma, Enhong Chen

Specifically, we first encode user/item reviews via BERT and propose a light-weighted sentiment learner to extract semantic features of each review.

Recommendation Systems

LadRa-Net: Locally-Aware Dynamic Re-read Attention Net for Sentence Semantic Matching

no code implementations6 Aug 2021 Kun Zhang, Guangyi Lv, Le Wu, Enhong Chen, Qi Liu, Meng Wang

In order to overcome this problem and boost the performance of attention mechanism, we propose a novel dynamic re-read attention, which can pay close attention to one small region of sentences at each step and re-read the important parts for better sentence representations.

Language Modelling Natural Language Inference +2

Decision-Making Technology for Autonomous Vehicles Learning-Based Methods, Applications and Future Outlook

no code implementations2 Jul 2021 Qi Liu, Xueyuan Li, Shihua Yuan, Zirui Li

Autonomous vehicles have a great potential in the application of both civil and military fields, and have become the focus of research with the rapid development of science and economy.

Autonomous Vehicles Decision Making

GraphMI: Extracting Private Graph Data from Graph Neural Networks

1 code implementation5 Jun 2021 Zaixi Zhang, Qi Liu, Zhenya Huang, Hao Wang, Chengqiang Lu, Chuanren Liu, Enhong Chen

Then we design a graph auto-encoder module to efficiently exploit graph topology, node attributes, and target model parameters for edge inference.

Hybrid attention network based on progressive embedding scale-context for crowd counting

no code implementations4 Jun 2021 Fusen Wang, Jun Sang, Zhongyuan Wu, Qi Liu, Nong Sang

In this paper, we propose a Hybrid Attention Network (HAN) by employing Progressive Embedding Scale-context (PES) information, which enables the network to simultaneously suppress noise and adapt head scale variation.

Crowd Counting

Causal Effect Inference for Structured Treatments

2 code implementations NeurIPS 2021 Jean Kaddour, Yuchen Zhu, Qi Liu, Matt J. Kusner, Ricardo Silva

We address the estimation of conditional average treatment effects (CATEs) for structured treatments (e. g., graphs, images, texts).

Estimating Fund-Raising Performance for Start-up Projects from a Market Graph Perspective

no code implementations27 May 2021 Likang Wu, Zhi Li, Hongke Zhao, Qi Liu, Enhong Chen

Usually, this prediction is always with great challenges to making a comprehensive understanding of both the start-up project and market environment.

Cardiac Functional Analysis with Cine MRI via Deep Learning Reconstruction

no code implementations17 May 2021 Eric Z. Chen, Xiao Chen, Jingyuan Lyu, Qi Liu, Zhongqi Zhang, Yu Ding, Shuheng Zhang, Terrence Chen, Jian Xu, Shanhui Sun

To the best of our knowledge, this is the first work to evaluate the cine MRI with deep learning reconstruction for cardiac function analysis and compare it with other conventional methods.

A Survey of Knowledge Tracing

1 code implementation6 May 2021 Qi Liu, Shuanghong Shen, Zhenya Huang, Enhong Chen, Yonghe Zheng

In contrast to traditional face-to-face classroom education, online education enables us to record and research a large amount of learning data for offering intelligent educational services.

Knowledge Tracing

XCrossNet: Feature Structure-Oriented Learning for Click-Through Rate Prediction

1 code implementation22 Apr 2021 Runlong Yu, Yuyang Ye, Qi Liu, Zihan Wang, Chunfeng Yang, Yucheng Hu, Enhong Chen

Motivated by this, we propose a novel Extreme Cross Network, abbreviated XCrossNet, which aims at learning dense and sparse feature interactions in an explicit manner.

Click-Through Rate Prediction Feature Engineering +1

Pretraining the Noisy Channel Model for Task-Oriented Dialogue

no code implementations18 Mar 2021 Qi Liu, Lei Yu, Laura Rimell, Phil Blunsom

Direct decoding for task-oriented dialogue is known to suffer from the explaining-away effect, manifested in models that prefer short and generic responses.

End-To-End Dialogue Modelling

PRIN/SPRIN: On Extracting Point-wise Rotation Invariant Features

2 code implementations24 Feb 2021 Yang You, Yujing Lou, Ruoxi Shi, Qi Liu, Yu-Wing Tai, Lizhuang Ma, Weiming Wang, Cewu Lu

Spherical Voxel Convolution and Point Re-sampling are proposed to extract rotation invariant features for each point.

3D Feature Matching Data Augmentation

NewsBERT: Distilling Pre-trained Language Model for Intelligent News Application

no code implementations Findings (EMNLP) 2021 Chuhan Wu, Fangzhao Wu, Yang Yu, Tao Qi, Yongfeng Huang, Qi Liu

However, existing language models are pre-trained and distilled on general corpus like Wikipedia, which has some gaps with the news domain and may be suboptimal for news intelligence.

Knowledge Distillation Language Modelling +2

Improving Accuracy and Diversity in Matching of Recommendation with Diversified Preference Network

no code implementations7 Feb 2021 Ruobing Xie, Qi Liu, Shukai Liu, Ziwei Zhang, Peng Cui, Bo Zhang, Leyu Lin

In this paper, we propose a novel Heterogeneous graph neural network framework for diversified recommendation (GraphDR) in matching to improve both recommendation accuracy and diversity.

Graph Attention Recommendation Systems

Scenario Generation for Cooling, Heating, and Power Loads Using Generative Moment Matching Networks

no code implementations5 Feb 2021 Wenlong Liao, Yusen Wang, Yuelong Wang, Kody Powell, Qi Liu, Zhe Yang

Scenario generations of cooling, heating, and power loads are of great significance for the economic operation and stability analysis of integrated energy systems.

Learning the Implicit Semantic Representation on Graph-Structured Data

1 code implementation16 Jan 2021 Likang Wu, Zhi Li, Hongke Zhao, Qi Liu, Jun Wang, Mengdi Zhang, Enhong Chen

Existing representation learning methods in graph convolutional networks are mainly designed by describing the neighborhood of each node as a perceptual whole, while the implicit semantic associations behind highly complex interactions of graphs are largely unexploited.

Representation Learning

Quality meets Diversity: A Model-Agnostic Framework for Computerized Adaptive Testing

no code implementations15 Jan 2021 Haoyang Bi, Haiping Ma, Zhenya Huang, Yu Yin, Qi Liu, Enhong Chen, Yu Su, Shijin Wang

In this paper, we study a novel model-agnostic CAT problem, where we aim to propose a flexible framework that can adapt to different cognitive models.

Active Learning

Multi-Interactive Attention Network for Fine-grained Feature Learning in CTR Prediction

no code implementations13 Dec 2020 Kai Zhang, Hao Qian, Qing Cui, Qi Liu, Longfei Li, Jun Zhou, Jianhui Ma, Enhong Chen

In the Click-Through Rate (CTR) prediction scenario, user's sequential behaviors are well utilized to capture the user interest in the recent literature.

Click-Through Rate Prediction

Early systems change necessary for catalyzing long-term sustainability in a post-2030 agenda

no code implementations8 Dec 2020 Enayat A. Moallemi, Sibel Eker, Lei Gao, Michalis Hadjikakou, Qi Liu, Jan Kwakkel, Patrick M. Reed, Michael Obersteiner, Zhaoxia Guo, Brett A. Bryan

Progress to-date towards the Sustainable Development Goals (SDGs) has fallen short of expectations and is unlikely to fully meet 2030 targets.

An Odor Labeling Convolutional Encoder-Decoder for Odor Sensing in Machine Olfaction

no code implementations25 Nov 2020 Tengteng Wen, Zhuofeng Mo, Jingshan Li, Qi Liu, Liming Wu, Dehan Luo

In this paper, we proposed an odor labeling convolutional encoder-decoder (OLCE) for odor identification in machine olfaction.

Reduced Reference Perceptual Quality Model and Application to Rate Control for 3D Point Cloud Compression

no code implementations25 Nov 2020 Qi Liu, Hui Yuan, Raouf Hamzaoui, Honglei Su, Junhui Hou, Huan Yang

In rate-distortion optimization, the encoder settings are determined by maximizing a reconstruction quality measure subject to a constraint on the bit rate.

Quantization

Sampling-Decomposable Generative Adversarial Recommender

no code implementations NeurIPS 2020 Binbin Jin, Defu Lian, Zheng Liu, Qi Liu, Jianhui Ma, Xing Xie, Enhong Chen

The GAN-style recommenders (i. e., IRGAN) addresses the challenge by learning a generator and a discriminator adversarially, such that the generator produces increasingly difficult samples for the discriminator to accelerate optimizing the discrimination objective.

End-to-end trainable network for degraded license plate detection via vehicle-plate relation mining

1 code implementation27 Oct 2020 Song-Lu Chen, Shu Tian, Jia-Wei Ma, Qi Liu, Chun Yang, Feng Chen, Xu-Cheng Yin

Second, we propose to predict the quadrilateral bounding box in the local region by regressing the four corners of the license plate to robustly detect oblique license plates.

License Plate Detection License Plate Recognition +1

An Investigation on Different Underlying Quantization Schemes for Pre-trained Language Models

no code implementations14 Oct 2020 Zihan Zhao, Yuncong Liu, Lu Chen, Qi Liu, Rao Ma, Kai Yu

Recently, pre-trained language models like BERT have shown promising performance on multiple natural language processing tasks.

Clustering Quantization

Unsupervised Point Cloud Pre-Training via Occlusion Completion

1 code implementation ICCV 2021 Hanchen Wang, Qi Liu, Xiangyu Yue, Joan Lasenby, Matthew J. Kusner

We find that even when we construct a single pre-training dataset (from ModelNet40), this pre-training method improves accuracy across different datasets and encoders, on a wide range of downstream tasks.

3D Point Cloud Linear Classification Few-Shot 3D Point Cloud Classification +5

Pre-Training by Completing Point Clouds

no code implementations28 Sep 2020 Hanchen Wang, Qi Liu, Xiangyu Yue, Joan Lasenby, Matt Kusner

There has recently been a flurry of exciting advances in deep learning models on point clouds.

Conditional Uncorrelation and Efficient Non-approximate Subset Selection in Sparse Regression

no code implementations8 Sep 2020 Jianji Wang, Qi Liu, Shupei Zhang, Nanning Zheng, Fei-Yue Wang

By the proposed method, the computational complexity is reduced from $O(\frac{1}{6}{k^3}+mk^2+mkd)$ to $O(\frac{1}{6}{k^3}+\frac{1}{2}mk^2)$ for each candidate subset in sparse regression.

regression

A Study on Effects of Implicit and Explicit Language Model Information for DBLSTM-CTC Based Handwriting Recognition

no code implementations31 Jul 2020 Qi Liu, Lijuan Wang, Qiang Huo

Deep Bidirectional Long Short-Term Memory (D-BLSTM) with a Connectionist Temporal Classification (CTC) output layer has been established as one of the state-of-the-art solutions for handwriting recognition.

Handwriting Recognition Language Modelling

Future Vector Enhanced LSTM Language Model for LVCSR

no code implementations31 Jul 2020 Qi Liu, Yanmin Qian, Kai Yu

For the speech recognition rescoring, although the proposed LSTM LM obtains very slight gains, the new model seems obtain the great complementary with the conventional LSTM LM.

Language Modelling speech-recognition +1

An Investigation on Deep Learning with Beta Stabilizer

no code implementations31 Jul 2020 Qi Liu, Tian Tan, Kai Yu

It is concluded that beta stabilizer parameters can reduce the sensitivity of learning rate with almost the same performance on DNN with relu activation function and LSTM.

Handwriting Recognition speech-recognition +1

ASGN: An Active Semi-supervised Graph Neural Network for Molecular Property Prediction

1 code implementation7 Jul 2020 Zhongkai Hao, Chengqiang Lu, Zheyuan Hu, Hao Wang, Zhenya Huang, Qi Liu, Enhong Chen, Cheekong Lee

Here we propose a novel framework called Active Semi-supervised Graph Neural Network (ASGN) by incorporating both labeled and unlabeled molecules.

Active Learning Molecular Property Prediction +1

A Survey on Sensor Technologies for Unmanned Ground Vehicles

no code implementations4 Jul 2020 Qi Liu, Shihua Yuan, Zirui Li

Unmanned ground vehicles have a huge development potential in both civilian and military fields, and have become the focus of research in various countries.

HGKT: Introducing Hierarchical Exercise Graph for Knowledge Tracing

no code implementations13 Jun 2020 Hanshuang Tong, Zhen Wang, Yun Zhou, Shiwei Tong, Wenyuan Han, Qi Liu

To solve the above problems, we propose a hierarchical graph knowledge tracing model called HGKT to explore the latent hierarchical relations between exercises.

Knowledge Tracing

Learning the Compositional Visual Coherence for Complementary Recommendations

no code implementations8 Jun 2020 Zhi Li, Bo Wu, Qi Liu, Likang Wu, Hongke Zhao, Tao Mei

Towards this end, in this paper, we propose a novel Content Attentive Neural Network (CANN) to model the comprehensive compositional coherence on both global contents and semantic contents.

Fast and Scalable Dialogue State Tracking with Explicit Modular Decomposition

no code implementations NAACL 2021 Dingmin Wang, Chenghua Lin, Qi Liu, Kam-Fai Wong

We present a fast and scalable architecture called Explicit Modular Decomposition (EMD), in which we incorporate both classification-based and extraction-based methods and design four modules (for classification and sequence labelling) to jointly extract dialogue states.

Classification Dialogue State Tracking +3

A Survey on Contextual Embeddings

no code implementations16 Mar 2020 Qi Liu, Matt J. Kusner, Phil Blunsom

Contextual embeddings, such as ELMo and BERT, move beyond global word representations like Word2Vec and achieve ground-breaking performance on a wide range of natural language processing tasks.

Model Compression

Beyond Clicks: Modeling Multi-Relational Item Graph for Session-Based Target Behavior Prediction

1 code implementation19 Feb 2020 Wen Wang, Wei zhang, Shukai Liu, Qi Liu, Bo Zhang, Leyu Lin, Hongyuan Zha

Specifically, we build a Multi-Relational Item Graph (MRIG) based on all behavior sequences from all sessions, involving target and auxiliary behavior types.

Representation Learning

Domain Adaption for Knowledge Tracing

no code implementations14 Jan 2020 Song Cheng, Qi Liu, Enhong Chen

We refer to this problem as domain adaptation for knowledge tracing (DAKT) which contains two aspects: (1) how to achieve great knowledge tracing performance in each domain.

Domain Adaptation Knowledge Tracing

Deep Technology Tracing for High-tech Companies

no code implementations2 Jan 2020 Han Wu, Kun Zhang, Guangyi Lv, Qi Liu, Runlong Yu, Weihao Zhao, Enhong Chen, Jianhui Ma

Technological change and innovation are vitally important, especially for high-tech companies.

Vocal Bursts Intensity Prediction

Crowdfunding Dynamics Tracking: A Reinforcement Learning Approach

no code implementations27 Dec 2019 Jun Wang, Hefu Zhang, Qi Liu, Zhen Pan, Hanqing Tao

However, few of them take into account the inherent decision-making process between investors and crowdfunding dynamics.

Continuous Control Decision Making +4

A Comprehensive Study and Comparison of Core Technologies for MPEG 3D Point Cloud Compression

no code implementations20 Dec 2019 Hao Liu, Hui Yuan, Qi Liu, Junhui Hou, Ju Liu

Point cloud based 3D visual representation is becoming popular due to its ability to exhibit the real world in a more comprehensive and immersive way.

Estimating Early Fundraising Performance of Innovations via Graph-based Market Environment Model

no code implementations14 Dec 2019 Likang Wu, Zhi Li, Hongke Zhao, Zhen Pan, Qi Liu, Enhong Chen

In the crowdfunding market, the early fundraising performance of the project is a concerned issue for both creators and platforms.

Hyperbolic Graph Neural Networks

1 code implementation NeurIPS 2019 Qi Liu, Maximilian Nickel, Douwe Kiela

Learning from graph-structured data is an important task in machine learning and artificial intelligence, for which Graph Neural Networks (GNNs) have shown great promise.

BIG-bench Machine Learning Representation Learning

Long-term Joint Scheduling for Urban Traffic

1 code implementation27 Oct 2019 Xianfeng Liang, Likang Wu, Joya Chen, Yang Liu, Runlong Yu, Min Hou, Han Wu, Yuyang Ye, Qi Liu, Enhong Chen

Recently, the traffic congestion in modern cities has become a growing worry for the residents.

Scheduling

Neural Cognitive Diagnosis for Intelligent Education Systems

1 code implementation23 Aug 2019 Fei Wang, Qi Liu, Enhong Chen, Zhenya Huang, Yuying Chen, Yu Yin, Zai Huang, Shijin Wang

Cognitive diagnosis is a fundamental issue in intelligent education, which aims to discover the proficiency level of students on specific knowledge concepts.

cognitive diagnosis

Molecular Property Prediction: A Multilevel Quantum Interactions Modeling Perspective

2 code implementations25 Jun 2019 Chengqiang Lu, Qi Liu, Chao Wang, Zhenya Huang, Peize Lin, Lixin He

In this paper, we propose a generalizable and transferable Multilevel Graph Convolutional neural Network (MGCN) for molecular property prediction.

Graph Regression Molecular Property Prediction +1

EKT: Exercise-aware Knowledge Tracing for Student Performance Prediction

1 code implementation7 Jun 2019 Qi Liu, Zhenya Huang, Yu Yin, Enhong Chen, Hui Xiong, Yu Su, Guoping Hu

In EERNN, we simply summarize each student's state into an integrated vector and trace it with a recurrent neural network, where we design a bidirectional LSTM to learn the encoding of each exercise's content.

Knowledge Tracing

Chinese Embedding via Stroke and Glyph Information: A Dual-channel View

no code implementations3 Jun 2019 Hanqing Tao, Shiwei Tong, Tong Xu, Qi Liu, Enhong Chen

Recent studies have consistently given positive hints that morphology is helpful in enriching word embeddings.

Word Embeddings Word Similarity

Promotion of Answer Value Measurement with Domain Effects in Community Question Answering Systems

no code implementations1 Jun 2019 Binbin Jin, Enhong Chen, Hongke Zhao, Zhenya Huang, Qi Liu, HengShu Zhu, Shui Yu

Existing solutions mainly exploit the syntactic or semantic correlation between a question and its related answers (Q&A), where the multi-facet domain effects in CQA are still underexplored.

Answer Selection Community Question Answering +1

Explainable Fashion Recommendation: A Semantic Attribute Region Guided Approach

no code implementations30 May 2019 Min Hou, Le Wu, Enhong Chen, Zhi Li, Vincent W. Zheng, Qi Liu

When making cloth decisions, people usually show preferences for different semantic attributes (e. g., the clothes with v-neck collar).

 Ranked #1 on Recommendation Systems on Amazon Fashion (nDCG@10 (500 Neg. Samples) metric, using extra training data)

Attribute Recommendation Systems

QuesNet: A Unified Representation for Heterogeneous Test Questions

no code implementations27 May 2019 Yu Yin, Qi Liu, Zhenya Huang, Enhong Chen, Wei Tong, Shijin Wang, Yu Su

Then we propose a two-level hierarchical pre-training algorithm to learn better understanding of test questions in an unsupervised way.

Language Modelling

Transcribing Content from Structural Images with Spotlight Mechanism

no code implementations27 May 2019 Yu Yin, Zhenya Huang, Enhong Chen, Qi Liu, Fuzheng Zhang, Xing Xie, Guoping Hu

Then, we decide "what-to-write" by developing a GRU based network with the spotlight areas for transcribing the content accordingly.

MCNE: An End-to-End Framework for Learning Multiple Conditional Network Representations of Social Network

no code implementations27 May 2019 Hao Wang, Tong Xu, Qi Liu, Defu Lian, Enhong Chen, Dongfang Du, Han Wu, Wen Su

Recently, the Network Representation Learning (NRL) techniques, which represent graph structure via low-dimension vectors to support social-oriented application, have attracted wide attention.

Multi-Task Learning Representation Learning

Enhancing Item Response Theory for Cognitive Diagnosis

1 code implementation27 May 2019 Song Cheng, Qi Liu

However, traditional IRT ignores the rich information in question texts, cannot diagnose knowledge concept proficiency, and it is inaccurate to diagnose the parameters for the questions which only appear several times.

cognitive diagnosis

Exploiting Cognitive Structure for Adaptive Learning

no code implementations23 May 2019 Qi Liu, Shiwei Tong, Chuanren Liu, Hongke Zhao, Enhong Chen, Haiping Ma, Shijin Wang

Although it is well known that modeling the cognitive structure including knowledge level of learners and knowledge structure (e. g., the prerequisite relations) of learning items is important for learning path recommendation, existing methods for adaptive learning often separately focus on either knowledge levels of learners or knowledge structure of learning items.

Quaternion Knowledge Graph Embeddings

1 code implementation NeurIPS 2019 Shuai Zhang, Yi Tay, Lina Yao, Qi Liu

In this work, we move beyond the traditional complex-valued representations, introducing more expressive hypercomplex representations to model entities and relations for knowledge graph embeddings.

Knowledge Graph Embedding Knowledge Graph Embeddings +1

Machine Vision Guided 3D Medical Image Compression for Efficient Transmission and Accurate Segmentation in the Clouds

no code implementations CVPR 2019 Zihao Liu, Xiaowei Xu, Tao Liu, Qi Liu, Yanzhi Wang, Yiyu Shi, Wujie Wen, Meiping Huang, Haiyun Yuan, Jian Zhuang

In this paper we will use deep learning based medical image segmentation as a vehicle and demonstrate that interestingly, machine and human view the compression quality differently.

Image Compression Image Segmentation +3

Insertion-based Decoding with automatically Inferred Generation Order

no code implementations TACL 2019 Jiatao Gu, Qi Liu, Kyunghyun Cho

Conventional neural autoregressive decoding commonly assumes a fixed left-to-right generation order, which may be sub-optimal.

Code Generation Machine Translation +1

Pointwise Rotation-Invariant Network with Adaptive Sampling and 3D Spherical Voxel Convolution

1 code implementation23 Nov 2018 Yang You, Yujing Lou, Qi Liu, Yu-Wing Tai, Lizhuang Ma, Cewu Lu, Weiming Wang

Point cloud analysis without pose priors is very challenging in real applications, as the orientations of point clouds are often unknown.

3D Feature Matching Data Augmentation

Skeptical Deep Learning with Distribution Correction

no code implementations9 Nov 2018 Mingxiao An, Yongzhou Chen, Qi Liu, Chuanren Liu, Guangyi Lv, Fangzhao Wu, Jianhui Ma

Recently deep neural networks have been successfully used for various classification tasks, especially for problems with massive perfectly labeled training data.

Classification General Classification

Random Occlusion-recovery for Person Re-identification

no code implementations26 Sep 2018 Di Wu, Kun Zhang, Fei Cheng, Yang Zhao, Qi Liu, Chang-An Yuan, De-Shuang Huang

As a basic task of multi-camera surveillance system, person re-identification aims to re-identify a query pedestrian observed from non-overlapping multiple cameras or across different time with a single camera.

Generative Adversarial Network Person Re-Identification

Learning from History and Present: Next-item Recommendation via Discriminatively Exploiting User Behaviors

no code implementations3 Aug 2018 Zhi Li, Hongke Zhao, Qi Liu, Zhenya Huang, Tao Mei, Enhong Chen

In this paper, we propose a novel Behavior-Intensive Neural Network (BINN) for next-item recommendation by incorporating both users' historical stable preferences and present consumption motivations.

Session-Based Recommendations

Mining Evidences for Concept Stock Recommendation

no code implementations NAACL 2018 Qi Liu, Yue Zhang

We investigate the task of mining relevant stocks given a topic of concern on emerging capital markets, for which there is lack of structural understanding.

Information Retrieval reinforcement-learning +2

Cannot find the paper you are looking for? You can Submit a new open access paper.