Search Results for author: Kan Li

Found 26 papers, 6 papers with code

An Analytic Solution for Kernel Adaptive Filtering

no code implementations5 Feb 2024 Benjamin Colburn, Luis G. Sanchez Giraldo, Kan Li, Jose C. Principe

We provide an extended functional Wiener equation, and present a solution to this equation in an explicit, finite dimensional, data-dependent RKHS.

Generative Dense Retrieval: Memory Can Be a Burden

1 code implementation19 Jan 2024 Peiwen Yuan, Xinglin Wang, Shaoxiong Feng, Boyuan Pan, Yiwei Li, HeDa Wang, Xupeng Miao, Kan Li

Memorizing-free matching mechanism from Dense Retrieval (DR) is then introduced to conduct fine-grained intra-cluster matching from clusters to relevant documents.

Retrieval

BatchEval: Towards Human-like Text Evaluation

1 code implementation31 Dec 2023 Peiwen Yuan, Shaoxiong Feng, Yiwei Li, Xinglin Wang, Boyuan Pan, HeDa Wang, Kan Li

Significant progress has been made in automatic text evaluation with the introduction of large language models (LLMs) as evaluators.

Turning Dust into Gold: Distilling Complex Reasoning Capabilities from LLMs by Leveraging Negative Data

1 code implementation20 Dec 2023 Yiwei Li, Peiwen Yuan, Shaoxiong Feng, Boyuan Pan, Bin Sun, Xinglin Wang, HeDa Wang, Kan Li

In this work, we illustrate the merit of negative data and propose a model specialization framework to distill LLMs with negative samples besides positive ones.

Arithmetic Reasoning

EXMODD: An EXplanatory Multimodal Open-Domain Dialogue dataset

1 code implementation17 Oct 2023 Hang Yin, Pinren Lu, Ziang Li, Bin Sun, Kan Li

The need for high-quality data has been a key issue hindering the research of dialogue tasks.

Language Modelling

Bilevel Scheduled Sampling for Dialogue Generation

no code implementations5 Sep 2023 Jiawen Liu, Kan Li

To enhance sampling diversity and improve the model's adaptability, we propose a smooth function that maps the combined result of sentence-level and word-level information to an appropriate range, and employ probabilistic sampling based on the mapped values instead of threshold truncation.

Dialogue Generation Sentence

Advances and Challenges of Multi-task Learning Method in Recommender System: A Survey

no code implementations23 May 2023 Mingzhu Zhang, Ruiping Yin, Zhen Yang, Yipeng Wang, Kan Li

Multi-task learning has been widely applied in computational vision, natural language processing and other fields, which has achieved well performance.

Multi-Task Learning Recommendation Systems

Heterogeneous-Branch Collaborative Learning for Dialogue Generation

no code implementations21 Mar 2023 Yiwei Li, Shaoxiong Feng, Bin Sun, Kan Li

Collaborative learning, also known as online knowledge distillation, is an effective way to conduct one-stage group distillation in the absence of a well-trained large teacher model.

Attribute Dialogue Generation +1

Towards Diverse, Relevant and Coherent Open-Domain Dialogue Generation via Hybrid Latent Variables

no code implementations2 Dec 2022 Bin Sun, Yitong Li, Fei Mi, Weichao Wang, Yiwei Li, Kan Li

Specifically, HLV constrains the global semantics of responses through discrete latent variables and enriches responses with continuous latent variables.

Dialogue Generation Response Generation

Modeling Complex Dialogue Mappings via Sentence Semantic Segmentation Guided Conditional Variational Auto-Encoder

no code implementations1 Dec 2022 Bin Sun, Shaoxiong Feng, Yiwei Li, Weichao Wang, Fei Mi, Yitong Li, Kan Li

Complex dialogue mappings (CDM), including one-to-many and many-to-one mappings, tend to make dialogue models generate incoherent or dull responses, and modeling these mappings remains a huge challenge for neural dialogue systems.

Dialogue Generation Semantic Segmentation +1

Stop Filtering: Multi-View Attribute-Enhanced Dialogue Learning

no code implementations23 May 2022 Yiwei Li, Bin Sun, Shaoxiong Feng, Kan Li

However, the discarded samples may obtain high scores in other perspectives and can provide regularization effects on the model learning, which causes the performance improvement to be sensitive to the filtering ratio.

Attribute

Diversifying Neural Dialogue Generation via Negative Distillation

no code implementations NAACL 2022 Yiwei Li, Shaoxiong Feng, Bin Sun, Kan Li

Generative dialogue models suffer badly from the generic response problem, limiting their applications to a few toy scenarios.

Dialogue Generation

Hierarchical Inductive Transfer for Continual Dialogue Learning

no code implementations Findings (ACL) 2022 Shaoxiong Feng, Xuancheng Ren, Kan Li, Xu sun

However, for the continual increase of online chit-chat scenarios, directly fine-tuning these models for each of the new tasks not only explodes the capacity of the dialogue system on the embedded devices but also causes knowledge forgetting on pre-trained models and knowledge interference among diverse dialogue tasks.

General Knowledge

Generating Relevant and Coherent Dialogue Responses using Self-separated Conditional Variational AutoEncoders

no code implementations ACL 2021 Bin Sun, Shaoxiong Feng, Yiwei Li, Jiamou Liu, Kan Li

Conditional Variational AutoEncoder (CVAE) effectively increases the diversity and informativeness of responses in open-ended dialogue generation tasks through enriching the context vector with sampled latent variables.

Dialogue Generation Informativeness

THINK: A Novel Conversation Model for Generating Grammatically Correct and Coherent Responses

no code implementations28 May 2021 Bin Sun, Shaoxiong Feng, Yiwei Li, Jiamou Liu, Kan Li

In this work, we proposed a conversation model named "THINK" (Teamwork generation Hover around Impressive Noticeable Keywords) to make the decoder more complicated and avoid generating duplicated and self-contradicting responses.

Informativeness

Multi-View Feature Representation for Dialogue Generation with Bidirectional Distillation

no code implementations22 Feb 2021 Shaoxiong Feng, Xuancheng Ren, Kan Li, Xu sun

The finding of general knowledge is further hindered by the unidirectional distillation, as the student should obey the teacher and may discard some knowledge that is truly general but refuted by the teacher.

Dialogue Generation General Knowledge +1

Regularizing Dialogue Generation by Imitating Implicit Scenarios

no code implementations EMNLP 2020 Shaoxiong Feng, Xuancheng Ren, Hongshen Chen, Bin Sun, Kan Li, Xu sun

Human dialogues are scenario-based and appropriate responses generally relate to the latent context knowledge entailed by the specific scenario.

Dialogue Generation Imitation Learning

Collaborative Group Learning

no code implementations16 Sep 2020 Shaoxiong Feng, Hongshen Chen, Xuancheng Ren, Zhuoye Ding, Kan Li, Xu sun

Collaborative learning has successfully applied knowledge transfer to guide a pool of small student networks towards robust local minima.

Computational Efficiency Inductive Bias +1

Fast Estimation of Information Theoretic Learning Descriptors using Explicit Inner Product Spaces

no code implementations1 Jan 2020 Kan Li, Jose C. Principe

The inner product defined by the feature mapping corresponds to a positive-definite finite-rank kernel that induces a finite-dimensional reproducing kernel Hilbert space (RKHS).

No-Trick (Treat) Kernel Adaptive Filtering using Deterministic Features

no code implementations10 Dec 2019 Kan Li, Jose C. Principe

Without loss of generality, we apply this approach to classical adaptive filtering algorithms and validate the methodology to show that deterministic features are faster to generate and outperform state-of-the-art kernel methods based on random Fourier features.

Functional Bayesian Filter

no code implementations24 Nov 2019 Kan Li, Jose C. Principe

We present a general nonlinear Bayesian filter for high-dimensional state estimation using the theory of reproducing kernel Hilbert space (RKHS).

Time Series Time Series Analysis

Behavior Pattern and Compiled Information Based Performance Prediction in MOOCs

no code implementations4 Aug 2019 Shaojie Qu, Kan Li, Zheyi Fan, Sisi Wu, Xinyi Liu, Zhiguo Huang

This paper mainly focuses on the students' accomplishment behaviors in programming assignments and compiled information from programming assignments.

Magnitude Bounded Matrix Factorisation for Recommender Systems

no code implementations15 Jul 2018 Shuai Jiang, Kan Li, Richard Yi Da Xu

Low rank matrix factorisation is often used in recommender systems as a way of extracting latent features.

Recommendation Systems

Relative Pairwise Relationship Constrained Non-negative Matrix Factorisation

1 code implementation5 Mar 2018 Shuai Jiang, Kan Li, Richard Yida Xu

Non-negative Matrix Factorisation (NMF) has been extensively used in machine learning and data analytics applications.

Clustering Image Clustering +1

Cannot find the paper you are looking for? You can Submit a new open access paper.