Search Results for author: Dehong Ma

Found 9 papers, 2 papers with code

PILE: Pairwise Iterative Logits Ensemble for Multi-Teacher Labeled Distillation

no code implementations11 Nov 2022 Lianshang Cai, Linhao Zhang, Dehong Ma, Jun Fan, Daiting Shi, Yi Wu, Zhicong Cheng, Simiu Gu, Dawei Yin

In this paper, we focus on two key questions in knowledge distillation for ranking models: 1) how to ensemble knowledge from multi-teacher; 2) how to utilize the label information of data in the distillation process.

Knowledge Distillation

Pre-trained Language Model based Ranking in Baidu Search

no code implementations24 May 2021 Lixin Zou, Shengqiang Zhang, Hengyi Cai, Dehong Ma, Suqi Cheng, Daiting Shi, Zhifan Zhu, Weiyue Su, Shuaiqiang Wang, Zhicong Cheng, Dawei Yin

However, it is nontrivial to directly apply these PLM-based rankers to the large-scale web search system due to the following challenging issues:(1) the prohibitively expensive computations of massive neural PLMs, especially for long texts in the web-document, prohibit their deployments in an online ranking system that demands extremely low latency;(2) the discrepancy between existing ranking-agnostic pre-training objectives and the ad-hoc retrieval scenarios that demand comprehensive relevance modeling is another main barrier for improving the online ranking system;(3) a real-world search engine typically involves a committee of ranking components, and thus the compatibility of the individually fine-tuned ranking model is critical for a cooperative ranking system.

Language Modelling Retrieval

Text Level Graph Neural Network for Text Classification

2 code implementations IJCNLP 2019 Lianzhe Huang, Dehong Ma, Sujian Li, Xiaodong Zhang, Houfeng Wang

Recently, researches have explored the graph neural network (GNN) techniques on text classification, since GNN does well in handling complex structures and preserving global information.

General Classification text-classification +1

Exploring Sequence-to-Sequence Learning in Aspect Term Extraction

no code implementations ACL 2019 Dehong Ma, Sujian Li, Fangzhao Wu, Xing Xie, Houfeng Wang

Aspect term extraction (ATE) aims at identifying all aspect terms in a sentence and is usually modeled as a sequence labeling problem.

Position Sentence +1

Joint Learning for Targeted Sentiment Analysis

no code implementations EMNLP 2018 Dehong Ma, Sujian Li, Houfeng Wang

Targeted sentiment analysis (TSA) aims at extracting targets and classifying their sentiment classes.

Sentiment Analysis Word Embeddings

Interactive Attention Networks for Aspect-Level Sentiment Classification

5 code implementations4 Sep 2017 Dehong Ma, Sujian Li, Xiaodong Zhang, Houfeng Wang

In this paper, we argue that both targets and contexts deserve special treatment and need to be learned their own representations via interactive learning.

Aspect-Based Sentiment Analysis (ABSA) Classification +2

Cannot find the paper you are looking for? You can Submit a new open access paper.