Search Results for author: Mingqi Li

Found 3 papers, 1 papers with code

Effectively Prompting Small-sized Language Models for Cross-lingual Tasks via Winning Tickets

no code implementations1 Apr 2024 Mingqi Li, Feng Luo

Then, we prepend soft prompts to the original pre-trained language model and only update the selected parameters together with prompt-related parameters when adapting to the downstream tasks.

Language Modelling Masked Language Modeling

Multi-level Distillation of Semantic Knowledge for Pre-training Multilingual Language Model

no code implementations2 Nov 2022 Mingqi Li, Fei Ding, Dan Zhang, Long Cheng, Hongxin Hu, Feng Luo

In this paper, we propose Multi-level Multilingual Knowledge Distillation (MMKD), a novel method for improving multilingual language models.

Knowledge Distillation Language Modelling +2

Segmentation with Multiple Acceptable Annotations: A Case Study of Myocardial Segmentation in Contrast Echocardiography

2 code implementations29 Jun 2021 Dewen Zeng, Mingqi Li, Yukun Ding, Xiaowei Xu, Qiu Xie, Ruixue Xu, Hongwen Fei, Meiping Huang, Jian Zhuang, Yiyu Shi

Experiment results on our clinical MCE data set demonstrate that the neural network trained with the proposed loss function outperforms those existing ones that try to obtain a unique ground truth from multiple annotations, both quantitatively and qualitatively.

Image Segmentation Segmentation +1

Cannot find the paper you are looking for? You can Submit a new open access paper.