Search Results for author: Qinghua Xu

Found 5 papers, 3 papers with code

PanGu-$π$: Enhancing Language Model Architectures via Nonlinearity Compensation

no code implementations27 Dec 2023 Yunhe Wang, Hanting Chen, Yehui Tang, Tianyu Guo, Kai Han, Ying Nie, Xutao Wang, Hailin Hu, Zheyuan Bai, Yun Wang, Fangcheng Liu, Zhicheng Liu, Jianyuan Guo, Sinan Zeng, Yinchen Zhang, Qinghua Xu, Qun Liu, Jun Yao, Chao Xu, DaCheng Tao

We then demonstrate that the proposed approach is significantly effective for enhancing the model nonlinearity through carefully designed ablations; thus, we present a new efficient model architecture for establishing modern, namely, PanGu-$\pi$.

Language Modelling

Digital Twin-based Anomaly Detection with Curriculum Learning in Cyber-physical Systems

1 code implementation27 Sep 2023 Qinghua Xu, Shaukat Ali, Tao Yue

LATTICE also, on average, reduces the training time of ATTAIN by 4. 2% on the five datasets and is on par with the baselines in terms of detection delay time.

Anomaly Detection

Knowledge Distillation-Empowered Digital Twin for Anomaly Detection

no code implementations8 Sep 2023 Qinghua Xu, Shaukat Ali, Tao Yue, Zaimovic Nedim, Inderjeet Singh

However, constructing a DT for anomaly detection in TCMS necessitates sufficient training data and extracting both chronological and context features with high quality.

Anomaly Detection Knowledge Distillation +2

EvoCLINICAL: Evolving Cyber-Cyber Digital Twin with Active Transfer Learning for Automated Cancer Registry System

1 code implementation6 Sep 2023 Chengjie Lu, Qinghua Xu, Tao Yue, Shaukat Ali, Thomas Schwitalla, Jan F. Nygård

To tackle this challenge, we propose EvoCLINICAL, which considers the CCDT developed for the previous version of GURI as the pretrained model and fine-tunes it with the dataset labelled by querying a new GURI version.

Active Learning Transfer Learning

An Encoding Strategy Based Word-Character LSTM for Chinese NER

1 code implementation NAACL 2019 Wei Liu, Tongge Xu, Qinghua Xu, Jiayu Song, Yueran Zu

A recently proposed lattice model has demonstrated that words in character sequence can provide rich word boundary information for character-based Chinese NER model.

NER Segmentation

Cannot find the paper you are looking for? You can Submit a new open access paper.