Search Results for author:
Found 8 papers, 8 papers with code
MedDialog: Large-scale Medical Dialogue Datasets
We also study the transferability of models trained on MedDialog to low-resource medical dialogue generation tasks.
Sailor: Open Language Models for South-East Asia
We present Sailor, a family of open language models ranging from 0. 5B to 7B parameters, tailored for South-East Asian (SEA) languages.
TinyLlama: An Open-Source Small Language Model
We present TinyLlama, a compact 1. 1B language model pretrained on around 1 trillion tokens for approximately 3 epochs.
Towards a Mechanistic Interpretation of Multi-Step Reasoning Capabilities of Language Models
We show that MechanisticProbe is able to detect the information of the reasoning tree from the model's attentions for most examples, suggesting that the LM indeed is going through a process of multi-step reasoning within its architecture in many cases.
One Network, Many Masks: Towards More Parameter-Efficient Transfer Learning
Fine-tuning pre-trained language models for multiple tasks tends to be expensive in terms of storage.
Unsupervised Non-transferable Text Classification
Training a good deep learning model requires substantial data and computing resources, which makes the resulting neural model a valuable intellectual property.
On the Generation of Medical Dialogs for COVID-19
Training complex dialog generation models on small datasets bears high risk of overfitting.
On the Generation of Medical Dialogues for COVID-19
On these two datasets, we train several dialogue generation models based on Transformer, GPT, and BERT-GPT.
