Search Results for author:
Found 9 papers, 5 papers with code
Arabic Stable LM: Adapting Stable LM 2 1.6B to Arabic
Our Arabic Stable LM 1. 6B chat model achieves impressive results on several benchmarks beating multiple models with up to 8x the parameters.
Rephrasing natural text data with different languages and quality levels for Large Language Model pre-training
In addition, we provide a detailed study of our pipeline, investigating the choice of the base dataset and LLM for the rephrasing, as well as the relationship between the model size and the performance after pre-training.
Are large language models superhuman chemists?
Large language models (LLMs) have gained widespread interest due to their ability to process human language and perform tasks on which they have not been explicitly trained.
Stable LM 2 1.6B Technical Report
We introduce StableLM 2 1. 6B, the first in a new generation of our language model series.
Inverse Scaling: When Bigger Isn't Better
Here, we present evidence for the claim that LMs may show inverse scaling, or worse task performance with increased scale, e. g., due to flaws in the training objective and data.
14 Examples of How LLMs Can Transform Materials Science and Chemistry: A Reflection on a Large Language Model Hackathon
Recent studies suggested that these models could be useful in chemistry and materials science.
Robust Preference Learning for Storytelling via Contrastive Reinforcement Learning
However, simply fine-tuning a generative language model with a contrastive reward model does not always reliably result in a story generation system capable of generating stories that meet user preferences.
Few-shot Adaptation Works with UnpredicTable Data
Finetuning on the resulting dataset leads to improved FSL performance on Natural Language Processing (NLP) tasks, but not proportionally to dataset scale.
GPT-NeoX-20B: An Open-Source Autoregressive Language Model
We introduce GPT-NeoX-20B, a 20 billion parameter autoregressive language model trained on the Pile, whose weights will be made freely and openly available to the public through a permissive license.
Ranked #95 on
Multi-task Language Understanding
on MMLU
