Search Results for author:
Found 1 papers, 1 papers with code
Rethinking Optimization and Architecture for Tiny Language Models
Several design formulas are empirically proved especially effective for tiny language models, including tokenizer compression, architecture tweaking, parameter inheritance and multiple-round training.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
