Scaling Language Models: Methods, Analysis & Insights from Training Gopher

Browse State-of-the-Art
Datasets
Methods
More
Newsletter RC2022
About Trends Portals Libraries

Sign In

Subscribe to the PwC Newsletter

Stay informed on the latest trending ML papers with code, research developments, libraries, methods, and datasets.

Read previous issues

Join the community

You need to log in to edit.
You can create a new account if you don't have one.

Or, discuss a change on Slack.

TASK	DATASET	MODEL	METRIC NAME	METRIC VALUE	GLOBAL RANK
Language Modelling	arXiv	Gopher	BPB	0.662	# 1
Reasoning About Colored Objects	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	49.2	# 2
StrategyQA	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	61.0	# 4
Temporal Sequences	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	19.0	# 2
Abstract Algebra	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	25.0	# 1
College Mathematics	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	37.0	# 1
Formal Logic	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	35.7	# 1
Mathematical Induction	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	57.6	# 1
Professional Accounting	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	44.3	# 1
Anatomy	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	56.3	# 1
Clinical Knowledge	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	67.2	# 1
College Medicine	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	60.1	# 1
Human Aging	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	66.4	# 1
Human Organs Senses Multiple Choice	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	84.8	# 2
Medical Genetics	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	69.0	# 1
Nutrition	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	69.9	# 1
Professional Medicine	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	64.0	# 1
Virology	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	47.0	# 1
English Proverbs	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	57.6	# 2
Fantasy Reasoning	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	64.1	# 2
Figure Of Speech Detection	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	52.7	# 2
Formal Fallacies Syllogisms Negation	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	50.7	# 2
GRE Reading Comprehension	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	27.3	# 2
Hyperbaton	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	51.7	# 2
Implicatures	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	62.0	# 2
Implicit Relations	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	36.4	# 2
Intent Recognition	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	88.7	# 2
LAMBADA	BIG-bench	Gopher-280B (zero-shot)	Accuracy	74.5	# 2
Movie Dialog Same Or Different	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	50.7	# 2
Nonsense Words Grammar	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	61.4	# 2
Phrase Relatedness	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	81.8	# 2
Question Selection	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	41.4	# 2
RACE-h	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	71.6	# 1
RACE-m	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	75.1	# 1
College Chemistry	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	45.0	# 1
College Physics	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	34.3	# 1
Computer Security	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	65.0	# 1
Conceptual Physics	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	49.4	# 1
High School Biology	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	71.3	# 1
High School Chemistry	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	47.8	# 1
Presuppositions As NLI	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	34.0	# 2
High School Computer Science	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	54.0	# 1
High School Physics	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	33.8	# 1
High School Statistics	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	50	# 1
Physics MC	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	50.9	# 2
Econometrics	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	43	# 1
Analogical Similarity	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	17.2	# 2
High School Geography	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	76.8	# 1
High School Government and Politics	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	83.9	# 1
Identify Odd Metapor	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	38.6	# 2
Odd One Out	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	32.5	# 2
High School Macroeconomics	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	65.1	# 1
Anachronisms	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	56.4	# 2
High School Microeconomics	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	66.4	# 1
High School Psychology	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	81.8	# 1
Causal Judgment	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	50.8	# 2
Crash Blossom	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	63.6	# 1
Human Sexuality	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	67.2	# 1
Professional Psychology	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	68.1	# 1
Astronomy	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	65.8	# 1
Public Relations	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	71.8	# 1
Elementary Mathematics	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	33.6	# 1
Similarities Abstraction	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	81.8	# 2
Sports Understanding	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	54.9	# 2
TriviaQA	BIG-bench	Gopher-280B (few-shot, k=64)	Accuracy	57.1	# 1
Analytic Entailment	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	53.0	# 2
Date Understanding	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	44.1	# 2
Entailed Polarity	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	89.5	# 2
Epistemic Reasoning	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	56.4	# 2
Evaluating Information Essentiality	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	16.7	# 2
Logic Grid Puzzle	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	35.1	# 4
Logical Args	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	59.1	# 1
High School European History	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	72.1	# 1
Logical Fallacy Detection	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	58.9	# 2
High School US History	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	78.9	# 1
Logical Sequence	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	36.4	# 2
High School World History	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	75.1	# 1
Hindu Knowledge	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	80.0	# 2
Metaphor Boolean	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	59.3	# 2
International Law	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	77.7	# 1
Jurisprudence	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	71.3	# 1
Navigate	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	51.1	# 2
Logical Fallacies	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	72.4	# 1
Management	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	77.7	# 1
Marketing	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	83.3	# 1
Novel Concepts	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	59.1	# 4
Philosophy	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	68.8	# 1
Prehistory	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	67.6	# 1
Penguins In A Table	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	40.6	# 2
Professional Law	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	44.5	# 1
World Religions	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	84.2	# 1
Physical Intuition	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	59.7	# 2
College Computer Science	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	49	# 1
Electrical Engineering	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	60	# 1
BIG-bench Machine Learning	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	41.1	# 1
High School Mathematics	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	23.7	# 1
Security Studies	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	64.9	# 1
Sociology	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	84.1	# 1
US Foreign Policy	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	81.0	# 1
College Biology	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	70.8	# 1
Crass AI	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	56.8	# 2
Disambiguation Q	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	45.5	# 2
Discourse Marker Prediction	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	11.7	# 2
Empirical Judgments	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	52.5	# 2
HellaSwag	BIG-bench	Gopher-280B (zero-shot)	Accuracy	79.2	# 1
Irony Identification	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	69.7	# 2
PIQA	BIG-bench	Gopher-280B (zero-shot)	Accuracy	81.8	# 1
Riddle Sense	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	68.2	# 2
SIQA	BIG-bench	Gopher-280B (zero-shot)	Accuracy	50.6	# 1
Timedial	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	50.9	# 2
Understanding Fables	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	39.6	# 2
Winogrande	BIG-bench	Gopher-280B (zero-shot)	Accuracy	70.1	# 1
Winowhy	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	56.7	# 4
Dark Humor Detection	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	83.1	# 1
Ruin Names	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	38.6	# 2
SNARKS	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	48.3	# 2
Business Ethics	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	70.0	# 1
Moral Disputes	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	66.8	# 1
Moral Permissibility	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	55.1	# 2
Moral Scenarios	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	40.2	# 1
FEVER (2-way)	BIG-bench	Gopher-280B (few-shot, k=10)	Accuracy	77.5	# 1
FEVER (3-way)	BIG-bench	Gopher-280B (few-shot, k=15)	Accuracy	77.5	# 1
Known Unknowns	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	63.6	# 3
Misconceptions	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	61.7	# 2
Sentence Ambiguity	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	69.1	# 2
General Knowledge	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	93.9	# 2
Global Facts	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	38.0	# 1
Miscellaneous	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	75.7	# 1
Movie Recommendation	BIG-bench	Gopher-280B (few-shot, k=5)	Accuracy	50.5	# 2
Natural Questions	BIG-bench	Gopher-280B (few-shot, k=64)	Accuracy	28.2	# 1
Language Modelling	Bookcorpus2	Gopher	BPB	0.741	# 1
Language Modelling	Books3	Gopher	BPB	0.712	# 1
Question Answering	BoolQ	Gopher (zero-shot)	Accuracy	79.3	# 10
Language Modelling	Curation Corpus	Gopher	BPB	0.475	# 1
Language Modelling	DM Mathematics	Gopher	BPB	1.14	# 1
Language Modelling	FreeLaw	Gopher	BPB	0.513	# 1
Language Modelling	GitHub	Gopher	BPB	0.377	# 1
Language Modelling	Gutenberg PG-19	Gopher	BPB	0.656	# 1
Language Modelling	HackerNews	Gopher	BPB	0.890	# 1
Sentence Completion	HellaSwag	Gopher (zero-shot)	Accuracy	79.2	# 9
Multi-task Language Understanding	MMLU	Gopher-7.1B (few-shot, k=5)	Humanities	28.0	# 12
Multi-task Language Understanding	MMLU	Gopher-7.1B (few-shot, k=5)	Average (%)	29.5	# 35
Multi-task Language Understanding	MMLU	Gopher-7.1B (few-shot, k=5)	Parameters (Billions)	7.1	# 11
Multi-task Language Understanding	MMLU	Gopher-7.1B (few-shot, k=5)	STEM	30.1	# 18
Multi-task Language Understanding	MMLU	Gopher-7.1B (few-shot, k=5)	Social Sciences	31.0	# 11
Multi-task Language Understanding	MMLU	Gopher-7.1B (few-shot, k=5)	Other	31.0	# 11
Multi-task Language Understanding	MMLU	Gopher-7.1B (few-shot, k=5)	Tokens (Billions)	300	# 6
Multi-task Language Understanding	MMLU	Gopher-0.4B (few-shot, k=5)	Humanities	26.6	# 18
Multi-task Language Understanding	MMLU	Gopher-0.4B (few-shot, k=5)	Average (%)	25.7	# 44
Multi-task Language Understanding	MMLU	Gopher-0.4B (few-shot, k=5)	Parameters (Billions)	0.4	# 3
Multi-task Language Understanding	MMLU	Gopher-0.4B (few-shot, k=5)	STEM	26.0	# 23
Multi-task Language Understanding	MMLU	Gopher-0.4B (few-shot, k=5)	Social Sciences	23.4	# 20
Multi-task Language Understanding	MMLU	Gopher-0.4B (few-shot, k=5)	Other	24.1	# 20
Multi-task Language Understanding	MMLU	Gopher-0.4B (few-shot, k=5)	Tokens (Billions)	300	# 6
Multi-task Language Understanding	MMLU	Gopher (few-shot, k=5)	Humanities	65.8	# 3
Multi-task Language Understanding	MMLU	Gopher (few-shot, k=5)	Average (%)	60.0	# 13
Multi-task Language Understanding	MMLU	Gopher (few-shot, k=5)	Parameters (Billions)	280	# 27
Multi-task Language Understanding	MMLU	Gopher (few-shot, k=5)	STEM	48.0	# 7
Multi-task Language Understanding	MMLU	Gopher (few-shot, k=5)	Social Sciences	71.2	# 3
Multi-task Language Understanding	MMLU	Gopher (few-shot, k=5)	Other	64.0	# 3
Multi-task Language Understanding	MMLU	Gopher (few-shot, k=5)	Tokens (Billions)	300	# 6
Multi-task Language Understanding	MMLU	Gopher-1.4B (few-shot, k=5)	Humanities	27.5	# 15
Multi-task Language Understanding	MMLU	Gopher-1.4B (few-shot, k=5)	Average (%)	27.3	# 39
Multi-task Language Understanding	MMLU	Gopher-1.4B (few-shot, k=5)	Parameters (Billions)	1.4	# 4
Multi-task Language Understanding	MMLU	Gopher-1.4B (few-shot, k=5)	STEM	26.6	# 22
Multi-task Language Understanding	MMLU	Gopher-1.4B (few-shot, k=5)	Social Sciences	30.0	# 14
Multi-task Language Understanding	MMLU	Gopher-1.4B (few-shot, k=5)	Other	24.7	# 19
Multi-task Language Understanding	MMLU	Gopher-1.4B (few-shot, k=5)	Tokens (Billions)	300	# 6
Question Answering	Natural Questions	Gopher (few-shot, k=64)	EM	28.2	# 19
Language Modelling	NIH ExPorter	Gopher	BPB	0.590	# 1
Language Modelling	OpenSubtitles	Gopher	BPB	0.899	# 1
Language Modelling	OpenWebtext2	Gopher	BPB	0.677	# 1
Language Modelling	PhilPapers	Gopher	BPB	0.695	# 1
Language Modelling	Pile CC	Gopher	BPB	0.691	# 1
Question Answering	PIQA	Gopher 280B (zero-shot)	Accuracy	81.8	# 2
Language Modelling	PubMed Central	Gopher	BPB	0.525	# 1
Language Modelling	PubMed Cognitive Control Abstracts	Gopher	BPB	0.577	# 1
Question Answering	SIQA	Gopher (zero-shot)	Accuracy	50.6	# 2
Language Modelling	StackExchange	Gopher	BPB	0.641	# 1
Question Answering	TruthfulQA	Gopher 7.1 (zero-shot, QA prompts)	MC1	0.25	# 3
Question Answering	TruthfulQA	Gopher 280B (zero-shot, QA prompts)	MC1	0. 27	# 16
Question Answering	TruthfulQA	Gopher 280B (zero-shot, Our Prompt + Choices)	MC1	0.295	# 1
Question Answering	TruthfulQA	Gopher 7.1B (zero-shot, Our Prompt + Choices)	MC1	0.23	# 5
Question Answering	TruthfulQA	Gopher 1.4 (zero-shot, QA prompts)	MC1	0.23	# 5
Question Answering	TruthfulQA	Gopher 1.4B (zero-shot, Our Prompt + Choices)	MC1	0.217	# 8
Language Modelling	Ubuntu IRC	Gopher	BPB	1.09	# 1
Language Modelling	USPTO Backgrounds	Gopher	BPB	0.546	# 1
Language Modelling	WikiText-103	Gopher	BPB	0.566	# 1

Badge	Markdown
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/language-modelling-on-arxiv)](https://paperswithcode.com/sota/language-modelling-on-arxiv?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/abstract-algebra-on-big-bench)](https://paperswithcode.com/sota/abstract-algebra-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/college-mathematics-on-big-bench)](https://paperswithcode.com/sota/college-mathematics-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/formal-logic-on-big-bench)](https://paperswithcode.com/sota/formal-logic-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/mathematical-induction-on-big-bench)](https://paperswithcode.com/sota/mathematical-induction-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/professional-accounting-on-big-bench)](https://paperswithcode.com/sota/professional-accounting-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/anatomy-on-big-bench)](https://paperswithcode.com/sota/anatomy-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/clinical-knowledge-on-big-bench)](https://paperswithcode.com/sota/clinical-knowledge-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/college-medicine-on-big-bench)](https://paperswithcode.com/sota/college-medicine-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/human-aging-on-big-bench)](https://paperswithcode.com/sota/human-aging-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/medical-genetics-on-big-bench)](https://paperswithcode.com/sota/medical-genetics-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/nutrition-on-big-bench)](https://paperswithcode.com/sota/nutrition-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/professional-medicine-on-big-bench)](https://paperswithcode.com/sota/professional-medicine-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/virology-on-big-bench)](https://paperswithcode.com/sota/virology-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/race-h-on-big-bench)](https://paperswithcode.com/sota/race-h-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/race-m-on-big-bench)](https://paperswithcode.com/sota/race-m-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/college-chemistry-on-big-bench)](https://paperswithcode.com/sota/college-chemistry-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/college-physics-on-big-bench)](https://paperswithcode.com/sota/college-physics-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/computer-security-on-big-bench)](https://paperswithcode.com/sota/computer-security-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/conceptual-physics-on-big-bench)](https://paperswithcode.com/sota/conceptual-physics-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/high-school-biology-on-big-bench)](https://paperswithcode.com/sota/high-school-biology-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/high-school-chemistry-on-big-bench)](https://paperswithcode.com/sota/high-school-chemistry-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/high-school-computer-science-on-big-bench)](https://paperswithcode.com/sota/high-school-computer-science-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/high-school-physics-on-big-bench)](https://paperswithcode.com/sota/high-school-physics-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/high-school-statistics-on-big-bench)](https://paperswithcode.com/sota/high-school-statistics-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/econometrics-on-big-bench)](https://paperswithcode.com/sota/econometrics-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/high-school-geography-on-big-bench)](https://paperswithcode.com/sota/high-school-geography-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/high-school-government-and-politics-on-big)](https://paperswithcode.com/sota/high-school-government-and-politics-on-big?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/high-school-macroeconomics-on-big-bench)](https://paperswithcode.com/sota/high-school-macroeconomics-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/high-school-microeconomics-on-big-bench)](https://paperswithcode.com/sota/high-school-microeconomics-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/high-school-psychology-on-big-bench)](https://paperswithcode.com/sota/high-school-psychology-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/crash-blossom-on-big-bench)](https://paperswithcode.com/sota/crash-blossom-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/human-sexuality-on-big-bench)](https://paperswithcode.com/sota/human-sexuality-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/professional-psychology-on-big-bench)](https://paperswithcode.com/sota/professional-psychology-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/astronomy-on-big-bench)](https://paperswithcode.com/sota/astronomy-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/public-relations-on-big-bench)](https://paperswithcode.com/sota/public-relations-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/elementary-mathematics-on-big-bench)](https://paperswithcode.com/sota/elementary-mathematics-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/triviaqa-on-big-bench)](https://paperswithcode.com/sota/triviaqa-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/logical-args-on-big-bench)](https://paperswithcode.com/sota/logical-args-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/high-school-european-history-on-big-bench)](https://paperswithcode.com/sota/high-school-european-history-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/high-school-us-history-on-big-bench)](https://paperswithcode.com/sota/high-school-us-history-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/high-school-world-history-on-big-bench)](https://paperswithcode.com/sota/high-school-world-history-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/international-law-on-big-bench)](https://paperswithcode.com/sota/international-law-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/jurisprudence-on-big-bench)](https://paperswithcode.com/sota/jurisprudence-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/logical-fallacies-on-big-bench)](https://paperswithcode.com/sota/logical-fallacies-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/management-on-big-bench)](https://paperswithcode.com/sota/management-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/marketing-on-big-bench)](https://paperswithcode.com/sota/marketing-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/philosophy-on-big-bench)](https://paperswithcode.com/sota/philosophy-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/prehistory-on-big-bench)](https://paperswithcode.com/sota/prehistory-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/professional-law-on-big-bench)](https://paperswithcode.com/sota/professional-law-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/world-religions-on-big-bench)](https://paperswithcode.com/sota/world-religions-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/college-computer-science-on-big-bench)](https://paperswithcode.com/sota/college-computer-science-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/electrical-engineering-on-big-bench)](https://paperswithcode.com/sota/electrical-engineering-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/machine-learning-on-big-bench)](https://paperswithcode.com/sota/machine-learning-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/high-school-mathematics-on-big-bench)](https://paperswithcode.com/sota/high-school-mathematics-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/security-studies-on-big-bench)](https://paperswithcode.com/sota/security-studies-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/sociology-on-big-bench)](https://paperswithcode.com/sota/sociology-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/us-foreign-policy-on-big-bench)](https://paperswithcode.com/sota/us-foreign-policy-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/college-biology-on-big-bench)](https://paperswithcode.com/sota/college-biology-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/hellaswag-on-big-bench)](https://paperswithcode.com/sota/hellaswag-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/piqa-on-big-bench)](https://paperswithcode.com/sota/piqa-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/siqa-on-big-bench)](https://paperswithcode.com/sota/siqa-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/winogrande-on-big-bench)](https://paperswithcode.com/sota/winogrande-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/dark-humor-detection-on-big-bench)](https://paperswithcode.com/sota/dark-humor-detection-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/business-ethics-on-big-bench)](https://paperswithcode.com/sota/business-ethics-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/moral-disputes-on-big-bench)](https://paperswithcode.com/sota/moral-disputes-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/moral-scenarios-on-big-bench)](https://paperswithcode.com/sota/moral-scenarios-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/fever-2-way-on-big-bench)](https://paperswithcode.com/sota/fever-2-way-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/fever-3-way-on-big-bench)](https://paperswithcode.com/sota/fever-3-way-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/global-facts-on-big-bench)](https://paperswithcode.com/sota/global-facts-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/miscellaneous-on-big-bench)](https://paperswithcode.com/sota/miscellaneous-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/natural-questions-on-big-bench)](https://paperswithcode.com/sota/natural-questions-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/language-modelling-on-bookcorpus2)](https://paperswithcode.com/sota/language-modelling-on-bookcorpus2?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/language-modelling-on-books3)](https://paperswithcode.com/sota/language-modelling-on-books3?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/language-modelling-on-curation-corpus)](https://paperswithcode.com/sota/language-modelling-on-curation-corpus?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/language-modelling-on-dm-mathematics)](https://paperswithcode.com/sota/language-modelling-on-dm-mathematics?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/language-modelling-on-freelaw)](https://paperswithcode.com/sota/language-modelling-on-freelaw?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/language-modelling-on-github)](https://paperswithcode.com/sota/language-modelling-on-github?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/language-modelling-on-gutenberg-pg-19)](https://paperswithcode.com/sota/language-modelling-on-gutenberg-pg-19?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/language-modelling-on-hackernews)](https://paperswithcode.com/sota/language-modelling-on-hackernews?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/language-modelling-on-nih-exporter)](https://paperswithcode.com/sota/language-modelling-on-nih-exporter?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/language-modelling-on-opensubtitles)](https://paperswithcode.com/sota/language-modelling-on-opensubtitles?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/language-modelling-on-openwebtext2)](https://paperswithcode.com/sota/language-modelling-on-openwebtext2?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/language-modelling-on-philpapers)](https://paperswithcode.com/sota/language-modelling-on-philpapers?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/language-modelling-on-pile-cc)](https://paperswithcode.com/sota/language-modelling-on-pile-cc?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/language-modelling-on-pubmed-central)](https://paperswithcode.com/sota/language-modelling-on-pubmed-central?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/language-modelling-on-pubmed-abstracts)](https://paperswithcode.com/sota/language-modelling-on-pubmed-abstracts?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/language-modelling-on-stackexchange)](https://paperswithcode.com/sota/language-modelling-on-stackexchange?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/question-answering-on-truthfulqa)](https://paperswithcode.com/sota/question-answering-on-truthfulqa?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/language-modelling-on-ubuntu-irc)](https://paperswithcode.com/sota/language-modelling-on-ubuntu-irc?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/language-modelling-on-uspto-backgrounds)](https://paperswithcode.com/sota/language-modelling-on-uspto-backgrounds?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/language-modelling-on-wikitext-103)](https://paperswithcode.com/sota/language-modelling-on-wikitext-103?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/reasoning-about-colored-objects-on-big-bench)](https://paperswithcode.com/sota/reasoning-about-colored-objects-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/temporal-sequences-on-big-bench)](https://paperswithcode.com/sota/temporal-sequences-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/human-organs-senses-multiple-choice-on-big)](https://paperswithcode.com/sota/human-organs-senses-multiple-choice-on-big?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/english-proverbs-on-big-bench)](https://paperswithcode.com/sota/english-proverbs-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/fantasy-reasoning-on-big-bench)](https://paperswithcode.com/sota/fantasy-reasoning-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/figure-of-speech-detection-on-big-bench)](https://paperswithcode.com/sota/figure-of-speech-detection-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/formal-fallacies-syllogisms-negation-on-big)](https://paperswithcode.com/sota/formal-fallacies-syllogisms-negation-on-big?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/gre-reading-comprehension-on-big-bench)](https://paperswithcode.com/sota/gre-reading-comprehension-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/hyperbaton-on-big-bench)](https://paperswithcode.com/sota/hyperbaton-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/implicatures-on-big-bench)](https://paperswithcode.com/sota/implicatures-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/implicit-relations-on-big-bench)](https://paperswithcode.com/sota/implicit-relations-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/intent-recognition-on-big-bench)](https://paperswithcode.com/sota/intent-recognition-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/lambada-on-big-bench)](https://paperswithcode.com/sota/lambada-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/movie-dialog-same-or-different-on-big-bench)](https://paperswithcode.com/sota/movie-dialog-same-or-different-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/nonsense-words-grammar-on-big-bench)](https://paperswithcode.com/sota/nonsense-words-grammar-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/phrase-relatedness-on-big-bench)](https://paperswithcode.com/sota/phrase-relatedness-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/question-selection-on-big-bench)](https://paperswithcode.com/sota/question-selection-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/presuppositions-as-nli-on-big-bench)](https://paperswithcode.com/sota/presuppositions-as-nli-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/physics-mc-on-big-bench)](https://paperswithcode.com/sota/physics-mc-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/analogical-similarity-on-big-bench)](https://paperswithcode.com/sota/analogical-similarity-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/identify-odd-metapor-on-big-bench)](https://paperswithcode.com/sota/identify-odd-metapor-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/odd-one-out-on-big-bench)](https://paperswithcode.com/sota/odd-one-out-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/anachronisms-on-big-bench)](https://paperswithcode.com/sota/anachronisms-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/causal-judgment-on-big-bench)](https://paperswithcode.com/sota/causal-judgment-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/similarities-abstraction-on-big-bench)](https://paperswithcode.com/sota/similarities-abstraction-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/sports-understanding-on-big-bench)](https://paperswithcode.com/sota/sports-understanding-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/analytic-entailment-on-big-bench)](https://paperswithcode.com/sota/analytic-entailment-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/date-understanding-on-big-bench)](https://paperswithcode.com/sota/date-understanding-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/entailed-polarity-on-big-bench)](https://paperswithcode.com/sota/entailed-polarity-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/epistemic-reasoning-on-big-bench)](https://paperswithcode.com/sota/epistemic-reasoning-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/evaluating-information-essentiality-on-big)](https://paperswithcode.com/sota/evaluating-information-essentiality-on-big?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/logical-fallacy-detection-on-big-bench)](https://paperswithcode.com/sota/logical-fallacy-detection-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/logical-sequence-on-big-bench)](https://paperswithcode.com/sota/logical-sequence-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/hindu-knowledge-on-big-bench)](https://paperswithcode.com/sota/hindu-knowledge-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/metaphor-boolean-on-big-bench)](https://paperswithcode.com/sota/metaphor-boolean-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/navigate-on-big-bench)](https://paperswithcode.com/sota/navigate-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/penguins-in-a-table-on-big-bench)](https://paperswithcode.com/sota/penguins-in-a-table-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/physical-intuition-on-big-bench)](https://paperswithcode.com/sota/physical-intuition-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/crass-ai-on-big-bench)](https://paperswithcode.com/sota/crass-ai-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/disambiguation-q-on-big-bench)](https://paperswithcode.com/sota/disambiguation-q-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/discourse-marker-prediction-on-big-bench)](https://paperswithcode.com/sota/discourse-marker-prediction-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/empirical-judgments-on-big-bench)](https://paperswithcode.com/sota/empirical-judgments-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/irony-identification-on-big-bench)](https://paperswithcode.com/sota/irony-identification-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/riddle-sense-on-big-bench)](https://paperswithcode.com/sota/riddle-sense-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/timedial-on-big-bench)](https://paperswithcode.com/sota/timedial-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/understanding-fables-on-big-bench)](https://paperswithcode.com/sota/understanding-fables-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/ruin-names-on-big-bench)](https://paperswithcode.com/sota/ruin-names-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/snarks-on-big-bench)](https://paperswithcode.com/sota/snarks-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/moral-permissibility-on-big-bench)](https://paperswithcode.com/sota/moral-permissibility-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/misconceptions-on-big-bench)](https://paperswithcode.com/sota/misconceptions-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/sentence-ambiguity-on-big-bench)](https://paperswithcode.com/sota/sentence-ambiguity-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/general-knowledge-on-big-bench)](https://paperswithcode.com/sota/general-knowledge-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/movie-recommendation-on-big-bench)](https://paperswithcode.com/sota/movie-recommendation-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/question-answering-on-piqa)](https://paperswithcode.com/sota/question-answering-on-piqa?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/question-answering-on-social-iqa)](https://paperswithcode.com/sota/question-answering-on-social-iqa?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/known-unknowns-on-big-bench)](https://paperswithcode.com/sota/known-unknowns-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/strategyqa-on-big-bench)](https://paperswithcode.com/sota/strategyqa-on-big-bench?p=scaling-language-models-methods-analysis-1)`
	`[![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/scaling-language-models-methods-analysis-1/logic-grid-puzzle-on-big-bench)](https://paperswithcode.com/sota/logic-grid-puzzle-on-big-bench?p=scaling-language-models-methods-analysis-1)`

Edit Social Preview