Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling
Paper
• 2304.01373 • Published
• 9
Pythia Scaling Suite
Pythia is the first LLM suite designed specifically to enable scientific research on LLMs. To learn more see https://github.com/EleutherAI/pythia
Note The paper introduced the Pythia model suite
EleutherAI/pythia-14m-deduped
Text Generation • 39.2M • Updated • 73k • 28Note This model was trained after the paper was released.
EleutherAI/pythia-70m
95.6M • Updated • 156k • 78Note This model was trained after the paper was released.
-
EleutherAI/pythia-160m
Text Generation • Updated • 2.24M • 38 -
EleutherAI/pythia-410m
Text Generation • 0.5B • Updated • 84.1k • 36 -
EleutherAI/pythia-1b
Text Generation • 1B • Updated • 28.8k • 43 -
EleutherAI/pythia-1.4b
Text Generation • 2B • Updated • 26.4k • 26 -
EleutherAI/pythia-2.8b
Text Generation • 3B • Updated • 18.8k • 32 -
EleutherAI/pythia-6.9b
Text Generation • 7B • Updated • 20.8k • 59 -
EleutherAI/pythia-12b
Text Generation • 12B • Updated • 10.7k • 144 -
EleutherAI/pythia-70m-deduped
Text Generation • 95.6M • Updated • 529k • 27 -
EleutherAI/pythia-160m-deduped
Text Generation • 0.2B • Updated • 79.6k • 3 -
EleutherAI/pythia-410m-deduped
Text Generation • 0.5B • Updated • 32.4k • 20 -
EleutherAI/pythia-1b-deduped
Text Generation • Updated • 6.59k • 19 -
EleutherAI/pythia-1.4b-deduped
Text Generation • 1B • Updated • 10.8k • 21 -
EleutherAI/pythia-2.8b-deduped
Text Generation • 3B • Updated • 10.3k • 14 -
EleutherAI/pythia-6.9b-deduped
Text Generation • Updated • 109k • 8 -
EleutherAI/pythia-12b-deduped
Text Generation • Updated • 5.62k • 52