Instruction Pre-Training: Language Models are Supervised Multitask Learners
Paper
• 2406.14491 • Published
• 96
Instruction Pre-Training
-
-
Instruction Synthesizer
🐠86Generate instruction-response pairs from text
-
instruction-pretrain/InstructLM-1.3B
Text Generation • 1B • Updated • 25 • 43 -
instruction-pretrain/InstructLM-500M
Text Generation • 0.6B • Updated • 56 • 35 -
instruction-pretrain/instruction-synthesizer
Text Generation • 7B • Updated • 33 • 79 -
instruction-pretrain/medicine-Llama3-8B
Text Generation • 8B • Updated • 92 • 38 -
instruction-pretrain/finance-Llama3-8B
Text Generation • 8B • Updated • 9.92k • • 74 -
instruction-pretrain/ft-instruction-synthesizer-collection
Viewer • Updated • 249k • 267 • 63