Doctor-Shotgun/TinyLlama-1.1B-32k
Text Generation • 1B • Updated • 882 • • 30
LLM Speculative Decoding Experiments
Tiny language models meant to serve as draft models for speculative decoding.
-
-
Doctor-Shotgun/TinyLlama-1.1B-32k-Instruct
Text Generation • 1B • Updated • 835 • • 13 -
Doctor-Shotgun/smol_llama-220M-GQA-32k-theta
Text Generation • Updated • 6 • 1 -
Doctor-Shotgun/smol_llama-220M-GQA-32k-theta-sft
Text Generation • Updated • 9 • 2 -
Doctor-Shotgun/smol_llama-220M-GQA-32k-theta-sft-limarp
Text Generation • Updated • 4 -
Doctor-Shotgun/smol_llama-220M-GQA-32k-linear
Text Generation • Updated • 10