Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

40

Base only

Active filters: llima

simaai/llava-1.5-7b-hf-a16w4

Image-Text-to-Text • Updated Jun 20 • 2

simaai/Llama-3.1-8B-Instruct-a16w4

Text Generation • Updated Jun 20 • 1

simaai/Llama-3.2-3B-Instruct-a16w4

Text Generation • Updated Jun 20 • 3

simaai/Phi-3.5-mini-instruct-a16w4

Text Generation • Updated Jun 20 • 3

simaai/gemma-3-4b-it-a16w4

Text Generation • Updated Jun 20

simaai/Llama-2-7b-chat-hf-a16w4

Text Generation • Updated Jun 20 • 1

simaai/gemma-3-1b-it-a16w4

Text Generation • Updated Jun 20 • 1

simaai/Mistral-7B-Instruct-v0.3-a16w4

Text Generation • Updated Jun 20

simaai/gemma3-siglip448-a16w4

Image-Text-to-Text • Updated Jun 20 • 71

simaai/Qwen2.5-0.5B-Instruct-GPTQ-a16w4

Text Generation • Updated Jun 20 • 3

simaai/Qwen2.5-7B-Instruct-GPTQ-a16w4

Text Generation • Updated Jun 20

simaai/Qwen3-0.6B-GPTQ-a16w4

Text Generation • Updated Jun 20 • 29

simaai/Qwen3-1.7B-GPTQ-a16w4

Text Generation • Updated Jun 30

simaai/Qwen3-4B-Instruct-2507-GPTQ-a16w4

Text Generation • Updated Jun 20

simaai/Qwen3-8B-GPTQ-a16w4

Text Generation • Updated Jun 20 • 1

simaai/LFM2-VL-450M-a16w4

Image-Text-to-Text • Updated Jun 30

simaai/LFM2-VL-1.6B-a16w4

Image-Text-to-Text • Updated Jun 30

simaai/LFM2-VL-3B-a16w4

Image-Text-to-Text • Updated Jun 30

simaai/Qwen2.5-VL-3B-Instruct-GPTQ-a16w4

Image-Text-to-Text • Updated Jun 20

simaai/Qwen3-VL-4B-Instruct-GPTQ-a16w4

Image-Text-to-Text • Updated Jun 20

simaai/Qwen3-VL-8B-Instruct-GPTQ-a16w4

Image-Text-to-Text • Updated Jun 20

simaai/Qwen2.5-1.5B-Instruct-GPTQ-a16w4

Text Generation • Updated Jun 20

simaai/Llama-3.2-1B-Instruct-GPTQ-a16w4

Text Generation • Updated Jun 20

simaai/LFM2-350M-a16w4

Text Generation • Updated Jun 30

simaai/LFM2-1.2B-a16w4

Text Generation • Updated Jun 30

simaai/LFM2-2.6B-a16w4

Text Generation • Updated Jun 30

simaai/Qwen2.5-3B-Instruct-GPTQ-a16w4

Text Generation • Updated Jun 20

simaai/Qwen2.5-VL-7B-Instruct-GPTQ-a16w4

Image-Text-to-Text • Updated Jun 20

simaai/Qwen3-VL-2B-Instruct-GPTQ-a16w4

Image-Text-to-Text • Updated Jun 20

simaai/gemma-4-E2B-it-GPTQ-a16w4

Image-Text-to-Text • Updated 7 days ago