Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

7,710

Base only

Active filters: awq

cyankiwi/Qwen3.6-35B-A3B-AWQ-4bit

Image-Text-to-Text • 36B • Updated 6 days ago • 1.42M • 72

Brooooooklyn/Qwen3.6-35B-A3B-UD-Q2_K_XL-mlx

Text Generation • 4B • Updated 21 days ago • 1.15k • 6

prism-ml/Bonsai-8B-AWQ-4-bit

Text Generation • 8B • Updated May 4 • 461 • 3

shawnw3i/Huihui-Qwen3.6-27B-abliterated-AWQ-MTP

Image-Text-to-Text • 6B • Updated 14 days ago • 23k • 8

shawnw3i/Qwen3.6-27B-AWQ-MTP

Image-Text-to-Text • 6B • Updated 7 days ago • 6.08k • 3

Reza2kn/Cosmos3-Nano-INT4-AWQ

Text-to-Image • Updated 3 days ago • 55 • 2

Qwen/Qwen2.5-VL-3B-Instruct-AWQ

Image-Text-to-Text • 4B • Updated Apr 6, 2025 • 130k • 64

Qwen/Qwen2.5-VL-7B-Instruct-AWQ

Image-Text-to-Text • 8B • Updated Apr 6, 2025 • 1.05M • 105

Qwen/Qwen3-14B-AWQ

Text Generation • 15B • Updated May 21, 2025 • 2.09M • 65

openbmb/MiniCPM-V-4-AWQ

Image-Text-to-Text • 4B • Updated 3 days ago • 419 • 12

QuantTrio/Qwen3-30B-A3B-Thinking-2507-AWQ-BF16Mix

Text Generation • 31B • Updated Sep 5, 2025 • 1.7k • 5

QuantTrio/Qwen3-VL-30B-A3B-Instruct-AWQ

Text Generation • 31B • Updated Oct 8, 2025 • 1.31M • 43

bullpoint/Qwen3-Coder-Next-AWQ-4bit

Text Generation • 14B • Updated Feb 3 • 69.2k • 26

steadyflow/Phi-4-reasoning-plus-AWQ

Text Generation • 15B • Updated Mar 9 • 28 • 1

KRAFTON/Raon-Speech-9B-AWQ-INT4

Any-to-Any • 9B • Updated Apr 7 • 45 • 9

ebircak/gemma-4-31B-it-4bit-W4A16-AWQ

Text Generation • 32B • Updated Apr 7 • 40.7k • 2

majentik/gemma-4-E2B-it-RotorQuant-AWQ-4bit

Image-Text-to-Text • Updated 30 days ago • 2

QuantTrio/Qwen3.6-27B-AWQ-6Bit

Image-Text-to-Text • 28B • Updated Apr 23 • 29k • 10

vrfai/Qwen3-ASR-0.6B-int4-QAD

Automatic Speech Recognition • 0.9B • Updated 29 days ago • 59 • 4

openbmb/MiniCPM-V-4.6-AWQ

Image-Text-to-Text • 1B • Updated 17 days ago • 4.5k • 4

cyankiwi/Intern-S2-Preview-AWQ-INT4

Image-Text-to-Text • 36B • Updated 3 days ago • 15 • 1

cyankiwi/LFM2.5-8B-A1B-AWQ-INT4

Text Generation • 8B • Updated 5 days ago • 774 • 1

Vishva007/gemma-4-12B-it-W4A16-AutoRound-AWQ

1B • Updated about 19 hours ago • 335 • 1

casperhansen/mpt-7b-8k-chat-awq

Text Generation • Updated Nov 4, 2023 • 21 • 3

casperhansen/falcon-7b-awq

Text Generation • Updated Nov 4, 2023 • 553 • 1

casperhansen/vicuna-7b-v1.5-awq

Text Generation • Updated Oct 31, 2023 • 10 • 3

casperhansen/vicuna-7b-v1.5-awq-gemv

Text Generation • Updated Oct 31, 2023 • 8 • 1

casperhansen/mpt-7b-8k-chat-awq-gemv

Text Generation • Updated Oct 31, 2023 • 5

casperhansen/opt-125m-awq

Text Generation • 0.2B • Updated Oct 31, 2023 • 994 • 3

casperhansen/tinyllama-1b-awq

Text Generation • Updated Oct 31, 2023 • 31 • 1