Models

cyankiwi/Devstral-2-123B-Instruct-2512-AWQ-4bit

22B • Updated 4 days ago • 1.76k • 13

cyankiwi/GLM-4.6V-AWQ-4bit

Image-Text-to-Text • 19B • Updated 7 days ago • 46.7k • 7

cyankiwi/Devstral-Small-2-24B-Instruct-2512-AWQ-4bit

5B • Updated 4 days ago • 6.22k • 4

cpatonn/Qwen3-30B-A3B-Instruct-2507-AWQ-4bit

Text Generation • 5B • Updated 14 days ago • 201k • 21

cpatonn/Qwen3-Omni-30B-A3B-Instruct-AWQ-4bit

Any-to-Any • 10B • Updated Sep 28 • 29k • 35

QuantTrio/DeepSeek-V3.2-AWQ

Text Generation • 685B • Updated 12 days ago • 2.8k • 5

gaunernst/gemma-3-12b-it-int4-awq

Image-Text-to-Text • 12B • Updated Apr 6 • 4.08k • 22

Qwen/Qwen3-4B-AWQ

Text Generation • 4B • Updated May 21 • 127k • 21

cpatonn/ERNIE-4.5-21B-A3B-Thinking-AWQ-4bit

Text Generation • 5B • Updated Sep 9 • 246 • 5

cyankiwi/Ministral-3-8B-Instruct-2512-AWQ-4bit

3B • Updated 6 days ago • 800 • 2

cyankiwi/rnj-1-instruct-AWQ-4bit

2B • Updated 9 days ago • 406 • 2

nn-tech/MetalGPT-1-AWQ

Text Generation • 33B • Updated 1 day ago • 98 • 2

Qwen/Qwen2.5-32B-Instruct-AWQ

Text Generation • 33B • Updated Oct 9, 2024 • 905k • 90

Qwen/Qwen2.5-Coder-1.5B-Instruct-AWQ

Text Generation • 2B • Updated Nov 18, 2024 • 104k • 4

GreenHalo/Qwen2.5-7B-Instruct-AWQ-4bit-ONNX

Updated Nov 25, 2024 • 1

Qwen/Qwen2.5-VL-7B-Instruct-AWQ

Image-Text-to-Text • 8B • Updated Apr 6 • 165k • 95

gaunernst/gemma-3-4b-it-int4-awq

Image-Text-to-Text • Updated Apr 6 • 6.93k • 2

Qwen/Qwen3-32B-AWQ

Text Generation • 33B • Updated May 21 • 151k • 117

Qwen/Qwen3-14B-AWQ

Text Generation • 15B • Updated May 21 • 199k • 47

Qwen/Qwen3-8B-AWQ

Text Generation • 8B • Updated May 21 • 104k • 30

Qwen/Qwen2.5-Omni-7B-AWQ

Any-to-Any • 11B • Updated May 15 • 32.8k • 15

cpatonn/Devstral-Small-2507-AWQ-4bit

Text Generation • 24B • Updated Aug 8 • 14.7k • 9

QuantTrio/GLM-4.5-Air-AWQ-FP16Mix

Text Generation • 24B • Updated Sep 5 • 5.96k • 14

cpatonn/Qwen3-30B-A3B-Thinking-2507-AWQ-4bit

Text Generation • 5B • Updated 13 days ago • 7.21k • 14

QuantTrio/Qwen3-30B-A3B-Thinking-2507-AWQ-BF16Mix

Text Generation • 14B • Updated Sep 5 • 169 • 4

QuantTrio/Qwen3-30B-A3B-Thinking-2507-AWQ

Text Generation • 31B • Updated Sep 5 • 13k • 2

warshanks/Qwen3-16B-A3B-abliterated-AWQ

Text Generation • 3B • Updated Aug 5 • 112 • 1

cpatonn/Qwen3-4B-Instruct-2507-AWQ-4bit

Text Generation • 1B • Updated Aug 6 • 41.3k • 5

cpatonn/Qwen3-4B-Thinking-2507-AWQ-4bit

Text Generation • 1B • Updated Aug 6 • 882 • 3

cpatonn/Qwen3-30B-A3B-Thinking-2507-AWQ-8bit

Text Generation • 9B • Updated 13 days ago • 1.13k • 1