Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

93

Base only

Active filters: quant

Ne7/LTX2-Rapid-Merges-GGUF

Image-Text-to-Video • 19B • Updated Feb 17 • 104

SufficientPrune3897/gemma-3-27b-Character-Creator-GGUF

27B • Updated Mar 7 • 21 • 2

CelesteImperia/Llama-3-8B-Quant-Reasoning-v1.1

8B • Updated Apr 2

CelesteImperia/Llama-3-8B-Indian-Finance-Quant-v2.0-RELEASE

Text Generation • 41.9M • Updated Apr 2

CelesteImperia/DeepSeek-R1-Llama-8B-Indian-Finance-Quant-v2.1-RELEASE

8B • Updated Apr 2 • 7

Hyper-AI/Qwen3.5-9B-fp8

Image-Text-to-Text • 10B • Updated Jun 4 • 3.65k • 3

eaddario/Qwen3.5-4B-GGUF

Text Generation • 4B • Updated May 13 • 105

eaddario/Qwen3.5-9B-GGUF

Text Generation • 9B • Updated May 13 • 777 • 5

eaddario/gemma-4-E2B-it-GGUF

Any-to-Any • 5B • Updated May 13 • 109

eaddario/gemma-4-E4B-it-GGUF

Any-to-Any • 8B • Updated May 13 • 177

eaddario/gemma-4-26B-A4B-it-GGUF

Any-to-Any • 25B • Updated May 13 • 272

AngelSlim/Hy-MT1.5-1.8B-1.25bit

Translation • 2B • Updated May 26 • 67 • 194

AngelSlim/Hy-MT1.5-1.8B-1.25bit-GGUF

Translation • 2B • Updated May 26 • 541 • 42

AngelSlim/Hy-MT1.5-1.8B-2bit

Translation • 2B • Updated Jun 23 • 9 • 11

AngelSlim/Hy-MT1.5-1.8B-2bit-GGUF

Translation • 2B • Updated Jun 23 • 138 • 23

tencent/Hy-MT1.5-1.8B-2bit-GGUF

Translation • 2B • Updated Apr 29 • 130 • 28

tencent/Hy-MT1.5-1.8B-2bit

Translation • 2B • Updated Apr 29 • 53 • 35

tencent/Hy-MT1.5-1.8B-1.25bit-GGUF

Translation • 2B • Updated Jun 4 • 155 • 20

tencent/Hy-MT1.5-1.8B-1.25bit

Translation • 2B • Updated May 27 • 50 • 32

qiaopan/Hy-MT1.5-1.8B-1.25bit

Translation • 2B • Updated Apr 30 • 4

tritueviet/Hy-MT1.5-1.8B-1.25bit

Translation • 2B • Updated May 1 • 7

aoiandroid/Hy-MT1.5-1.8B-2bit-GGUF

Translation • 2B • Updated May 1 • 4

senjiangchen/Hy-MT1.5-1.8B-2bit

Translation • 2B • Updated May 1 • 6

eaddario/Qwen3.6-27B-GGUF

Image-Text-to-Text • 27B • Updated May 13 • 447 • 4

eaddario/Qwen3.6-35B-A3B-GGUF

Image-Text-to-Text • 35B • Updated May 13 • 344 • 2

eaddario/granite-4.1-30b-GGUF

Text Generation • 29B • Updated May 13 • 109

eaddario/granite-4.1-8b-GGUF

Text Generation • 9B • Updated May 13 • 85

rasgaard/hviske-v5.3-mlx-int8

Automatic Speech Recognition • 0.8B • Updated May 12 • 27 • 1

yrq985/gemma-4-E2B-it-GGUF

Any-to-Any • 5B • Updated May 20 • 111

groxaxo/LocateAnything-3B-AutoRound-W4A16

Image-Text-to-Text • 1B • Updated Jun 9 • 5.39k • 1