Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

227

Base only

Active filters: metal

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 27B • Updated Jul 18 • 571k • • 1.22k

huihui-ai/Huihui-DeepSeek-V4-Flash-0731-abliterated-GGUF

Text Generation • 284B • Updated 16 days ago • 298k • 152

prism-ml/Bonsai-27B-gguf

Text Generation • 27B • Updated Jul 17 • 1.43M • 786

antirez/deepseek-v4-gguf

Text Generation • 284B • Updated 3 days ago • 1.53M • 454

Doses-AI/Pestle-27B-Ternary-GGUF

Text Generation • 27B • Updated 3 days ago • 1.58k • 12

prism-ml/Bonsai-27B-mlx-1bit

Text Generation • 2B • Updated Jul 14 • 1.65M • 215

prism-ml/Ternary-Bonsai-27B-mlx-2bit

Text Generation • 3B • Updated Jul 14 • 1.66M • 178

EschaLabs/Qwen3.6-35B-A3B-Escha-W2

Text Generation • 7B • Updated 10 days ago • 7.3k • 253

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 86.6k • 768

prism-ml/Bonsai-1.7B-gguf

Text Generation • 2B • Updated Apr 18 • 66.2k • 90

prism-ml/Bonsai-4B-gguf

Text Generation • 4B • Updated Apr 18 • 20.3k • 56

huihui-ai/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated Jun 6 • 326k • 127

apetersson/DeepSeek-V4-Flash-0731-Abliterated-DS4-Quality128

Text Generation • 284B • Updated 15 days ago • 20.1k • 6

SatiricalGuru/beatrice-voice-models

Updated 6 days ago • 1

Leonickson/Qwen3-Next-80B-A3B-qpack

0.4B • Updated 16 days ago • 230 • 3

Hagwell/Bonsai-27B-gguf

Text Generation • 27B • Updated 16 days ago • 868 • 1

CoreWolf/Huihui-DeepSeek-V4-Flash-0731-abliterated-GGUF

Text Generation • 284B • Updated about 2 hours ago • 1

HarroweD/HarrlogosXL

Text-to-Image • Updated Jan 14, 2024 • 91 • • 15

RalFinger/chrome-style-sdxl-lora

Text-to-Image • Updated Nov 22, 2023 • 18 • • 1

e-n-v-y/envy-metallic-xl-01

Text-to-Image • Updated Nov 24, 2023 • 17 • • 2

UnionStreet/vision-1-mini

Text Classification • 8B • Updated Jan 16, 2025 • 13 • 1

halley-ai/gpt-oss-20b-MLX-4bit-gs32

Text Generation • 21B • Updated Aug 18, 2025 • 149 • 3

halley-ai/gpt-oss-20b-MLX-6bit-gs32

Text Generation • 21B • Updated Aug 18, 2025 • 37 • 1

halley-ai/gpt-oss-20b-MLX-5bit-gs32

Text Generation • 21B • Updated Sep 8, 2025 • 61 • 1

halley-ai/gpt-oss-120b-MLX-8bit-gs32

Text Generation • 117B • Updated Sep 8, 2025 • 55 • 1

halley-ai/gpt-oss-120b-MLX-bf16

Text Generation • 117B • Updated Sep 8, 2025 • 167 • 3

halley-ai/gpt-oss-120b-MLX-6bit-gs64

Text Generation • 117B • Updated Sep 8, 2025 • 37 • 1

halley-ai/Qwen3-Next-80B-A3B-Instruct-MLX-4bit-gs64

Text Generation • 80B • Updated Sep 19, 2025 • 35 • 1

halley-ai/Qwen3-Next-80B-A3B-Instruct-MLX-5bit-gs32

Text Generation • 80B • Updated Sep 19, 2025 • 24 • 1

halley-ai/Qwen3-Next-80B-A3B-Instruct-MLX-6bit-gs64

Text Generation • 80B • Updated Sep 19, 2025 • 31 • 1