Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,009

Base only

Active filters: llama-cpp

prithivMLmods/VibeThinker-3B-GGUF

Text Generation • 3B • Updated 5 days ago • 24.7k • 43

deadbydawn101/RavenX-CyberAgent-Qwen3.6-35B-A3B-Opus-4.7-OpenMythos-Pentester-BugHunter-RATH-GGUF

Text Generation • 36B • Updated 8 days ago • 12.1k • 60

mitkox/FastContext-1.0-4B-SFT-Q4_K_M-GGUF

4B • Updated 6 days ago • 1.66k • 10

barozp/Qwen3.6-28B-REAP20-A3B-GGUF

Text Generation • 28B • Updated Apr 19 • 24.1k • 40

oussaber/VibeThinker-3B-Q4_K_M-GGUF

Text Generation • 3B • Updated 5 days ago • 2.82k • 7

autotrust/gpt-oss-120b-Fable-5-Distilled-GGUF

Text Generation • 117B • Updated about 1 hour ago • 243 • 7

deadbydawn101/gemma-4-E4B-Agentic-Opus-Reasoning-GeminiCLI-GGUF

Text Generation • 8B • Updated Apr 16 • 6.08k • 21

spiritbuun/buun-Qwen3.6-chat_template

Updated 24 days ago • 51

Tesslate/OmniCoder-9B-GGUF

9B • Updated Mar 12 • 14.6k • 312

mitkox/FastContext-1.0-4B-SFT-Q5_K_M-GGUF

4B • Updated 6 days ago • 451 • 5

JohnRoger/VibeThinker-3B-Q8_0-GGUF

Text Generation • 3B • Updated 5 days ago • 1.65k • 5

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 18k • 721

jica98/qwen3.5-4B-super-coder

Text Generation • 4B • Updated 4 days ago • 4.96k • 5

prithivMLmods/gemma-4-12B-it-heretic_decensored-GGUF

Image-Text-to-Text • 12B • Updated 4 days ago • 2.44k • 4

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated 11 days ago • 14.8k • 99

LocalAI-io/privacy-filter-multilingual-GGUF

Token Classification • 1B • Updated 3 days ago • 2.77k • 5

cfontes/GLM-5.2-Q4_K_M-GGUF

Text Generation • 753B • Updated 4 days ago • 1.43k • 3

prithivMLmods/lift-GGUF

Image-Text-to-Text • 9B • Updated 2 days ago • 464 • 3

wepiqx/Qwable-9B-Claude-Fable-5-LWQ8-GGUF

Text Generation • 9B • Updated about 5 hours ago • 5 • 3

aiplatforms/mistral-24b-ru-uncensored-gguf

Text Generation • 24B • Updated May 7 • 791 • 6

AlicanKiraz0/BaronLLM-v2-OffensiveSecurityLLM-Q8

15B • Updated Aug 21, 2025 • 316 • 29

squ11z1/gpt-oss-nano

Text Generation • 9B • Updated 19 days ago • 3.51k • 22

sillykiwi/Qwen3-4B-Cybersecurity-Heretic-16bit-Q4_K_M-GGUF

Text Generation • 4B • Updated Apr 3 • 772 • 6

rico03/Qwen3.6-27B-Claude-Opus-Reasoning-Distilled-GGUF

Text Generation • 27B • Updated Apr 23 • 17.9k • 48

brunopio/Qwen3.5-14B-A3B-Claude-4.6-Opus-Reasoning-Distilled-reap-Q4_K_M-GGUF

Text Generation • 14B • Updated 26 days ago • 6.11k • 10

DAXZEIT/Qwen3.6-27B-Claude-Opus-Reasoning-Distilled-UD-Q4_K_XL-gguf

Text Generation • 27B • Updated May 20 • 662 • 5

gaston-parravicini/LFM2.5-8B-A1B-Uncensored-Gaston-GGUF

Text Generation • 8B • Updated 22 days ago • 8.78k • 15

FlameF0X/Apodex-1.0-mini-Q4_K_M-GGUF

Text Generation • 36B • Updated 9 days ago • 322 • 3

RachidAR/ablation-model-fineweb-v1-Q6_K-GGUF

2B • Updated Apr 23, 2024 • 5 • 1

NoelJacob/Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Apr 24, 2024 • 640 • 3