Inference Providers
Active filters: 6-bit
MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF
Text Generation
• 7B • Updated • 101k
• 147
MaziyarPanahi/Qwen2.5-1.5B-Instruct-GGUF
Text Generation
• 2B • Updated • 81k
• 11
MikeRoz/ArliAI_Mistral-Small-22B-ArliAI-RPMax-v1.1-6.0bpw-h6-exl2
Updated • 7
• 37
MaziyarPanahi/L3-8B-Sunfall-v0.5-Stheno-v3.2-GGUF
Text Generation
• 8B • Updated • 1.78k
• 7
MaziyarPanahi/BioMistral-Clinical-7B-GGUF
Text Generation
• 7B • Updated • 62
• 2
mlx-community/Llama-3.2-3B-Instruct-uncensored-6bit
Text Generation
• 0.7B • Updated • 626
• 4
dphn/Dolphin-Llama3-8B-Instruct-exl2-6bpw
Updated • 25
• 32
MaziyarPanahi/NVIDIA-Nemotron-Nano-12B-v2-GGUF
Text Generation
• 12B • Updated • 42.5k
• 3
nightmedia/Qwen3.6-35B-A3B-Holo3-Qwopus-Instruct-qx64-hi-mlx
Image-Text-to-Text
• 9B • Updated • 730
• 2
mlx-community/Qwen3.6-27B-AEON-Ultimate-Uncensored-BF16-mlx-6Bit
Text Generation
• 27B • Updated • 118
• 7
deepsweet/Qwen3.6-35B-A3B-MLX-oQ6
Text Generation
• 8B • Updated • 70
• 3
Jundot/Qwen3.6-27B-oQ6-mtp
7B • Updated • 1.3k
• 7
Jundot/Qwen3.6-35B-A3B-oQ6-mtp
8B • Updated • 968
• 5
Jundot/Qwen3.6-35B-A3B-oQ6-fp16-mtp
8B • Updated • 639
• 6
nightmedia/Qwen3.6-35B-A3B-MTP-Holo3-Qwopus-Coder-qx64y-hi-mlx
Image-Text-to-Text
• 9B • Updated • 2.44k
• 4
mlx-community/gemma-4-12B-6bit
Any-to-Any
• 3B • Updated • 931
• 3
Youssofal/Qwen3.6-35B-A3B-MTPLX-Optimized-Balance
Text Generation
• 8B • Updated • 1.37k
• 6
lexrivera/zerank-2-reranker-mlx-6Bit
Text Ranking
• 0.9B • Updated • 31
• 1
deadbydawn101/RavenX-OpenFable-Qwopus-Coder-Holo3-Qwen3.6-35B-A3B-MTP-mlx
Text Generation
• 35B • Updated • 225
• 5
porschefreak/Qwen3.6-35B-A3B-MTP-Holo3-Qwopus-Coder-qx64y-hi-mlx-mlx-4Bit
Image-Text-to-Text
• 35B • Updated • 887
• 1
AtomicChat/ornith-9b-MLX-6bit
Text Generation
• 9B • Updated • 2.93k
• 2
deepsweet/Ornith-1.0-35B-MLX-oQ6
Text Generation
• 8B • Updated • 305
• 1
AnuAmba/Ornith-9B-6bpw-exl3
Text Generation
• 5B • Updated • 124
• 1
tekosML/Nemotron-Labs-3-Puzzle-75B-A9B-MLX-4bit-experts-6bit
Text Generation
• 75B • Updated • 330
• 1
felkf/Qwen3.6-35B-A3B-Fable-5-Distill-oQ6-fp16-mtp
8B • Updated • 423
• 1
Text Generation
• 8B • Updated • 221
• 1
nathansutton/Ornith-1.0-35B-Q6-MLX
Text Generation
• 35B • Updated • 293
• 1
mlx-community/ThinkingCap-Qwen3.6-27B-mlx-6Bit
Image-Text-to-Text
• 27B • Updated • 2
LoneStriker/Yi-6B-200K-6.0bpw-h6-exl2
Text Generation
• Updated • 5
• 1
Text Generation
• 3B • Updated • 621
• 6