Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

3,511

Full-text search

Active filters: 6-bit

nightmedia/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-qx64-hi-mlx

Text Generation • 27B • Updated 1 day ago • 4.92k • 6

mlx-community/Qwen3.5-2B-6bit

Image-Text-to-Text • 0.7B • Updated 8 days ago • 35.1k • 5

mlx-community/Huihui-Qwen3.5-35B-A3B-abliterated-6bit

Text Generation • 35B • Updated 5 days ago • 727 • 3

Jackrong/MLX-Qwen3.5-9B-Claude-4.6-Opus-Reasoning-Distilled-6bit

Text Generation • 9B • Updated 2 days ago • 414 • 3

dphn/Dolphin-Llama3-8B-Instruct-exl2-6bpw

Updated Apr 28, 2025 • 35 • 18

nightmedia/Qwen3-53B-A3B-TOTAL-RECALL-MASTER-CODER-v1.4-q6-mlx

Text Generation • 53B • Updated Jul 8, 2025 • 273 • 3

nightmedia/Qwen3.5-35B-A3B-Text-qx64-hi-mlx

Text Generation • 35B • Updated 2 days ago • 6.99k • 7

cs2764/Qwen3.5-397B-A17B-6bit-abliterated-mlx

87B • Updated 7 days ago • 345 • 2

MaziyarPanahi/v1olet_marcoroni-go-bruins-merge-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • 7B • Updated Jan 26, 2024 • 49 • 1

MaziyarPanahi/v1olet_marcoroni-go-bruins-merge-7B-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • 7B • Updated Jan 26, 2024 • 59 • 1

MaziyarPanahi/Phi-3.5-mini-instruct-GGUF

Text Generation • 4B • Updated Aug 20, 2024 • 273k • 26

MaziyarPanahi/phi-4-GGUF

Text Generation • 15B • Updated Jan 8, 2025 • 80.9k • 7

MaziyarPanahi/gemma-3-4b-it-GGUF

Text Generation • 4B • Updated Mar 12, 2025 • 92.8k • 18

MaziyarPanahi/DeepSeek-R1-0528-Qwen3-8B-GGUF

Text Generation • 8B • Updated May 29, 2025 • 89.3k • 9

mlx-community/Qwen3-4B-Sky-High-Hermes-6bit

Text Generation • 0.9B • Updated Jan 19 • 20 • 1

inferencerlabs/GLM-5-MLX-4.8bit

Text Generation • 744B • Updated 12 days ago • 7.09k • 10

LiquidAI/LFM2-24B-A2B-MLX-6bit

Text Generation • 24B • Updated 14 days ago • 104 • 4

lmstudio-community/LFM2-24B-A2B-MLX-6bit

Text Generation • 24B • Updated 14 days ago • 290k • 2

mlx-community/Qwen3.5-122B-A10B-6bit

Image-Text-to-Text • 27B • Updated 13 days ago • 1.87k • 1

mlx-community/Qwen3.5-9B-6bit

Image-Text-to-Text • 2B • Updated 7 days ago • 1.69k • 2

CountCandy/Golddiamondgold-Paperbliteration-L33-70b-EXL3-6.0BPW

Text Generation • 27B • Updated 7 days ago • 29 • 1

MaziyarPanahi/LocoOperator-4B-GGUF

Text Generation • 4B • Updated 7 days ago • 159 • 1

mlx-community/Huihui-Qwen3.5-27B-abliterated-6bit

Text Generation • 27B • Updated 5 days ago • 454 • 1

mlx-community/Qwen3.5-27B-Claude-4.6-Opus-Distilled-MLX-6bit

27B • Updated 4 days ago • 682 • 1

ailexleon/Slimaki-24B-v1-mlx-6Bit

Text Generation • 24B • Updated 3 days ago • 67 • 1

Jackrong/MLX-Qwen3.5-35B-A3B-Claude-4.6-Opus-Reasoning-Distilled-6bit

Text Generation • 35B • Updated 2 days ago • 156 • 1

nightmedia/Qwen3.5-35B-A3B-Claude-4.6-Opus-Engineer-9e-qx64-hi-mlx

Text Generation • 35B • Updated about 16 hours ago • 47 • 1

mlx-community/JOSIE-1.1-4B-Thinking-6bit

Text Generation • 0.9B • Updated about 16 hours ago • 1

DeathGodlike/crownelius_Crow-9B-Opus-4.6-Distill-Heretic-Qwen3.5_EXL3

Text Generation • Updated about 12 hours ago • 1

LoneStriker/Yi-6B-200K-6.0bpw-h6-exl2

Text Generation • Updated Mar 16, 2024 • 1 • 1