Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

45,311

Base only

Active filters: 4-bit

antirez/deepseek-v4-gguf

Text Generation • 284B • Updated about 1 hour ago • 617k • 199

huihui-ai/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated about 4 hours ago • 8.13k • 17

Jiunsong/supergemma4-26b-uncensored-mlx-4bit-v2

Text Generation • 25B • Updated Apr 12 • 21.3k • 251

Lorbus/Qwen3.6-27B-int4-AutoRound

Image-Text-to-Text • 6B • Updated Apr 22 • 912k • 108

AlicanKiraz0/Titus-CybersecurityLLM-v1.0-mlx-4Bit

Text Generation • 35B • Updated 4 days ago • 268 • 9

mlx-community/Qwen3.6-27B-OptiQ-4bit

Text Generation • 27B • Updated about 9 hours ago • 14.6k • 24

Jackrong/Qwopus3.6-27B-v2-MLX-4bit

Text Generation • 27B • Updated 9 days ago • 2.75k • 14

Youssofal/Qwen3.6-27B-MTPLX-Optimized-Speed

Text Generation • 5B • Updated 27 days ago • 41.6k • 30

openbmb/MiniCPM5-1B-MLX

Text Generation • 0.2B • Updated 6 days ago • 2.1k • 11

mlx-community/gemma-4-e4b-it-OptiQ-4bit

Text Generation • 7B • Updated about 7 hours ago • 13.1k • 22

mlx-community/Qwen3.6-35B-A3B-4bit

Image-Text-to-Text • 6B • Updated Apr 16 • 92.4k • 58

tomasmcm/Darwin-4B-Genesis-mlx-4Bit

Text Generation • 1B • Updated 8 days ago • 73 • 5

Intel/Qwen3.6-27B-int4-AutoRound

6B • Updated 10 days ago • 204k • 39

mlx-community/Qwen3.6-35B-A3B-OptiQ-4bit

Text Generation • 35B • Updated about 9 hours ago • 7.02k • 10

stamsam/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-MLX-oQ4-MTP

Text Generation • 35B • Updated 19 days ago • 7.02k • 10

dawncr0w/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive-text-oQ4

Text Generation • 6B • Updated 13 days ago • 2.44k • 4

cHunter789/Qwen3.6-27B-i1-IQ4_KS-GGUF

Text Generation • 27B • Updated 9 days ago • 4.06k • 12

XReyRobert/Qwopus3.6-27B-v2-GPTQ-Pro-v1

Text Generation • 27B • Updated 6 days ago • 505 • 4

unsloth/mistral-7b-instruct-v0.3-bnb-4bit

Text Generation • 7B • Updated Nov 22, 2024 • 138k • 41

unsloth/gemma-4-26b-a4b-it-UD-MLX-4bit

Image-Text-to-Text • 5B • Updated Apr 13 • 1.57k • 29

cyankiwi/Qwen3.6-35B-A3B-AWQ-4bit

Image-Text-to-Text • 36B • Updated 1 day ago • 1.18M • 71

froggeric/Qwen3.6-35B-A3B-Uncensored-Heretic-MLX-4bit

Image-Text-to-Text • 6B • Updated 25 days ago • 5.51k • 6

JC1DA/Qwopus3.6-27B-v2-INT4-W4A16-Autoround

6B • Updated 6 days ago • 2.03k • 3

aguken-ai/Qwen-3-TTS-12Hz-0.6B-Base-hi-LoRA-Finetuned-BNB-NF4

Text-to-Speech • 0.9B • Updated 5 days ago • 109 • 8

philbert440/Qwen3.6-40B-DeckardUncensored-OpusDistilled-HermesCalibrated-W4A16-AWQ

Image-Text-to-Text • 40B • Updated 4 days ago • 295 • 3

shawnw3i/Qwen3.6-27B-AWQ-MTP

Image-Text-to-Text • 6B • Updated 2 days ago • 402 • 3

CohereLabs/c4ai-command-r-plus-4bit

Text Generation • 105B • Updated Apr 16, 2025 • 3.88k • 261

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • 7B • Updated May 22, 2024 • 171k • 141

Qwen/Qwen3-32B-AWQ

Text Generation • 33B • Updated May 21, 2025 • 799k • 135

Qwen/Qwen3-8B-AWQ

Text Generation • 8B • Updated May 21, 2025 • 2.54M • 44