Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,651

Base only

Active filters: llama-cpp

Edge-Quant/Nanbeige4.1-3B-Q4_K_M-GGUF

Text Generation • 4B • Updated Feb 11 • 2.63k • 39

Tho465/Qwen3-Coder-Next-REAM-AWQ-4bit-Q4_K_M-GGUF

60B • Updated Feb 20 • 249 • 3

loolzrulez/Qwen3-4B-Instruct-2507-heretic-Q8_0-GGUF

Text Generation • 4B • Updated Feb 24 • 1.37k • 1

anthonym21/dots.ocr-GGUF

Image-to-Text • 2B • Updated Mar 23 • 1.2k • 3

Sumitc13/sarvam-30b-GGUF

32B • Updated May 9 • 214 • 8

Tesslate/OmniCoder-9B-GGUF

9B • Updated Mar 12 • 9.38k • 323

pltobing/streaming-speech-translation

Audio-to-Audio • 4B • Updated May 14 • 21 • 6

prism-ml/Bonsai-4B-gguf

Text Generation • 4B • Updated Apr 18 • 16.4k • 53

sillykiwi/Qwen3-4B-Cybersecurity-Heretic-16bit-Q4_K_M-GGUF

Text Generation • 4B • Updated Apr 3 • 541 • 7

0xSero/Qwen3.5-99B-GGUF

Text Generation • 99B • Updated May 30 • 6.08k • 11

DavidOKB/MathThink-Qwen-3.5-4B

4B • Updated Apr 12 • 183 • 11

deadbydawn101/gemma-4-E4B-Agentic-Opus-Reasoning-GeminiCLI-GGUF

Text Generation • 8B • Updated Apr 16 • 3.9k • 31

Abiray/Qwen3.6-35B-A3B-Q3_K_M-GGUF

Image-Text-to-Text • 35B • Updated Apr 16 • 832 • 1

prism-ml/Ternary-Bonsai-1.7B-gguf

Text Generation • 2B • Updated Jun 10 • 7.67k • 40

prism-ml/Ternary-Bonsai-4B-gguf

Text Generation • 4B • Updated Jun 10 • 7.98k • 28

Youssofal/Kimi-K2.6-Abliterated-Heretic-GGUF

Text Generation • Updated Apr 21 • 21

dulshanbandara/qwen2vl-2b-photography-critique-GGUF

Image-Text-to-Text • 2B • Updated Apr 22 • 204 • 1

rico03/Qwen3.6-27B-Claude-Opus-Reasoning-Distilled-GGUF

Text Generation • 27B • Updated Apr 23 • 7.87k • 50

audarai/Audar-ASR-V1-Turbo

Automatic Speech Recognition • 2B • Updated 14 days ago • 1.55k • 7

brunopio/Qwen3.5-14B-A3B-Claude-4.6-Opus-Reasoning-Distilled-reap-Q4_K_M-GGUF

Text Generation • 14B • Updated May 26 • 6.86k • 15

Abiray/Qwen3.6-27B-AEON-Ultimate-Uncensored-GGUF

Text Generation • 27B • Updated Apr 27 • 3.39k • 18

keithnull/Qwen3.6-VL-REAP-26B-A3B-GGUF

Image-Text-to-Text • 27B • Updated May 5 • 2.36k • 7

TheRofli/qquark-435m

Text Generation • 0.5B • Updated May 30 • 21 • 1

prithivMLmods/CapQwen3.6-27B-BLIP3o-Long-Caption-Distilled-GGUF

Image-Text-to-Text • 27B • Updated May 2 • 327 • 4

ia-espirita/riv-ai-v2-Q4_K_M-GGUF

Text Generation • 8B • Updated May 10 • 18 • 2

Grapheneos/Assistant_Pepe_32B-Q4_K_M-GGUF

33B • Updated May 4 • 80 • 2

ATH-MaaS/Marco-DeepResearch-8B-GGUF

Text Generation • 8B • Updated May 18 • 589 • 5

usermma/Quark-270m-Base-GGUF

Text Generation • 0.3B • Updated Jun 12 • 250 • 1

usermma/Quark-270m-Base-i1-GGUF

Text Generation • 0.3B • Updated Jun 12 • 471 • 1

YMRohit/ouroboros-kernelsmith-minicpm5-1b-GGUF

Text Generation • 1B • Updated Jun 15 • 72 • 2