Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8

Base only

Active filters: sub-2-bit

FermionResearch/Neutrino-8B

Text Generation • 8B • Updated 3 days ago • 666 • 81

DuoNeural/Qwen2.5-Coder-7B-Instruct-CodeInfused-IQ2_M-GGUF

Text Generation • 8B • Updated 4 days ago • 212 • 1

DuoNeural/Qwen2.5-Coder-7B-Instruct-GTAP-v3-IQ2_M-GGUF

Text Generation • 8B • Updated 4 days ago • 229 • 1

ims-lab/Qwen3-14B-base-QTEA

Text Generation • Updated about 1 month ago

manjunathshiva/Qwen3-235B-A22B-Instruct-2507-tq3a-tqTe-g64

Text Generation • 16B • Updated Jul 16 • 135 • 1

manjunathshiva/Qwen3.6-35B-A3B-tq3a-tqTe-g64

Text Generation • 3B • Updated Jul 16 • 180 • 3

manjunathshiva/Qwen3.5-122B-A10B-tq3a-tqTe-g64

Text Generation • 9B • Updated Jul 16 • 109 • 3

DuoNeural/Qwen2.5-Coder-7B-Instruct-GTAP-v3-IQ2_XXS-GGUF

Text Generation • 8B • Updated 4 days ago • 180