Unquantized (fp16, the parent model is bf16) version of Dolphin3.0-Llama3.2-1B for inference with Private LLM.

Downloads last month
-
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for numen-tech/Dolphin3.0-Llama3.2-1B-q0f16

Quantized
(25)
this model