GGUF imatrix quants available
#1
by
ddh0 - opened
A set of several imatrix GGUF quants will be available at https://huggingface.co/ddh0/Unnamed-Exp-70b-v0.6.A-GGUF/ starting in a few hours, and I'll update this discussion when they're all done. Thank you for the model! 🤗
ddh0 changed discussion title from
GGUF imatrix quants incoming
to GGUF imatrix quants available