RDson/Dolphin-less-Llama-3-Instruct-8B-GGUF

The GGUF files of RDson/Dolphin-less-Llama-3-Instruct-8B.

Use the ChatML prompt template

<|im_start|>system
You are Dolphin, a helpful AI assistant.<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant

Or as Ollama Modelfile

FROM Dolphin-less-Llama-3-Instruct-8B-GGUF-Q<PICK A FILE HERE>.gguf
TEMPLATE """<|im_start|>system
{{ .System }}<|im_end|>
<|im_start|>user
{{ .Prompt }}<|im_end|>
<|im_start|>assistant
{{ .Response }}<|im_end|>"""
PARAMETER stop "<|im_start|>"
PARAMETER stop "<|im_end|>"
SYSTEM "You are Dolphin, a helpful AI assistant."

Whichever works for you...