duyntnet/Nous-Hermes-Llama2-13b-imatrix-GGUF

Quantizations of https://huggingface.co/NousResearch/Nous-Hermes-Llama2-13b

Inference Clients/UIs

• llama.cpp
• JanAI
• KoboldCPP
• text-generation-webui
• ollama
• GPT4All

---

From original readme

Prompt Format

The model follows the Alpaca prompt format:

### Instruction:
<prompt>

### Response:
<leave a newline blank for model to respond>

or

### Instruction:
<prompt>

### Input:
<additional context>

### Response:
<leave a newline blank for model to respond>