Update README.md
Browse files
README.md
CHANGED
@@ -1,14 +1,14 @@
|
|
1 |
---
|
2 |
quantized_by: bartowski
|
3 |
pipeline_tag: text-generation
|
4 |
-
base_model:
|
5 |
---
|
6 |
|
7 |
## Llamacpp imatrix Quantizations of DeepSeek-R1
|
8 |
|
9 |
Using <a href="https://github.com/ggerganov/llama.cpp/">llama.cpp</a> release <a href="https://github.com/ggerganov/llama.cpp/releases/tag/b4514">b4514</a> for quantization.
|
10 |
|
11 |
-
Original model: https://huggingface.co/
|
12 |
|
13 |
All quants made using imatrix option with dataset from [here](https://gist.github.com/bartowski1182/eb213dccb3571f863da82e99418f81e8)
|
14 |
|
@@ -17,7 +17,7 @@ Run them in [LM Studio](https://lmstudio.ai/)
|
|
17 |
## Prompt format
|
18 |
|
19 |
```
|
20 |
-
<|begin▁of▁sentence|>{system_prompt}<|User|>{prompt}<|Assistant
|
21 |
```
|
22 |
|
23 |
## Download a file (not the whole branch) from below:
|
|
|
1 |
---
|
2 |
quantized_by: bartowski
|
3 |
pipeline_tag: text-generation
|
4 |
+
base_model: deepseek-ai/DeepSeek-R1
|
5 |
---
|
6 |
|
7 |
## Llamacpp imatrix Quantizations of DeepSeek-R1
|
8 |
|
9 |
Using <a href="https://github.com/ggerganov/llama.cpp/">llama.cpp</a> release <a href="https://github.com/ggerganov/llama.cpp/releases/tag/b4514">b4514</a> for quantization.
|
10 |
|
11 |
+
Original model: https://huggingface.co/deepseek-ai/DeepSeek-R1
|
12 |
|
13 |
All quants made using imatrix option with dataset from [here](https://gist.github.com/bartowski1182/eb213dccb3571f863da82e99418f81e8)
|
14 |
|
|
|
17 |
## Prompt format
|
18 |
|
19 |
```
|
20 |
+
<|begin▁of▁sentence|>{system_prompt}<|User|>{prompt}<|Assistant|>
|
21 |
```
|
22 |
|
23 |
## Download a file (not the whole branch) from below:
|