eachadea
/

legacy-ggml-vicuna-7b-4bit

Text Generation

text-generation-inference

Model card Files Files and versions Community

eachadea commited on Apr 5, 2023

Commit

77ba78a

·

1 Parent(s): 96c7f50

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -8,7 +8,7 @@ tags:
 Converted for use with [llama.cpp](https://github.com/ggerganov/llama.cpp)
 ---
 - 4-bit quantized
-- Needs ~10GB of CPU RAM
 - Won't work with alpaca.cpp or old llama.cpp (new ggml format requires latest llama.cpp)
 - 7B parameter version

 Converted for use with [llama.cpp](https://github.com/ggerganov/llama.cpp)
 ---
 - 4-bit quantized
+- Needs ~6GB of CPU RAM
 - Won't work with alpaca.cpp or old llama.cpp (new ggml format requires latest llama.cpp)
 - 7B parameter version