Hugging Face's logo

Lewdiculous
/
Kukul-Stanta-0.420-32k-7B-0.2-GGUF-IQ-Imatrix

GGUF
quantized
roleplay
multimodal
vision
llava
sillytavern
Merge
mistral
conversational
Model card Files Community
1
Lewdiculous commited on
Commit
5b02e3a
·
verified ·
1 Parent(s): bc708ea

IQ3_M, IQ4_XS, Q5_K_M, Q5_K_S, Q6_K, Q8_0

Browse files
Files changed (7) hide show
  1. .gitattributes +6 -0
  2. Kukul-Stanta-0.420-32k-7B-0.2-IQ3_M-imat.gguf +3 -0
  3. Kukul-Stanta-0.420-32k-7B-0.2-IQ4_XS-imat.gguf +3 -0
  4. Kukul-Stanta-0.420-32k-7B-0.2-Q5_K_M-imat.gguf +3 -0
  5. Kukul-Stanta-0.420-32k-7B-0.2-Q5_K_S-imat.gguf +3 -0
  6. Kukul-Stanta-0.420-32k-7B-0.2-Q6_K-imat.gguf +3 -0
  7. Kukul-Stanta-0.420-32k-7B-0.2-Q8_0-imat.gguf +3 -0
.gitattributes CHANGED
@@ -38,3 +38,9 @@ Kukul-Stanta-0.420-32k-7B-0.2-F16.gguf filter=lfs diff=lfs merge=lfs -text
38
  Kukul-Stanta-0.420-32k-7B-0.2-Q4_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
39
  Kukul-Stanta-0.420-32k-7B-0.2-Q4_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
40
  mmproj/mmproj-model-f16.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
38
  Kukul-Stanta-0.420-32k-7B-0.2-Q4_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
39
  Kukul-Stanta-0.420-32k-7B-0.2-Q4_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
40
  mmproj/mmproj-model-f16.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Kukul-Stanta-0.420-32k-7B-0.2-IQ3_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Kukul-Stanta-0.420-32k-7B-0.2-IQ4_XS-imat.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Kukul-Stanta-0.420-32k-7B-0.2-Q5_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Kukul-Stanta-0.420-32k-7B-0.2-Q5_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Kukul-Stanta-0.420-32k-7B-0.2-Q6_K-imat.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Kukul-Stanta-0.420-32k-7B-0.2-Q8_0-imat.gguf filter=lfs diff=lfs merge=lfs -text
Kukul-Stanta-0.420-32k-7B-0.2-IQ3_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:12a3966e0ce7e468330a318c038e4884cc281e6d4c5f7d99c8129593c0b65ad8
3
+ size 3284891904
Kukul-Stanta-0.420-32k-7B-0.2-IQ4_XS-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d920fb18212e9decdb19aae5cdf0b9e7692272ee18bf462deda33bf1a30fd0c7
3
+ size 3907688704
Kukul-Stanta-0.420-32k-7B-0.2-Q5_K_M-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:821758c6cdbc7ff6c58f21207b6d4b889333d8e46816dd48e8abf730930e971b
3
+ size 5131409664
Kukul-Stanta-0.420-32k-7B-0.2-Q5_K_S-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d89294d562e7ce9a16b0e6c1821ea3970dedc4057a7cfe69b4ef0ee308840311
3
+ size 4997716224
Kukul-Stanta-0.420-32k-7B-0.2-Q6_K-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:779d9adb033f6a197a2cb7ec0ad76e367f512a61d1cb34f6658aae92f2aa9ff1
3
+ size 5942065408
Kukul-Stanta-0.420-32k-7B-0.2-Q8_0-imat.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d46aa529c84eced3eb798202ce94adb3edea9a4e637fec4d32b21a3831545bbb
3
+ size 7695857920