gelukuMLG
/

llama-3-stinky-v2-8B-GGUF

Inference Endpoints

Model card Files Files and versions Community

llama-3-stinky-v2-8B-GGUF

1 contributor

History: 16 commits

gelukuMLG's picture

Decided to also add the f32 files used for the quanting. Enjoy

c3b8f2c verified 10 months ago

.gitattributes

2.33 kB

Decided to also add the f32 files used for the quanting. Enjoy 10 months ago
README.md

254 Bytes

Update README.md 10 months ago
llama-3-stinky-v2-8B-F16.gguf

16.1 GB
LFS

Upload llama-3-stinky-v2-8B-F16.gguf 10 months ago
llama-3-stinky-v2-8B-IQ4_XS.gguf

4.48 GB
LFS

Upload llama-3-stinky-v2-8B-IQ4_XS.gguf 10 months ago
llama-3-stinky-v2-8B-Q4_0.gguf

4.66 GB
LFS

Upload llama-3-stinky-v2-8B-Q4_0.gguf 10 months ago
llama-3-stinky-v2-8B-Q4_K_M.gguf

4.92 GB
LFS

Upload llama-3-stinky-v2-8B-Q4_K_M.gguf 10 months ago
llama-3-stinky-v2-8B-Q4_K_S.gguf

4.69 GB
LFS

Upload llama-3-stinky-v2-8B-Q4_K_S.gguf 10 months ago
llama-3-stinky-v2-8B-Q5_0.gguf

5.6 GB
LFS

Upload llama-3-stinky-v2-8B-Q5_0.gguf 10 months ago
llama-3-stinky-v2-8B-Q5_K_M.gguf

5.73 GB
LFS

Upload llama-3-stinky-v2-8B-Q5_K_M.gguf 10 months ago
llama-3-stinky-v2-8B-Q5_K_S.gguf

5.6 GB
LFS

Upload llama-3-stinky-v2-8B-Q5_K_S.gguf 10 months ago
llama-3-stinky-v2-8B-Q6_K.gguf

6.6 GB
LFS

Upload llama-3-stinky-v2-8B-Q6_K.gguf 10 months ago
llama-3-stinky-v2-8B-Q8_0.gguf

8.54 GB
LFS

Rename llama-3-stinky-8B-Q8_0.gguf to llama-3-stinky-v2-8B-Q8_0.gguf 10 months ago
llama-3-stinky-v2-8B-f32.gguf

32.1 GB
LFS

Decided to also add the f32 files used for the quanting. Enjoy 10 months ago