Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
eaddario
/
DeepSeek-R1-Distill-Qwen-7B-GGUF
like
0
Text Generation
GGUF
eaddario/imatrix-calibration
English
quant
Inference Endpoints
conversational
License:
mit
Model card
Files
Files and versions
Community
Deploy
Use this model
75442e7
DeepSeek-R1-Distill-Qwen-7B-GGUF
1 contributor
History:
33 commits
eaddario
Generate perplexity and kld scores
75442e7
unverified
26 days ago
imatrix
Generate Small imatrix
26 days ago
logits
Rename to F16
26 days ago
scores
Generate perplexity and kld scores
26 days ago
.gitattributes
Safe
1.65 kB
Update lfs attributes and ignores
26 days ago
.gitignore
Safe
6.78 kB
Update lfs attributes and ignores
26 days ago
DeepSeek-R1-Distill-Qwen-7B-F16.gguf
Safe
15.2 GB
LFS
Rename to F16
26 days ago
DeepSeek-R1-Distill-Qwen-7B-IQ3_M.gguf
Safe
3.57 GB
LFS
Generate IQ3_M quant
26 days ago
DeepSeek-R1-Distill-Qwen-7B-IQ3_S.gguf
Safe
3.5 GB
LFS
Generate IQ3_S quant
26 days ago
DeepSeek-R1-Distill-Qwen-7B-IQ4_NL.gguf
Safe
4.44 GB
LFS
Generate IQ4_NL quant
26 days ago
DeepSeek-R1-Distill-Qwen-7B-Q3_K_L.gguf
Safe
4.09 GB
LFS
Generate Q3_K_L quant
26 days ago
DeepSeek-R1-Distill-Qwen-7B-Q3_K_M.gguf
Safe
3.81 GB
LFS
Generate Q3_K_M quant
26 days ago
DeepSeek-R1-Distill-Qwen-7B-Q3_K_S.gguf
Safe
3.49 GB
LFS
Generate Q3_K_S quant
26 days ago
DeepSeek-R1-Distill-Qwen-7B-Q4_K_M.gguf
Safe
4.68 GB
LFS
Generate Q4_K_M quant
26 days ago
DeepSeek-R1-Distill-Qwen-7B-Q4_K_S.gguf
Safe
4.46 GB
LFS
Generate Q4_K_S quant
26 days ago
DeepSeek-R1-Distill-Qwen-7B-Q5_K_M.gguf
Safe
5.44 GB
LFS
Generate Q5_K_M quant
26 days ago
DeepSeek-R1-Distill-Qwen-7B-Q5_K_S.gguf
Safe
5.32 GB
LFS
Generate Q5_K_S quant
26 days ago
DeepSeek-R1-Distill-Qwen-7B-Q6_K.gguf
Safe
6.25 GB
LFS
Generate Q6_K quant
26 days ago
DeepSeek-R1-Distill-Qwen-7B-Q8_0.gguf
Safe
8.1 GB
LFS
Generate Q8_0 quant
26 days ago
