Edit Models filters

Model Tree

deepseek-ai/DeepSeek-R1-Distill-Llama-8B

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

83

Full-text search

Active filters: deepseek-ai/DeepSeek-R1-Distill-Llama-8B

roleplaiapp/DeepSeek-R1-Distill-Llama-8B-Q3_K_L-GGUF

Text Generation • Updated 11 days ago • 28

roleplaiapp/DeepSeek-R1-Distill-Llama-8B-Q4_K_S-GGUF

Text Generation • Updated 11 days ago • 5

roleplaiapp/DeepSeek-R1-Distill-Llama-8B-Q4_K_M-GGUF

Text Generation • Updated 11 days ago • 23

roleplaiapp/DeepSeek-R1-Distill-Llama-8B-Q5_0-GGUF

Text Generation • Updated 11 days ago • 26

roleplaiapp/DeepSeek-R1-Distill-Llama-8B-Q5_K_S-GGUF

Text Generation • Updated 11 days ago • 22

roleplaiapp/DeepSeek-R1-Distill-Llama-8B-Q5_K_M-GGUF

Text Generation • Updated 11 days ago • 37

roleplaiapp/DeepSeek-R1-Distill-Llama-8B-Q6_K-GGUF

Text Generation • Updated 11 days ago • 72

roleplaiapp/DeepSeek-R1-Distill-Llama-8B-Q8_0-GGUF

Text Generation • Updated 11 days ago • 445

jakiAJK/DeepSeek-R1-Distill-Llama-8B_GPTQ-int4

Text Generation • Updated 10 days ago • 293

jakiAJK/DeepSeek-R1-Distill-Llama-8B_AWQ

Text Generation • Updated 10 days ago • 640

XelotX/DeepSeek-R1-Distill-Llama-8B-GGUF

Updated 11 days ago • 871

mlx-community/DeepSeek-R1-Distill-Llama-8B-4bit-mlx

Updated 11 days ago • 915

mlx-community/DeepSeek-R1-Distill-Llama-8B-8bit-mlx

Updated 10 days ago • 133

jesusoctavioas/DeepSeek-R1-Distill-Llama-8B-MLX-Q4

Updated 8 days ago • 7

mlx-community/DeepSeek-R1-Distill-Llama-8B-3bit

Updated 10 days ago • 15.2k

mlx-community/DeepSeek-R1-Distill-Llama-8B-6bit

Updated 10 days ago • 3.16k

numen-tech/DeepSeek-R1-Distill-Llama-8B-w4a16g128asym

Text Generation • Updated 10 days ago

mlc-ai/DeepSeek-R1-Distill-Llama-8B-q4f16_1-MLC

Updated 10 days ago • 512

mlc-ai/DeepSeek-R1-Distill-Llama-8B-q0f16-MLC

Updated 10 days ago • 4

mlc-ai/DeepSeek-R1-Distill-Llama-8B-q4f32_1-MLC

Updated 10 days ago • 399

pbatra/DeepSeek-R1-Distill-Llama-8B-GGUF

Text Generation • Updated 10 days ago • 471

Cran-May/DeepSeek-R1-Distill-Llama-8B-Q5_K_M-GGUF

Updated 10 days ago • 714

Cran-May/DeepSeek-R1-Distill-Llama-8B-IQ4_NL-GGUF

Updated 9 days ago • 122

featherless-ai-quants/deepseek-ai-DeepSeek-R1-Distill-Llama-8B-GGUF

Text Generation • Updated 7 days ago • 485

osllmai-community/DeepSeek-R1-Distill-Llama-8B-GGUF

Updated 2 days ago • 1.23k

brunosk/DeepSeek-R1-Distill-Llama-8B-Q4_K_M-GGUF

Updated 6 days ago • 2

vankhoa/DeepSeek-R1-Distill-Llama-8B-Q4_K_M-GGUF

Updated 6 days ago • 9

Triangle104/DeepSeek-R1-Distill-Llama-8B-Q4_K_S-GGUF

Updated 6 days ago • 36

Triangle104/DeepSeek-R1-Distill-Llama-8B-Q4_K_M-GGUF

Updated 6 days ago • 115

Triangle104/DeepSeek-R1-Distill-Llama-8B-Q5_K_S-GGUF

Updated 6 days ago • 33