FP8 Deepseek R1 Distilled LLMs for SGLang and vLLM Collection Accurate FP8 quantized deepseek R1 distilled models, ready for use with SGLang and vLLM! • 6 items • Updated 14 days ago • 1
JamAndTeaStudios/DeepSeek-R1-Distill-Qwen-32B-FP8-Dynamic Text Generation • Updated 14 days ago • 288 • 1
JamAndTeaStudios/DeepSeek-R1-Distill-Qwen-14B-FP8-Dynamic Text Generation • Updated 14 days ago • 405 • 1
JamAndTeaStudios/DeepSeek-R1-Distill-Llama-70B-FP8-Dynamic Text Generation • Updated 14 days ago • 672
JamAndTeaStudios/DeepSeek-R1-Distill-Llama-8B-FP8-Dynamic Text Generation • Updated 14 days ago • 78 • 1
JamAndTeaStudios/DeepSeek-R1-Distill-Qwen-7B-FP8-Dynamic Text Generation • Updated 14 days ago • 82 • 1
JamAndTeaStudios/DeepSeek-R1-Distill-Qwen-1.5B-FP8-Dynamic Text Generation • Updated 14 days ago • 81
JamAndTeaStudios/DeepSeek-R1-Distill-Qwen-7B-FP8-Dynamic Text Generation • Updated 14 days ago • 82 • 1
JamAndTeaStudios/DeepSeek-R1-Distill-Llama-70B-FP8-Dynamic Text Generation • Updated 14 days ago • 672
JamAndTeaStudios/DeepSeek-R1-Distill-Llama-8B-FP8-Dynamic Text Generation • Updated 14 days ago • 78 • 1