neuralmagic
/

DeepSeek-R1-Distill-Qwen-7B-quantized.w8a8

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

compressed-tensors

Model card Files Files and versions Community

nm-research commited on 14 days ago

Commit

5409131

·

verified ·

1 Parent(s): 5b23942

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -12,7 +12,7 @@ library_name: transformers
 # DeepSeek-R1-Distill-Qwen-7B-quantized.w8a8
 ## Model Overview
-- **Model Architecture:** LlamaForCausalLM
   - **Input:** Text
   - **Output:** Text
 - **Model Optimizations:**

 # DeepSeek-R1-Distill-Qwen-7B-quantized.w8a8
 ## Model Overview
+- **Model Architecture:** Qwen2ForCausalLM
   - **Input:** Text
   - **Output:** Text
 - **Model Optimizations:**