numen-tech's picture
Add weights
108c075
|
raw
history blame
421 Bytes
metadata
language:
  - en
license: mit
base_model: deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B
base_model_relation: quantized
library_name: mlc-llm
pipeline_tag: text-generation

4-bit OmniQuant quantized version of DeepSeek-R1-Distill-Qwen-1.5B for inference with the Private LLM app.