Valdemardi
/

DeepSeek-R1-Distill-Qwen-32B-AWQ

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

share awq command

#1

by devops724 - opened 11 days ago

11 days ago

Hi, i want convert another model into awq
can you share your practilcal best command for convert a model to awq ,

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment