Hugging Face's logo

deepseek-ai
/
deepseek-llm-67b-chat

Text Generation
Transformers
PyTorch
llama
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
11

Can you provide 4-bits version ?

#7
by hanswang73 - opened
Discussion
hanswang73

Can you provide 4-bits version ?

Beygo

You can find the 4-bit AWQ version here:
https://huggingface.co/TheBloke/deepseek-llm-67b-chat-AWQ/tree/main

Sign up or log in to comment