Hugging Face's logo

neuralmagic
/
Meta-Llama-3.1-8B-Instruct-FP8-dynamic

Text Generation
Transformers
Safetensors
llama
fp8
vllm
conversational
text-generation-inference
Inference Endpoints
compressed-tensors
Model card Files Community
2

Sparse Instruct model

#2
by Eryk-Chmielewski - opened
Discussion
Eryk-Chmielewski

Hi,

Could you create Sparse version of the Instruct model?
I can find only Sparse versions of the Base model.

Sign up or log in to comment