Converted to MLX and quiantized to Q4. Original model https://huggingface.co/meta-llama/Llama-3.1-8B-Instruct .

Downloads last month
5
Safetensors
Model size
1.25B params
Tensor type
FP16
·
U32
·
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Model tree for jesusoctavioas/Meta-Llama-3.1-8B-Instruct-MLX-Q4

Quantized
(340)
this model