Converted to MLX and quantized to Q4. Base model https://huggingface.co/meta-llama/Llama-3.2-3B-Instruct .

Downloads last month
13
Safetensors
Model size
502M params
Tensor type
FP16
·
U32
·
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Model tree for jesusoctavioas/Llama-3.2-3B-Instruct-MLX-Q4

Quantized
(229)
this model