Edit Models filters

Model Tree

meta-llama/Llama-3.2-3B-Instruct

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

223

Full-text search

Active filters: meta-llama/Llama-3.2-3B-Instruct

mlx-community/Llama-3.2-3B-Instruct-4bit

Text Generation • Updated Sep 25, 2024 • 1.05M • 26

bartowski/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Oct 8, 2024 • 61.2k • 106

hugging-quants/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 25, 2024 • 17.4k • 44

lmstudio-community/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated 13 days ago • 6.68k • 31

unsloth/Llama-3.2-3B-Instruct-bnb-4bit

Text Generation • Updated 5 days ago • 248k • 15

MaziyarPanahi/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 25, 2024 • 1.04M • 10

neuralmagic/Llama-3.2-3B-Instruct-FP8

Text Generation • Updated Oct 16, 2024 • 7.86k • 4

kingabzpro/llama-3.2-3b-it-Ecommerce-ChatBot

Text Generation • Updated Oct 1, 2024 • 33 • 4

spxiong/Llama-3.2-3B-Chinese-Instruct

Text Generation • Updated Nov 11, 2024 • 279 • 3

nvidia/Meta-Llama-3.2-3B-Instruct-ONNX-INT4

Updated Nov 15, 2024 • 7

mkurman/llama-3.2-MEDIT-3B-o1

Text Generation • Updated 20 days ago • 810 • 12

pankajmathur/orca_mini_v9_6_3B-Instruct-GGUF

Updated 4 days ago • 151 • 1

onnx-community/Llama-3.2-3B-Instruct

Text Generation • Updated Oct 8, 2024 • 107 • 10

hugging-quants/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 25, 2024 • 1.32k • 19

samurai-zero/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 25, 2024 • 3 • 1

paultimothymooney/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 25, 2024 • 11

mlc-ai/Llama-3.2-3B-Instruct-q0f16-MLC

Updated Sep 25, 2024 • 4

mlc-ai/Llama-3.2-3B-Instruct-q4f16_1-MLC

Updated Sep 25, 2024 • 1.78k • 4

mlc-ai/Llama-3.2-3B-Instruct-q0f32-MLC

Updated Sep 25, 2024

bartowski/Llama-3.2-3B-Instruct-exl2

Text Generation • Updated Oct 8, 2024 • 68 • 5

mlc-ai/Llama-3.2-3B-Instruct-q4f32_1-MLC

Updated Sep 25, 2024 • 2.1k • 2

neuralmagic/Llama-3.2-3B-Instruct-FP8-dynamic

Text Generation • Updated Oct 9, 2024 • 1.69k • 2

legraphista/Llama-3.2-3B-Instruct-IMat-GGUF

Text Generation • Updated Sep 25, 2024 • 496 • 1

neuralmagic/Llama-3.2-3B-Instruct-quantized.w8a8

Text Generation • Updated Oct 16, 2024 • 5.96k • 1

mukel/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 26, 2024 • 86

second-state/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated 29 days ago • 8.14k • 2

gaianet/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 25, 2024 • 2.72k • 1

baslak/Llama-3.2-3B-Instruct-ONNX-Q4

Updated Sep 25, 2024 • 3

baslak/Llama-3.2-3B-Instruct-ONNX-Q4-F16

Updated Sep 25, 2024 • 1

DevQuasar/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Dec 4, 2024 • 21