Edit Models filters

Model Tree

meta-llama/Llama-3.2-3B-Instruct

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

213

Full-text search

Active filters: meta-llama/Llama-3.2-3B-Instruct

mkurman/llama-3.2-MEDIT-3B-o1

Text Generation • Updated 5 days ago • 643 • 9

hugging-quants/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 25, 2024 • 18.1k • 43

mlx-community/Llama-3.2-3B-Instruct-4bit

Text Generation • Updated Sep 25, 2024 • 726k • 22

bartowski/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Oct 8, 2024 • 50.4k • 104

mlc-ai/Llama-3.2-3B-Instruct-q4f16_1-MLC

Updated Sep 25, 2024 • 1.2k • 4

mlc-ai/Llama-3.2-3B-Instruct-q4f32_1-MLC

Updated Sep 25, 2024 • 1.06k • 2

neuralmagic/Llama-3.2-3B-Instruct-FP8

Text Generation • Updated Oct 16, 2024 • 9.83k • 3

QuantFactory/VersatiLlama-Llama-3.2-3B-Instruct-Abliterated-GGUF

Text Generation • Updated Oct 8, 2024 • 301 • 4

kinetical/llama3.2-3b-simulMT-et-en

Updated Nov 9, 2024 • 1 • 3

andmev/Llama-3.2-3B-Instruct-CoreML

Text Generation • Updated Nov 9, 2024 • 12 • 4

nvidia/Meta-Llama-3.2-3B-Instruct-ONNX-INT4

Updated Nov 15, 2024 • 5

lumii-api/llama-3-dove-2.0-mini-gguf

Text2Text Generation • Updated Dec 10, 2024 • 39 • 3

QuantFactory/Codepy-Deepthink-3B-GGUF

Text Generation • Updated 11 days ago • 626 • 2

onnx-community/Llama-3.2-3B-Instruct

Text Generation • Updated Oct 8, 2024 • 223 • 10

hugging-quants/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 25, 2024 • 2.1k • 19

lmstudio-community/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated 5 days ago • 4.99k • 30

samurai-zero/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 25, 2024 • 1

unsloth/Llama-3.2-3B-Instruct-bnb-4bit

Text Generation • Updated Dec 10, 2024 • 191k • 14

paultimothymooney/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 25, 2024 • 5

MaziyarPanahi/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 25, 2024 • 2.18M • 8

mlc-ai/Llama-3.2-3B-Instruct-q0f16-MLC

Updated Sep 25, 2024 • 14

mlc-ai/Llama-3.2-3B-Instruct-q0f32-MLC

Updated Sep 25, 2024

bartowski/Llama-3.2-3B-Instruct-exl2

Text Generation • Updated Oct 8, 2024 • 69 • 5

neuralmagic/Llama-3.2-3B-Instruct-FP8-dynamic

Text Generation • Updated Oct 9, 2024 • 1.45k • 2

jxtngx/Meta-Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 25, 2024 • 16

legraphista/Llama-3.2-3B-Instruct-IMat-GGUF

Text Generation • Updated Sep 25, 2024 • 223 • 1

neuralmagic/Llama-3.2-3B-Instruct-quantized.w8a8

Text Generation • Updated Oct 16, 2024 • 6.22k • 1

mukel/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 26, 2024 • 118

second-state/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated 15 days ago • 1.35k • 2

gaianet/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 25, 2024 • 127 • 1