Edit Models filters

Model Tree

ibm-granite/granite-3.1-2b-base

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

15

Full-text search

Active filters: ibm-granite/granite-3.1-2b-base

DevQuasar/ibm-granite.granite-3.1-2b-base-GGUF

Text Generation • Updated Dec 18, 2024 • 19

QuantFactory/granite-3.1-2b-instruct-GGUF

Text Generation • Updated Dec 19, 2024 • 641 • 4

mradermacher/granite-3.1-2b-base-GGUF

Updated Dec 21, 2024 • 48

mradermacher/granite-3.1-2b-base-i1-GGUF

Updated Dec 21, 2024 • 41

itlwas/granite-3.1-2b-base-Q4_K_M-GGUF

Updated Dec 23, 2024 • 11

Triangle104/granite-3.1-2b-base-Q4_K_S-GGUF

Updated Dec 26, 2024 • 6

Triangle104/granite-3.1-2b-base-Q4_K_M-GGUF

Updated Dec 26, 2024 • 9

Triangle104/granite-3.1-2b-base-Q5_K_S-GGUF

Updated Dec 26, 2024 • 4

Triangle104/granite-3.1-2b-base-Q5_K_M-GGUF

Updated Dec 26, 2024 • 7

Triangle104/granite-3.1-2b-base-Q6_K-GGUF

Updated Dec 26, 2024 • 14

Triangle104/granite-3.1-2b-base-Q8_0-GGUF

Updated Dec 26, 2024 • 4

tensorblock/granite-3.1-2b-base-GGUF

Updated 26 days ago • 269

neuralmagic/granite-3.1-2b-base-quantized.w8a8

Text Generation • Updated 3 days ago • 15

neuralmagic/granite-3.1-2b-base-quantized.w4a16

Text Generation • Updated 3 days ago • 22

neuralmagic/granite-3.1-2b-base-FP8-dynamic

Text Generation • Updated 3 days ago • 14