Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

Misc with no match

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

104

Full-text search

Active filters: 1bit

legraphista/Qwen2.5-3B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19, 2024 • 47

legraphista/Qwen2.5-7B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19, 2024 • 89

legraphista/Qwen2.5-14B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19, 2024 • 87

legraphista/Qwen2.5-32B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19, 2024 • 317

legraphista/Qwen2.5-Coder-1.5B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19, 2024 • 219

legraphista/Qwen2.5-Math-1.5B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19, 2024 • 497

legraphista/Qwen2.5-Coder-7B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19, 2024 • 279

legraphista/Qwen2.5-Math-7B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19, 2024 • 253

legraphista/Qwen2.5-72B-Instruct-IMat-GGUF

Text Generation • Updated Sep 20, 2024 • 168

legraphista/Llama-3.2-1B-Instruct-IMat-GGUF

Text Generation • Updated Sep 25, 2024 • 164

legraphista/Llama-3.2-3B-Instruct-IMat-GGUF

Text Generation • Updated Sep 25, 2024 • 496 • 1

legraphista/Llama-Guard-3-1B-IMat-GGUF

Text Generation • Updated Sep 25, 2024 • 653

mradermacher/Bitnet-M7-70m-GGUF

Updated 9 days ago • 167

mradermacher/Bitnet-M7-70m-i1-GGUF

Updated 9 days ago • 336