Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

3,932

Full-text search

Active filters: chat

Dracones/Qwen2.5-72B-Instruct_exl2_8.0bpw

Text Generation • Updated Dec 2, 2024 • 7

Dracones/Qwen2.5-72B-Instruct_exl2_7.0bpw

Text Generation • Updated Dec 2, 2024 • 4

Dracones/Qwen2.5-72B-Instruct_exl2_6.0bpw

Text Generation • Updated Dec 2, 2024 • 4

Dracones/Qwen2.5-72B-Instruct_exl2_5.0bpw

Text Generation • Updated Dec 2, 2024 • 9

Dracones/Qwen2.5-72B-Instruct_exl2_4.5bpw

Text Generation • Updated Dec 2, 2024 • 15 • 1

Dracones/Qwen2.5-72B-Instruct_exl2_4.0bpw

Text Generation • Updated Dec 2, 2024 • 6

Dracones/Qwen2.5-72B-Instruct_exl2_3.5bpw

Text Generation • Updated Dec 2, 2024 • 4

Dracones/Qwen2.5-72B-Instruct_exl2_3.0bpw

Text Generation • Updated Dec 2, 2024 • 6 • 1

mradermacher/EZO-QwQ-32B-Preview-i1-GGUF

Updated Dec 2, 2024 • 20 • 1

Apel-sin/qwq-32b-coder-fusion-9010-exl2

Text Generation • Updated Dec 2, 2024

bullerwins/QwQ-32B-Preview-exl2_4.0bpw

Text Generation • Updated Dec 2, 2024 • 4

bullerwins/QwQ-32B-Preview-exl2_5.0bpw

Text Generation • Updated Dec 2, 2024 • 5

bullerwins/QwQ-32B-Preview-exl2_6.0bpw

Text Generation • Updated Dec 2, 2024 • 4

bullerwins/QwQ-32B-Preview-exl2_8.0bpw

Text Generation • Updated Dec 2, 2024 • 7

roxy45/QwQ-32B-Preview-Q4_K_M-GGUF

Updated Dec 2, 2024 • 3

mradermacher/Holland-4B-V1-i1-GGUF

Updated Dec 11, 2024 • 14

mradermacher/Darkens-8B-GGUF

Updated Dec 3, 2024 • 205 • 1

mradermacher/Baldur-8B-GGUF

Updated Dec 3, 2024 • 40

mradermacher/Tor-8B-GGUF

Updated Dec 3, 2024 • 9

mradermacher/Baldur-8B-i1-GGUF

Updated Dec 3, 2024 • 41

mradermacher/Darkens-8B-i1-GGUF

Updated Dec 3, 2024 • 293 • 1

mradermacher/Tor-8B-i1-GGUF

Updated Dec 3, 2024 • 23

tensorblock/calme-3.2-instruct-3b-GGUF

Text Generation • Updated Dec 3, 2024 • 27

Dracones/QwQ-32B-Preview_exl2_8.0bpw

Text Generation • Updated Dec 3, 2024 • 5

Dracones/QwQ-32B-Preview_exl2_7.0bpw

Text Generation • Updated Dec 3, 2024 • 8

Dracones/QwQ-32B-Preview_exl2_6.0bpw

Text Generation • Updated Dec 3, 2024 • 25 • 1

Dracones/QwQ-32B-Preview_exl2_5.0bpw

Text Generation • Updated Dec 3, 2024 • 4

Dracones/QwQ-32B-Preview_exl2_4.5bpw

Text Generation • Updated Dec 3, 2024 • 5

Dracones/QwQ-32B-Preview_exl2_4.0bpw

Text Generation • Updated Dec 3, 2024 • 5

tensorblock/calme-3.2-baguette-3b-GGUF

Text Generation • Updated Dec 3, 2024 • 28