Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

8-bit precision

AutoTrain Compatible

Inference Endpoints

text-generation-inference

Mixture of Experts

Misc with no match

4-bit precision

text-embeddings-inference

Carbon Emissions

Models

361

Full-text search

Active filters: hqq

mobiuslabsgmbh/Meta-Llama-3-8B-Instruct_4bitgs64_hqq_hf

Text Generation • Updated Feb 6 • 54 • 2

mobiuslabsgmbh/Llama-3.1-8B-Instruct_4bitgs64_hqq_hf

Text Generation • Updated Feb 6 • 259 • 1

mobiuslabsgmbh/Llama-3.2-3B-Instruct_4bitgs64_hqq_hf

Text Generation • Updated Feb 6 • 59 • 1

mobiuslabsgmbh/Qwen2.5-7B-Instruct-1M_4bitgs64_hqq_hf

Text Generation • Updated Feb 6 • 38 • 1

mobiuslabsgmbh/Qwen2.5-14B-Instruct-1M_4bitgs64_hqq_hf

Text Generation • Updated Feb 6 • 34 • 1

mobiuslabsgmbh/Qwen2.5-7B-Instruct_4bitgs64_hqq_hf

Text Generation • Updated Feb 6 • 64 • 2

mlabonne/AlphaMonarch-7B-2bit-HQQ

Text Generation • Updated Mar 28, 2024 • 12 • 7

speakleash/Bielik-7B-Instruct-v0.1-3bit-HQQ

Text Generation • Updated Apr 4, 2024 • 30 • 1

mayflowergmbh/occiglot-7b-de-en-instruct-HQQ

Text Generation • Updated Apr 7, 2024 • 8

mayflowergmbh/occiglot-7b-es-en-instruct-HQQ

Text Generation • Updated Apr 7, 2024 • 8

mayflowergmbh/occiglot-7b-eu5-instruct-HQQ

Text Generation • Updated Apr 7, 2024 • 10

mayflowergmbh/occiglot-7b-fr-en-instruct-HQQ

Text Generation • Updated Apr 7, 2024 • 12

mayflowergmbh/occiglot-7b-it-en-instruct-HQQ

Text Generation • Updated Apr 7, 2024 • 10

Chronal/Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss_attn-4bit-moe-2bit-metaoffload-HQQ

Text Generation • Updated Apr 15, 2024 • 10 • 1

mayflowergmbh/SauerkrautLM-7b-LaserChat-HQQ

Text Generation • Updated Apr 19, 2024 • 10

mayflowergmbh/Llama-3-SauerkrautLM-8b-Instruct-HQQ

Text Generation • Updated Apr 26, 2024 • 9

mayflowergmbh/Llama3_DiscoLM_German_8b_v0.1_experimental-HQQ

Text Generation • Updated Apr 26, 2024 • 6

PrunaAI/shenzhi-wang-Llama3-8B-Chinese-Chat-HQQ-4bit-smashed

Text Generation • Updated 12 days ago • 46

webbigdata/C3TR-Adapter_hqq

Translation • Updated May 24, 2024 • 24

aspirina765/Daredevil-8B-abliterated-2bit-HQQ

Text Generation • Updated Jun 9, 2024 • 15 • 3

PrunaAI/01-ai-Yi-6B-HQQ-4bit-smashed

Text Generation • Updated 12 days ago • 30

PrunaAI/google-gemma-2-2b-it-HQQ-4bit-smashed

Updated 20 days ago • 19

nm-testing/Llama-3.2-1B-Instruct-HQQ

Updated Oct 30, 2024 • 11

alpindale/magnum-v4-123b-hqq-4bit

Updated Nov 3, 2024 • 8 • 1

PyrTools/Cydonia-22B-v1.2-HQQ-4bit

Updated Nov 3, 2024 • 8

fayez-siddiqui/Llama3_8b_HQQ-1bit

Text Generation • Updated Nov 6, 2024 • 11

fayez-siddiqui/Llama3_8b_HQQ-4bit

Text Generation • Updated Nov 6, 2024 • 7

fayez-siddiqui/Llama3_8b_HQQ-2bit

Text Generation • Updated Nov 6, 2024 • 8

gurro/Llama-3.1-8B_hqq_4bit

Updated Nov 29, 2024 • 6

gurro/llama-3.1-8B-hqq-int3-g64

Updated Dec 1, 2024 • 6