Edit Models filters

Inference status

Misc

8-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

11,128

Full-text search

Active filters: 8-bit

MaziyarPanahi/Sailor2-1B-Chat-GGUF

Text Generation • Updated Dec 3, 2024 • 651k • 4

BigHuggyD/MarsupialAI_Monstral-123B-v2_exl2_8.0bpw_h8

Text Generation • Updated Dec 9, 2024 • 258 • 2

mlx-community/Llama-3.3-70B-Instruct-8bit

Text Generation • Updated Dec 6, 2024 • 3.35k • 9

MaziyarPanahi/Llama-3.3-70B-Instruct-GGUF

Text Generation • Updated Dec 7, 2024 • 2.13M • 9

jackboyla/Phi-3-mini-4k-instruct-graph-GGUF

Text Generation • Updated Dec 7, 2024 • 11 • 1

reinforce20001/SakuraLLM.Sakura-7B-Qwen2.5-v1.0-W8A8-Int8

Updated Dec 8, 2024 • 10 • 1

mlx-community/Josiefied-Qwen2.5-14B-Instruct-abliterated-v4-8-bit

Text Generation • Updated Dec 9, 2024 • 48 • 1

PrunaAI/DiatWork-GPT-Neox-MentalHealth-Finetune-10epoch-bnb-8bit-smashed

Updated Dec 10, 2024 • 6 • 1

PrunaAI/Sakalti-Saba1.5-Pro-bnb-8bit-smashed

Updated Dec 12, 2024 • 5 • 1

PrunaAI/Sakalti-magro-7B-bnb-8bit-smashed

Updated Dec 11, 2024 • 3 • 1

PrunaAI/nqzfaizal77ai-swiftstrike-aero-init-580m-bnb-8bit-smashed

Updated Dec 12, 2024 • 4 • 1

PrunaAI/nqzfaizal77ai-mirabel-tempest-init-570m-bnb-8bit-smashed

Updated Dec 12, 2024 • 3 • 1

prithivMLmods/QwQ-LCoT-3B-Instruct-GGUF

Text Generation • Updated about 1 month ago • 1.29k • 10

ai-sage/GigaChat-20B-A3B-instruct-int8

Updated 30 days ago • 508 • 4

PrunaAI/prithivMLmods-QwQ-LCoT-3B-Instruct-bnb-8bit-smashed

Updated about 1 month ago • 24 • 3

PrunaAI/sakaltcommunity-sakaltum-7b-bnb-8bit-smashed

Updated about 1 month ago • 6 • 1

PrunaAI/sakaltcommunity-wasser-4b-bnb-8bit-smashed

Updated about 1 month ago • 6 • 1

PrunaAI/EpistemeAI-Polypsyche-Llama-3.1-8B-Instruct-Agent-0.003-128K-code-ds-auto-Logic-bnb-8bit-smashed

Updated about 1 month ago • 8 • 1

tiiuae/Falcon3-10B-Instruct-GPTQ-Int8

Updated 26 days ago • 466 • 2

tiiuae/Falcon3-3B-Instruct-GPTQ-Int8

Updated 26 days ago • 246 • 1

tiiuae/Falcon3-1B-Instruct-GPTQ-Int8

Updated 26 days ago • 198 • 1

vitekkor/T-pro-it-1.0-bnb-8bit

Updated 28 days ago • 621 • 1

PrunaAI/Sakalti-Saba1-3B-bnb-8bit-smashed

Updated 29 days ago • 5 • 1

tiiuae/Falcon3-10B-Instruct-1.58bit

Text Generation • Updated 24 days ago • 271 • 12

tiiuae/Falcon3-10B-Base-1.58bit

Text Generation • Updated 24 days ago • 114 • 4

PrunaAI/Pinkstack-PARM-V2-QwQ-Qwen-2.5-o1-3B-VLLM-bnb-8bit-smashed

Updated 27 days ago • 34 • 1

PrunaAI/romanoza-gpt2-small-III-bnb-8bit-smashed

Updated 23 days ago • 4 • 1

PrunaAI/Sakalti-saba1.5-coder-bnb-8bit-smashed

Updated 21 days ago • 4 • 1

Dracones/Anubis-70B-v1_exl2_8.0bpw

Text Generation • Updated 19 days ago • 75 • 1

PrunaAI/burgasdotpro-bgGPT-llama-3.1-8B-math-bnb-8bit-smashed

Updated 16 days ago • 6 • 1