Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

61

Full-text search

Active filters: bnb

unsloth/gemma-2b-it-bnb-4bit

Text Classification • Updated Sep 3, 2024 • 932 • 19

unsloth/codegemma-7b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 717 • 2

hugging-quants/Meta-Llama-3.1-8B-Instruct-BNB-NF4

Text Generation • Updated Aug 8, 2024 • 606 • 8

vitekkor/T-pro-it-1.0-bnb-8bit

Updated 28 days ago • 621 • 1

mwz/UrduOPT-2.7b-lora

Updated Sep 19, 2023 • 13

unsloth/mistral-7b

Text Generation • Updated Sep 11, 2024 • 2.73k • 5

unsloth/mistral-7b-bnb-4bit

Text Generation • Updated Sep 11, 2024 • 12.8k • 24

unsloth/zephyr-sft-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 1.54k • 4

unsloth/mistral-7b-instruct-v0.2-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 9.82k • 31

unsloth/codellama-13b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 98 • 1

unsloth/yi-6b-bnb-4bit

Text Generation • Updated Mar 22, 2024 • 14 • 1

unsloth/solar-10.7b-bnb-4bit

Text Generation • Updated Mar 22, 2024 • 75 • 3

unsloth/yi-34b-bnb-4bit

Text Generation • Updated Mar 22, 2024 • 43 • 2

unsloth/tinyllama-chat-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 2.39k • 3

BioMistral/BioMistral-7B-BnB.4

Text Generation • Updated Feb 19, 2024 • 12

BioMistral/BioMistral-7B-BnB.8

Text Generation • Updated Feb 19, 2024 • 12

unsloth/gemma-7b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 3.47k • 17

unsloth/gemma-2b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 2.22k • 15

unsloth/gemma-7b-it-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 7.1k • 13

alokabhishek/Mistral-7B-Instruct-v0.2-bnb-4bit

Text Generation • Updated Apr 2, 2024 • 23 • 1

alokabhishek/Llama-2-7b-chat-hf-bnb-4bit

Text Generation • Updated Mar 16, 2024 • 25 • 2

alokabhishek/falcon-7b-instruct-bnb-4bit

Text Generation • Updated Mar 16, 2024 • 14 • 1

unsloth/mistral-7b-v0.2-bnb-4bit

Text Generation • Updated Sep 11, 2024 • 205 • 13

unsloth/mistral-7b-v0.2

Text Generation • Updated Sep 11, 2024 • 1.77k • 23

alokabhishek/Llama-2-7b-chat-hf-bnb-8bit

Text Generation • Updated Apr 2, 2024 • 28 • 2

alokabhishek/Mistral-7B-Instruct-v0.2-bnb-8bit

Text Generation • Updated Apr 2, 2024 • 11 • 2

unsloth/gemma-1.1-2b-it

Text Generation • Updated Sep 3, 2024 • 2.7k • 1

unsloth/gemma-1.1-2b-it-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 1.48k • 4

unsloth/gemma-1.1-7b-it-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 331 • 2

unsloth/gemma-1.1-7b-it

Text Generation • Updated Sep 3, 2024 • 70