unsloth
/

gemma-2-27b-it-bnb-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Resources

View closed (0)

Aphrodite/VLLM/SGLang all refuse to load this model

#5 opened 6 months ago by

Dealing with the split safetensor files

#4 opened 6 months ago by

How to create gguf fromm this

#3 opened 7 months ago by

hidden state is nan

#2 opened 7 months ago by

whats the best tool to run this model

#1 opened 8 months ago by