unsloth/phi-4-unsloth-bnb-4bit
Text Generation
•
Updated
•
7.7k
•
24
Unsloth 4-bit Dynamic Quants
Unsloths Dynamic 4bit Quants selectively skips quantizing certain parameters; greatly improving accuracy while only using <10% more VRAM than BnB 4bit
-
-
unsloth/Llama-3.2-11B-Vision-Instruct-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 41.9k • 15 -
unsloth/Qwen2-VL-7B-Instruct-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 15.9k • 7 -
unsloth/Qwen2-VL-2B-Instruct-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 10.4k • 4 -
unsloth/Pixtral-12B-2409-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 3.04k • 3 -
unsloth/QwQ-32B-Preview-unsloth-bnb-4bit
Text Generation • Updated • 890 • 15 -
unsloth/Llama-3.2-11B-Vision-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 756 • 1