neuralmagic/granite-3.1-8b-instruct-quantized.w4a16
Text Generation
•
Updated
•
175
•
1
Edit Models filters
Inference Providers
Active filters:
w4a16
neuralmagic/whisper-large-v2-W4A16-G128
Automatic Speech Recognition
•
Updated
•
38
•
1
nm-testing/whisper-large-v3.w4a16
Automatic Speech Recognition
•
Updated
•
14
•
1
nm-testing/Qwen2-VL-72B-Instruct-FP8-dynamic
Image-Text-to-Text
•
Updated
•
934
neuralmagic/granite-3.1-2b-instruct-quantized.w4a16
Text Generation
•
Updated
•
183
neuralmagic/granite-3.1-2b-base-quantized.w4a16
Text Generation
•
Updated
•
62
neuralmagic/granite-3.1-8b-base-quantized.w4a16
Text Generation
•
Updated
•
42
nm-testing/Qwen2-VL-72B-Instruct-quantized.w4a16
Image-Text-to-Text
•
Updated
•
438
neuralmagic/Phi-3-vision-128k-instruct-W4A16-G128
Text Generation
•
Updated
•
249
•
1
nm-testing/Pixtral-Large-Instruct-2411-hf-quantized.w4a16
Image-Text-to-Text
•
Updated
•
267
nm-testing/Qwen2.5-VL-7B-Instruct-quantized.w4a16
Image-Text-to-Text
•
Updated
•
369
nm-testing/Qwen2.5-VL-3B-Instruct-quantized.w4a16
Image-Text-to-Text
•
Updated
•
411
nm-testing/Qwen2.5-VL-72B-Instruct-quantized.w4a16
Image-Text-to-Text
•
Updated
•
740
nm-testing/pixtral-12b-quantized.w4a16
Image-Text-to-Text
•
Updated
•
212
neuralmagic/Llama-3.2-11B-Vision-Instruct-quantized.w4a16
Image-Text-to-Text
•
Updated
•
295