L3.3-Nevoria-R1-70b - EXL2 6.0bpw
This is a 6.0bpw EXL2 quant of mistralai/Mistral-Small-24B-Base-2501
Details about the model can be found at the above model page.
Perplexity Scoring
Below are the perplexity scores for the EXL2 models. A lower score is better.
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
HF Inference API has been turned off for this model.
Model tree for Dracones/Mistral-Small-24B-Base-2501_exl2_6.0bpw
Base model
mistralai/Mistral-Small-24B-Base-2501