ikawrakow
/

mistral-7b-quantized-gguf

Inference Endpoints

Model card Files Files and versions Community

mistral-7b-quantized-gguf / mistral-7b-q2k-extra-small.gguf

Commit History

Adding 2-bit and large 5-bit quants

86ea5c5

ikawrakow commited on Dec 7, 2023