Upload README.md with huggingface_hub

README.md

@@ -0,0 +1,30 @@
+---
+library_name: transformers
+pipeline_tag: text-generation
+tags:
+- 24b
+- 3-bit
+- Q3_K_L
+- gguf
+- instruct
+- llama-cpp
+- mistral
+- small
+- text-generation
+---
+
+# roleplaiapp/Mistral-Small-24B-Instruct-2501-Q3_K_L-GGUF
+
+**Repo:** `roleplaiapp/Mistral-Small-24B-Instruct-2501-Q3_K_L-GGUF`
+**Original Model:** `Mistral-Small-24B-Instruct-2501`
+**Quantized File:** `Mistral-Small-24B-Instruct-2501-Q3_K_L.gguf`
+**Quantization:** `GGUF`
+**Quantization Method:** `Q3_K_L`  
+
+## Overview
+This is a GGUF Q3_K_L quantized version of Mistral-Small-24B-Instruct-2501
+## Quantization By
+I often have idle GPUs while building/testing for the RP app, so I put them to use quantizing models.
+I hope the community finds these quantizations useful.
+
+Andrew Webby @ [RolePlai](https://roleplai.app/).