kierarkia's picture
Create README.md
b2968f1 verified
metadata
license: apache-2.0
tags:
  - imatrix
  - gguf
  - internlm3
  - conversational

Llamacpp imatrix Quantizations of InternLM3-8B-Instruct

Original model: https://huggingface.co/internlm/internlm3-8b-instruct

All quants made using imatrix option with dataset from https://gist.github.com/bartowski1182/eb213dccb3571f863da82e99418f81e8