Quantizer Tool

#14
by TobDeBer - opened

Are there any plans to publish the dynamic quant quantizer tool or is this considered proprietary IP?
I'd be interested to apply the process to a few other models.

It is already published here: https://github.com/unslothai/llama.cpp

Thank you very much. That's good news.

TobDeBer changed discussion status to closed

Sign up or log in to comment