What is this?
#1
by
vdruts
- opened
LOL. What is this based on?
Updated the model card with more info. Err.. apologies.
GPTQ 4bit planned?
edit: found it here
https://huggingface.co/Aeala/GPT4-x-AlpacaDente-30b-4bit
Hmm, can't seem to load it in Ooba with the latest GPTQ
GPTQ 4bit planned?
edit: found it here
https://huggingface.co/Aeala/GPT4-x-AlpacaDente-30b-4bit
That's a different version. It's pretty good. I'll also upload 4bit shortly.
Here you go. https://huggingface.co/MetaIX/GPT4-X-Alpasta-30b-4bit/tree/main Uploading 128g/ggml q4_1+2+3 soon