TheBloke
/

WizardLM-30B-Uncensored-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Resources

View closed (4)

Adding Evaluation Results

#15 opened over 1 year ago by

leaderboard-pr-bot

is it possible to use a continuous batching inference server with this model?

#14 opened over 1 year ago by

Can the model be sharded over several GPUs?

#13 opened over 1 year ago by

Works well on a 3090 ! Insane good !

#11 opened almost 2 years ago by

Anyone has been successful in deploying this to Sagemaker or so?

#9 opened almost 2 years ago by

Model exits in Windows Booga

#8 opened almost 2 years ago by

Model Performance Curiosity

#7 opened almost 2 years ago by

Have a problem with rtx4090

#6 opened almost 2 years ago by

i got messy code

#3 opened almost 2 years ago by

Will this work with the Local LLMs One-Click UI runpod?

#2 opened almost 2 years ago by

How much vram+ram 30B needs? I have 3060 12gb + 32gb ram.

#1 opened almost 2 years ago by