DarkForest 20B v2.0

Runs smoothly on single 3090 in webui with context length set to 4096, ExLlamav2_HF loader and cache_8bit=True

All comments are greatly appreciated, download, test and if you appreciate my work, consider buying me my fuel:

Inference Providers NEW

This model is not currently available via any of the supported Inference Providers.

Collection including TeeZee/DarkForest-20B-v2.0-bpw4.0-h6-exl2