Hugging Face's logo

Spaces:
open-llm-leaderboard
/
open_llm_leaderboard
Running on CPU Upgrade

App Files Community
1079

[FLAG] Suspiciously high MMLU score for LoKuS-13B

#245
by llama-anon - opened
Discussion
llama-anon

image.png

https://huggingface.co/JoSw-14/LoKuS-13B

Chat-Error

In the config
"_name_or_path": "/root/.cache/huggingface/hub/models--Aspik101--trurl-2-13b-pl-instruct_unload/snapshots/17f57642165e30a4025d6817bd47dcd80d0c5c4d",
Another trurl-2 merge, explain the high MMLU

Q-bert
This comment has been hidden
JoSw-14

This wan as experimantal test so feel free to delete the model from leaderboard

clefourrier
 Open LLM Leaderboard org

Hi @JoSw-14 , thank you for your comment! I removed the model from the leaderboard!

clefourrier changed discussion status to closed

Sign up or log in to comment