tons of models are stuck in the queue

#1093
by Xiaojian9992024 - opened

One model decided to take an extended vacation inside the queue, and now 20+ of its friends are stuck behind it, honking their virtual horns. Looks like our queue needs a traffic cop...or maybe just a bigger eject button.

please reset the queue, we don't want these models stuck.

gscreenshot_2025-02-07-215418.png

Feels like an Ethereum transaction.

Most likely gpus are busy on different task, or they can't fix cuda problem they have with some models. And where get information wtf is going on is unknown.

Open LLM Leaderboard org

Hi!
We are running on the spare cycle of the cluster, which means that if cool research experiments are running (like open r1, open deepresearch, smolLMs, etc), the leaderboard just waits for the more important xps to run. This is a normal behavior and documented

clefourrier changed discussion status to closed
Open LLM Leaderboard org

And it's unrelated to previous model evaluations, all evals are independant

All good! Thanks for the update!

Sign up or log in to comment