What to vote when quality of generation is equal or both are bad?

#22
by MoritzLaurer HF staff - opened

I really like the space!
It could be good to add two more options for voting: "equally good/tie" and "both are bad" like in the chatbot arena: https://lmarena.ai/
I'm currently not sure what to vote in these cases

Thanks!

Then I'd advise skipping them. I might add a skip button.

The reason I do not want to add the suggested buttons is because the Arena was attacked once. The suggested options would make things easier for attackers and damage the dataset.
https://huggingface.co/datasets/Pendrokar/TTS_Arena/discussions/2

Maybe the buttons could be made available to non-cached samples. But I have no clue how many times do visitors have the patience to wait for synthesis. It is much slower than the original Arena.

Sign up or log in to comment