Gemini 3 when?

[pauljones0]

I'm curious if/when Gemini 3 will be added.

Or if I run through the whole gauntlet (unknown costs) will my results be added to the main webpage? Or is that restricted access?

[john-b-yang]

Working on it! We're currently trying to figure out how to make CodeClash a bit more cost accessible, amongst many things. After all, running against all models across all arenas costs quite a bit.

We'll post more updates in the very near future here. Here's the options we're currently exploring:

• Make it easier for community contribution. People can run CodeClash for (model 1, model 2, arena) tournaments they want to see, and we add the results to the leaderboard.
• See if there are correlations between overall Elo and win rate against a specific model, like what AlpacaEval did.
• Reduce cost of running a tournament (e.g., fewer rounds)

Options 1 and 2 are very likely what we're going to move towards, but will follow up here with a more concrete solution when we settle upon one!

[pauljones0]

Thank you :D