LMSys Overall Leaderboard

Stay effortlessly current with the best general-purpose AI models. This mix automatically utilizes the top-ranked models from the LMSys Chatbot Arena's overall leaderboard, ensuring you always have access to the most capable AI for a wide range of tasks.

Updated Sep 9$4.55/M tokens$13.65/M tokensGithubGitHub

API

Example

Models

This mix uses the models below:

OpenAI Icon

chatgpt-4o-latest

Provided by multiple sources

Google Gemini Icon

gemini-1.5-pro-exp-0827

Provided by multiple sources

Google Gemini Icon

gemini-1.5-pro-exp-0801

Provided by multiple sources

OpenAI Icon

gpt-4o-2024-05-13

Provided by multiple sources

Readme

LMSys Overall Leaderboard

This mix is based on the top coding models ranked in the LMSys Chatbot Arena for the Overall category. The weight is a function of the Elo score adjusted for number of votes and variance. Models with more consistently high votes will be weighed more heavily.

Composition

This mix produces responses from the following models:

Model NameWeight %
chatgpt-4o-latest22.51%
gemini-1.5-pro-exp-082721.54%
gemini-1.5-pro-exp-080123.79%
gpt-4o-2024-05-1332.15%

Update Frequency: Based on LMSys (every few weeks) Source: https://lmarena.ai/