LMSys Overall Leaderboard

Stay effortlessly current with the best general-purpose AI models. This mix automatically utilizes the top-ranked models from the LMSys Chatbot Arena's overall leaderboard, ensuring you always have access to the most capable AI for a wide range of tasks.

Updated Sep 9$4.45/M input tokens$13.34/M output tokensGithubGitHub

API

Example

Models

This mix uses the models below:

OpenAI Icon

chatgpt-4o-latest

Provided by multiple sources

Google Gemini Icon

gemini-1.5-pro-exp-0827

Provided by multiple sources

OpenAI Icon

gpt-4o-2024-05-13

Provided by multiple sources

Google Gemini Icon

gemini-1.5-pro-exp-0801

Provided by multiple sources

Google Gemini Icon

gemini-1.5-pro-002

Provided by multiple sources

OpenAI Icon

gpt-4o-mini

Provided by multiple sources

Readme

LMSys Overall Leaderboard

This mix is based on the top models ranked in the LMSys Chatbot Arena for the Overall category. The weight is a function of the Elo score adjusted for number of votes and variance. Models with more consistently high votes will be weighed more heavily.

Note: o1-mini and o1-preview are not included in this mix because they do not support system prompts and other parameters.

Categories

  • 💬 General
  • 🏆 Leaderboard

Composition

This mix produces responses from the following models:

ModelWeight %
"chatgpt-4o-latest"50.26%
"gemini-1.5-pro-exp-0827"13.56%
"gpt-4o-2024-05-13"12.93%
"gemini-1.5-pro-exp-0801"11.56%
"gemini-1.5-pro-002"9.03%
"gpt-4o-mini"2.66%

Update Frequency: Based on LMSys (every few weeks) Source: https://lmarena.ai/