Top Chat Models

Optimized for extended conversations, this mix utilizes top-performing models in multi-turn interactions. It leverages the LMSys Chatbot Arena rankings for conversations with two or more turns, ensuring high-quality responses in longer dialogues.

Updated Sep 9$4.54/M input tokens$14.38/M output tokensGithubGitHub

API

Example

Models

This mix uses the models below:

OpenAI Icon

chatgpt-4o-latest

Provided by multiple sources

OpenAI Icon

gpt-4o-2024-05-13

Provided by multiple sources

Anthropic Icon

claude-3-5-sonnet-20240620

Provided by multiple sources

Google Gemini Icon

gemini-1.5-pro-exp-0827

Provided by multiple sources

Google Gemini Icon

gemini-1.5-pro-exp-0801

Provided by multiple sources

Google Gemini Icon

gemini-1.5-pro-002

Provided by multiple sources

Readme

Top Chat Models (LMSys)

Optimized for extended conversations, this mix utilizes top-performing models in multi-turn interactions. It leverages the LMSys Chatbot Arena rankings for conversations with two or more turns, ensuring high-quality responses in longer dialogues. The weight is a function of the Elo score adjusted for number of votes and variance. Models with more consistently high votes will be weighed more heavily.

Categories

  • 💬 General
  • 🏆 Leaderboard
  • 🧠 Reasoning

Composition

This mix produces responses from the following models:

ModelWeight %
"chatgpt-4o-latest"53.92%
"gpt-4o-2024-05-13"13.39%
"claude-3-5-sonnet-20240620"12.67%
"gemini-1.5-pro-exp-0827"9.09%
"gemini-1.5-pro-exp-0801"8.13%
"gemini-1.5-pro-002"2.80%

Update Frequency: Based on LMSys Source: https://lmarena.ai/