LMSys Overall Leaderboard

A mix indexed on the top models in the LMSYS leaderboard. Models with a higher score and more consistent votes will be selected more often.

Updated Aug 13$4.42/M tokens$13.25/M tokensGithubGitHub

API

Example

import OpenAI from 'openai'


const openai = new OpenAI({
  baseURL: "https://api.crosshatch.app/v1",
  apiKey: "your_api_key_here"
})


const completion = await openai.chat.completions({
  model: "lmsys-overall",
  messages: [
    {
      role: "user",
      content: "Hello there"
    }
  ]
})

Models

This mix uses the models below:

OpenAI Icon

chatgpt-4o-latest

Provided by openai

Google Gemini Icon

gemini-1.5-pro-exp-0827

Provided by google

Google Gemini Icon

gemini-1.5-pro-exp-0801

Provided by google

OpenAI Icon

gpt-4o-2024-05-13

Provided by openai

Readme

LMSys Overall Leaderboard Mix

This mix is based on the top coding models ranked in the LMSys Chatbot Arena for the Overall category. The weight is a function of the Elo score adjusted for number of votes and variance. Models with more consistently high votes will be weighed more heavily.

Composition

This mix produces responses from the following models:

Model NameWeight %
chatgpt-4o-latest22.51%
gemini-1.5-pro-exp-082721.54%
gemini-1.5-pro-exp-080123.79%
gpt-4o-2024-05-1332.15%

Update Frequency: Based on LMSys (every few weeks)