LMSys Overall Leaderboard
A mix indexed on the top models in the LMSYS leaderboard. Models with a higher score and more consistent votes will be selected more often.
API
Example
import OpenAI from 'openai'const openai = new OpenAI({baseURL: "https://api.crosshatch.app/v1",apiKey: "your_api_key_here"})const completion = await openai.chat.completions({model: "lmsys-overall",messages: [{role: "user",content: "Hello there"}]})
Models
This mix uses the models below:
chatgpt-4o-latest
Provided by openai
gemini-1.5-pro-exp-0827
Provided by google
gemini-1.5-pro-exp-0801
Provided by google
gpt-4o-2024-05-13
Provided by openai
Readme
LMSys Overall Leaderboard Mix
This mix is based on the top coding models ranked in the LMSys Chatbot Arena for the Overall category. The weight is a function of the Elo score adjusted for number of votes and variance. Models with more consistently high votes will be weighed more heavily.
Composition
This mix produces responses from the following models:
Model Name | Weight % |
---|---|
chatgpt-4o-latest | 22.51% |
gemini-1.5-pro-exp-0827 | 21.54% |
gemini-1.5-pro-exp-0801 | 23.79% |
gpt-4o-2024-05-13 | 32.15% |
Update Frequency: Based on LMSys (every few weeks)