LMSys Spanish (LMSys Leaderboard)

A mix that picks the highest-ranked model for Spanish prompts, based on LMSYS Spanish Leaderboard.

Updated Oct 10$4.20/M input tokens$13.23/M output tokensGithubGitHub

API

Example

Models

This mix uses the models below:

OpenAI Icon

chatgpt-4o-latest

Provided by multiple sources

Google Gemini Icon

gemini-1.5-pro-exp-0827

Provided by multiple sources

Google Gemini Icon

gemini-1.5-pro-exp-0801

Provided by multiple sources

Anthropic Icon

claude-3-5-sonnet-20240620

Provided by multiple sources

Google Gemini Icon

gemini-1.5-pro-002

Provided by multiple sources

OpenAI Icon

gpt-4o-mini

Provided by multiple sources

Readme

LMSys Spanish

This mix picks the highest-ranked model for Spanish prompts, based on LMSys Spanish Leaderboard.

Categories

  • 💬 General
  • 🏆 Leaderboard
  • 🗣️ Multilingual

Composition

This mix produces responses from the following models:

ModelWeight %
"chatgpt-4o-latest"50.46%
"gemini-1.5-pro-exp-0827"18.63%
"gemini-1.5-pro-exp-0801"11.25%
"claude-3-5-sonnet-20240620"10.37%
"gemini-1.5-pro-002"6.63%
"gpt-4o-mini"2.66%