LMSys Japanese (LMSys Leaderboard)

A mix that picks the highest-ranked model for Japanese prompts, based on LMSYS Japanese Leaderboard.

Updated Oct 10$4.39/M input tokens$13.17/M output tokensGithubGitHub

API

Example

Models

This mix uses the models below:

OpenAI Icon

chatgpt-4o-latest

Provided by multiple sources

Google Gemini Icon

gemini-1.5-pro-exp-0801

Provided by multiple sources

Google Gemini Icon

gemini-1.5-pro-exp-0827

Provided by multiple sources

Google Gemini Icon

gemini-1.5-pro-002

Provided by multiple sources

OpenAI Icon

gpt-4o-2024-05-13

Provided by multiple sources

Readme

LMSys Japanese

This mix picks the highest-ranked model for Japanese prompts, based on LMSys Japanese Leaderboard.

Categories

  • 💬 General
  • 🏆 Leaderboard
  • 🗣️ Multilingual

Composition

This mix produces responses from the following models:

ModelWeight %
"chatgpt-4o-latest"50.28%
"gemini-1.5-pro-exp-0801"18.48%
"gemini-1.5-pro-exp-0827"16.95%
"gemini-1.5-pro-002"10.90%
"gpt-4o-2024-05-13"3.39%