LMSys Vision

A mix that picks the highest-ranked model for prompts with image attachments, based on LMSYS Vision Leaderboard.

Updated Oct 10$4.94/M input tokens$14.81/M output tokensGithubGitHub

API

Example

Models

This mix uses the models below:

OpenAI Icon

chatgpt-4o-latest-20240903

Provided by multiple sources

Google Gemini Icon

gemini-1.5-pro-exp-0827

Provided by multiple sources

Google Gemini Icon

gemini-1.5-flash-exp-0827

Provided by multiple sources

OpenAI Icon

gpt-4o-2024-05-13

Provided by multiple sources

Readme

LMSys Vision

This mix picks the highest-ranked model for Vision prompts, based on LMSys Vision Leaderboard.

Categories

  • 💬 General
  • 🏆 Leaderboard

Composition

This mix produces responses from the following models:

ModelWeight %
"chatgpt-4o-latest-20240903"52.99%
"gemini-1.5-pro-exp-0827"34.77%
"gemini-1.5-flash-exp-0827"7.42%
"gpt-4o-2024-05-13"4.82%