Top Non-Commercial Coding Models

The best non-commercial coding models according to the LMSys leaderboard. This mix will use the top coding models ranked in the LMSys Chatbot Arena for the Coding category without any proprietary models.

Updated Aug 13$2.44/M input tokens$2.67/M output tokensGithubGitHub

API

Example

Models

This mix uses the models below:

Meta Logo Facebook Icon

meta-llama/Meta-Llama-3.1-405B-Instruct

Provided by multiple sources

DE

deepseek-chat

Provided by multiple sources

QW

Qwen/Qwen2.5-72B-Instruct

Provided by multiple sources

MI

mistralai/large-2

Provided by multiple sources

Readme

Top Non-Commercial Coding Models (LMSys)

The best non-proprietary coding models according to the LMSys leaderboard. This mix will use the top coding models ranked in the LMSys Chatbot Arena for the Coding category without any proprietary models. The weight is a function of the Elo score adjusted for number of votes and variance. Models with more consistently high votes will be weighed more heavily.

Categories

  • 👩🏽‍💻 Coding
  • 🏆 Leaderboard
  • 🌐 Open-Source

Composition

This mix produces responses from the following models:

ModelWeight %
"meta-llama/Meta-Llama-3.1-405B-Instruct"61.59%
"deepseek-chat"24.16%
"Qwen/Qwen2.5-72B-Instruct"10.93%
"mistralai/large-2"3.32%

Update Frequency: Based on LMSys (every few weeks)

Source: https://lmarena.ai/