Top Non-Commercial Coding Models
The best non-commercial coding models according to the LMSys leaderboard. This mix will use the top coding models ranked in the LMSys Chatbot Arena for the Coding category without any proprietary models.
API
Example
Models
This mix uses the models below:
meta-llama/Meta-Llama-3.1-405B-Instruct
Provided by multiple sources
mistralai/large-2
Provided by multiple sources
meta-llama/Meta-Llama-3.1-70B-Instruct
Provided by multiple sources
deepseek-chat
Provided by multiple sources
Readme
##Top Non-Commercial Coding Models (LMSys)
The best non-proprietary coding models according to the LMSys leaderboard. This mix will use the top coding models ranked in the LMSys Chatbot Arena for the Coding category without any proprietary models. The weight is a function of the Elo score adjusted for number of votes and variance. Models with more consistently high votes will be weighed more heavily.
Composition
This mix produces responses from the following models:
| Model | Weight % |
|---|---|
| "llama-3.1-405b-instruct" | 46.14% |
| "mistral-large-2407" | 30.74% |
| "llama-3.1-70b-instruct" | 18.92% |
| "deepseek-v2-api-0628" | 4.20% |
Update Frequency: Based on (every few weeks) Source: https://lmarena.ai/