BenchLMirror

BenchLM Mirror

πŸ‡¬πŸ‡§ English Β· [πŸ‡·πŸ‡Ί Русский](/README.ru.html) Β· [πŸ‡¨πŸ‡³ δΈ­ζ–‡](/README.zh.html) Β· [πŸ‡ͺπŸ‡Έ EspaΓ±ol](/README.es.html) Β· [πŸ‡©πŸ‡ͺ Deutsch](/README.de.html) Β· [πŸ‡«πŸ‡· FranΓ§ais](/README.fr.html) Β· [πŸ‡―πŸ‡΅ ζ—₯本θͺž](/README.ja.html) Β· [πŸ‡°πŸ‡· ν•œκ΅­μ–΄](/README.ko.html)

An automatically updated mirror of public BenchLM data.

Updates Source Files


🎯 Why?

BenchLM provides data about AI models, including rankings, benchmarks, prices, speed, and comparison results.

This repository is designed as a simple and convenient mirror of this data for use in third-party projects.

What can you do?

The repository can therefore be used as a simple source of BenchLM data for websites, applications, bots, analytics tools, and other projects.


πŸ“Š Data

File Description Raw
models.json Information about AI models Open
leaderboard.json Model rankings Open
benchmarks.json Benchmark information Open
pricing.json Model pricing Open
speed.json Model speed and performance Open
comparisons.json Model comparisons Open

πŸ”— Quick Access

All data is located in the data/ directory.

GitHub Raw

For example, models.json:

https://raw.githubusercontent.com/seregannj/benchlmirror/main/data/models.json

Other files are available at similar URLs:

https://raw.githubusercontent.com/seregannj/benchlmirror/main/data/leaderboard.json
https://raw.githubusercontent.com/seregannj/benchlmirror/main/data/benchmarks.json
https://raw.githubusercontent.com/seregannj/benchlmirror/main/data/pricing.json
https://raw.githubusercontent.com/seregannj/benchlmirror/main/data/speed.json
https://raw.githubusercontent.com/seregannj/benchlmirror/main/data/comparisons.json

GitHub API

Files can also be retrieved through the GitHub Contents API:

https://api.github.com/repos/seregannj/benchlmirror/contents/data/models.json

⚠️ When using the GitHub API, be aware of its limitations and terms of use.


πŸ’» Usage

Python

import requests

url = "https://raw.githubusercontent.com/seregannj/benchlmirror/main/data/models.json"

response = requests.get(url)
response.raise_for_status()

data = response.json()

print(data)

JavaScript

const response = await fetch(
  "https://raw.githubusercontent.com/seregannj/benchlmirror/main/data/models.json"
);

if (!response.ok) {
  throw new Error(`HTTP ${response.status}`);
}

const data = await response.json();

console.log(data);

cURL

curl -L https://raw.githubusercontent.com/seregannj/benchlmirror/main/data/models.json

πŸ”„ Automatic Updates

Data is automatically downloaded from BenchLM once a day using GitHub Actions.

Update process:

BenchLM
   ↓
JSON download
   ↓
File validation
   ↓
JSON validation
   ↓
data/
   ↓
Git commit

If a file fails to download, the previous version is not replaced.

Updates can also be triggered manually from the Actions tab.


πŸ• Change History

All file changes are preserved in Git history.

This makes it possible to:

The change history is available in the repository’s Commits tab.


πŸ“ Structure

benchlmirror/
β”‚
β”œβ”€β”€ data/
β”‚   β”œβ”€β”€ models.json
β”‚   β”œβ”€β”€ leaderboard.json
β”‚   β”œβ”€β”€ benchmarks.json
β”‚   β”œβ”€β”€ pricing.json
β”‚   β”œβ”€β”€ speed.json
β”‚   └── comparisons.json
β”‚
β”œβ”€β”€ .github/
β”‚   └── workflows/
β”‚
β”œβ”€β”€ LICENSE
β”œβ”€β”€ README.md
└── README.ru.md

πŸ”— Source

Data source:

BenchLM

This repository is an independent mirror and is not directly affiliated with BenchLM.


βš–οΈ License and Data

The code and configuration of this repository are distributed under the MIT License.

The mirrored data belongs to its original source.

The MIT License does not automatically apply to BenchLM data.

Before using the data, review the terms and requirements of its original source.


Data from BenchLM [BenchLM](https://benchlm.ai/) Β· [GitHub](https://github.com/seregannj/benchlmirror) Β· [Data Source](https://benchlm.ai/data)