Benchmarks

The benchmarks Tokscale tracks, grouped by what they test. Each one keeps its own unit, source and license. Tokscale does not combine them into one score.

12 benchmarks with results, 1 linked onlyFrom Epoch AI, LMArena, Terminal-BenchRetrieved Oct 21, 2026

Overall

1 benchmark
  • Combines scores from many benchmarks into one general capability scale, so models can be compared even after single benchmarks saturate.

    Unit
    ECI
    Models
    160 matched270 in the source
    Last update
    Oct 15, 2026Newest model releaseRetrieved Oct 21, 2026

Agentic coding

5 benchmarks
  • Agents work on tasks inside a terminal. The score is the share of tasks resolved, with a 95% confidence interval.

    Unit
    % resolved
    Models
    23 matched23 in the source
    Last update
    Oct 6, 2026Newest publish dateRetrieved Oct 21, 2026
    License
    Terms not stated
  • SWE-Bench Pro V2Link only

    Long-horizon software engineering tasks in public open-source repositories. V2 is a refreshed public split of 642 tasks with a locked evaluation protocol (Scale AI, September 22, 2026).

    Results not republished. Open the leaderboard on Scale AI's site.

    Open the SWE-Bench Pro V2 leaderboard (opens in a new tab)
    Unit
    % resolved
    Models
    Not republishedResults stay on the source site
    Last update
    —See the leaderboard
    License
    Leaderboard: all rights reserved (Scale AI)
  • Cursor evaluates agents on ambiguous, multi-file tasks taken from real Cursor sessions.

    Unit
    score
    Models
    18 matched18 in the source
    Last update
    Oct 12, 2026Newest model releaseRetrieved Oct 21, 2026
  • Coding agents on original, long-horizon software engineering tasks. The score is pass@1.

    Unit
    pass@1
    Models
    26 matched26 in the source
    Last update
    Sep 3, 2026Newest model releaseRetrieved Oct 21, 2026
  • Very long software engineering tasks at the edge of human ability. The score is the mean of five trials per task.

    Unit
    mean@5
    Models
    21 matched21 in the source
    Last update
    Oct 7, 2026Newest model releaseRetrieved Oct 21, 2026

Web development

1 benchmark
  • Human preference for web development: people compare what two anonymous models build for the same prompt and vote. Scores are Bradley-Terry ratings with 95% confidence intervals.

    Unit
    Arena score
    Models
    110 matched129 in the source
    Last update
    Oct 19, 2026Newest publish dateRetrieved Oct 21, 2026

Agents

1 benchmark
  • Signals from real agent sessions on Arena (task success, user feedback, tool errors) turned into an estimated net improvement per orchestrator model, with 95% confidence intervals.

    Unit
    net improvement
    Models
    48 matched51 in the source
    Last update
    Oct 19, 2026Newest publish dateRetrieved Oct 21, 2026

Reasoning

3 benchmarks
  • Hard multiple-choice questions in biology, chemistry and physics, written by PhD-level experts.

    Near its ceiling: the top score is 96.4%, and Epoch AI estimates the reachable maximum at 97%. Differences between top models are small.

    Unit
    % correct
    Models
    151 matched224 in the source
    Last update
    Oct 15, 2026Newest run dateRetrieved Oct 21, 2026
  • 2,500 expert-written questions across more than 100 academic subjects that need deep, specialised knowledge.

    Unit
    % correct
    Models
    40 matched46 in the source
    Last update
    Oct 7, 2026Newest model releaseRetrieved Oct 21, 2026
  • Expert-written math problems from advanced undergraduate level to early career research.

    Near its ceiling: the top score is 93.7%, and Epoch AI estimates the reachable maximum at 95%. Differences between top models are small.

    Unit
    % solved
    Models
    86 matched87 in the source
    Last update
    Oct 15, 2026Newest run dateRetrieved Oct 21, 2026

Knowledge

1 benchmark
  • 1,000 short factual questions about politics, science and technology, art, sports, geography, music and more.

    Unit
    % correct
    Models
    80 matched82 in the source
    Last update
    Oct 15, 2026Newest run dateRetrieved Oct 21, 2026

History

1 benchmark
  • GitHub issues from real Python repositories: can the model write a valid fix?

    History only. Newer agentic coding benchmarks are on the main board.

    Unit
    % resolved
    Models
    32 matched32 in the source
    Last update
    Jun 25, 2026Newest run dateRetrieved Oct 21, 2026