BenchmarksReading · ~3 min · 30 words deep

WeirdML

WeirdML is a coding benchmark tracked on BenchGecko. Unusual and adversarial machine learning challenges. Tests robustness of reasoning about edge cases in ML systems.

Built from BenchGecko data as of October 2, 2026 · updates when the data changes

WeirdML leaderboard
TL;DR

WeirdML is a coding benchmark tracked on BenchGecko. Unusual and adversarial machine learning challenges. Tests robustness of reasoning about edge cases in ML systems.

Live data · updated daily
See full leaderboard
Level 1

Unusual and adversarial machine learning challenges. Tests robustness of reasoning about edge cases in ML systems.

Level 2

Scores are reported (%, maximum 100); higher is better. BenchGecko collects WeirdML scores from Epoch AI and refreshes them daily; the leaderboard on this page shows the current top models.

Level 3

Compare models only on the same benchmark version and settings. A benchmark separates models well while scores are spread out; when top models bunch together near the maximum, it stops telling them apart.

The takeaway for you
If you are a
Researcher
  • ·coding benchmark (%, maximum 100)
  • ·Source: Epoch AI
If you are a
Builder
  • ·Useful if your workload is coding
  • ·Check the live leaderboard on /benchmark/weirdml before choosing a model
If you are a
Investor
  • ·Labs cite benchmark results in launch announcements; check the source and version
If you are a
Curious · Normie
  • ·WeirdML is a test of how good an AI is at coding
  • ·A higher score means better results on that kind of task
Unusual and adversarial machine learning challenges. Tests robustness of reasoning about edge cases in ML systems.