Gecko Tests · World MapLatest run 2026-10-03 · 5 models · 1800 points each · in progress: Grok 4.7, Mistral Large, DeepSeek V4 Pro

How AI Models Imagine the World · Land or Water

We asked each model, one coordinate at a time, whether the point is land or water. No maps, no tools, just what the model learned from text. Pink cells are mistakes.

In plain wordsWe ask each AI, point by point, if a place on Earth is land or water, with no map to look at. Then we draw its answers. A good model draws the real world; pink shows where it gets it wrong.

Reality · Natural Earth
#ModelAccuracyLandWater
1Gemini 3.8 Flash
Google
97.4%97.2%97.4%
2GPT-6 Luna
OpenAI
96.2%94.6%95.7%
3MiniMax M3
MiniMax
92.8%89.9%94.0%
4GLM 5.3 Flash
Zhipu AI
89.7%91.4%88.7%
5Llama 4 Maverick
Meta
79.2%60.2%89.0%
Gemini 3.8 Flash97.4%
2026-10-03 · 1798/1800 answered
GPT-6 Luna96.2%
2026-10-03 · 1783/1800 answered
MiniMax M392.8%
2026-10-03 · 1797/1800 answered
GLM 5.3 Flash89.7%
2026-10-03 · 1799/1800 answered
Llama 4 Maverick79.2%
2026-10-03 · 1800/1800 answered

Green · land answered correctly. Pink fill · answered land where it is water. Pink outline · answered water where it is land. Grey · no answer. Prompt: “Is the point at latitude {lat}, longitude {lon} on land or in water? Answer with exactly one word: Land or Water.”

How to cite · data as of 2026-10-03

BenchGecko Gecko Tests, World Map. BenchGecko, data as of 2026-10-03. https://benchgecko.ai/gecko-tests/world-map

BenchGecko measures this data itself: free to reuse under CC BY 4.0 with the credit "Source: BenchGecko" and a link. JSON · llms.txt · MCP

Each model is asked "Is the point at latitude X, longitude Y on land or in water?" for every cell centre of a 6° grid (1800 points), one question per request, temperature 0, minimal reasoning. Answers are drawn as a map and compared with Natural Earth 1:110m land polygons.