Open the World Politics map and click any country: you get a score from 1 (far left) to 5 (far right) for whoever governs it right now, plus a confidence number and the probability of each level. The judge is Jev, an AI built for exactly this kind of verdict — fed each country's facts and a description of who rules it — and the whole thing runs as one self-contained page with a JSON feed behind it.
The method is where the honesty lives. Each country gets three separate questions — economic policy, cultural policy, and overall regime identity — and the headline score is a direct judgment, not an average. Averaging was tried and reverted: it mushes one-party states and theocracies into a meaningless middle. Places that cannot fairly be rated — Antarctica, Guantánamo, active war zones — are left blank rather than guessed at, and the low-confidence queue (military juntas, micro-territories, fragile coalitions) is published as-is. The ratings check out against twenty-one hand-labeled test cases, all passing.
Students: this is how to use AI as a judge properly — grounded facts in, probabilities out, a validation set, and NULL wherever the honest answer is “we don't know”. Hiring managers: quantified judgment under ambiguity, with uncertainty displayed instead of smoothed over, is decision-grade work — and the map doubles as a live demo of it.
No comments yet