(A follow-up to "The Scholar System Is a Global Labor Market.")
Last time I argued the scholar system is a global labor market hiding in plain sight — and that the one thing still missing everywhere is a trustworthy way to measure human skill. This post is about why that measurement is about to get much harder for everyone, not just for games — and the one move that solves it.
For all of history, if you wanted to know how good someone was, you looked at what they produced. The essay. The spreadsheet. The win.
That worked because the result was the proof. A polished essay meant a capable writer. You couldn't hit the mark without the skill.
That bargain is over. Generative AI hands a competent result to anyone who asks. Twenty years ago, spelling every word correctly quietly signaled "educated." Then spell-check did it for everybody, and spelling stopped saying anything about you at all. When everyone has a calculator, getting the arithmetic right tells you nothing.
The pattern to hold onto: the moment a tool can produce a given result for everyone, that result stops being evidence about the person. A passing grade, a clean report, a decent win rate — if a machine can reach it on its own, reaching it tells you nothing about the human who turned it in.
Here's the tempting wrong turn: "if AI fakes the output, stop scoring results and just watch how people work." That's backwards. Results are still the point — a labor market pays for results, not for effort. The problem was never that we measured outcomes. The problem is the baseline we measured them against.
A rising tide lifts all the boats. AI raised the baseline result everyone can reach. Measuring someone's raw result against zero now measures the tide, not the sailor. You have to measure against the new waterline — the result a machine reaches on its own.
This is the whole idea, and it's the one move that matters:
Measure the outcome. Find the level a machine — a bot, a model, pure automation — reaches by itself. That level is the noise. The human signal is everything above it.
Noise-cancelling headphones do exactly this. They measure the sound everyone in the room is hearing and subtract precisely that — and the one voice you actually care about is whatever's left. The machine's result is the ambient noise: every automated player produces it. Subtract it, and what remains — the margin above the machine's own win rate — is the human.
Not the win. The win rate above the rate a machine gets on its own. Below that line is noise the machine already explains. Above it is the only thing a human added.
This part isn't even new. It's the oldest rule in labor, just sharpened.
Give a hundred people the same camera and one of them still takes the photo that stops you cold. Same tool, different human — and that difference is the value. We never paid for "can operate the camera." We paid for the gap between this person with the camera and the average person holding the exact same one.
AI is simply the most powerful tool that gap has ever been measured across. So the question capital is really asking isn't "human or machine?" It's: does this human, using AI, beat AI working alone — and beat the average person using the very same AI? For a stretch in chess, a sharp player steering an engine could beat the engine by itself — the human supplied something the machine couldn't generate on its own. That's the whole prize. Not the person who can run the tool; anyone can run the tool. The person who runs it better than it runs itself.
So where does watching the behavior — the live, decision-by-decision play — come in? It's essential, but it's the supporting evidence, not the headline.
An above-the-machine result raises two fair questions: was it luck, and was there even a human involved? Behavior answers both. The recorded, replayable decision trail is the receipts — the black box on the aircraft, the game tape the coach studies after the win. Not the thing you score, but the proof the score was earned, by a person, under pressure, and not handed over by a script.
The outcome above the machine's bar tells you that a human added something. The behavior trail tells you it was real. One is the signal; the other is the chain of custody.
Here's the part almost nobody clocks. Splinterlands has a quiet design goal: stay genuinely, stubbornly hard. And a game that's hard for skilled humans is, by definition, hard for machines too.
Think about why. A machine dominates a solved game — tic-tac-toe, checkers — because there's a fixed answer to memorize. What breaks automation is a game that refuses to sit still: rulesets that change every match, a meta that keeps moving, hidden information, no dominant line you can lock in and farm forever. Splinterlands is built that way on purpose. If a human can't coast on a memorized playbook, neither can a script.
That difficulty isn't a side effect. It's the moat — and it's also what makes the measurement work. The harder the game is to automate, the wider and more honest the gap between the machine's bar and what a real human reaches above it. A hard game is a precise instrument for measuring that gap; an easy one is just noise. So Splinterlands isn't an awkward place to measure human skill against AI — it's close to the ideal one:
The AI-mediated economy will need exactly this measurement everywhere. When a model writes the report, ships the code, and drafts the contract, the result alone proves nothing — the model can reach a competent result by itself. "They did a good job" will increasingly mean "the tool did a good job." Every labor market on earth is about to face the question Splinterlands lets us answer now:
Measure the outcome. Subtract what a machine reaches on its own. What clears that bar — the human who beats the tool instead of merely running it — is the signal. The behavior trail proves it was earned.
That margin above the machine is the one thing still worth paying a premium for. Splinterlands makes it large, honest, and impossible to fake — which is exactly why it gets proven here first, then travels everywhere work is done with a machine in the loop.
That's the real superpower. 🛡️
