{ "schemaVersion": 1, "id": "where-the-line-was", "title": "Where the line was", "category": "perspectives", "format": "Essay and film", "description": "A 183-year ledger of artificial intelligence's moving finish line, and what changes when AI moves from passing benchmarks to producing formally checkable knowledge.", "canonicalUrl": "https://semiaifoundry.com/updates/where-the-line-was/", "publishedDate": "2026-09-08", "revisionDate": "2026-10-05", "author": "F. M. Cinnor", "topic": "Intelligence and discovery", "series": null, "license": null, "rightsUrl": "https://semiaifoundry.com/terms-of-use/", "version": null, "status": "Published public page", "evidenceScope": null, "contentCoverage": "published-page", "artifactUrl": null, "interactiveUrl": null, "related": [], "supersedes": [], "supersededBy": [], "contentHash": "eed3790eb1ff747ab09a4a83ccf5066a5785af6e35283f93b55992dc4b0629e5", "contentLength": 20332, "jsonUrl": "https://semiaifoundry.com/agents/publications/where-the-line-was.json", "markdownUrl": "https://semiaifoundry.com/agents/publications/where-the-line-was.md", "sections": [ { "id": "section-1", "title": "Where the line was", "start": 29, "end": 1183 }, { "id": "section-2", "title": "The short version", "start": 1183, "end": 3936 }, { "id": "section-3", "title": "The tether between Lovelace’s objection and Turing’s answer", "start": 3936, "end": 4618 }, { "id": "section-4", "title": "Turing’s list of things a machine will never do", "start": 4618, "end": 5573 }, { "id": "section-5", "title": "How long each line stood", "start": 5573, "end": 6421 }, { "id": "section-6", "title": "Who drew the line, and what they said when it fell", "start": 6421, "end": 6709 }, { "id": "section-7", "title": "Always about twenty years away", "start": 6709, "end": 7446 }, { "id": "section-8", "title": "Why the line moves", "start": 7446, "end": 7621 }, { "id": "section-9", "title": "The achievement is redescribed until it no longer signifies intelligence.", "start": 7621, "end": 7946 }, { "id": "section-10", "title": "Success exposes what the test never measured.", "start": 7946, "end": 8226 }, { "id": "section-11", "title": "A demonstrated capability is not yet an accepted outcome.", "start": 8226, "end": 8993 }, { "id": "section-12", "title": "The line left the benchmark.", "start": 8993, "end": 9887 }, { "id": "section-13", "title": "Discovery clock", "start": 9887, "end": 9990 }, { "id": "section-14", "title": "Formal verification clock", "start": 9990, "end": 10103 }, { "id": "section-15", "title": "Institutional clock", "start": 10103, "end": 10369 }, { "id": "section-16", "title": "Provenance is part of the result.", "start": 10369, "end": 11632 }, { "id": "section-17", "title": "Will it ever end?", "start": 11632, "end": 12020 }, { "id": "section-18", "title": "The line is defined by an absence, and absences refill.", "start": 12020, "end": 13955 }, { "id": "section-19", "title": "The question stops being asked.", "start": 13955, "end": 15835 }, { "id": "section-20", "title": "The line leaves performance and enters acceptance.", "start": 15835, "end": 17007 }, { "id": "section-21", "title": "Consequences", "start": 17007, "end": 17334 }, { "id": "section-22", "title": "Reliability and control", "start": 17334, "end": 17603 }, { "id": "section-23", "title": "Consciousness and moral status", "start": 17603, "end": 18844 }, { "id": "section-24", "title": "Why it feels new and old at the same time", "start": 18844, "end": 19975 }, { "id": "section-25", "title": "Receipts", "start": 19975, "end": 20332 } ], "citations": [ { "title": "[77]", "url": "https://semiaifoundry.com/updates/where-the-line-was/#sources" }, { "title": "Announcement", "url": "https://openai.com/index/navier-stokes-solution/" }, { "title": "Analytical paper", "url": "https://cdn.openai.com/pdf/32d9f210-8b73-45e0-91bc-82a30aef8a9a/navier-stokes.pdf" }, { "title": "Lean formalization", "url": "https://github.com/openai/NavierStokesAndEuler" }, { "title": "Clay rules", "url": "https://www.claymath.org/millennium-problems/rules/" } ], "recordHash": "72f67e79df99db0c9c8c686a04b019e2fc8fc2a57d6868c7f17f493b1b53444b", "contentFormat": "text/markdown", "content": "Analysis · 8 September 2026\n\n# Where the line was\n\nBy F. M. Cinnor\n\nFor 183 years, the finish line for machine intelligence moved whenever machines reached it. This week, the line changed kind: from whether AI can solve problems whose answers we know to whether it can produce knowledge we did not.\n\nThe moving goalpost, 1950 to 2026 An illustrative field. A ball representing machine capability climbs an exponential curve from 1950 to 2026. A goalpost stands at the current definition of intelligence. Each time the ball clears it, the post jumps forward: chess, Jeopardy, Go, language benchmarks, ARC puzzles, the Turing test, an IMO gold, interactive reasoning, and finally original mathematical discovery. Ghost outlines mark where the post used to stand. The current post, past 2026, is blurred and labelled with a question mark.\n\nEach time the ball clears the bar, the post moves. The final marker is different: it crosses from solving known tests into producing a proposed answer at the research frontier. The curve is illustrative; the years are not.\n\nReplay\n\n Your browser does not support embedded video.\n\nWhere the Line Was · 1 minute 56 secondsRevised 8 September 2026\n\n## The short version\n\nIn 1957, a machine that could beat the world chess champion would be intelligent. In 1997 one did, and it became _just brute-force search_. That summer, Go was declared the real test, perhaps a century away. In 2016 it fell, and it became _pattern matching on a board_. In 2019, ARC-AGI was built around novel puzzles language models could not touch. On 2 September 2026, a model scored 99.9% on its third version; the benchmark’s creators wrote, reasonably, that saturation would not prove AGI.\n\nSix days later, OpenAI reported something categorically different. An internal multi-agent system had produced an analytical proof and Lean formalization for finite-time singularity in the forced three-dimensional incompressible Navier–Stokes equations, a proposed resolution of a Millennium Prize Problem that had remained open for roughly 90 years. [\\[77\\]](https://semiaifoundry.com/updates/where-the-line-was/#sources)\n\nThis is not another score on a test with known answers. It is a claim to new, formally checkable knowledge. It also reveals that the relevant unit of intelligence is no longer obviously one model: OpenAI describes roughly 10,000 concurrent agents, code and internet tools, cross-group synthesis, 2.7 million messages, and about 130 billion output tokens. Capability now appears at the level of an organized system.\n\nThe result still has to survive independent mathematical scrutiny. Clay continues to list the problem as unsolved, and its rules require publication in a qualifying outlet, two years of elapsed time, and general acceptance by the global mathematics community before consideration. [\\[78\\]](https://semiaifoundry.com/updates/where-the-line-was/#sources) [\\[79\\]](https://semiaifoundry.com/updates/where-the-line-was/#sources) That delay is not a footnote. It exposes three different clocks: discovery, verification, and institutional acceptance.\n\nThe cycle is older than the computer. In 1843, Ada Lovelace wrote that the Analytical Engine “has no pretensions to originate anything.” Turing quoted the sentence in 1950, named it “Lady Lovelace’s Objection,” and answered that machines surprised him frequently. The objection has been reissued after every milestone in the vocabulary of the day: _brute force_, _lookup_, _pattern matching_, _autocomplete_, _training data_. The verdict is 183 years old. Only the noun changes.\n\nThis page keeps the ledger: who drew each line, when it fell, what people said afterward, and where the line went next. The latest event changes the final question. If a machine can originate a result that no one knew, the argument can no longer stop at whether it passed our test. It must ask whether the result is correct, attributable, reproducible, and accepted.\n\n## The tether between Lovelace’s objection and Turing’s answer\n\n![Timeline from 1843 to 2026 showing Ada Lovelace’s objection that machines do only what they are told, Alan Turing’s answer that machines surprise him, and both claims recurring in new forms after major AI milestones.](https://semiaifoundry.com/assets/images/where-the-line-was/the-tether.png)\n\n**The tether.** Lovelace’s objection and Turing’s answer remain paired across the history of machine intelligence, reissued after each milestone in the vocabulary of the day. [\\[1, 51\\]](https://semiaifoundry.com/updates/where-the-line-was/#sources) semiAIfoundry Research · 8 September 2026\n\nAct one, written in advance\n\n## Turing’s list of things a machine will never do\n\nThe tether runs through the rest of Turing’s 1950 paper. He catalogued the objections he expected to hear, including the _Argument from Various Disabilities_: a list of things people would insist a machine could never do. He wrote it down seventy-six years ago. It is the ledger below, in advance. Here is how the list stands this week.\n\n- Fallen plainly done, and argued about anyway\n- Contested done by some reasonable reading, denied by another\n- Untestable about inner experience — no result can touch it\n\nTuring’s own reply to most of the list: they are things people had never seen a machine do, so they assumed no machine could. To “enjoy strawberries and cream” he answered that it “would be idiotic” to try — and then noted that the objection is really about whether anything is felt, which is a different question. Keep that one in mind; it is where the story ends up.\n\nThe compression\n\n## How long each line stood\n\nBars start the year a test was proposed as the thing machines couldn’t do, and end the year machines did it. The bars get shorter to the right. That shrinking is the takeoff, visible in the goalposts themselves.\n\n40 yrsChess stood as the test, from Herbert Simon’s 1957 prediction to Deep Blue in 1997.\n\n19 yrsGo stood, from “a hundred years” in 1997 to AlphaGo in 2016.\n\n5 yrsARC-AGI-1 stood, from its 2019 launch to o3 in December 2024.\n\n≈6 monthsARC-AGI-3 stood, from its 2026 launch to 99.9% on 2 September 2026.\n\n- Years the line stood, proposed → beaten\n- Still standing (open end)\n\n“Beaten” is dated to the first widely accepted result at or above human level on the test as originally posed. Where that is contested (the Turing test, driving) the entry in the ledger below says so.\n\nTable view\n\nThe ledger\n\n## Who drew the line, and what they said when it fell\n\nEach entry records the line as it was drawn, the year it fell, the verdict that followed, and where the line moved next. The verdicts are the point: they are almost always _right_, and they almost always move the post.\n\nThe horizon\n\n## Always about twenty years away\n\nPlot the year a prediction was made against the year it said human-level AI would arrive. For seven decades the dots hover in the same band: fifteen to twenty-five years out, whoever is talking. Then, after 2022, the dots fall toward the diagonal — the line where “it arrives” and “I said so” are the same year.\n\n- Named individuals\n- Surveys and forecasting communities\n- Declared already here\n\nShaded band: the 15–25-year zone that Armstrong and Sotala found when they analysed 95 predictions in 2012. Survey points are the median year respondents gave a 50% chance of “high-level machine intelligence.” Definitions differ from dot to dot — which is rather the point.\n\nTable view\n\nThe pattern\n\n## Why the line moves\n\nThe ledger is real, but not every revision means the same thing. Three mechanisms recur, and a serious account has to keep them separate.\n\n01 · Denial\n\n### The achievement is redescribed until it no longer signifies intelligence.\n\nSearch, statistics, pattern matching, and next-token prediction can be accurate mechanistic descriptions. They become goalpost movement when the mechanism is used to erase a capability that the original test was meant to reveal.\n\n02 · Discovery\n\n### Success exposes what the test never measured.\n\nChess did not establish common sense. ARC does not establish reliability in an open institution. Some movement is honest measurement learning: a proxy falls, its limits become visible, and the science improves.\n\n03 · Deployment\n\n### A demonstrated capability is not yet an accepted outcome.\n\nReal systems must survive uncertainty, transfer, audit, control, and consequence. Raising the standard from a result to dependable use is not denial. It is the difference between a laboratory event and an operating reality.\n\n> It’s part of the history of the field of artificial intelligence that every time somebody figured out how to make a computer do something — play good checkers, solve simple but relatively informal problems — there was a chorus of critics to say, “that’s not thinking.”\n> \n> Pamela McCorduck, Machines Who Think, 1979\n\n> The model layer changes what is possible. The acceptance layer determines what becomes real.\n> \n> semiAIfoundry Research, 2026\n\nAct four · 8 September 2026\n\n## The line left the benchmark.\n\nThe benchmark era asks whether a system can match a known answer. The discovery era asks whether it can **create an answer nobody had**, then expose that answer to proof, replay, criticism, and time.\n\nPerformance**Solve the closed task**\n\nThe target and scoring rule are already known.\n\nTransfer**Adapt to novelty**\n\nThe task is unfamiliar, but the answer can still be checked.\n\nDiscovery**Extend the frontier**\n\nProduce a claim the field did not previously possess.\n\nVerification**Make it inspectable**\n\nFormalize the claim and expose every dependency.\n\nAcceptance**Let the field decide**\n\nIndependent experts test whether the proof truly closes the problem.\n\nOpenAI’s account compresses the first two clocks into days. The third is deliberately slower. Together they show why “solved” is an event, a process, and an institutional judgment at once.\n\n88 hours\n\n### Discovery clock\n\nFrom launching the agent effort to the reported analytical resolution.\n\n17 hours\n\n### Formal verification clock\n\nAdditional time reported for Lean formalization and machine checking.\n\n≥ 2 years\n\n### Institutional clock\n\nClay’s minimum elapsed time, alongside qualifying publication and broad mathematical acceptance.\n\nThe machine may have crossed the mathematical frontier in four days. _The institution will take years to decide whether the crossing counts._\n\n### Provenance is part of the result.\n\nOpenAI says a rumor of other Millennium Problem progress prompted the evaluation. It later learned that the parallel result concerned forced Euler, disclosed the overlap, stated that its agents had not seen that work, and recognized its authors’ priority. In machine-originated research, the lineage of prompts, tools, intermediate results, and concurrent work becomes part of the evidence a field must inspect. [\\[77\\]](https://semiaifoundry.com/updates/where-the-line-was/#sources)\n\nOpenAI states that its proof establishes statements C and D in the official formulation and has released both the paper and a Lean formalization. Clay currently lists Navier–Stokes as unsolved. A formal checker can establish that a theorem follows from encoded definitions and assumptions; independent review must still establish that the encoding, assumptions, and correspondence to the prize problem are complete. [Announcement](https://openai.com/index/navier-stokes-solution/) · [Analytical paper](https://cdn.openai.com/pdf/32d9f210-8b73-45e0-91bc-82a30aef8a9a/navier-stokes.pdf) · [Lean formalization](https://github.com/openai/NavierStokesAndEuler) · [Clay rules](https://www.claymath.org/millennium-problems/rules/)\n\nThe question\n\n## Will it ever end?\n\nThe line has moved since 1843. Does that make it inevitable that it always will? The evidence points to three endings: the line can keep retreating, the label can dissolve into ordinary technology, or the argument can migrate from capability to the conditions under which capability becomes trusted knowledge and consequential action.\n\nEnding one\n\nNeverthe default\n\n### The line is defined by an absence, and absences refill.\n\n“AI is whatever hasn’t been done yet” is not a joke about the field; it is a description of how the word works. A line drawn at _the thing machines can’t do_ has no stopping rule — when the thing is done, the definition, not the machine, is what has to change. Three forces keep the rule in place. The first is psychological: once a mechanism is understood it stops looking like intelligence (McCorduck’s “chorus of critics,” Brooks’s “that’s just a computation”). The second is structural: machine intelligence is _jagged_ — superhuman on one task, sub-human on its neighbour — so there is always a shortfall to point at, and it is usually the sensorimotor one Moravec named in 1988. [\\[52\\]](https://semiaifoundry.com/updates/where-the-line-was/#sources) [\\[58\\]](https://semiaifoundry.com/updates/where-the-line-was/#sources) The third is interest: for a decade the word carried a contract clause worth tens of billions, and it still carries reputations on both sides. Nobody with a stake in a line wants it settled against them.\n\n**Precedent: “only humans can…”** The other great moving goalpost of the last century is the one between humans and other animals, and it has never stopped moving. In 1960 Jane Goodall watched chimpanzees strip leaves from twigs to fish for termites; Louis Leakey’s telegram in reply: “Now we must redefine tool, redefine man, or accept chimpanzees as humans.” [\\[63\\]](https://semiaifoundry.com/updates/where-the-line-was/#sources) They redefined man. The line then moved, in order, to language, to mirror self-recognition, to episodic memory, to culture, to teaching, to theory of mind — and each fell to a field study. Sixty-six years on, the line still exists and still moves. Nobody expects it to stop; they expect it to keep retreating toward whatever cannot be observed from outside.\n\nTable view\n\nEnding two\n\nDissolvesthe likeliest\n\n### The question stops being asked.\n\nIn 1984 Edsger Dijkstra wrote that whether machines can think is “about as relevant as the question of whether Submarines Can Swim.” [\\[59\\]](https://semiaifoundry.com/updates/where-the-line-was/#sources) Nobody argues that a calculator “really” computes, or that a plane “really” flies; those debates ended not with a verdict but with the technology becoming furniture. Narayanan and Kapoor’s 2025 essay “AI as Normal Technology” is the modern form of the argument: the term retires as the thing becomes infrastructure. [\\[60\\]](https://semiaifoundry.com/updates/where-the-line-was/#sources) This ending is already visibly under way — and, tellingly, it is the people who used the word most who are dropping it. Altman calls AGI “a very sloppy term.” Nadella calls self-declared milestones “nonsensical benchmark hacking.” Brockman, in the week he declared the AGI era, recast it as “a mission concept or spiritual concept.” The contract that once defined it no longer has a trigger. And ARC Prize, having built three benchmarks with “AGI” in the name, now writes that saturating them is “not intended as a finish line,” and measures human-normalised efficiency instead of a verdict. [\\[39\\]](https://semiaifoundry.com/updates/where-the-line-was/#sources) [\\[70\\]](https://semiaifoundry.com/updates/where-the-line-was/#sources)\n\nTuring predicted this ending in the same 1950 paper: “at the end of the century the use of words and general educated opinion will have altered so much that one will be able to speak of machines thinking without expecting to be contradicted.” [\\[1\\]](https://semiaifoundry.com/updates/where-the-line-was/#sources) He was early, as he was on the five-minute test. But the sentence describes exactly how this ends: not with a proof, but with the contradiction going quiet.\n\nEnding three\n\nChanges kindhappening now\n\n### The line leaves performance and enters acceptance.\n\nOnce a system produces a proposed answer at an open research frontier, another benchmark is no longer the obvious next test. The questions become whether the result is correct, whether the path is attributable, whether independent experts can reproduce it, whether the system can do it repeatedly, and whether institutions can act on what it finds.\n\nNavier–Stokes makes the transition visible. The reported discovery took 88 hours. Formalization took 17 more. Institutional consideration cannot begin until the result has been published for at least two years and broadly accepted. [\\[77\\]](https://semiaifoundry.com/updates/where-the-line-was/#sources) [\\[78\\]](https://semiaifoundry.com/updates/where-the-line-was/#sources) The capability clock can move exponentially while the acceptance clock remains deliberately human.\n\nThis is not a softer finish line. It is a more consequential one. The object of measurement has changed from what a model can demonstrate to what a human-machine system can make true, inspectable, and usable in the world.\n\nWhere the argument goes when capability runs out\n\nSettles by data\n\n### Consequences\n\nWhat it does to work, science and institutions. Marcus’s bet with Brundage is this in miniature: ten real-world tasks, judged at the end of 2027, six of them arguably done already. Whatever the answer, it is an answer. [\\[72\\]](https://semiaifoundry.com/updates/where-the-line-was/#sources)\n\nSettles by data\n\n### Reliability and control\n\nRobustness, monitorability, autonomy — the grounds Marcus gave for waiting this week, and the grounds OpenAI itself gave when it labelled Astra’s cyber capability “critical.” These are measurable, and they will be measured.\n\nCannot settle\n\n### Consciousness and moral status\n\nTuring’s strawberries. The 2023 “Consciousness in AI” report found no current system a strong candidate and no test that could confirm one. [\\[61\\]](https://semiaifoundry.com/updates/where-the-line-was/#sources) This is the goalpost that will not move, because it cannot be reached from outside. It is where the three untestable items on Turing’s list already sit.\n\nA verdict, since the page has been giving them\n\nThe proxy cycle will not end on its own terms. A line drawn at the last thing machines cannot do has no stopping rule. Some revisions are denial, some are genuine scientific correction, and some reflect the distance between a capability event and an accepted outcome. All three can occur around the same result.\n\nBut the cycle does not need to be won to lose its importance. It ends when the operational question outruns the label. Navier–Stokes sharpens that moment: AGI can remain disputed while machines begin producing claims that alter the frontier of human knowledge. The argument then moves to correctness, control, provenance, consequence, and acceptance. Those are harder questions than a benchmark, but they are questions about reality rather than vocabulary.\n\nInside the takeoff\n\n## Why it feels new and old at the same time\n\nAn exponential curve has an odd property: it looks the same at every zoom level. Stand anywhere on it and the past looks flat and the future looks like a wall. Pick any other point and you see exactly the same picture. That is why 1997 felt like the year everything changed, and so did 2016, and so did 2023, and so does this month.\n\n**New**, because each milestone really is a first: no machine had beaten a world champion, won an IMO gold, learned an unfamiliar game faster than a person, or presented a formally encoded proposed resolution to a Millennium Prize Problem. **Old**, because the reaction still begins with the ledger: isolate the mechanism, narrow the meaning, and identify the residual.\n\nThe latest event is different for one reason. Navier–Stokes was not selected because the current model failed it, and its answer was not waiting in a hidden test set. If the proof survives review, the system did not merely reach a human-drawn line. It extended the field on which the line can be drawn.\n\nThe label may remain unsettled. _The operating reality will not._\n\nSources\n\n## Receipts\n\nCompiled and updated 8 September 2026. Scores are as reported by benchmark maintainers or labs on the dates given; “saturated” follows the source’s wording. OpenAI’s Navier–Stokes result is described as a proposed resolution pending independent and institutional review. The capability curve in the opening figure is illustrative, not measured." }