{
  "schemaVersion": 1,
  "id": "atlas-lesson-evaluation",
  "title": "Evaluation & the AGI frontier",
  "category": "learning",
  "format": "Atlas lesson",
  "description": "Measure breadth, reliability, and practical competence.",
  "canonicalUrl": "https://semiaifoundry.com/learn/atlas/evaluation/",
  "publishedDate": null,
  "revisionDate": "2026-10-07",
  "author": null,
  "topic": "Evidence and frontiers",
  "series": null,
  "license": null,
  "rightsUrl": "https://semiaifoundry.com/ai-atlas/licenses.html",
  "version": "1.3.0",
  "status": "Published educational lesson",
  "evidenceScope": "Benchmark selection, contamination, rubric and dependence dominate many real evaluations.\n\nThe examples use fictional environments and deterministic authored policies. They do not reproduce τ-bench cases or establish a real agent’s reliability or benchmark score.\n\nMode: executable final report; worked uncertainty. Independent Bernoulli sampling model for the illustrative interval; the authored four-case split is not demonstrated to be a representative population sample. Interval does not cure dataset selection bias. Numerical examples are authored calculations, except explicitly identified automated core fixtures. Primary sources support the scoped mechanism; no human specialist review or learner outcome is implied.",
  "contentCoverage": "published-lesson",
  "artifactUrl": "https://semiaifoundry.com/ai-atlas/lesson-data/evaluation-3092c2a64c0ff0e2.json",
  "interactiveUrl": "https://semiaifoundry.com/ai-atlas/#evaluation",
  "related": [],
  "supersedes": [],
  "supersededBy": [],
  "contentHash": "d5ec81135bef83993af9fdbc757ef6cd7bfb5bbab952ef271f67af24f0d25ec1",
  "contentLength": 11547,
  "jsonUrl": "https://semiaifoundry.com/agents/publications/atlas-lesson-evaluation.json",
  "markdownUrl": "https://semiaifoundry.com/agents/publications/atlas-lesson-evaluation.md",
  "sections": [
    {
      "id": "section-1",
      "title": "Evaluation & the AGI frontier",
      "start": 39,
      "end": 331
    },
    {
      "id": "section-2",
      "title": "The mechanism",
      "start": 331,
      "end": 2571
    },
    {
      "id": "section-3",
      "title": "Science and assumptions",
      "start": 2571,
      "end": 2599
    },
    {
      "id": "section-4",
      "title": "Benchmark success has sampling uncertainty",
      "start": 2599,
      "end": 3844
    },
    {
      "id": "section-5",
      "title": "A development protocol and an independent final test · worked relation",
      "start": 3844,
      "end": 4958
    },
    {
      "id": "section-6",
      "title": "Engineering example",
      "start": 4958,
      "end": 5902
    },
    {
      "id": "section-7",
      "title": "Distinctions and tradeoffs",
      "start": 5902,
      "end": 6261
    },
    {
      "id": "section-8",
      "title": "Specifications and interfaces",
      "start": 6261,
      "end": 6466
    },
    {
      "id": "section-9",
      "title": "Interfaces",
      "start": 6466,
      "end": 6605
    },
    {
      "id": "section-10",
      "title": "Check your understanding",
      "start": 6605,
      "end": 6634
    },
    {
      "id": "section-11",
      "title": "What does strong performance on one benchmark demonstrate?",
      "start": 6634,
      "end": 6975
    },
    {
      "id": "section-12",
      "title": "Every call succeeded and the source supports the FAN-9 work order, but the task requested FAN-7. Is the task correct?",
      "start": 6975,
      "end": 7381
    },
    {
      "id": "section-13",
      "title": "What should happen to a 4/4 report after the weights change?",
      "start": 7381,
      "end": 7986
    },
    {
      "id": "section-14",
      "title": "Historical context",
      "start": 7986,
      "end": 8009
    },
    {
      "id": "section-15",
      "title": "2023 · Levels of AGI separates breadth from performance",
      "start": 8009,
      "end": 8394
    },
    {
      "id": "section-16",
      "title": "Evidence and scope",
      "start": 8394,
      "end": 9297
    },
    {
      "id": "section-17",
      "title": "Sources",
      "start": 9297,
      "end": 10200
    },
    {
      "id": "section-18",
      "title": "Continue exploring",
      "start": 10200,
      "end": 10223
    },
    {
      "id": "section-19",
      "title": "Foundations",
      "start": 10223,
      "end": 10322
    },
    {
      "id": "section-20",
      "title": "Related lessons",
      "start": 10322,
      "end": 11547
    }
  ],
  "citations": [
    {
      "title": "Explore in Atlas",
      "url": "https://semiaifoundry.com/ai-atlas/#evaluation"
    },
    {
      "title": "Morris et al. — Levels of AGI for Operationalizing Progress on the Path to AGI",
      "url": "https://arxiv.org/abs/2311.02462"
    },
    {
      "title": "NIST — Binomial Distribution",
      "url": "https://itl.nist.gov/div898/handbook/eda/section3/eda366i.htm"
    },
    {
      "title": "NIST — Exact Binomial Confidence Limits",
      "url": "https://itl.nist.gov/div898/software/dataplot/refman2/auxillar/exacbici.htm"
    },
    {
      "title": "τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains",
      "url": "https://arxiv.org/abs/2406.12045"
    },
    {
      "title": "Holistic Evaluation of Language Models",
      "url": "https://arxiv.org/html/2211.09110v1"
    },
    {
      "title": "On Calibration of Modern Neural Networks",
      "url": "https://arxiv.org/html/1706.04599v2"
    },
    {
      "title": "NIST Dataplot: Wilson proportion interval",
      "url": "https://www.itl.nist.gov/div898/software/dataplot/refman2/auxillar/agrecoul.htm"
    },
    {
      "title": "Published lesson data",
      "url": "https://semiaifoundry.com/ai-atlas/lesson-data/evaluation-3092c2a64c0ff0e2.json"
    },
    {
      "title": "Atlas releases and licensing",
      "url": "https://semiaifoundry.com/ai-atlas/licenses.html"
    },
    {
      "title": "Output head & decoding",
      "url": "https://semiaifoundry.com/learn/atlas/output-head/"
    },
    {
      "title": "Tools, memory & agent loop",
      "url": "https://semiaifoundry.com/learn/atlas/tool-loop/"
    },
    {
      "title": "Post-training & feedback",
      "url": "https://semiaifoundry.com/learn/atlas/post-training/"
    },
    {
      "title": "Scaling laws & resource allocation",
      "url": "https://semiaifoundry.com/learn/atlas/scaling-laws/"
    },
    {
      "title": "Workflow graphs and explicit state",
      "url": "https://semiaifoundry.com/learn/atlas/workflow-graphs-state/"
    },
    {
      "title": "Traces connect cost, latency and results",
      "url": "https://semiaifoundry.com/learn/atlas/telemetry-traces-evaluation/"
    },
    {
      "title": "Retrieval from source document to answer",
      "url": "https://semiaifoundry.com/learn/atlas/retrieval-indexing-evaluation/"
    },
    {
      "title": "Confidence, errors and refusal to guess",
      "url": "https://semiaifoundry.com/learn/atlas/probability-calibration-abstention/"
    },
    {
      "title": "Human and model judgments under a rubric",
      "url": "https://semiaifoundry.com/learn/atlas/judge-rubric-agreement/"
    },
    {
      "title": "From lexical retrieval to model answers with evidence",
      "url": "https://semiaifoundry.com/learn/atlas/retrieval-supported-generation/"
    },
    {
      "title": "Sampling more candidates versus selecting correct ones",
      "url": "https://semiaifoundry.com/learn/atlas/test-time-search-verification/"
    },
    {
      "title": "Version the entire evaluated system",
      "url": "https://semiaifoundry.com/learn/atlas/model-system-regression-contract/"
    }
  ],
  "recordHash": "1645ed627966e6660cb21cd34f97697aee5257fc560c3d2c249a34dc62622a98",
  "contentFormat": "text/markdown",
  "content": "Evidence and frontiers · Atlas v1.3.0\n\n# Evaluation & the AGI frontier\n\nMeasure breadth, reliability, and practical competence.\n\n[Explore in Atlas](https://semiaifoundry.com/ai-atlas/#evaluation)Logical structure · mapped onto physical hardware\n\nLearning objectiveUse a proportion with uncertainty rather than a single pass rate.\n\n## The mechanism\n\nA useful evaluation asks what the entire system can accomplish under clear conditions. It records correctness, consistency, cost, latency, tool access, and the amount of human help allowed. Generality involves breadth across tasks and transfer to unfamiliar situations; excellent results on one benchmark cannot establish all of it. Contamination and benchmark saturation complicate comparison. This atlas ends at an open research frontier: the assembled machinery enables increasingly capable systems, while the definition and demonstration of AGI require explicit evidence.\n\nThe durable incident experience adds a task-state oracle to the existing distinction between source support and answer correctness. The oracle checks actual reservations, work orders, inventory conservation and prohibited exports. It does not accept the worker’s completion status as its label. Repeated trials can later assess reliability, but a deterministic fixture run is only evidence for its declared case.\n\nEvaluation attaches a scoring rule and denominator to a fixed checkpoint. Development cases guide iteration, while an independent final test assesses a choice made before its answers are inspected. Repeatedly consulting that final set while choosing changes weakens its independence. A small perfect result also leaves substantial uncertainty about future cases. The lifecycle’s seal is procedural: source files remain inspectable, and its first final report retains checkpoint identity rather than updating silently as training continues.\n\n1.  Define tasks, success criteria, and permitted resources.\n2.  Test on held-out and unfamiliar cases, including failures.\n3.  Report uncertainty, repeatability, and limits alongside successes.\n4.  The evaluation target specifies acceptable environment state and forbidden effects independently of the policy.\n5.  Source support, task correctness, abstention and tool error rates retain distinct denominators and interpretations.\n6.  Choose the task and score before revealing final outcomes.\n7.  Preserve checkpoint, dataset, tokenizer and inference identities with each result.\n8.  Report counts and uncertainty rather than only percentages; mark exposed final data as previously seen.\n\n## Science and assumptions\n\n### Benchmark success has sampling uncertainty\n\n$$\n\\hat p=\\frac{k}{n},\\qquad\\operatorname{SE}(\\hat p)\\approx\\sqrt{\\frac{\\hat p(1-\\hat p)}{n}}\n$$\n\nEstimated success probability is successes divided by trials. Its plug-in standard error is the square root of estimated probability times one minus that probability divided by trial count.\n\nSymbols and units\n\np̂\n\nObserved success fraction\n\nprobability fraction\n\nk\n\nSuccessful independent trials\n\ntrials\n\nn\n\nTotal independent trials, greater than zero\n\ntrials\n\nSE(p̂)\n\nPlug-in standard error of the success-fraction estimator\n\nprobability fraction\n\nIf k of n independently sampled tasks succeed, p̂ estimates the success probability for that task distribution. The estimated standard error shrinks only as the square root of sample size: roughly four times as many comparable trials are needed to halve it. This uncertainty says nothing by itself about tasks outside the tested distribution.\n\nAssumptions Binary outcomes, independent trials, fixed conditions, and a representative sample are required. The plug-in approximation is poor near zero or one or with small n; use suitable binomial intervals. Correlated tasks, benchmark selection, contamination, and judge error add other uncertainties.\n\n### A development protocol and an independent final test · worked relation\n\n$$\nCI=\\frac{\\hat p+z^2/(2n)\\ \\pm\\ z\\sqrt{\\frac{\\hat p(1-\\hat p)}{n}+\\frac{z^2}{4n^2}}}{1+z^2/n}\n$$\n\nKeep development feedback separate from a first final-test report and state its uncertainty.\n\nSymbols and units\n\nCI\n\nWilson interval under the stated binomial model\n\nprobability interval\n\np hat\n\nObserved success fraction\n\ndimensionless\n\nn\n\nEvaluated cases\n\ncases\n\nz\n\nNormal quantile, 1.96 for approximate 95 percent\n\ndimensionless\n\nA result of 4/4 on the tiny final copy split is 100% observed accuracy, not proof of perfect population accuracy. A Wilson 95% interval with z=1.96 has lower bound about 0.510 and upper bound 1.000. The finite test supports only its declared toy task and split. Updating weights after the report changes model identity; the earlier 4/4 must remain attributed to the earlier checkpoint.\n\nAssumptions Independent Bernoulli sampling model for the illustrative interval; the authored four-case split is not demonstrated to be a representative population sample. Interval does not cure dataset selection bias.\n\n## Engineering example\n\nIf k=90 of n=100 items pass, p̂=0.9; the standard-error approximation is about 0.03 under a simple independent-sample model.\n\nIn the wrong-entity incident, the authored policy completes one FAN-9 work order supported by the FAN-9 manual. Source support is 1/1, yet the original FAN-7 task is wrong. In the canceled-after-commit case the reservation exists but the required work order does not, so task success is false even though an external write succeeded. These outcomes expose errors that counting successful calls would miss.\n\nA result of 4/4 on the tiny final copy split is 100% observed accuracy, not proof of perfect population accuracy. A Wilson 95% interval with z=1.96 has lower bound about 0.510 and upper bound 1.000. The finite test supports only its declared toy task and split. Updating weights after the report changes model identity; the earlier 4/4 must remain attributed to the earlier checkpoint.\n\n## Distinctions and tradeoffs\n\nAn impressive system architecture does not, by itself, establish general intelligence.\n\nA compact benchmark is easy to compare but cannot cover all real-world situations. More representative evaluation costs time and effort.\n\nThe goal is useful, reliable competence; larger machines are a means to test, not proof of the goal.\n\n## Specifications and interfaces\n\nDimensions\n\nBreadth + competence + autonomy\n\nA framework, not a single universal score.\n\nEvidence\n\nTask-specific and repeatable\n\nBenchmark conditions affect conclusions.\n\n### Interfaces\n\nModel system Input\n\nBehavior under controlled conditions\n\nResearch decisions Output\n\nMeasured strengths and failure modes\n\n## Check your understanding\n\n### What does strong performance on one benchmark demonstrate?\n\n1.  Universal AGI by itself\n2.  Performance on that benchmark under its stated conditions\n3.  That evaluation is no longer needed\n\nAnswer and reasoning\n\nPerformance on that benchmark under its stated conditions\n\nBreadth, reliability, and transfer require additional evidence.\n\n### Every call succeeded and the source supports the FAN-9 work order, but the task requested FAN-7. Is the task correct?\n\n1.  Yes, because all calls succeeded\n2.  No, because the environment fails the original goal\n3.  Yes, because the citation is valid\n\nAnswer and reasoning\n\nNo, because the environment fails the original goal\n\nCall status and source support do not replace the original task contract.\n\n### What should happen to a 4/4 report after the weights change?\n\n1.  It proves every later model also succeeds.\n2.  It remains attached to the checkpoint that was actually evaluated.\n3.  It silently becomes a report about the new weights.\n\nAnswer and reasoning\n\nIt remains attached to the checkpoint that was actually evaluated.\n\nIt remains attached to the checkpoint that was actually evaluated. Independent Bernoulli sampling model for the illustrative interval; the authored four-case split is not demonstrated to be a representative population sample. Interval does not cure dataset selection bias.\n\n## Historical context\n\n### 2023 · Levels of AGI separates breadth from performance\n\nMorris and colleagues proposed a framework for comparing capability breadth and performance while treating deployment autonomy separately, making progress claims more explicit than a single benchmark score.\n\n[Morris et al. — Levels of AGI for Operationalizing Progress on the Path to AGI](https://arxiv.org/abs/2311.02462)\n\n## Evidence and scope\n\nBenchmark selection, contamination, rubric and dependence dominate many real evaluations.\n\nThe examples use fictional environments and deterministic authored policies. They do not reproduce τ-bench cases or establish a real agent’s reliability or benchmark score.\n\nMode: executable final report; worked uncertainty. Independent Bernoulli sampling model for the illustrative interval; the authored four-case split is not demonstrated to be a representative population sample. Interval does not cure dataset selection bias. Numerical examples are authored calculations, except explicitly identified automated core fixtures. Primary sources support the scoped mechanism; no human specialist review or learner outcome is implied.\n\nUse the execution investigation for the shared tensor-to-memory-to-result thread; no current standalone calculator models this lesson’s full mechanism.\n\n## Sources\n\n-   [Morris et al. — Levels of AGI](https://arxiv.org/abs/2311.02462)\n-   [NIST — Binomial Distribution](https://itl.nist.gov/div898/handbook/eda/section3/eda366i.htm)\n-   [NIST — Exact Binomial Confidence Limits](https://itl.nist.gov/div898/software/dataplot/refman2/auxillar/exacbici.htm)\n-   [τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains](https://arxiv.org/abs/2406.12045)\n-   [Holistic Evaluation of Language Models](https://arxiv.org/html/2211.09110v1)\n-   [On Calibration of Modern Neural Networks](https://arxiv.org/html/1706.04599v2)\n-   [NIST Dataplot: Wilson proportion interval](https://www.itl.nist.gov/div898/software/dataplot/refman2/auxillar/agrecoul.htm)\n\n[Published lesson data](https://semiaifoundry.com/ai-atlas/lesson-data/evaluation-3092c2a64c0ff0e2.json) · [Atlas releases and licensing](https://semiaifoundry.com/ai-atlas/licenses.html)\n\n## Continue exploring\n\n### Foundations\n\n-   [Output head & decoding](https://semiaifoundry.com/learn/atlas/output-head/)\n\n### Related lessons\n\n-   [Tools, memory & agent loop](https://semiaifoundry.com/learn/atlas/tool-loop/)\n-   [Post-training & feedback](https://semiaifoundry.com/learn/atlas/post-training/)\n-   [Scaling laws & resource allocation](https://semiaifoundry.com/learn/atlas/scaling-laws/)\n-   [Workflow graphs and explicit state](https://semiaifoundry.com/learn/atlas/workflow-graphs-state/)\n-   [Traces connect cost, latency and results](https://semiaifoundry.com/learn/atlas/telemetry-traces-evaluation/)\n-   [Retrieval from source document to answer](https://semiaifoundry.com/learn/atlas/retrieval-indexing-evaluation/)\n-   [Confidence, errors and refusal to guess](https://semiaifoundry.com/learn/atlas/probability-calibration-abstention/)\n-   [Human and model judgments under a rubric](https://semiaifoundry.com/learn/atlas/judge-rubric-agreement/)\n-   [From lexical retrieval to model answers with evidence](https://semiaifoundry.com/learn/atlas/retrieval-supported-generation/)\n-   [Sampling more candidates versus selecting correct ones](https://semiaifoundry.com/learn/atlas/test-time-search-verification/)\n-   [Version the entire evaluated system](https://semiaifoundry.com/learn/atlas/model-system-regression-contract/)"
}