Skip to main content

Reports

Every number this project claims is in a report under reports/, generated by a script anyone can run, and regenerated for each release. A claim without a report is a slogan.

ReportWhat it measuresRegenerate
eval-healing.mdrelocalization recovery over twenty interface changes, with wrong-element and unverified countspnpm eval:healing
eval-compiler.mdexact match per tier over the golden setpnpm eval:compiler (--tier2 needs the local model)
eval-grounding.mdthe recorder's grounding accuracy; against the fake gateway it says it measures the harnesspnpm eval:grounding
eval-conformance.mdthe surface conformance suite per adapterpnpm eval:conformance
adapter-ax.md, adapter-uia.mdthe desktop gates, live against the packaged app, with the per-node cost and the load averagepnpm conform:desktop on a host with the permission
adapter-bidi.mdthe BiDi adapter's independence from Playwrightpnpm bidi:independence
runtime-java.mdthe Java runtime's conformance against the published fixturepnpm conform:runtime
self-parity.mdYam verifying Yam: agreement between Yam's own flows and the external oracles over every checkpnpm self
eval-finetune.mdthe withdrawn Tier 2 fine-tune, with the number it missedpnpm finetune:eval
app-*.png, sheet-*.png, ui-*.txtscreenshots of every app screen, the component sheet, and the terminal cockpitpnpm app:shoot, pnpm sheet:shoot, pnpm ui:capture

A report names the machine it was taken on and the load beside the number, because a per-node cost without the load is not a number. The desktop gate writes outside the tree unless asked to update the committed report, so a verifier's run leaves a clean checkout clean.