Proof

What was measured, and where it fell short.

Every number on this page comes from docs/FACTS.json, which scripts/facts.mjs writes from the evidence files in the repository. Generated 2026-11-09. The room, the gauges and the plant are stand-ins in the Lens Studio preview, so this is a measurement of the reading path, not of a ship.

Live reads against the plant simulator

8 gauges, 5 captures each with the overlay hidden, plus 3 each with it shown. Truth is the PlantSim value at the moment of capture. Error is in minor ticks of the gauge. One tick is the smallest printed division.

RunCapturesReadMedian errorMean errorWithin 1 tickWithin 2 ticksMedian time
Tried: with a scale hint line, overlay hidden (not adopted)4032 of 352.243.38163338 ms
Shipped configuration, overlay hidden4034 of 351.252.7115183243 ms
Shipped configuration, overlay shown2420 of 211.12.799113377 ms

Rows count legible dials only. The fogged dial is below. The shipped request adds the crop size in pixels and sets the thinking budget to 0. The scale hint is one more line saying how a 270 degree scale is laid out. It was tried because one live read had put the scale ends on the wrong sides, and it did not help, so it is off. The shared prompt in ReaderContract.ts is unchanged in every run.

Per gauge: pointing against the model's own number

Code computes the value from the points the model places. The model also returns its own guess, which is recorded and never used. Where the two differ, the pointing step is the weak part.

GaugeReadsMean error from points (ticks)Mean error of the model's own number (ticks)
ME-LO-IN51.020.37
ME-JCW-OUT55.70.9
ME-SCAV54.910.03
FO-SUP50.920.91
SW-PUMP40.930.68
AIR-START54.220.29
AE1-LO40.930.93
STG-OIL50.920.77

The misses

Fogged dial. The fog quad in the stand-in scene is too light. The reader flagged the dial unreadable 1 of 5 times with the overlay hidden. The legibility gate was not properly tested by this stand-in.

A wrong read can look alarming. 4 reads of the engine jacket water outlet gauge came out well above the true value and crossed into ALARM, with the overlay hidden, although the plant value was normal. A person must still accept each one, and the tag shows the number and the verdict word, but the gate cannot catch a wrong number a person agrees with.

Three gauges carry a steady bias. The jacket water outlet, scavenge air and starting air gauges read 4 to 7 ticks high from the points, while the model's own number for them is within about one tick. The pointing step is the weak part and is not fixed. A line telling the model how the scale is laid out was tried and did not help.

Overlay hidden or shown. No difference this set of captures can show. Hiding it costs a few frames and removes the risk, so it stays.

Tokens. The gateway response carries no usage count, so tokens per read are not recorded. Nothing is estimated.

Wild set. The evaluation on real dial photos is pre-registered in eval/PREREGISTRATION.md. It was started with a different model after the pre-registered one returned 404 for the API key (Amendment 1), and it is not finished, so this page states no figure for it.

Tests

WhatResultFile
Unit tests of Core, the same files the Lens runs17 pass, 0 failtests/core.test.ts
LEAF scenarios on the fixture reader10 of 10 passdevpost/evidence/leaf-p5-suite.log
Planted breaks, one per extra scenario5 of 5 went red, 5 back to greendevpost/evidence/break-proofs.log
Pinch targets at station distance39 measured, 0 below 2 degrees or within 1 degree of a neighbourAssets/Tests/ExtraPinchTargets.ts
Signed round sent to the doorHTTP 201, forced failure 500 shown as Not sentAssets/Tests/ExtraSend.ts
c1 in live modefaileddevpost/evidence/leaf-p5-suite.log