the suite
gate discipline
No speed number is reported until its gate is green, and a gate is not trusted until it has been seen to fail.
the oracle
Every solver ships with a reference implementation: slow, plain, and written to be read. The fast build, C on the CPU tier or CUDA on the GPU tier, is not callable until it agrees with the reference across the gate suite. The reference is the contract; the fast path is only ever an optimization of it.
build to fail
A gate that passes the first time it is run proves nothing, because a gate that would have passed anyway cannot detect the absence of the behavior it claims to check. Gates are therefore built to fail first: the check is written, watched failing, and only then allowed to pass. A green light is meaningful because it was once red.
honest speed
Speed is reported in absolute nanoseconds per operation on the CPU tier and as a percentage of roofline on the GPU tier. Multipliers over an interpreted baseline are not speed claims: they measure interpreter overhead removed, not an algorithm beating a competent implementation.
provenance
Inputs are fingerprinted with a content hash before anything reads them, and every result carries an inputs manifest tying the answer to the exact bytes that produced it. A figure with no lineage is treated as no figure at all.