Skip to content
CLI

Conform an agent or a capability

Run each port's conformance kit; a port enters offers only through a pass, recorded in the definition.

Conform
nullius standard conform <other>[@version] --model M [--provider P] [--port PORT]... \
    [--unsandboxed | --backend docker] [--option NAME=VALUE]... [--repeat K] [--jobs DIR] [--stamp STAMP] [--from-run]
Flag Does
<other> KEY (its default version) or KEY@VERSION
--model, --provider The kits' model; anthropic, custom, openai or openrouter
--port PORT Only this port's kit (repeatable)
--unsandboxed, --backend As for a run: as you on this machine, or each check in docker
--option NAME=VALUE An agent's or capability's option (repeatable)
--repeat K Each check K times (u0002r1 to u0002rK, one kit job); a majority passes it. Default 1
--jobs, --stamp Where kit jobs go (default jobs_standard/), and their time stamp
--from-run Started by Nullius: OPENAI_API_KEY only, saved settings unread
Recorded Detail
proven Date, score, model, kit_version, skills shown, the kit job; with --repeat, "repeat": K, each count ("3/3"), each skill's "passed"
Skills A benchmark's needs_skills fits only an agent whose proof shows them
Replaced A pass on the current kit replaces an older proof; a fail takes the port back; a fidelity record stays

A new version runs nothing

Until conform KEY@VERSION passes; bumping a pin in a file without versions asks again. The app's Prove its ports is the same.