← All features

Verify and reviewAvailable in v0.3.0

oah models report and export

New in v0.3.0: oah models report counts how model choices were made — tier source, Jev's difficulty status and confidence, the model judge's status, and how often a floor raised the tier. oah models export saves one JSON line per run as cases you can compare later. Counts alone do not prove Jev helped.

When you need it

Without a record of how each run's tier and model were chosen, you cannot compare the rules with Jev or tune a rule later.

How it works

  1. oah models report reads this repository's run records (<state>/runs/<task>/<run-id>/result.json) and counts by stage, engine and in total; --json prints the same counts as one object with a format number.
  2. oah models export prints one JSON line per run folder, ordered by task folder and run id, with only decision data (axes, stage, engine, tiers, Jev and judge fields, model choice) and the outcome (status, exit code, timeout, duration).
  3. Prompts, briefs, task names, paths, commands, environment values and worker output are left out; values a correction record hashed stay hashed.
  4. Both call no provider, reach no network and write nothing; redirect stdout to keep the export.

Example

Print the counts as one JSON object (from Upgrade).

oah models report --json

Requirements

  • Requires v0.3.0 or later.
  • Run records in this repository.

Limits and recovery

  • The counts show how choices were made, not whether Jev helped: no outcome or quality is compared.
  • A run that finished does not prove its choice was right.
  • Older runs lack newer fields and count as not recorded; a value that cannot be read counts as unreadable, never as zero.

Original documents

Related