← All features

Extend the toolkitAvailable in v0.3.0

Jev judges difficulty

Released in v0.3.0: TypeSafe Jev judges difficulty from the task's Intent and Scope paths. When its confidence reaches the threshold, its tier runs, never below the floor. When Jev is off or has low confidence, the rule-based difficulty runs. A call is never blocked.

When you need it

Rules score the axes from the Scope alone, so a one-line concurrency fix can score low and a 20-file rename high.

How it works

  1. Jev receives the four axes and a work text: the five parts of the accepted Intent (Problem, Desired outcome, Success conditions, Constraints and Non-goals), then the Scope paths, cut to 16,000 characters (about 4,000 tokens).
  2. Before anything is sent, the privacy scanner's content rules read the text; if one flags a part, nothing is sent, the status is unused(secret), and OAH_RERANK_SECRET names the part, never the match.
  3. When Jev's confidence is at or above [rerank] difficulty_min_confidence (0.6 unless you set a number from 0 to 1), its tier runs, raised to the floor tier when lower, and tier_source is jev.
  4. Otherwise the rule tier runs and jev_status says why. --tier, or a plan tier you edited, leaves Jev out as unused(tier-given).
  5. Run records and review receipts keep rule_tier, jev_tier, jev_confidence, jev_status, tier and tier_source.

Requirements

  • Requires v0.3.0 or later.
  • [rerank] enabled = true and your own TYPESAFE_API_KEY.

Limits and recovery

  • Jev never receives code, diffs, file contents, stored values, the brief or your key; a path is sent as a path, never its contents.
  • The first request in a project prints OAH_RERANK_SCOPE_WIDENED once; set enabled = false under [rerank] to stop every request.
  • A review's floor stays scored from its scope alone, so Jev can lower a review only down to that floor.
  • A thin Intent gives a thin judgement, and TypeSafe may charge for each request.
  • A difficulty_min_confidence outside 0 to 1 refuses with OAH_CONFIG_INVALID before anything is sent.

Original documents

Related