Skip to content

Metrics Dashboard: HELIX 2026-Q3 (human-outputs branch)

Example from HELIX’s own docs. This generated page comes from docs/helix/. Use it to see the method in practice; start with the artifact-type catalog for reusable templates. Historical plans and reports may describe retired architecture.

Source identity (from 06-iterate/metrics-dashboard.md):

ddx:
  id: metrics-dashboard
  authoring:
    home: repo
  review:
    self_hash: 08901f26fcd1422bd385122af0254abacc088a9f0eed2ae7a1df3173e2a5ee5a
    deps: {}
    reviewed_at: "2026-09-16T03:20:33Z"

Metrics Dashboard: HELIX 2026-Q3 (human-outputs branch)

Review Window: 2026-09-10 → 2026-09-15 (feat/helix-human-outputs) Baseline: none. This is the first sample against the PRD’s success metrics (docs/helix/01-frame/prd.md Success Metrics). The previous dashboard measured the execution loop (bead close rate, cycle time, wrapper-CLI green rate); those metrics belong to the runtime and are retired here. Status: Complete

Decision

The branch made three PRD metrics measurable for the first time and measured a fourth surface, present mode, through its own gate. The eval run passes 33 of 36 deterministic checks and scores 57/62 on the rubric; the skill body carries zero runtime-specific commands; the one deck produced so far passes the deliverable gate with 0 blocking findings. The alignment-quality target (fewer than three findings per align run on a healthy artifact set) is not yet measurable: the only sample is a fixture seeded with drift. No metric crossed a degradation threshold because there is no prior reading to degrade from.

Summary

evals/results/20260915-2202/summary.md is the current sample for the skill metrics (commit 20315d5c, nine briefs, about $32 per run); the present-mode sample is the DEL-001 gate record (docs/helix/06-iterate/deliverables/DEL-001-helix-evaluation-deck.md Render section). Authoring quality reads well on the proxy available (template-authored PRDs pass validate-instance.py on the first attempt); the PRD’s comparative study against free-form PRDs has not been run.

Metrics Table

MetricBaselineCurrentDirectionResultSource
Alignment findings per align run (healthy set)none26 on the seeded recipe-app/baseline fixture; no healthy-set samplelower is better (target < 3)not measurable yetevals/results/20260915-2202/align-baseline.json; evals/briefs.yml align-baseline
Eval deterministic checksnone33/36 across 9 briefs (investor deck shape rule and coverage status, survey deck two 11-word titles, ambiguous reply without a question mark)higher is betterthree failed checksevals/results/20260915-2202/summary.md
Eval rubric totalnone57/62 (investor deck 6/8, align brief 6/8, validate 5/6)higher is bettertrend signal onlyevals/results/20260915-2202/summary.md Rubric notes
Authoring quality: template-authored PRD passes first reviewnone2/2 PRD-producing briefs pass validate-instance.py with 0 blocking findings (frame-prd-from-vision 5/5, validate-prd 4/4); no free-form comparisonhigher is betterpass (proxy)evals/results/20260915-2202/frame-prd-from-vision.json, validate-prd.json
Skill portability: runtime-specific commands in the skill body00lower is betterpasstests/validate-skills.sh runtime-neutrality gate; eval output_not_contains tracker vocabulary 7/7 clean
Present mode: deliverable gate on DEL-001nonecheck-deliverable.py 0 blocking, 0 warnings; deck-qa.py 15 slides, 0 blocking, 3 warnings; validate-instance.py 0 findings; Vale 0 errorslower is betterpassDEL-001 Render section; python3 skills/helix/scripts/check-deliverable.py docs/helix/06-iterate/deliverables/DEL-001-helix-evaluation-deck.md
Present mode: eval briefsnonepresent-investor-deck checks 3/4, rubric 6/8; present-survey-deck checks 3/4, rubric 8/8 (render checks excluded on a headless host)higher is bettergate findings on both decksevals/results/20260915-2202/present-investor-deck.json, present-survey-deck.json

Interpretation Rules

  • Deterministic checks are pass or fail; a lost check on any brief is a regression and blocks the change that caused it.
  • Rubric scores are a trend signal between runs, not a pass mark; a change is kept when checks stay green and the rubric total moves up on the briefs it targets (evals/README.md Reading a result).
  • The alignment target reads only on a healthy artifact set. A finding count on a seeded fixture records the mode’s recall, not the metric.
  • A present-mode gate warning is tolerated when the Render section names it and the reason; a blocking finding is not.
  • A row marked “not measurable yet” creates a follow-up; a “proxy” row creates a follow-up to replace the proxy with the PRD’s measurement.

Trend Notes

  • Second reading (20260915-2202 at 20315d5c) against the first (20260911-0955 at 0756e5fa): checks went from 32/32 over eight briefs to 33/36 over nine; the three losses are gate and wording rules that did not exist at the first run (evals/README.md Runs). Rubric went from 48/54 to 57/62.
  • The two rubric points lost on present-investor-deck were evidence visibility (slide bodies and owner dates fall outside the truncated diff the judge sees), not deck content.
  • The two points lost on align-baseline were a truncated handoff block and fixture text absent from the evidence, both report shape rather than finding quality; the one point lost on validate-prd was judgment content authored in place.

Follow-Up

  • Add a healthy-set align brief (a fixture with no seeded drift, or docs/helix/ itself) so the < 3 findings target has a reading; improvement-backlog.md carries the item.
  • Fix the three failed checks (coverage vocabulary and the shape rule in the present mode text; the title stop) and run the eval again.
  • Replace the first-review proxy with the PRD’s comparative study (template-authored vs free-form PRDs through the same review).

Review Checklist

  • Baseline is explicit (none; first sample, prior execution metrics retired)
  • Each metric cites a source (an eval result file, a test lane, or the DEL-001 gate record)
  • The summary states the decision implication (checks and portability pass; alignment target not yet measurable)
Innsigle seal: model-primary by HELIX

The signature covers the markdown source of this page, not these HTML bytes. This page quotes that seal; verify it against the source file.

Composition
model-primary
Issuer
HELIX helix
Signing key
ed25519:b0865d76d834a52c48506414d16f4e5a (build key)
Signed source
artifacts/metrics-dashboard.md
Signed
2026-09-23T14:11:58Z
Content digest
sha256:873534fc…8def262f

This build key is endorsed by the human key for build signing; the signature is not a detector and not a truth guarantee.

Raw attestation JSON
{
  "payload": {
    "innsigle": "1",
    "type": "https://innsigle.dev/claim/colophon/v1",
    "issued_at": "2026-09-23T14:11:58Z",
    "issuer": {
      "id": "helix",
      "name": "HELIX",
      "key_id": "ed25519:b0865d76d834a52c48506414d16f4e5a",
      "key_url": "https://documentdrivendx.github.io/helix/.well-known/innsigle/keys.json"
    },
    "subjects": [
      {
        "uri": "https://documentdrivendx.github.io/helix/artifacts/metrics-dashboard/",
        "digest": {
          "alg": "sha256",
          "value": "873534fca274d8f950da8eb014e278253a51774c547dab53c842695a8def262f"
        }
      }
    ],
    "colophon": {
      "schema_version": "1",
      "composition": "model-primary",
      "ingredients": [
        {
          "kind": "model",
          "name": "Claude",
          "role": "draft"
        },
        {
          "kind": "tool",
          "name": "sloptimizer",
          "role": "rewrite"
        },
        {
          "kind": "human",
          "name": "operator",
          "role": "structure-edit"
        }
      ],
      "notes": null
    }
  },
  "payload_encoding": "json",
  "signatures": [
    {
      "key_id": "ed25519:b0865d76d834a52c48506414d16f4e5a",
      "alg": "ed25519",
      "sig": "pWiqHNTMPUF26OE1gJQlFkXqYAhyD3BDLnw9vL0DvB11lxX87pUinBA6Rj7eKh_PFPC7_32bMrgGbDGqoawyBQ",
      "signed_at": "2026-09-23T14:11:58Z"
    }
  ]
}