Metrics Dashboard: HELIX 2026-Q3 (human-outputs branch)
Example from HELIX’s own docs. This generated page comes from
docs/helix/. Use it to see the method in practice; start with the artifact-type catalog for reusable templates. Historical plans and reports may describe retired architecture.
Source identity (from
06-iterate/metrics-dashboard.md):
ddx:
id: metrics-dashboard
authoring:
home: repo
review:
self_hash: 08901f26fcd1422bd385122af0254abacc088a9f0eed2ae7a1df3173e2a5ee5a
deps: {}
reviewed_at: "2026-09-16T03:20:33Z"Metrics Dashboard: HELIX 2026-Q3 (human-outputs branch)
Review Window: 2026-09-10 → 2026-09-15 (feat/helix-human-outputs)
Baseline: none. This is the first sample against the PRD’s success
metrics (docs/helix/01-frame/prd.md Success Metrics). The previous
dashboard measured the execution loop (bead close rate, cycle time,
wrapper-CLI green rate); those metrics belong to the runtime and are
retired here.
Status: Complete
Decision
The branch made three PRD metrics measurable for the first time and
measured a fourth surface, present mode, through its own gate. The eval
run passes 33 of 36 deterministic checks and scores 57/62 on the
rubric; the skill body carries zero runtime-specific commands; the one
deck produced so far passes the deliverable gate with 0 blocking findings.
The alignment-quality target (fewer than three findings per align run on
a healthy artifact set) is not yet measurable: the only sample is a fixture
seeded with drift. No metric crossed a degradation threshold because there
is no prior reading to degrade from.
Summary
evals/results/20260915-2202/summary.md is the current sample for the
skill metrics (commit 20315d5c, nine briefs, about $32 per run); the
present-mode sample is the DEL-001 gate record
(docs/helix/06-iterate/deliverables/DEL-001-helix-evaluation-deck.md
Render section). Authoring quality reads well on the proxy available
(template-authored PRDs pass validate-instance.py on the first attempt);
the PRD’s comparative study against free-form PRDs has not been run.
Metrics Table
| Metric | Baseline | Current | Direction | Result | Source |
|---|---|---|---|---|---|
Alignment findings per align run (healthy set) | none | 26 on the seeded recipe-app/baseline fixture; no healthy-set sample | lower is better (target < 3) | not measurable yet | evals/results/20260915-2202/align-baseline.json; evals/briefs.yml align-baseline |
| Eval deterministic checks | none | 33/36 across 9 briefs (investor deck shape rule and coverage status, survey deck two 11-word titles, ambiguous reply without a question mark) | higher is better | three failed checks | evals/results/20260915-2202/summary.md |
| Eval rubric total | none | 57/62 (investor deck 6/8, align brief 6/8, validate 5/6) | higher is better | trend signal only | evals/results/20260915-2202/summary.md Rubric notes |
| Authoring quality: template-authored PRD passes first review | none | 2/2 PRD-producing briefs pass validate-instance.py with 0 blocking findings (frame-prd-from-vision 5/5, validate-prd 4/4); no free-form comparison | higher is better | pass (proxy) | evals/results/20260915-2202/frame-prd-from-vision.json, validate-prd.json |
| Skill portability: runtime-specific commands in the skill body | 0 | 0 | lower is better | pass | tests/validate-skills.sh runtime-neutrality gate; eval output_not_contains tracker vocabulary 7/7 clean |
| Present mode: deliverable gate on DEL-001 | none | check-deliverable.py 0 blocking, 0 warnings; deck-qa.py 15 slides, 0 blocking, 3 warnings; validate-instance.py 0 findings; Vale 0 errors | lower is better | pass | DEL-001 Render section; python3 skills/helix/scripts/check-deliverable.py docs/helix/06-iterate/deliverables/DEL-001-helix-evaluation-deck.md |
| Present mode: eval briefs | none | present-investor-deck checks 3/4, rubric 6/8; present-survey-deck checks 3/4, rubric 8/8 (render checks excluded on a headless host) | higher is better | gate findings on both decks | evals/results/20260915-2202/present-investor-deck.json, present-survey-deck.json |
Interpretation Rules
- Deterministic checks are pass or fail; a lost check on any brief is a regression and blocks the change that caused it.
- Rubric scores are a trend signal between runs, not a pass mark; a change
is kept when checks stay green and the rubric total moves up on the
briefs it targets (
evals/README.mdReading a result). - The alignment target reads only on a healthy artifact set. A finding count on a seeded fixture records the mode’s recall, not the metric.
- A present-mode gate warning is tolerated when the Render section names it and the reason; a blocking finding is not.
- A row marked “not measurable yet” creates a follow-up; a “proxy” row creates a follow-up to replace the proxy with the PRD’s measurement.
Trend Notes
- Second reading (
20260915-2202at20315d5c) against the first (20260911-0955at0756e5fa): checks went from 32/32 over eight briefs to 33/36 over nine; the three losses are gate and wording rules that did not exist at the first run (evals/README.mdRuns). Rubric went from 48/54 to 57/62. - The two rubric points lost on
present-investor-deckwere evidence visibility (slide bodies and owner dates fall outside the truncated diff the judge sees), not deck content. - The two points lost on
align-baselinewere a truncated handoff block and fixture text absent from the evidence, both report shape rather than finding quality; the one point lost onvalidate-prdwas judgment content authored in place.
Follow-Up
- Add a healthy-set
alignbrief (a fixture with no seeded drift, ordocs/helix/itself) so the < 3 findings target has a reading;improvement-backlog.mdcarries the item. - Fix the three failed checks (coverage vocabulary and the shape rule in the present mode text; the title stop) and run the eval again.
- Replace the first-review proxy with the PRD’s comparative study (template-authored vs free-form PRDs through the same review).
Review Checklist
- Baseline is explicit (none; first sample, prior execution metrics retired)
- Each metric cites a source (an eval result file, a test lane, or the DEL-001 gate record)
- The summary states the decision implication (checks and portability pass; alignment target not yet measurable)
Innsigle seal: model-primary by HELIX
The signature covers the markdown source of this page, not these HTML bytes. This page quotes that seal; verify it against the source file.
- Composition
- model-primary
- Issuer
- HELIX
helix - Signing key
ed25519:b0865d76d834a52c48506414d16f4e5a(build key)- Signed source
artifacts/metrics-dashboard.md- Signed
- 2026-09-23T14:11:58Z
- Content digest
sha256:873534fc…8def262f
This build key is endorsed by the human key for build signing; the signature is not a detector and not a truth guarantee.
Raw attestation JSON
{
"payload": {
"innsigle": "1",
"type": "https://innsigle.dev/claim/colophon/v1",
"issued_at": "2026-09-23T14:11:58Z",
"issuer": {
"id": "helix",
"name": "HELIX",
"key_id": "ed25519:b0865d76d834a52c48506414d16f4e5a",
"key_url": "https://documentdrivendx.github.io/helix/.well-known/innsigle/keys.json"
},
"subjects": [
{
"uri": "https://documentdrivendx.github.io/helix/artifacts/metrics-dashboard/",
"digest": {
"alg": "sha256",
"value": "873534fca274d8f950da8eb014e278253a51774c547dab53c842695a8def262f"
}
}
],
"colophon": {
"schema_version": "1",
"composition": "model-primary",
"ingredients": [
{
"kind": "model",
"name": "Claude",
"role": "draft"
},
{
"kind": "tool",
"name": "sloptimizer",
"role": "rewrite"
},
{
"kind": "human",
"name": "operator",
"role": "structure-edit"
}
],
"notes": null
}
},
"payload_encoding": "json",
"signatures": [
{
"key_id": "ed25519:b0865d76d834a52c48506414d16f4e5a",
"alg": "ed25519",
"sig": "pWiqHNTMPUF26OE1gJQlFkXqYAhyD3BDLnw9vL0DvB11lxX87pUinBA6Rj7eKh_PFPC7_32bMrgGbDGqoawyBQ",
"signed_at": "2026-09-23T14:11:58Z"
}
]
}