Skip to content

docs(analytics): restore explicit Analytical Judge gate after findings (#357) - #359

Merged
sergstack merged 1 commit into
mainfrom
codex/issue-357-analytical-judge-gate
Sep 2, 2026
Merged

docs(analytics): restore explicit Analytical Judge gate after findings (#357)#359
sergstack merged 1 commit into
mainfrom
codex/issue-357-analytical-judge-gate

Conversation

@sergstack

Copy link
Copy Markdown
Owner

Closes #357.

Summary

Restores an explicit Analytical Judge gate directly after findings in the [Analytics] reasoning/workflow docs — a compact orchestration checkpoint that challenges the analytical conclusion itself before narrative packaging. Docs-only. It reuses the existing controls and adds no second QA framework, taxonomy, method, or intent.

DETERMINISTIC CALCULATION → FINDINGS → ANALYTICAL JUDGE → PASS / REVISE / BLOCKED
→ revise or rerun when required → FINAL FINDINGS → MEMO / REPORT → MEMO QA / JUDGE → ACCEPTANCE

Changes

File Change
ANALYTICAL_REASONING_STANDARD.md New §8 Analytical Judge gate — the 7 semantic checks each mapped to an existing control (TASK_PROFILE/intent, METHOD_PLAN+registry, CLAIM_EVIDENCE_REGISTRY lineage, explanation challenge, CONTRADICTING_EVIDENCE+method-disagreement, FINAL_EVIDENCE_SUFFICIENCY+claim ladder, material management synthesis); ANALYTICAL_JUDGE output record; bounded revise/rerun rule; quick runtime collapse. §8→§9 (Runtime collapse), §9→§10 (Stop/escalation) renumbered; full-path block updated
ANALYTICS_WORKFLOW.md Canonical workflow list + Step 9 make findings → Analytical Judge → pass/revise/blocked → final findings explicit before memo/report
QA_CHECKLIST.md Post-findings Analytical Judge gate block (orchestration over existing Analysis QA, not a new framework)
ACCEPTANCE_CRITERIA.md Criterion 12; analytical_judge_status: pass/revise/blocked/not_applicable; blocked-status entry
GOVERNANCE_AND_ANTI_PATTERNS.md Gate principle; blocker entry; anti-pattern rows — no autonomous retry loop, no second framework/taxonomy, blocked != executed
SMOKE_QA_FOR_ANALYTICS.md Case forcing a plausible-but-over-strong "root cause" claim to revise (the issue's suggested test); quick-mode collapse case
CHANGELOG.md Dated entry
ANALYTICS_01/03/05 bundles + provenance audit Regenerated deterministically

Acceptance criteria (issue #357)

  • Workflow explicitly contains findings → Analytical Judge → pass/revise/blocked → final findings
  • Judge evaluates conclusions before memo generation
  • Seven checks represented semantically without duplicating existing contracts
  • claim strength <= final evidence sufficiency remains mandatory
  • driver != root cause / correlation != causation remain enforced
  • Material contradictory evidence / method disagreement cannot silently pass
  • blocked != executed remains enforced
  • manual_review_required still governed by the reasoning standard (§1); Judge only surfaces it
  • quick mode stays compact — no full Judge record without a material trigger
  • Revise/rerun bounded by explicit Judge findings + AES governance
  • Smoke QA has an over-strong-conclusion → revise case
  • No second QA framework or duplicate taxonomy

Non-goals respected: does not replace Memo Judge or deterministic QA; the 22-method registry, analytical intents, and AES execution governance are untouched; no autonomous agent / self-improvement loop.

Checks

6 canonical scripts + audit_bundle_provenance.py --check + pytest tests/ -q (231 passed).

Rollback

git revert this commit — docs-only; bundles + provenance regenerate from the reverted sources.

🤖 Generated with Claude Code

#357)

Adds a compact post-findings orchestration checkpoint — findings ->
Analytical Judge -> pass / revise / blocked -> final findings -> memo — that
challenges the analytical conclusion before narrative packaging. It reuses the
existing controls and introduces no second QA framework, taxonomy, method, or
intent.

- ANALYTICAL_REASONING_STANDARD.md: new §8 "Analytical Judge gate" (seven
  semantic checks mapped to TASK_PROFILE / METHOD_PLAN / CLAIM_EVIDENCE_REGISTRY
  / explanation challenge / FINAL_EVIDENCE_SUFFICIENCY / material synthesis;
  ANALYTICAL_JUDGE output record; bounded revise/rerun; quick-mode collapse).
  §8->§9 (Runtime collapse), §9->§10 (Stop/escalation) renumbered; full-path
  block updated.
- ANALYTICS_WORKFLOW.md: canonical workflow + Step 9 make the gate explicit
  before memo/report.
- QA_CHECKLIST.md: post-findings Analytical Judge gate block (orchestration,
  not a second framework).
- ACCEPTANCE_CRITERIA.md: criterion 12, analytical_judge_status field, blocked
  status entry.
- GOVERNANCE_AND_ANTI_PATTERNS.md: gate principle, blocker, and anti-pattern
  rows (no autonomous retry loop, no second framework, blocked != executed).
- SMOKE_QA_FOR_ANALYTICS.md: case forcing an over-strong "root cause" claim to
  revise; quick-mode collapse case.
- CHANGELOG.md entry; regenerated ANALYTICS_01/03/05 bundles + provenance.

Enforced invariants unchanged: claim strength <= final evidence sufficiency;
driver != root cause; correlation != causation; blocked != executed;
manual_review_required governed by the reasoning standard; AES canonical.

Checks: 6 canonical + provenance + pytest (231) pass.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
@github-actions github-actions Bot added the needs-human-review Human review is required before merge label Sep 2, 2026

@github-actions github-actions Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Merge gate: protected paths changed. Auto-merge is disabled and owner review is required via CODEOWNERS.

@sergstack
sergstack merged commit 64d39a5 into main Sep 2, 2026
2 checks passed
@sergstack
sergstack deleted the codex/issue-357-analytical-judge-gate branch September 2, 2026 13:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

needs-human-review Human review is required before merge

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Analytics] Restore explicit Analytical Judge gate after findings

1 participant