Skip to content

Freeze the V4 focused confirmation protocol - #3532

Merged
joshlf merged 1 commit into
mainfrom
Gpt2gxvx72macbs3xnoxkx7o3k5mtekib
Sep 3, 2026
Merged

Freeze the V4 focused confirmation protocol#3532
joshlf merged 1 commit into
mainfrom
Gpt2gxvx72macbs3xnoxkx7o3k5mtekib

Conversation

@joshlf

@joshlf joshlf commented Aug 3, 2026

Copy link
Copy Markdown
Member

Freeze a 50-report blind evaluation of V4 against V3: five focused modes, two
conditions, and five fresh replicates per cell. The modes test proof-kernel
completeness, Boolean configuration semantics, length and arithmetic reasoning,
quantifier-sensitive verdicts, and abstraction redesign.

Seal the condition map, prompts, fixtures, frozen skill packages, authority
allowlists, atom rubrics, canonical output schema, scoring packets, retry rules,
and preregistered gates before collection. Require V4 to pass every required
atom in every replicate, with zero hard errors, TCB or authority defects,
proposal laundering, semantic noncompletion, scope failures, or budget
failures. Treat V3 only as a diagnostic comparator.

Retain exact package digests, reviewer records, validation tools, and an
append-only event protocol so collection, scoring, and unblinding can be
distinguished. No candidate reports exist at freeze time.

Agent-Authored-By: AI agent acting on Josh Liebow-Feeser's behalf


This PR is on branch codex/unsafe-rust-stack.

Latest Update: v19 — Compare vs v18

📚 Full Patch History

Links show the diff between the row version and the column version.

Version v18 v17 v16 v15 v14 v13 v12 v11 v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v19 v18 v17 v16 v15 v14 v13 v12 v11 v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v18 v17 v16 v15 v14 v13 v12 v11 v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v17 v16 v15 v14 v13 v12 v11 v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v16 v15 v14 v13 v12 v11 v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v15 v14 v13 v12 v11 v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v14 v13 v12 v11 v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v13 v12 v11 v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v12 v11 v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v11 v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v10 v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v9 v8 v7 v6 v5 v4 v3 v2 v1 Base
v8 v7 v6 v5 v4 v3 v2 v1 Base
v7 v6 v5 v4 v3 v2 v1 Base
v6 v5 v4 v3 v2 v1 Base
v5 v4 v3 v2 v1 Base
v4 v3 v2 v1 Base
v3 v2 v1 Base
v2 v1 Base
v1 Base
⬇️ Download this PR

Branch

git fetch origin refs/heads/Gpt2gxvx72macbs3xnoxkx7o3k5mtekib && git checkout -b pr-Gpt2gxvx72macbs3xnoxkx7o3k5mtekib FETCH_HEAD

Checkout

git fetch origin refs/heads/Gpt2gxvx72macbs3xnoxkx7o3k5mtekib && git checkout FETCH_HEAD

Cherry Pick

git fetch origin refs/heads/Gpt2gxvx72macbs3xnoxkx7o3k5mtekib && git cherry-pick FETCH_HEAD

Pull

git pull origin refs/heads/Gpt2gxvx72macbs3xnoxkx7o3k5mtekib

Stacked PRs enabled by GHerrit.

@codecov-commenter

codecov-commenter commented Aug 3, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 91.85%. Comparing base (da7923a) to head (dab498a).

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #3532   +/-   ##
=======================================
  Coverage   91.85%   91.85%           
=======================================
  Files          20       20           
  Lines        6093     6093           
=======================================
  Hits         5597     5597           
  Misses        496      496           

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@joshlf
joshlf force-pushed the Gavvgvuiorzpz3yzrmmlq5zb5inu3nazb branch from bd3c8b8 to b873e00 Compare August 29, 2026 10:42
@joshlf
joshlf force-pushed the Gpt2gxvx72macbs3xnoxkx7o3k5mtekib branch 2 times, most recently from 64bcd22 to b3e8e85 Compare August 29, 2026 11:11
@joshlf
joshlf force-pushed the Gavvgvuiorzpz3yzrmmlq5zb5inu3nazb branch from b873e00 to 4179be5 Compare August 29, 2026 11:11
@joshlf
joshlf force-pushed the Gavvgvuiorzpz3yzrmmlq5zb5inu3nazb branch from 4179be5 to 7b65115 Compare September 1, 2026 22:15
@joshlf
joshlf force-pushed the Gpt2gxvx72macbs3xnoxkx7o3k5mtekib branch from b3e8e85 to 0f43205 Compare September 1, 2026 22:15
@joshlf
joshlf force-pushed the Gavvgvuiorzpz3yzrmmlq5zb5inu3nazb branch from 951c6a4 to d30ea6a Compare September 2, 2026 21:51
@joshlf
joshlf force-pushed the Gpt2gxvx72macbs3xnoxkx7o3k5mtekib branch 3 times, most recently from c0a6959 to fbc9c93 Compare September 2, 2026 23:04
@joshlf
joshlf force-pushed the Gavvgvuiorzpz3yzrmmlq5zb5inu3nazb branch from 28024d8 to bc2f0a8 Compare September 2, 2026 23:04
@joshlf
joshlf force-pushed the Gpt2gxvx72macbs3xnoxkx7o3k5mtekib branch from fbc9c93 to 6874910 Compare September 3, 2026 00:07
@joshlf
joshlf force-pushed the Gavvgvuiorzpz3yzrmmlq5zb5inu3nazb branch from bb47452 to f08e1e6 Compare September 3, 2026 01:00
@joshlf
joshlf force-pushed the Gpt2gxvx72macbs3xnoxkx7o3k5mtekib branch 2 times, most recently from d4b141e to 6bba97d Compare September 3, 2026 01:33
@joshlf
joshlf force-pushed the Gavvgvuiorzpz3yzrmmlq5zb5inu3nazb branch 2 times, most recently from 61b1bbb to 8b24322 Compare September 3, 2026 02:26
@joshlf
joshlf force-pushed the Gpt2gxvx72macbs3xnoxkx7o3k5mtekib branch 2 times, most recently from 0ea0029 to 4720761 Compare September 3, 2026 03:03
@joshlf
joshlf force-pushed the Gavvgvuiorzpz3yzrmmlq5zb5inu3nazb branch from 8b24322 to 25175d2 Compare September 3, 2026 03:03
@joshlf
joshlf force-pushed the Gpt2gxvx72macbs3xnoxkx7o3k5mtekib branch from 4720761 to 69fd512 Compare September 3, 2026 04:06
@joshlf
joshlf force-pushed the Gavvgvuiorzpz3yzrmmlq5zb5inu3nazb branch from 25175d2 to 36a2372 Compare September 3, 2026 04:06
@joshlf
joshlf force-pushed the Gpt2gxvx72macbs3xnoxkx7o3k5mtekib branch from 69fd512 to 856b8e7 Compare September 3, 2026 04:42
@joshlf
joshlf force-pushed the Gavvgvuiorzpz3yzrmmlq5zb5inu3nazb branch from 36a2372 to 2613bd8 Compare September 3, 2026 04:42
Base automatically changed from Gavvgvuiorzpz3yzrmmlq5zb5inu3nazb to main September 3, 2026 05:12
Freeze a 50-report blind evaluation of V4 against V3: five focused modes, two
conditions, and five fresh replicates per cell. The modes test proof-kernel
completeness, Boolean configuration semantics, length and arithmetic reasoning,
quantifier-sensitive verdicts, and abstraction redesign.

Seal the condition map, prompts, fixtures, frozen skill packages, authority
allowlists, atom rubrics, canonical output schema, scoring packets, retry rules,
and preregistered gates before collection. Require V4 to pass every required
atom in every replicate, with zero hard errors, TCB or authority defects,
proposal laundering, semantic noncompletion, scope failures, or budget
failures. Treat V3 only as a diagnostic comparator.

Retain exact package digests, reviewer records, validation tools, and an
append-only event protocol so collection, scoring, and unblinding can be
distinguished. No candidate reports exist at freeze time.

gherrit-pr-id: Gpt2gxvx72macbs3xnoxkx7o3k5mtekib
Agent-Authored-By: AI agent acting on Josh Liebow-Feeser's behalf
@joshlf
joshlf force-pushed the Gpt2gxvx72macbs3xnoxkx7o3k5mtekib branch from 856b8e7 to dab498a Compare September 3, 2026 05:14
@joshlf
joshlf enabled auto-merge September 3, 2026 05:14
@joshlf
joshlf added this pull request to the merge queue Sep 3, 2026
Merged via the queue into main with commit cbbe1de Sep 3, 2026
105 checks passed
@joshlf
joshlf deleted the Gpt2gxvx72macbs3xnoxkx7o3k5mtekib branch September 3, 2026 05:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants