Repository navigation
Qualify precision once per backend: 36% less time, full coverage - #5848
Mister-Meeseeks merged 5 commits into
Conversation
(cherry picked from commit ba8a9e6)
|
HANDOFF — complete single-pass precision qualification; local qualification and exact-head hosted CI complete.
|
|
CLAIM — bounded verification-engineering follow-up to PR #5848, frozen head |
|
NEGATIVE FINDING / DONE / RELEASED — the exact Fraction zero/unit prototype passes correctness but does not justify constructing a faster complete qualifier. No performance PR or kappa claim.
|
|
CLAIM — bounded verification follow-up to PR #5848, exact source |
|
FINDING / DONE / RELEASED — Fraction primitive profiling identifies a useful exact local table, but the complete-cost screen does not clear the requested 15% gate. No performance PR or kappa claim.
|
Change and mathematical scope
Complete frozen precision qualification recomputes the actual ideal/error outputs after both full contracts have already produced them. This opt-in package retains those complete first-pass outputs separately inside each independently executed backend, then performs the same full comparisons. Across six fresh serial processes, median wall time falls 61.007 → 39.015 seconds (36.05% less) and median CPU falls 60.950 → 38.880 seconds (36.21% less). All observations are retained in B,C,C,B,B,C order.
Both complete Fraction and exact-integer contracts still execute all 25,984 events and 799 coordinates. Full original results, actual ideal metadata/local weights, complete error traces and every signed witness are compared. All signed final transpose checks, literal attaining fixtures, six original semantic rejections, original 120-program/4,240-event differential and three integer rejections remain. No backend, frozen source, expected receipt, timeout, arithmetic or sampled subset is changed.
Each observation binds the whole word, exact weights and rounded operation set, checks input stability, deep-copies outputs and is consumed once after its complete contract succeeds. The two backends share no new answer cache; nothing persists across commands. The Fraction module-factory seam is scoped and restored in
finally.PROOF.mdandCOVERAGE.mdexplain why eliminating duplicate deterministic same-input calls preserves the comparisons. This is verification engineering: precision/physical claims, all five framework assumptions, kappa and selected metadata retain their status.Task and overlap
Explicit donor assignment; refined
replay-runtime, scopePR5831/frozen-7c5eb98/complete-single-pass-qualification. Pre-execution claim and profile/finite/first-pair progress precede expansion. Canonical main freshly fetched at entry and submission isde5ec2e7a6074068452f45b1a191b5c72832df4a, priority 8. Source PR #5831 remains7c5eb98e7439d778141d63e801e53d4cd7e1d587, retaining PR #582658f93cf41751920f3d6766a39caccc2974ce18b0.PR #5839 validates production replay on Linux and separately records the slower expanded qualification. This contribution addresses that expanded qualification. PR #5818 and PR #5832 address different literal-interpreter qualifications. Targeted PR/body searches, source PR comments and Discussion #2750 found no matching successor. This is bounded overlap coverage, not exhaustive or unpublished-work assurance.
Profiling and finite feasibility preceded construction. The nominated shared-helper group passes all ten tests after authenticating its complete fixture/history closure, but setup is only 0.287 of 51.317 seconds. Even removing all setup cannot meet 15%, so no shared helper, test, fixture, wait or platform skip is changed. The measured precision duplication justified the one candidate.
The isolated package is
research/p104-single-pass-qualification/. Its complete official 13-file PR5831 export is retained unchanged at ancestorb41545693de902b2b3b1ffd0218090de0cbcc062; pending predecessor Git objects are not runtime dependencies. The branch carries Ali Romman's same exact test-only PR #5761 dependency, sourceba8a9e640e1983f3c29993fefa3f46e8ed03313a, preserving authorship/cherry-pick credit. No other shared-code change is introduced.Validation
Ubuntu Linux x86_64, CPython 3.12.3. A valid five-event COPY/SCALE/CLEAR fixture uses both real frozen backends, complete fresh output comparisons and 27 input/lifetime/exception/alias controls, normally and under
-O, before full construction. The candidate's benchmark includes these controls. Four inherited pre-import custody corruptions remain a separate small prequalification stage inside the registered command.The first complete pair passes the required 15% wall/CPU gate before four further observations. All six complete scientific receipts match, including scale bits 55 and unchanged prefix/public/owned guards 26/23/22. Baseline wall range is 60.716–63.059 seconds; candidate 38.937–39.017. Kernel peak RSS maxima rise from 101.48 to 115.24 MiB; sampled process-group peaks are reported separately. The host is unreserved, OS caches unflushed and there are three samples per arm: no universal factor or statistical confidence is claimed.
This performs custody controls, new finite controls and fresh full qualification. Complete registered normal and optimized commands pass in 39.240 / 39.179 seconds. The read-only, Git-free implementation export passes under
-I -O -B, empty PATH and an explicit authenticated import root in 39.244 seconds; all 91 exported files keep their bytes/modes. The inherited private nested scratch remains writable; this adds no new nested-scratch enforcement claim.All 15 local guarded commands pass, including both profiles, four finite prototype/hardening commands, six balanced measurements and three full normal/optimized/export checks. They total 533.409 seconds, below the shared 1,500-second cap. The original precision command remains 180 seconds; helper profiling is capped at 300 seconds, sampled group RSS at 1 GiB. Full runs are serialized, with no automatic retries. A draft metadata outcome enum was rejected before registered execution and corrected; its message is retained. No scientific input, expected result, source or resource limit was repaired.
Publication
66fb6c6b8683b37967e9d7f313b3df99a49d2406: all 97 committed package files/bytes/modes, immediate own-input ancestry and official export/input coverage pass. Implementation export9b8cffa57c09eefba39dc6a4efdc34a15dfc1ebdcontains the qualified runtime; later changes are evidence/reporting/notices only. All 11 runtime/input files are unchanged. Full-history preflight is unavailable in this shallow checkout. Exact-head hosted CI and independent scientific acceptance remain separate and will be recorded in the canonical handoff.Raw scientific stdout is unfiltered; only the volatile timing field is excluded from scientific-receipt equality. Public resource receipts omit local script paths.
PROFILE.md,COVERAGE.md,PROOF.md,BENCHMARK.json,VALIDATION.jsonandevidence/retain the rejected nomination, gate history, measurements, full outputs and limitations.Credit
Ali Romman supplied the integer backend, scale proof, explicit adaptation, original qualification and macOS measurements. Preserve PR #5826, PR #5819, Adam Gall, ywz65, PR #2878, Mason Hale/PR #5811 and all retained P104/native/compiler/precision notices. roger-sato/Arham Tahir supplied the historical-source-role test lineage. Guard/custody mechanics follow PR #5816, PR #5818, PR #5832 and PR #5839. Original archives/notices are unchanged. New profiling, one-use observation, finite controls and Linux measurements: Chris R / Clear1nsight, with substantial OpenAI Codex assistance; no subagents or independent human/kernel acceptance. Apache-2.0.
Open next questions
Review the complete-output and observation-lifetime argument before adopting the opt-in command. Another Linux host can repeat the bounded six-process comparison. A source-owned explicit output interface could simplify the scoped wrapper, after coordination and fresh source binding. A changed word/backend requires new coverage and finite feasibility; this package gives no automatic transfer. The engineering scope ends at submission/handoff. Kappa research, Work 1/2, feeds, workers and automations remain paused.