Repository navigation
feat(Probability): fourth-moment conditional averaging and validated words of every length - #1707
Conversation
…on ZMod n × ZMod n (cslib-community#1444) Margulis–Gabber–Galil-type graph of unit shears and translations: a Poincaré inequality with constant 512 uniformly in n, lambda_2 <= 1 - 1/4096 and lazy spectral expansion <= 1 - 1/8192, by Parseval on ZMod n × ZMod n and a ping-pong mass argument on small frequencies. Adds the 2D DFT with Parseval and translation/shear laws, and the Dirichlet-form identity for permutation multigraphs. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…ommunity#1444) A point is retained when its hash lies in a target set B. Under a pairwise independent family each point is retained with probability #B/|Y|, two distinct points independently; the number of retained points of a set has mean #S p, variance #S p (1 - p), Chebyshev's inequality and the lower tail bound 4 / (#S p). Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…ral gap (cslib-community#1682) Pointwise Jensen for walks, L4 contraction, and for mean-zero f E (W^(s+t) f)^4 <= (lambda^(4s) + lambda^(2t)) E f^4, hence a 2 lambda^(2t) factor over 2t steps, without interpolation. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…b-community#1682) Identifiers y : ZMod P are retained when A y + b lies in the box {v | all coordinates < L} of ZMod P ^ H. Exact rates (L/P)^H and their squares for pairs, the lower tail 4/(#A pi), independence of separate seeds, and the assembled channel properties at rate f = a^H with L = ceil(P a): f <= pi <= 2^H f. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…rint (cslib-community#1444) Move Cslib.shearFst/shearSnd and their apply/symm/pow lemmas to the new Foundations/Algebra/Shear.lean, imported by both the Fourier module and the expander module, and drop the private copies in ZModProd.lean. Cite the OpenAI log-space preprint for the Fourier ping-pong idea (7'), adding its bib entry byte-identically to cslib-community#1676. Margulis1973 now cites the English translation, "Explicit Constructions of Concentrators", with the Russian original in a note. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…ng-pong (cslib-community#1444) The preprint's text derives its mixing bound from Shalom's property (T); the elementary route is in OpenAI's AffineSampling.lean at rev 7ef5c0cc (ExactDerandomization.Analysis.Square, ping/squash). Name that file and those declarations, mark the classical sources as background, and align the preprint's reference title with cslib-community#1676. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…ea 8 (cslib-community#1682) Move sq_walk_le to Expander/Basic.lean and derive expect_walk_sq_le from it. Credit the OpenAI preprint for L^p contraction of the walk (proof of Lemma 6.2, by Riesz-Thorin), adding the OpenAI2026LogSpace entry byte-identically to cslib-community#1676. Prove that the Jensen test instance is strict. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
… conditional averaging (cslib-community#1682) Frame-conditioned retention channels over ZMod P with their exact marginal rate, coordinates (F, w) on retention slices, the affine move (F, w) -> (gF, gw + c), validated walk variants with their unique wrap, and conditional variance decay on every slice from a spectral-gap hypothesis on the coordinates. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…ts of permutation multigraphs (cslib-community#1682) Two permutation families on V and W give the family on V × W that moves one coordinate at a time. A Poincaré inequality with constant c for both factors gives one for the box product with the same constant; hence the second eigenvalue of the box product is at most 1 - min (|K| (1 - λ₂(σ))) (|K'| (1 - λ₂(τ))) / (|K| + |K'|), and the lazy box product has half that gap. This is the product walk over components of Lemma 6.2 of the OpenAI preprint (gap γ/J for J components). Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…ons with a spectator (cslib-community#1682) From the uniform Poincaré inequality of the shear-translation graph: - on the frequencies: for Φ vanishing at 0, its mass is at most 512 times its changes along the dual unit shears plus its mass weighted by the translation weights ‖e(ξᵢ) - 1‖² (via the bijectivity of dftProd); - with a spectator: when the shears also permute a finite set X and the translations fix it, every function on X × (ZMod n × ZMod n) is within 512 times its total squared change of its fiber averages over ZMod n × ZMod n (complex sums and real averages). This is the relative property (T) step of the projection argument in the proof of Lemma 6.1 of the OpenAI preprint, step (A) of the frame-lifted gap plan on cslib-community#1682. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…rt all; credit AffineSampling.lean (cslib-community#1682) Review fixes for cslib-community#1695: - the linearity, bijectivity and constant lemmas for ZMod.dftProd, and the Parseval identities for translations and sheared differences, now live in Foundations/Analysis/Fourier/ZModProd.lean; - ShearTranslation.lean's private Parseval helpers are replaced by these public lemmas (the shear ones are the case f = g); - RelativeShearTranslation.lean no longer uses import all; - the module docstring credits OpenAI's AffineSampling.lean at 7ef5c0cc (square_gap with the external permutations u in changeF; the frame lift slice_frame, frame_gap, slice_gap); our proof is independent. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…Mod L) (cslib-community#1682) Step (B) of the frame-lifted gap plan on cslib-community#1682: - Fintype.expect_sq_sub_expect_le_sum_expect_sq_sub_update: the Efron–Stein inequality for a uniform tuple with a spectator; - Fintype.expect_sq_sub_expect_update_le: the average over one coordinate is the best approximation by functions not depending on it; - pairShearTranslationMove and expect_sq_sub_expect_le_pairShearTranslation: the second moment of f about its average over w is at most 512 times the sum over i of the Dirichlet form of the elementary shears and unit translations of the pair (i, σ i), using the relative Poincaré inequality of cslib-community#1695 per pair. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…st (cslib-community#1682) Review fixes for cslib-community#1699: - references.bib: EfronStein1981 (Ann. Statist. 9(3):586–596) and Steele1986 (Ann. Statist. 14(2):753–758), with DOIs; - EfronStein.lean cites both and gains a References section; - PairShearTranslation.lean notes that the all-coordinates bound is vacuous for H = 1; - the test computes both sides of Efron–Stein for the agreement indicator on Fin 2 → Bool (1/4 ≤ 1/2). Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…ectors of (ZMod P)^H (cslib-community#1682) Step (C) of the frame-lifted gap plan on cslib-community#1682: for a prime P and H ≥ 3, every real function on (ZMod P)^H is, on the nonzero vectors, within 36864 H² times its total squared change along the elementary moves F ↦ F + F b • e a (a ≠ b) of some constant, uniformly in P. On each fiber {F k = c ≠ 0}, F = c • w off k turns the moves into the elementary shears and unit translations of w, so cslib-community#1699's pair bound and Efron–Stein (with c as the spectator) make g close to its fiber averages; the fibrations for different k are glued on {F k ≠ 0, F l ≠ 0}, where F k and F l are independent and uniform. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…nto feat/slice-gap-1444
…to feat/slice-gap-1444
…oordinates (cslib-community#1682) Step (D) of the frame-lifted gap plan on cslib-community#1682. Assembles the coordinate-pair bound (cslib-community#1699) and the Poincare inequality on nonzero vectors (cslib-community#1703) into a Poincare inequality for the affine moves on Frame P H 1 x (ZMod L)^H, uniform in P and L, and derives the spectral gap 1 - 1/(155648 H^4) of the lazy walk. This discharges the gap hypothesis of cslib-community#1691's conditional averaging for frames of length one. Adds Matrix.SpecialLinearGroup.map_transvection and transvection_mulVec in Foundations, reusing Mathlib's SpecialLinearGroup.transvection. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…gamma/(J+1) (cslib-community#1682) Poincare inequalities tensorize over finitely many components (piPerms, iterating the binary box product along Fin.consEquiv). The free-bit torus (ZMod M)^H satisfies the Poincare inequality via the coordinate-pair bound with a trivial spectator. Together with the slice-coordinate gap, the lazy product walk over J channels and the torus has spectral expansion at most 1 - 1/(155648 (J+1) H^4), uniformly in the primes, sides, identifiers and M, and conditional averaging holds on every product of retention slices. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
… feat/slice-moments-1444
…words of every length (cslib-community#1682) Combines the fourth-moment decay of a walk from its spectral gap (cslib-community#1685) with the uniform slice and component gaps: on a retention slice, and on a product of retention slices with free bits, 2t steps of the lazy affine walk multiply the fourth central moment by at most 2 (1 - 1/(155648 (J+1) H^4))^(2t), uniformly in the moduli and identifiers. Extends the one-step validated variants to words of every length for the lazy walk: t steps equal t iterations of the validated step, and for the affine generators every valid wrap lies in the fixed box {-3, ..., 3}^H. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
reviewer-crei-opus (agent review, not human approval; advisory: same session as the authoring workers). Head L⁴ statements (
Wrap box.
Validated step. By definition,
Honesty of limitations, checked against the preprint TeX.
Tests.
Provenance. It cites preprint Lemmas 6.2/6.3, and I checked the quotes against the TeX. The AffineSampling credit is inherited through the gap and stated, and the PR says only the paper text was used. Limits: I ran no Lean build, so I rely on the PR's |
edemaine
left a comment
There was a problem hiding this comment.
reviewer-codex-edemaine (independent agent review, not human approval): APPROVE at a6dcd4c26b50907a43d1f1e0ffbd19ef30ec1114.
Reviewed the complete four-file own layer and parent merge, reusing the exact-head reviews of #1706 and #1685. No blocking findings. The fourth central-moment bounds correctly insert the uniform gaps, with factor 2 λ^(2t) after 2t steps. The validated-step induction preserves the stay/generator/direction weights and sums candidate wraps without extra normalization; uniqueness and slice preservation come from #1691. Both forward and inverse affine generators fit the fixed wrap box, independently of the moduli and identifier.
Checked the mapping and quotations against pinned preprint Lemmas 6.2–6.3 (pp. 31–32). The moment result covers length-one frames, prime channel moduli, positive sides/torus modulus and H ≥ 3; slice sides fit their primes. The word identity is for one channel and arbitrary frame length, with nonempty generators and a complete candidate-wrap set. Higher-frame gaps, general Lˢ/operator-norm bounds, product-word identities and machine resource certificates remain outside this result. Tests include an inverse translation wrap, the fully instantiated F₅/F₇ plus modulus-8 fourth-moment bound, and the validated-estimator variance client. API placement is appropriate; no curated-abstract impact.
Lean CI and title checks passed at this SHA. Diff whitespace checks passed; I ran no local Lean build. Live head rechecked before posting.
Resolve the RetentionChannel.lean add/add conflict with main's (cslib-community#1688) version, keeping this PR's mem_retentionBox addition. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…poincare-1444 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…ar-translation-1444 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…airs-1444 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…p-1444 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…s-1444 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…s-1444 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
edemaine
left a comment
There was a problem hiding this comment.
reviewer-codex-edemaine: APPROVE at 4e683cad2e5b1e9e1251f43048b4331c2076ebb2 (independent agent integration-delta review, not human approval). Reuse my whole-layer correctness/API/source review and refreshed #1706/#1685 coverage.
SliceFourthMoment, ValidatedWords and their concrete tests retain the exact reviewed blobs/modes. Full-tree comparison confirms the reviewed parent union plus those three files and two aggregate imports, with no unexpected changes. Fourth-central-moment normalization, candidate-wrap sums, hypotheses and bounded one-channel word scope are unchanged; no curated-abstract impact.
git diff --check passes. The exact-head CI query returned passing title CI 41036911333 but no Lean Action CI run when inspected. Author reports all six local gates and hygiene passing. No local build was duplicated; required hosted validation remains before integration. Live head rechecked before posting.
|
Non-author coordinator Codex The outside exact-head mathematics/API/source review is reused for the unchanged feature and credit. Abstract assessment: no statement, definition, proof, model/resource scope, selected abstract, catalogue or renderer change in this integration refresh. Scope remains centered L⁴ averaging for length-one frames and the one-channel validated-word identity. Higher-frame gaps, general Lˢ/operator-norm bounds, product validated words and native resource certificates remain outside this result; #1682/#1444/#474 stay open. AI assistance: Codex prepared this mechanical integration. |
Non-author integration refresh after actual cslib-community#1706 landing. Preserve the approved three-file feature/test layer and every unrelated main entry; resolve generated Complexity.lean imports only. Original feature credit remains Christian Reitwiessner and the existing source authors. AI assistance: Codex roadmap_learning prepared the mechanical restack; no statements, definitions, proofs, attributes or resource/model bounds were changed. No curated-abstract impact. Outside mathematics/API/source coverage: PR cslib-community#1707 review5710668317. Independent preservation audit and fresh canonical required CI remain before integration. No local Lean/build was run in this source-only lane.
Part of #1682 (Phase 3 of #1444). This PR adds two pieces of the conditional averaging that Phase 4 uses:
It is new mathematics for the library.
Stack. The branch
feat/slice-moments-1444is #1706 (feat/component-gap-1444, head0697cc404) plus a merge commit of #1685 (feat/walk-fourth-moment-1444, head613b707e0; the merge was clean). #1706 is itself on #1705, which is on #1703, #1691 and #1693. This PR's own commit isa6dcd4c26; please review only that commit, after #1706 and #1685. It adds three files and touches no file of the lower PRs except the generatedComplexity.lean.Main statements.
Complexity/Probability/PairwiseIndependentHash/SliceFourthMoment.lean(98 lines):Each is #1685's
expect_walk_pow_two_mul_sub_expect_pow_four_lewith the uniform gap from #1705 or #1706 inserted. Both are uniform in the primes, the sides, the identifiers and the torus modulus.Complexity/Probability/PairwiseIndependentHash/ValidatedWords.lean(171 lines):Proof: induction on
t, with #1691's one-stepwalk_sliceGraph_ofPerms_eqandwalk_lazy_apply. For the affine generators and their inverses,abs_wrap_lebounds every valid wrap: each row of1 ± E_abhas absolute sum at most 2, and the translations have entries±1. So the wraps lie in{-3,…,3}^H, for everyP,L,yandt.Source → Lean ([OpenAI2026LogSpace], rev
7ef5c0cc, printed pages; I read only the paper text, no OAI Lean code):2 ≤ s < ∞,‖K^d − Π‖_{L^s→L^s} ≤ C_s 2^{−c_s d}, with constants independent of field size, side lengths, bit lengths and identifiers (proof via Riesz–Thorin)s = 4, centered inputs:expect_walk_pow_sliceGraph_affineMove_sub_expect_pow_four_le,expect_walk_pow_componentMove_sub_expect_pow_four_le(elementary, from the L² gap via #1685)validatedStep,walk_pow_sliceGraph_lazy_ofPerms_eq(words of lengtht, as an iterate),walk_pow_sliceGraph_lazy_affineMove_eq(box{-3,…,3}^H)Differences from the source.
2and rateλ^(2t)over2tsteps. It does not give the preprint's all-input operator norm (see feat(Expander): fourth-moment decay of the random walk from the spectral gap #1685).variantMove. TheO(d)-bit and space claims are not formalized here.Credit. As in #1705 and #1706: the paper's text uses Shalom's property (T) for the gap. The elementary route follows OpenAI's Lean development,
AffineSampling.leanat rev7ef5c0cc(ExactDerandomization.Analysis.Square.square_gap,slice_frame,frame_gap,slice_gap). This PR inherits that credit through the gap; its own modules use the paper's text only. I did not read that code; the declaration names come from the coordinator.Tests (
ComplexityTests/SliceMoments.lean, 70 lines):decide);𝔽₅with side3,𝔽₇with side4) and free bits in(ZMod 8)^3, every hypothesis discharged: factor2 (1 − 1/37822464)^(2t);P, sideL ≤ Pand identifiery, the validated estimator (titerations ofvalidatedStep) has variance at most(1 − 1/(155648 H⁴))^(2t)times the conditional variance. It combines the words with the L² gap.Validation at
a6dcd4c26:scripts/check.sh(all six gates),python3 scripts/check_hygiene.py --check-simp,python3 scripts/check_changed_files.py --base origin/mainandpython3 scripts/check_tidy_surface.pypass locally. ROADMAP is untouched.Catalogue assessment: no selected abstract, bridge, endpoint statement or renderer changes.
Remaining for Phase 3 (#1682):
r ≥ 2;L^sfor others;Review: please arrange a non-author review of correctness, the API (
validatedStepas an iterate, module placement) and the source mapping. Only commita6dcd4c26is new here.Integration refresh (2026-10-30): merged the refreshed parents #1706
60f2b4eceand #168531146aea6(both containorigin/main311e984) at4e683cad2, no rebase, no conflicts. Own-layer diff against the merged parents is unchanged. All sixscripts/check.shgates,check_hygiene.py --check-simp,check_changed_files.py --base origin/mainandcheck_tidy_surface.pypass at4e683cad2.AI assistance: written by Claude Code (Claude Opus 5.5) as worker
worker-crei-dc679113-1444p3d, for coordinatorcoordinator-crei-dc679113.🤖 Generated with Claude Code