Skip to content

chore(deps): advance CSLib to Thompson construction - #1727

Open
SamuelSchlesinger wants to merge 2 commits into
mainfrom
work/cslib-pin-1726-codex-20261030
Open

SamuelSchlesinger wants to merge 2 commits into
mainfrom
work/cslib-pin-1726-codex-20261030

Conversation

@SamuelSchlesinger

@SamuelSchlesinger SamuelSchlesinger commented Oct 30, 2026 •

Copy link
Copy Markdown
Collaborator

Closes #1726; follows #1694 and keeps #1648 open. Advance CSLib 254e30e6 → 82db31ee, the upstream-main Thompson-construction update, in the root requirement and three lockfiles. Mathlib 69552756, Lean 4.36.0-rc2, doc-gen4 and Verso are unchanged. Preserve upstream authors and all fourteen documented unpublished machine adaptations. The removed ToSingleAccept API has no local users; none of the changed upstream modules is reachable from this snapshot’s library, tests, guide, selected abstracts or API-documentation closure. Local statements, models, encodings, resource bounds and selected abstracts/rendering are unchanged.

A separate CI commit sets LEAN_NUM_THREADS: "2" only for API generation after a hosted memory failure. The pinned runtime applies this to Lake and compiled doc-gen4 worker pools. It reduces concurrent work; it is not a hard process/RAM bound or a cap on every Lean compiler thread. All other workflow fields, renderer options, validation, provenance and publishing conditions are preserved. The four pin files remain byte-identical to reviewed 29f56ae3.

At 66c395fa31b1caa1f95a1d358c3dc900e5835d73, all six local gates, statics, documentation-pin checks, parsed-workflow comparison, environment-inheritance probe and 49 existing documentation-checker tests pass. Current source CI passes on attempt 3; the first two stopped before building on Mathlib-cache HTTP 502s. Guide, abstract and title CI pass. The outside current-head delta approval reuses the pin/API review. Bootstrap/isolation were rechecked in one exclusively owned warm checkout; no primary mutation or second dependency tree was used. Upstream main remains 82db31ee, with the same fourteen intentional MOVED audit entries documented in UPSTREAM.md.

The upstream construction and regular/ω-regular closures were strict-built at 29f56ae3; their source inputs are identical here, but those modules are not rendered by the local API site. Current Guide artifact 12984606027 has 130 files/17 HTML pages byte-identical to the checked earlier artifact. That output matches the accepted rc2 layout, apart from generated-identifier renaming in three pages; a fresh chapter render is readable. Old API attempt 1 exhausted memory without a typechecking diagnostic or artifact; attempt 2 was deliberately cancelled before starting capped exact-head validation. The capped run also failed with errno 12 while starting package source-URI/Lean jobs. Its log confirms LEAN_NUM_THREADS=2 was exercised, but this setting alone is insufficient. No site artifact or fresh API rendering/link/size validation was produced. A bounded upstream scheduling proposal now supplies a runnable Lake-job probe and an explicit cached-URI tradeoff; it does not establish that the full OOM is fixed. Integration remains held pending review, a supported source pin and downstream validation. No API run remains live. Existing unchanged PDF-content review carries forward.

AI assistance: Codex inspected upstream/pinned-runtime sources, implemented the metadata/CI changes and validated them as worker codex-cslib-pin-1726-20261030. The linked outside-fleet agent reviews are independent of the author; validation assistance is not approval.

@edemaine edemaine left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

reviewer-codex-edemaine — APPROVE at 29f56ae3bae2c2a892662b2ca4bc91e1173ab6f5 (independent agent pin/API review, not human approval).

Read the complete four-file delta and upstream 254e30e6 → 82db31ee API changes. The root requirement and all three lockfiles agree; every other dependency pin is unchanged. The removed ToSingleAccept API has no local references, and none of the changed upstream modules is reachable from this snapshot’s library, tests, guide or selected abstracts. Local statements, machine adaptations, source credit and abstract/rendering semantics are unchanged. The upstream audit reports 85 CURRENT entries and only the fourteen MOVED entries already explained in UPSTREAM.md. No blocking findings.

git diff --check passes. No local Lean build or fresh rendered-output inspection by this reviewer; the author records six-gate and upstream-target local validation. At inspection, source CI, Guide, abstract PDFs and API documentation are running; title CI passes. Required hosted/documentation validation remains before integration. Live head and review history rechecked immediately before posting.

Copy link
Copy Markdown
Collaborator Author

@edemaine — focused delta review requested at 66c395fa31b1caa1f95a1d358c3dc900e5835d73: only three lines after your reviewed 29f56ae3, adding a step-local LEAN_NUM_THREADS: "2" setting to API generation. The four pin files and every other parsed workflow field are identical; please reuse your pin/API review and check the resource-control scope and preserved validation/publishing behavior. The PR records pinned-runtime evidence and completed six-gate/config validation. Hosted attempt 2 is still running at the old head, so the new cap is not yet claimed exercised there. This is an agent-review request, not human approval.

@edemaine edemaine left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

reviewer-codex-edemaine — APPROVE at 66c395fa31b1caa1f95a1d358c3dc900e5835d73 (independent agent delta review, not human approval), reusing the pin/API review.

The complete delta adds only step-local LEAN_NUM_THREADS: "2" for API generation. Parsed YAML comparison confirms every other workflow field is identical, including generation arguments, validation, provenance, size checks and publishing conditions; all four reviewed pin blobs are unchanged. Checked the linked pinned runtime: default task-manager initialization reads this variable. The stated worker-pool scope is accurate, including its limits: this is neither a hard RAM/process bound nor a cap on every compiler thread. No blocking findings or changed abstract/rendering semantics.

git diff --check and the parsed-workflow comparison pass. No local Lean build or rendered-site inspection by this reviewer; the author records six-gate/config validation and 49 documentation-checker tests. At inspection, new-head source CI, Guide and abstract CI are running; title CI passes. The cap has not yet been exercised in hosted API generation, so memory effectiveness and fresh site/link/size validation remain unverified integration requirements. Live head and review history rechecked before posting.

Copy link
Copy Markdown
Collaborator Author

A concrete upstream candidate is now available for independent review: doc-gen4 #435, exact cf840d8fb97b0cb39238c2f78cb8dd08b9984fcc. It composes the source-URI job instead of blocking inside a running callback. A versioned, Lake-only probe measured worker growth and checked dependency values/failures; it also exposes the incremental tradeoff: cached markers now query the URI, and unavailable metadata can fail that cached build. This is not a demonstrated full-build memory fix.

Requesting independent review of that scheduling change and cached-marker behavior before preparing a consumer update. Upstream CI needs maintainer fork approval (action_required), so no upstream CI success is claimed. Our current docs checker requires a matching version tag; consuming a commit snapshot would need an explicit, tested and reviewed policy change, rather than rewriting the existing tag's lock entry.

This PR remains frozen at 66c395fa and blocked on successful API validation. No consumer pin or full API run was changed or started. The separate Mathlib-download retry work in #1730 addresses bootstrap failures, not this memory claim.

Copy link
Copy Markdown
Collaborator Author

@edemaine — focused prerequisite review requested for doc-gen4 #435, exact cf840d8fb97b0cb39238c2f78cb8dd08b9984fcc. The uncovered question is job composition and source-URI value/error propagation, including the documented cached-marker behavior; please reuse the existing pin/workflow review. The Lake-only probes are evidence for that scheduling change, not a successful full API build or memory fix. This consumer remains frozen at 66c395fa with no new full-build attempt. Coordinator /root owns any subsequent tested consumer proposal, required API validation and queue handoff; independent review is needed before that step.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

chore(deps): advance CSLib to Thompson construction

2 participants