Skip to content

Fix non-root Numba caching and release 0.1.2 - #3

Merged
jpn-- merged 1 commit into
mainfrom
fix/writable-numba-cache
Sep 19, 2026
Merged

jpn-- merged 1 commit into
mainfrom
fix/writable-numba-cache

Conversation

@jpn--

@jpn-- jpn-- commented Sep 19, 2026

Copy link
Copy Markdown
Member

A non-root benchmark container could fail during warmup when importing sharrow.maths, reporting cannot cache function 'piece': no locator available. Installed packages and the default home were not writable by the model user.

Set NUMBA_CACHE_DIR=/results/cache/flows/.numba before the container starts Python. Warmup, measured attempts, and spawned workers share this writable location, and compatible experiment snapshots retain its compiled artifacts. Check cache write access before launching the model.

The Docker fixture now imports and compiles the installed Sharrow piece helper, and checks that its compiled cache exists. Existing tests cover serial/MP runs, measured cache retries, and reuse across experiments. Prepare release 0.1.2 and document the new cache location.

Validation: 146 unit tests, all four Docker integration tests, and pre-commit checks passed locally. GitHub CI additionally checks Python 3.10–3.12 and built wheels.

@jpn--
jpn-- merged commit 6123edc into main Sep 19, 2026
8 checks passed
@jpn--
jpn-- deleted the fix/writable-numba-cache branch September 19, 2026 02:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant