Skip to content

Expose safe environment options for accelerator registration and vendor libraries - #4

Open
AlexWayfer wants to merge 2 commits into
offbit-ai:mainfrom
AlexWayfer:codex/environment-options
Open

AlexWayfer wants to merge 2 commits into
offbit-ai:mainfrom
AlexWayfer:codex/environment-options

Conversation

@AlexWayfer

Copy link
Copy Markdown

LiteRT auto-registers accelerators by default, but its dynamically loaded NPU backend requires a Dispatch library directory. Environment::new() cannot supply that directory or select which backends to register, so applications cannot configure vendor runtimes through the safe wrapper.

Add EnvironmentOptions and Environment::with_options() for accelerator registration masks, Dispatch libraries and compiler plugins. The environment owns the path strings for its entire native lifetime. Invalid encoding and embedded NUL bytes return InvalidPath; the native runtime remains responsible for loading and validating directories. Environment::new() retains its existing defaults.

Validation covers native option readback for all accelerator masks, default behavior, replacement values, temporary path lifetimes, environment moves, invalid paths and CPU inference. Windows wrapper tests (including GPU and lifecycle tests) and Clippy passed with the Windows MSVC fixes from #3; Linux API, CPU and lifecycle tests passed in Ubuntu WSL. No macOS or hardware NPU inference was tested. This PR contains only the environment API and tests; the Windows fixes remain in #3.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant