Repository navigation

All pull requests

Turn off thinking for Claude Code classifier requests
#670phaedrus1992 opened Oct 26, 2026
Build exact-prefix SSD restores with the caller's cache factory
#668CocoaBeans opened Oct 26, 2026
Bump mlx from 0.32.2 to 0.32.4
#667dependabot[bot] opened Oct 24, 2026Bot
Update transformers requirement from !=5.13.0,<5.17,>=5.10.0 to >=5.10.0,!=5.13.0,<5.21
#666dependabot[bot] opened Oct 24, 2026Bot
Bump actions/setup-python from 7.0.0 to 7.1.0
#665dependabot[bot] opened Oct 24, 2026Bot
Bump pypa/gh-action-pypi-publish from 1.14.2 to 1.14.3
#664dependabot[bot] opened Oct 24, 2026Bot
Bump filelock from 3.29.0 to 4.2.1
#663dependabot[bot] opened Oct 24, 2026Bot
Bump pillow from 12.3.0 to 13.0.0
#662dependabot[bot] opened Oct 24, 2026Bot
Make retries of the same prompt instant again
#661a3rosol opened Oct 23, 2026
Faster MoE routing on M1
#660a3rosol opened Oct 23, 2026
Add mtplx serve --jit: load models on demand
#659jregeimbal opened Oct 23, 2026
fix: guard QSA cache frontiers during resize and extension
#657transcendence-x opened Oct 23, 2026
fix: partial-prefix SSD restore must skip tuple meta states
#656Phydra11 opened Oct 23, 2026
A cancelled request keeps its cache outcome, and the dashboard shows it as cancelled
#652jvmenen opened Oct 20, 2026Contributor
SSD cold tier: the streaming spill uses the incremental-encode memo too
#651jvmenen opened Oct 20, 2026Contributor
fix: count pooled blocks from the restored keys, not the donor table
#650goodbadwolf opened Oct 20, 2026
1
SSD cold tier: read restores in parallel into one buffer per tensor
#648jvmenen opened Oct 19, 2026Contributor
SSD session cache telemetry: where restores spend their time, where they land, and how much the cache writes
#647jvmenen opened Oct 19, 2026Contributor
SSD cold tier: evict and expire entries this server can never restore first
#646jvmenen opened Oct 19, 2026Contributor
Tests: drop the operator's MTPLX switches before collection
#644jvmenen opened Oct 19, 2026Contributor
GDN prefill on MLX's chunked gated_delta_update (MTPLX_GDN_FAST_PREFILL, off by default)
#642jvmenen opened Oct 19, 2026Contributor
Segmented KV: the segment kernel follows the quarter split and the wide verify route
#639jvmenen opened Oct 17, 2026Contributor
Session bank: the generation-final commit keeps the prompt's recurrent checkpoints
#637jvmenen opened Oct 17, 2026Contributor
Fix DeepSeek MTP logit projection controls
#636sypsyp97 opened Oct 15, 2026Contributor
1
fix: apply output_config.effort on /v1/messages
#634goodbadwolf opened Oct 13, 2026
1

Pull requests