Issues

• Exact Newton-Schulz for sharded weights in Muon

  enhancement
  KempnerInstitute/KempnerForge#280 · Filter by author timothyngo opened on Oct 15, 2026

• Make Muon's Nesterov momentum and update scale configurable

  enhancement
  KempnerInstitute/KempnerForge#277 · Filter by author timothyngo opened on Oct 15, 2026

• Remove comments from the codebase and keep the standard docstring

  KempnerInstitute/KempnerForge#270 · Filter by author amazloumi opened on Oct 15, 2026

• compare-optimizers.md quotes a Muon/AdamW parameter split that 7b_16gpu_muon.toml does not produce

  documentationlow
  KempnerInstitute/KempnerForge#266 · Filter by author timothyngo opened on Oct 15, 2026

• test_pp.py's 1F1B tests cannot run on 4 GPUs: 2 micro-batches for 4 pipeline stages

  bugcoremedium
  KempnerInstitute/KempnerForge#265 · Filter by author timothyngo opened on Oct 15, 2026

• Transformer constructor knobs to omit the token embedding and output head

  coreenhancement
  KempnerInstitute/KempnerForge#263 · Filter by author amazloumi opened on Oct 15, 2026

• Typed config contract and pinned manifest for the image-understanding recipe example

  enhancement
  KempnerInstitute/KempnerForge#262 · Filter by author amazloumi opened on Oct 15, 2026

• Checkpoint resume restores rank 0's dataloader/RNG state on every rank

  bugcorehigh
  KempnerInstitute/KempnerForge#261 · Filter by author amazloumi opened on Oct 15, 2026

• Packed causal attention: caller-defined bidirectional visibility groups

  coreenhancement
  KempnerInstitute/KempnerForge#260 · Filter by author amazloumi opened on Oct 15, 2026

• Accept explicit per-token position ids in Transformer.forward

  coreenhancement
  KempnerInstitute/KempnerForge#259 · Filter by author amazloumi opened on Oct 15, 2026

• tokens/sec is computed from the configured seq_len, not the actual batch length

  coremedium
  KempnerInstitute/KempnerForge#251 · Filter by author amazloumi opened on Oct 9, 2026

• A plugin-registered scheduler cannot be selected from config: enum coercion rejects registered names

  coremedium
  KempnerInstitute/KempnerForge#250 · Filter by author amazloumi opened on Oct 9, 2026

• examples/notebooks/README.md documents uv run jupyter lab, but jupyterlab is not a dependency

  low
  KempnerInstitute/KempnerForge#249 · Filter by author amazloumi opened on Oct 9, 2026

• config-sections.md does not document the VLM, vision_encoder, adapter and video sections

  low
  KempnerInstitute/KempnerForge#248 · Filter by author amazloumi opened on Oct 9, 2026

• An odd inferred head_dim passes config validation and fails with a bare assert at build

  coremedium
  KempnerInstitute/KempnerForge#247 · Filter by author amazloumi opened on Oct 9, 2026

• CI trigger paths miss changes their suites depend on

  medium
  KempnerInstitute/KempnerForge#246 · Filter by author amazloumi opened on Oct 9, 2026

• kempnerforge/README.md relative links are broken on GitHub

  corelow
  KempnerInstitute/KempnerForge#245 · Filter by author amazloumi opened on Oct 9, 2026

• on_step_end hooks never see gradients: the loop zeroes them first, so the documented grad-norm example logs nothing

  coremedium
  KempnerInstitute/KempnerForge#244 · Filter by author amazloumi opened on Oct 9, 2026
  1

• Smoke-test failure messages keep only the last 3000 characters, hiding the root cause

  medium
  KempnerInstitute/KempnerForge#243 · Filter by author amazloumi opened on Oct 9, 2026

• Coverage's \.\.\. exclude pattern silently removes whole functions whose signature contains ...

  medium
  KempnerInstitute/KempnerForge#242 · Filter by author amazloumi opened on Oct 9, 2026

• Back-to-back async checkpoint saves still deadlock intermittently mid-suite (regression of #104)

  corehigh
  KempnerInstitute/KempnerForge#241 · Filter by author amazloumi opened on Oct 9, 2026

• FP8 converts projections whose dimensions are not divisible by 16; valid configs crash in the first forward

  corehigh
  KempnerInstitute/KempnerForge#240 · Filter by author amazloumi opened on Oct 9, 2026

• Checkpoint saved with AdamW loads silently into a Lion run

  coremedium
  KempnerInstitute/KempnerForge#239 · Filter by author amazloumi opened on Oct 9, 2026

• FreezeStage that unfreezes a module frozen at build silently trains nothing

  blockingcore
  KempnerInstitute/KempnerForge#237 · Filter by author amazloumi opened on Oct 9, 2026

• schedule_free_adamw cannot resume: ZeroDivisionError during checkpoint load

  corehigh
  KempnerInstitute/KempnerForge#236 · Filter by author amazloumi opened on Oct 9, 2026