Skip to content

Sweep add-ons: seeded repeats, local max_parallel, W&B grouping, sweep_slurm.sh (on #105) - #106

Open
aaronsmulktis wants to merge 6 commits into
mainfrom
aaronsmulktis/sweep-addons
Open

aaronsmulktis wants to merge 6 commits into
mainfrom
aaronsmulktis/sweep-addons

Conversation

@aaronsmulktis

@aaronsmulktis aaronsmulktis commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Changes:

  1. Stacked on Run multiple task files and agents with the parallel launcher #105. Adds the sweep features from my local branches on top of open_apps.parallel_launcher.
  2. parallel_tasks.repeats=N runs every job N times with the seed fixed, to measure run-to-run variance. W&B run names get -r<N>.
  3. max_parallel=N runs local jobs N at a time, each in its own spawned process writing to <job>/run.log, with a summary at the end. Default 1 keeps the current sequential behaviour.
  4. With use_wandb=True, a sweep's runs share a W&B group named after its run-<id> directory, with the agent as job_type.
  5. Per-job port windows wrap every 500 jobs, so jobs ≥ 606 keep a window of their own instead of a random port.
  6. scripts/sweep_slurm.sh finds the vLLM node and runs a local sweep inside the allocation, MAX_PARALLEL at a time.

@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Meta Open Source bot. label Oct 29, 2026
@aaronsmulktis aaronsmulktis self-assigned this Oct 29, 2026
@aaronsmulktis
aaronsmulktis marked this pull request as ready for review October 29, 2026 20:44
Base automatically changed from marksibrahim/parallel-task-agent-sweeps to main October 30, 2026 15:14

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Meta Open Source bot.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant