Skip to content

fix(skillgen): let GLM 5.3 Harness runs finish - #550

Merged
harlan-zw merged 5 commits into
mainfrom
fix/skillgen-run-deadline
Oct 7, 2026
Merged

harlan-zw merged 5 commits into
mainfrom
fix/skillgen-run-deadline

Conversation

@harlan-zw

@harlan-zw harlan-zw commented Oct 7, 2026 •

Copy link
Copy Markdown
Collaborator

🔗 Linked issue

Related to #529 and #545

❓ Type of change

  • 📖 Documentation
  • 🐞 Bug fix
  • 👌 Enhancement
  • ✨ New feature
  • 🧹 Chore
  • ⚠️ Breaking change

📚 Description

Since #529, no Skillgen run on GLM 5.3 can finish. With #545's session headers in place, three proofs on which-nuxt 0.4.1 failed for three reasons:

  • Time. GLM 5.3 takes about 26 seconds a step. One proof ran 32 verification steps and was cancelled at the 14 minute runner limit while it wrote SKILL.md. The sandbox limit rises to 45 minutes, and the runner asks the Agent to write SKILL.md by turn 20, so a deadline still leaves a candidate.
  • Output cap. GLM 5.3 reasoning counts as output. A step that reached the 8,192 token cap ended the Agent's turn with finish reason length, before any file was written. The OpenCode Go cap rises to 32,768.
  • Harness version. The runner pinned skilld-harness 3.3.0. The run ended on "Harness output directory is missing", a check that 3.6.4 returns to the Agent for up to two repair turns.

The GitHub job deadline also counted time in the queue. Jobs run one at a time, so a second tag would spend its deadline waiting behind a 45 minute run. The deadline is now 60 minutes from when a job leaves the queue. The /skillgen page and both runbooks state the new limits.

A branch deploy cannot prove this: a main deploy replaced the dispatched version 15 seconds later. The proof runs after this merges.

🤖 AI disclosure: Harlan Agent Kit modified this description. My AI open-source policy.

The first Harness proof on GLM 5.3 failed on its first model call:
OpenCode Go answered 400 MissingSessionID, because the gateway rebuilt
headers from scratch and dropped x-opencode-session. The gateway now
forwards the four x-opencode routing headers when each value is a plain
identifier. None of them carries a credential.
The first full GLM 5.3 proof spent its 14 minute runner budget on 32
verification steps, about 26 seconds each, and was cancelled while it
wrote SKILL.md. The sandbox limit rises to 45 minutes, and the runner
asks the Agent to write SKILL.md by turn 20 so a deadline still leaves a
candidate.

The GitHub job deadline counted time in the queue. Jobs run one at a
time, so a second tag would spend its deadline waiting behind a 45
minute run. The deadline now starts when a job leaves the queue.
@harlan-zw harlan-zw added the harlan-agent-review Pull request triage requires an adversarial Review. Adding this label manually always forces one. label Oct 7, 2026
@harlan-github-agent harlan-github-agent Bot added harlan-agent-review-required Pull request triage requires an adversarial Review for this head commit. and removed harlan-agent-review Pull request triage requires an adversarial Review. Adding this label manually always forces one. labels Oct 7, 2026
The proof client gave up after 17 minutes, before the new 45 minute sandbox limit.
Proof run 3 ended its turn at step 6 with finish reason length: GLM 5.3
reasoning counts as output, and the gateway capped each call at 8,192
tokens. The cap rises to 32,768 for OpenCode Go.

The runner also moves from skilld-harness 3.3.0 to 3.6.4, which returns
failed output checks to the Agent. That run ended with no output
directory, a check the Agent could have fixed in one more turn.
@harlan-zw
harlan-zw changed the base branch from fix/skillgen-opencode-session-header to main October 7, 2026 04:40
…line

# Conflicts:
#	workers/skill-harness/src/gateway.ts
@harlan-zw harlan-zw changed the title fix(skillgen): give GLM 5.3 runs time, start deadlines at run start fix(skillgen): let GLM 5.3 Harness runs finish Oct 7, 2026
@harlan-zw
harlan-zw merged commit 8608395 into main Oct 7, 2026
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

harlan-agent-review-required Pull request triage requires an adversarial Review for this head commit.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant