Skip to content

rewrite e2e scenarios as yaml steps - #184

Merged
atkrad merged 4 commits into
mainfrom
rewrite-e2e-yaml-steps
Oct 12, 2026
Merged

atkrad merged 4 commits into
mainfrom
rewrite-e2e-yaml-steps

Conversation

@atkrad

@atkrad atkrad commented Oct 11, 2026

Copy link
Copy Markdown
Member

Summary

  • Move the Kind suite to internal/testing/e2e and run scenarios from the new six-step YAML.
  • Check each fixture with an embedded JSON Schema, then compile durations, CEL, and regular expressions before any Kubernetes write.
  • Delete only a namespace this run created, using a UID precondition, and report cleanup errors separately from the scenario result.

Related

Test plan

  • Unit tests added/updated
  • Scenario under scenarios/ (if behavior changes)
  • nix run .#lint / pre-commit clean
  • Manual smoke (command + expected result), if user-facing

go test ./internal/testing/ ./internal/testing/e2e/ ./internal/testing/celassert/ passed.
go test -tags integration ./internal/testing/ passed.
DEPLOYAH_E2E_FORCE=1 nix run .#test-e2e passed (64 tests).

Labels

  • One of: kind/feature, kind/bug, kind/docs, kind/chore
  • Add breaking-change if this breaks existing CLI or config behavior
  • Add skip-changelog for internal-only PRs that should not appear in notes

Checklist

  • Title is short and imperative (matches commit style)
  • Docs / CLI help updated when user-facing (README.md, docs/cli/)
  • No secrets or local-only paths in the diff

- move the kind suite under internal/testing/e2e
- check fixtures with an embedded json schema before they run
- delete only namespaces this run created
@atkrad atkrad added kind/chore Cleanup, deps, CI, or refactor with no user-facing change skip-changelog Exclude this PR from release notes labels Oct 11, 2026
@github-actions github-actions Bot added kind/docs Documentation only area/testing Scenarios, harness, goldens labels Oct 11, 2026
@codecov

codecov Bot commented Oct 11, 2026 •

Copy link
Copy Markdown

- stop later assertions after a terminal failure
- delete namespaces and CRDs only with a recorded uid
- move the Kind suite out of the runner and drop image preload
- run scenarios with plain subtests and one shared cluster
- delete that cluster even when setup stops early
- include the observed value when a comparison is false
- create clients before the namespace claim and register cleanup next
- keep the comparison operator in cel failure text
- show assertion failures on the test case itself
@atkrad atkrad removed the kind/docs Documentation only label Oct 12, 2026
@atkrad
atkrad merged commit 93e069b into main Oct 12, 2026
17 checks passed
@atkrad
atkrad deleted the rewrite-e2e-yaml-steps branch October 12, 2026 15:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/testing Scenarios, harness, goldens kind/chore Cleanup, deps, CI, or refactor with no user-facing change skip-changelog Exclude this PR from release notes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant