Skip to content

ci: move system tests from Github Actions to Testing Farm - #9304

Draft
pbrezina wants to merge 1 commit into
SSSD:masterfrom
pbrezina:tft
Draft

pbrezina wants to merge 1 commit into
SSSD:masterfrom
pbrezina:tft

Conversation

@pbrezina

Copy link
Copy Markdown
Member

The system tests can quickly deplete available Github runners (20)
and we need them for process purposes (Accepted label). So we keep
only quick checks in GHA now.

Testing Farm is supported infrastructure for Fedora Project, we should
be able to see infra issues resolved more quickly as we can actually
ping people when needed.

@pbrezina

Copy link
Copy Markdown
Member Author

Note: Do not forget to switch sssd-ci-containers repo in the test plan after SSSD/sssd-ci-containers#219 is merged.

@pbrezina
pbrezina force-pushed the tft branch 2 times, most recently from afee380 to 482ba1f Compare September 22, 2026 11:25
@pbrezina

Copy link
Copy Markdown
Member Author

/packit build
/packit check

1 similar comment
@pbrezina

Copy link
Copy Markdown
Member Author

/packit build
/packit check

Comment thread tmt/plans/system-tests.fmf

- name: Setup containers and install ci-* commands
how: shell
url: https://github.com/pbrezina/sssd-ci-containers.git

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

just a note to switch back to SSSD GH project when ready

Comment thread tmt/plans/system-tests.fmf Outdated
Comment thread tmt/plans/system-tests.fmf Outdated
@pbrezina
pbrezina force-pushed the tft branch 2 times, most recently from 66e45be to 752e0b5 Compare September 29, 2026 09:27
@pbrezina

Copy link
Copy Markdown
Member Author

/packit check

@packit-as-a-service

Copy link
Copy Markdown

There appears to be a syntax error in the command provided. Please refer to the Packit documentation or use the /packit help command.

@pbrezina

Copy link
Copy Markdown
Member Author

/packit test

1 similar comment
@pbrezina

Copy link
Copy Markdown
Member Author

/packit test

@pbrezina

Copy link
Copy Markdown
Member Author

I get this failure on centos-10... it is a segfault in autofs, I can't reproduce this locally so I'm trying to catch it in reserved TF run.

FAILED tests/test_autofs.py::test_autofs__new_map_entries_added_to_provider_are_visible_after_reload (ldap) - pytest_mh.conn.ssh.SSHProcessTimeoutError: 
Command #19113 timed out after 300 seconds:
  Command:
    set -ex
    pushd "/var/export/export2"
    mount | grep "nfs.test:/dev/shm/exports/export2 on /var/export/export2"
    popd
    umount "/var/export/export2"
  CWD:
  Env:
  Output:
  Error output:
    + pushd /var/export/export2

Other two errors are in provisioning phase. Both looks like a network error.

On TF side, reported, they will implement a retry

[2026-09-30 07:04:47] [+] [worker_0] [guest-setup-order] Running guest setup for fedora-copr-build artifact
[2026-09-30 07:04:47] [+] [worker_0] [fedora-copr] Initialized with 11049366:fedora-rawhide-x86_64: package 'sssd' build '11049366' target 'fedora-rawhide-x86_64' (https://copr.fedorainfracloud.org/coprs/packit/SSSD-sssd-9304/build/11049366/)
[2026-09-30 07:04:47] [E] [Fedora-latest:x86_64:/tmt/plans/system-tests] guest setup failed: 'utf-8' codec can't decode byte 0xe2 in position 4642988: invalid continuation byte

Other one gets further but fails when downloading containers. I implemented a retry on our side.

unable to copy from source docker://quay.io/sssd/ci-keycloak:fedora-45: writing blob: storing blob to file "/var/tmp/container_images_storage484318116/2": happened during read: unexpected EOF (while reconnecting: Get "https://cdn01.quay.io/quayio-production-s3/sha256/5e/5e45f5cd39f75b56f8265cfad98cc04c5ca0c13ec20bc28b6b87dc757e650c0d?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIATAAF2YHTGR23ZTE6%2F20260930%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20260930T070847Z&X-Amz-Expires=600&X-Amz-SignedHeaders=host&X-Amz-Signature=f65e83168abafa3d93496c56b822de2a33b720be40388ce4189d8f19cb740a45&region=us-east-1&namespace=sssd&repo_name=ci-keycloak&akamai_signature=exp=1790753027~hmac=acd19ced820e2b607fc7b6017192e006e942755280af2463b297ac9bda1be5b3": EOF)
        Error: executing /usr/libexec/docker/cli-plugins/docker-compose up --no-recreate --detach: exit status 1

@pbrezina

Copy link
Copy Markdown
Member Author

/packit retest-failed

1 similar comment
@pbrezina

Copy link
Copy Markdown
Member Author

/packit retest-failed

@pbrezina

pbrezina commented Oct 1, 2026

Copy link
Copy Markdown
Member Author

/packit retest-failed

1 similar comment
@pbrezina

pbrezina commented Oct 2, 2026

Copy link
Copy Markdown
Member Author

/packit retest-failed

The system tests can quickly deplete available Github runners (20)
and we need them for process purposes (Accepted label). So we keep
only quick checks in GHA now.

Testing Farm is supported infrastructure for Fedora Project, we should
be able to see infra issues resolved more quickly as we can actually
ping people when needed.

Assisted-By: Claude Code (Claude Opus 4.8)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants