Skip to content

[8.0] fix (DMS): presigned URLs from the S3Gateway - #8837

Merged
chrisburr merged 1 commit into
DIRACGrid:rel-v8r0from
chrisburr:fix/s3gateway-presigned-urls-v8r0
Oct 19, 2026
Merged

chrisburr merged 1 commit into
DIRACGrid:rel-v8r0from
chrisburr:fix/s3gateway-presigned-urls-v8r0

Conversation

@chrisburr

Copy link
Copy Markdown
Member

Backport of #8835.

BEGINRELEASENOTES
*DataManagement
FIX: S3Gateway presigned URLs work with S3 implementations which validate them, and store the checksum on upload
ENDRELEASENOTES

Accessing an S3 storage element through the S3Gateway was broken with S3
implementations which validate presigned requests:
- the gateway looked up urls.get("Fields") instead of the fields of each URL,
  so the checksum metadata was never stored on upload
- boto does not add the Fields of generate_presigned_post to the policy, so
  once passed S3 rejected them as "Extra input fields"
- exists() sent a GET to a URL signed for HEAD, which is rejected as Forbidden
@chrisburr
chrisburr merged commit 627ed84 into DIRACGrid:rel-v8r0 Oct 19, 2026
31 of 32 checks passed
@DIRACGridBot DIRACGridBot added the sweep:ignore Prevent sweeping from being ran for this PR label Oct 19, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

sweep:ignore Prevent sweeping from being ran for this PR

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants