Skip to content

[SPARK-60234][INFRA] During releases create a single spark-website commit #59457

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
nchammas wants to merge 2 commits into
base: master
Choose a base branch
from
Open

[SPARK-60234][INFRA] During releases create a single spark-website commit #59457

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
903ee9a
one commit and push for spark-website during release
nchammas Oct 14, 2026
f17b0ac
commit wording tweak
nchammas Oct 14, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
16 changes: 6 additions & 10 deletions dev/create-release/release-build.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -154,19 +154,14 @@ if [[ "$1" == "finalize" ]]; then
rm -rf svn-spark
echo "PySpark uploaded"

# download the docs from the dev directory and upload it to spark-website
echo "Uploading docs to spark-website"
# Download the generated docs, then publish them with the website updates below.
echo "Preparing spark-website"
svn co "$RELEASE_STAGING_LOCATION/$RELEASE_TAG-docs" docs
git clone "https://$ASF_USERNAME:$ASF_PASSWORD@gitbox.apache.org/repos/asf/spark-website.git" -b asf-site
mv docs/_site "spark-website/site/docs/$RELEASE_VERSION"
cd spark-website
git add site/docs/$RELEASE_VERSION
git commit -m "Add docs for Apache Spark $RELEASE_VERSION"
cd ..
echo "docs committed for later upload"

echo "Uploading release docs to spark-website"
cd spark-website
echo "Updating spark-website for the release"

# 1. Add download link to documentation.md
python3 <<EOF
Expand Down Expand Up @@ -539,13 +534,14 @@ EOF
fi

git add .
git commit -m "Add release docs for Apache Spark $RELEASE_VERSION"
git commit -m "Update docs and website for Apache Spark $RELEASE_VERSION"
# One commit and one push.
# We want to `git push` the website only once to eliminate the chance that
# multiple pushes will race with spark-website CI pushing HTML commits,
# creating annoying fast-forward failures.
git push origin HEAD:asf-site
cd ..
echo "release docs uploaded"
echo "spark-website updated"
rm -rf spark-website

# Moves the docs from dev directory to release directory.
Expand Down