Skip to content

Restore the SQLite metastore from its backup when the local database is empty - #9894

Merged
begelundmuller merged 2 commits into
mainfrom
begelundmuller/restore-sqlite-metastore-from-backup
Sep 18, 2026
Merged

begelundmuller merged 2 commits into
mainfrom
begelundmuller/restore-sqlite-metastore-from-backup

Conversation

@begelundmuller

@begelundmuller begelundmuller commented Sep 16, 2026

Copy link
Copy Markdown
Contributor
  • Restores snapshot.db from the backup bucket on startup when the metastore has no migrations applied, which also covers a zero-length file or a previous startup that crashed before migrating.
  • Adds RILL_RUNTIME_METASTORE_BACKUPS_ENABLE (default true), gating both the daily backup and the restore.
  • A failed restore fails startup rather than booting empty, since the next nightly backup would otherwise overwrite the snapshot.
  • Raises backupMaxSizeBytes from 5 GB to 15 GB so the largest metastores are backed up (and therefore restorable) at all, and bounds a restore at 30 minutes, which is enough to download a snapshot at that limit.

@begelundmuller
begelundmuller merged commit 378513a into main Sep 18, 2026
15 of 17 checks passed
@begelundmuller
begelundmuller deleted the begelundmuller/restore-sqlite-metastore-from-backup branch September 18, 2026 10:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Area:CLI Size:M Medium change: 100-499 lines Type:Improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants