LotusGuild/matrix
3
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat(synapse): nightly state compression on CT 109
Lint / No secrets in webhook configs (push) Successful in 12s
Details
Lint / No Hookshot webhook IDs in README (push) Successful in 12s
Details
Lint / Landing page is rendered (matrix (push) Successful in 7s
Details
Lint / Python (ruff) (push) Successful in 5s
Details
Lint / Secret scan (gitleaks) (push) Successful in 6s
Details
Lint / Shell (shellcheck) (push) Successful in 9s
Details
Lint / Shell (shellcheck) (pull_request) Successful in 8s
Details
Lint / JS (eslint) (pull_request) Successful in 7s
Details
Lint / No Hookshot webhook IDs in README (pull_request) Successful in 5s
Details
Lint / No secrets in webhook configs (pull_request) Successful in 6s
Details
Lint / Landing page is rendered (matrix (pull_request) Successful in 4s
Details
Lint / Python deps (pip-audit) (push) Successful in 55s
Details
Lint / Python (ruff) (pull_request) Successful in 5s
Details
Lint / Secret scan (gitleaks) (pull_request) Successful in 7s
Details
Lint / JS (eslint) (push) Successful in 6s
Details
Lint / Python deps (pip-audit) (pull_request) Successful in 42s
Details

Browse Source 
The Synapse database grew from 2.2 GB (after the July cleanup) to
6.2 GB, almost all of it state_groups_state from large federated rooms
with one or two local members.

synapse_auto_compressor (matrix-org/rust-synapse-compress-state, built
from main) now runs nightly at 04:30, after the 03:00 vzdump backup.
It verifies compressed state against the original, writes each state
group in its own transaction, skips chunks that would not shrink, and
resumes from stored progress. The initial backlog took ~8 minutes with
no Synapse errors: state_groups_state 11.0 M -> 4.25 M rows (-61%).

Also documents the new "Synapse Database Growing Fast" Grafana alert
(> 500 MB in 7 days).

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_017PCb59uY3UKqDqt7B6hzd5
This commit is contained in:
Lotus CI
2026-11-03 19:08:01 -05:00
co-authored by Claude Opus 5.5
parent ded4a30530
commit b2877323c3
3 changed files with 64 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
systemd/synapse-state-compressor.timer
+10
View File
@@ -0,0 +1,10 @@
[Unit]
Description=Nightly Synapse state compression (after the 03:00 vzdump backup)
[Timer]
OnCalendar=*-*-* 04:30
RandomizedDelaySec=10min
Persistent=true
[Install]
WantedBy=timers.target