infra/stacks/broker-sync
Viktor Barzin a12b09af04
All checks were successful
ci/woodpecker/push/default Pipeline was successful
broker-sync: pin data-mounting CronJobs to k8s-node4 (stop nightly RWO wedge)
All broker-sync CronJobs share one RWO proxmox-lvm volume. With free
scheduling the nightly 02:00-04:15 runs land on different nodes, forcing
a detach/attach cycle whose QMP hotplug intermittently ghost-attaches on
disk-heavy VMs — every job then sits in ContainerCreating for hours
(happened 2026-06-30, 07-01 and again 07-02; fires
PodsStuckContainerCreating and skips the day's trade syncs). Pinning all
seven volume-mounting jobs to k8s-node4 (fewest CSI disks, 11) makes the
volume attach once and stay put — no hotplug dance, no wedge.
version_probe mounts nothing and stays unpinned. Durable fix for the
recurrence tracked in beads code-9ko8.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-02 05:16:38 +00:00
..
main.tf broker-sync: pin data-mounting CronJobs to k8s-node4 (stop nightly RWO wedge) 2026-07-02 05:16:38 +00:00
terragrunt.hcl fix: restore tree dropped by 6d224861; land stem95su gdrive-sync (10m) [ci skip] 2026-06-09 08:45:33 +00:00