End of forgejo-registry-consolidation. After Phase 0/1 already landed
(Forgejo ready, dual-push CI, integrity probe, retention CronJob,
images migrated via forgejo-migrate-orphan-images.sh), this commit
flips everything off registry.viktorbarzin.me onto Forgejo and
removes the legacy infrastructure.
Phase 3 — image= flips:
* infra/stacks/{payslip-ingest,job-hunter,claude-agent-service,
fire-planner,freedify/factory,chrome-service,beads-server}/main.tf
— image= now points to forgejo.viktorbarzin.me/viktor/<name>.
* infra/stacks/claude-memory/main.tf — also moved off DockerHub
(viktorbarzin/claude-memory-mcp:17 → forgejo.viktorbarzin.me/viktor/...).
* infra/.woodpecker/{default,drift-detection}.yml — infra-ci pulled
from Forgejo. build-ci-image.yml dual-pushes still until next
build cycle confirms Forgejo as canonical.
* /home/wizard/code/CLAUDE.md — claude-memory-mcp install URL updated.
Phase 4 — decommission registry-private:
* registry-credentials Secret: dropped registry.viktorbarzin.me /
registry.viktorbarzin.me:5050 / 10.0.20.10:5050 auths entries.
Forgejo entry is the only one left.
* infra/stacks/infra/main.tf cloud-init: dropped containerd
hosts.toml entries for registry.viktorbarzin.me +
10.0.20.10:5050. (Existing nodes already had the file removed
manually by `setup-forgejo-containerd-mirror.sh` rollout — the
cloud-init template only fires on new VM provision.)
* infra/modules/docker-registry/docker-compose.yml: registry-private
service block removed; nginx 5050 port mapping dropped. Pull-
through caches for upstream registries (5000/5010/5020/5030/5040)
stay on the VM permanently.
* infra/modules/docker-registry/nginx_registry.conf: upstream
`private` block + port 5050 server block removed.
* infra/stacks/monitoring/modules/monitoring/main.tf: registry_
integrity_probe + registry_probe_credentials resources stripped.
forgejo_integrity_probe is the only manifest probe now.
Phase 5 — final docs sweep:
* infra/docs/runbooks/registry-vm.md — VM scope reduced to pull-
through caches; forgejo-registry-breakglass.md cross-ref added.
* infra/docs/architecture/ci-cd.md — registry component table +
diagram now reflect Forgejo. Pre-migration root-cause sentence
preserved as historical context with a pointer to the design doc.
* infra/docs/architecture/monitoring.md — Registry Integrity Probe
row updated to point at the Forgejo probe.
* infra/.claude/CLAUDE.md — Private registry section rewritten end-
to-end (auth, retention, integrity, where the bake came from).
* prometheus_chart_values.tpl — RegistryManifestIntegrityFailure
alert annotation simplified now that only one registry is in
scope.
Operational follow-up (cannot be done from a TF apply):
1. ssh root@10.0.20.10 — edit /opt/registry/docker-compose.yml to
match the new template AND `docker compose up -d --remove-orphans`
to actually stop the registry-private container. Memory id=1078
confirms cloud-init won't redeploy on TF apply alone.
2. After 1 week of no incidents, `rm -rf /opt/registry/data/private/`
on the VM (~2.6GB freed).
3. Open the dual-push step in build-ci-image.yml and drop
registry.viktorbarzin.me:5050 from the `repo:` list — at that
point the post-push integrity check at line 33-107 also needs
to be repointed at Forgejo or removed (the per-build verify is
redundant with the every-15min Forgejo probe).
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
|
||
|---|---|---|
| .. | ||
| files | ||
| main.tf | ||
| README.md | ||
| terragrunt.hcl | ||
chrome-service
In-cluster headed Chromium exposed over Playwright's WebSocket protocol.
Sibling services drive it instead of running their own in-process browser
— useful when the upstream tries to detect headless mode (e.g. hmembeds'
disable-devtool.js redirect-to-google trap).
Connect
from playwright.async_api import async_playwright
WS_URL = "ws://chrome-service.chrome-service.svc.cluster.local:3000"
WS_TOKEN = os.environ["CHROME_WS_TOKEN"] # 32-byte URL-safe random
async with async_playwright() as p:
browser = await p.chromium.connect(f"{WS_URL}/{WS_TOKEN}", timeout=15_000)
context = await browser.new_context()
await context.add_init_script(STEALTH_JS) # see files/stealth.js
page = await context.new_page()
...
await browser.close()
The token comes from Vault KV secret/chrome-service.api_bearer_token,
which ESO syncs into a per-namespace K8s Secret in each caller stack
(see f1-stream's chrome-service-client-secrets).
Add a new caller
- Label the caller's namespace so the chrome-service NetworkPolicy
admits it:
resource "kubernetes_namespace" "<ns>" { metadata { labels = { "chrome-service.viktorbarzin.me/client" = "true" } } } - Add an ExternalSecret in the caller stack pulling the token:
resource "kubernetes_manifest" "chrome_token" { manifest = { apiVersion = "external-secrets.io/v1beta1" kind = "ExternalSecret" metadata = { name = "chrome-service-client-secrets", namespace = "<ns>" } spec = { refreshInterval = "15m" secretStoreRef = { name = "vault-kv", kind = "ClusterSecretStore" } target = { name = "chrome-service-client-secrets" } dataFrom = [{ extract = { key = "chrome-service" } }] } } } - Inject
CHROME_WS_URL+CHROME_WS_TOKENinto the caller's pod env. Usesecret_key_reffor the token; the URL is a plain value. - Vendor
stealth.jsinto the caller (or just paste — it's ~40 lines) and apply viaawait context.add_init_script(STEALTH_JS)after everynew_context(). Without it, hmembeds-class anti-bot still trips.
Image pin
Both the server image (mcr.microsoft.com/playwright:v1.48.0-noble in
main.tf) and the client (playwright==1.48.0 in callers' requirements)
must match minor-versions. Bump in lockstep — Playwright protocol changes
between minors.
Operations
- Storage: encrypted PVC at
/profilefor cookies + npm cache. Ephemeral contexts (browser.new_context()) bypass the profile; persistent contexts share it. Backed up tar+gzip every 6h to/srv/nfs/chrome-service-backup/, 30-day retention. - Probes: TCP/3000. Playwright run-server has no HTTP
/health; a TCP open is the only liveness signal available without spinning a browser. - Health page: visit
https://chrome.viktorbarzin.me(Authentik-gated) to confirm the pod is up. The WS port stays internal-only. - Token rotation:
vault kv put secret/chrome-service api_bearer_token=$(python3 -c 'import secrets; print(secrets.token_urlsafe(32))'). Reloader cascades the rotation to both the server pod and any caller whose secret has thereloader.stakater.com/auto = "true"annotation.
Why headed (Xvfb) instead of headless?
disable-devtool.js and similar libraries detect navigator.webdriver,
console-clear timing, and the HeadlessChromium/... user-agent suffix.
Running headed inside Xvfb :99 reports as a normal Chromium, and the
stealth init script handles the JS-visible giveaways.