viktor/infra
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
infra/stacks/platform/modules/monitoring/dashboards
History
Viktor Barzin ce79bd5c04 Add node hang instrumentation and scale down chromium services 
- Add journald collection to Alloy (loki.source.journal) for kernel OOM,
  panic, hung task, and soft lockup detection — ships system logs off-node
  so they survive hard resets
- Add 5 Loki alerting rules (KernelOOMKiller, KernelPanic, KernelHungTask,
  KernelSoftLockup, ContainerdDown) evaluating against node-journal logs
- Fix Loki ruler config: correct rules mount path (/var/loki/rules/fake),
  add alertmanager_url and enable_api
- Add Prometheus alerts: NodeMemoryPressureTrending (>85%), NodeExporterDown,
  NodeHighIOWait (>30%)
- Add caretta tolerations for control-plane and GPU nodes
- Scale down chromium-based services to 0 for cluster stability:
  f1-stream, flaresolverr, changedetection, resume/printer
2026-03-13 22:20:28 +00:00
..
api_server.json [ci skip] Move Terraform modules into stack directories 2026-02-22 14:38:14 +00:00
caretta-dashboard.json [ci skip] color only public IPs red in service map, private IPs (10.x, 192.168.x) get light blue 2026-02-28 19:44:16 +00:00
cluster_health.json Add node hang instrumentation and scale down chromium services 2026-03-13 22:20:28 +00:00
core_dns.json [ci skip] Move Terraform modules into stack directories 2026-02-22 14:38:14 +00:00
idrac.json [ci skip] Move Terraform modules into stack directories 2026-02-22 14:38:14 +00:00
k8s-audit.json [ci skip] Move Terraform modules into stack directories 2026-02-22 14:38:14 +00:00
kube-state-metrics.json [ci skip] Move Terraform modules into stack directories 2026-02-22 14:38:14 +00:00
loki.json [ci skip] Move Terraform modules into stack directories 2026-02-22 14:38:14 +00:00
nginx_ingress.json [ci skip] Move Terraform modules into stack directories 2026-02-22 14:38:14 +00:00
node_exporter_full.json [ci skip] Move Terraform modules into stack directories 2026-02-22 14:38:14 +00:00
nodes.json [ci skip] Move Terraform modules into stack directories 2026-02-22 14:38:14 +00:00
nvidia.json [ci skip] Move Terraform modules into stack directories 2026-02-22 14:38:14 +00:00
pods.json [ci skip] Move Terraform modules into stack directories 2026-02-22 14:38:14 +00:00
proxmox_node_exporter.json [ci skip] Move Terraform modules into stack directories 2026-02-22 14:38:14 +00:00
realestate-crawler.json [ci skip] wrongmove dashboard: add per-path latency table, fix layout, sort top offenders 2026-02-24 22:31:41 +00:00
registry.json [ci skip] Move Terraform modules into stack directories 2026-02-22 14:38:14 +00:00
technitium-dns.json [ci skip] Move Terraform modules into stack directories 2026-02-22 14:38:14 +00:00
ups-prometheus-metrics.yml [ci skip] Move Terraform modules into stack directories 2026-02-22 14:38:14 +00:00
ups.json [ci skip] Move Terraform modules into stack directories 2026-02-22 14:38:14 +00:00