Live
#2 high infra_monitor
Infra Monitor: Critical CPU utilization at 96.2%, immediate investigation required
Host: claw-gateway1 CPU usage has critically breached the 95% threshold at 96.2% and is trending sharply upward with a 55.6% increase over the last 5 readings, indicating a rapidly escalating problem. All other metrics remain healthy with memory at 43.4%, disk usage well below thresholds, and process count normal at 144. Immediate intervention is needed to identify and remediate the CPU load spike. CPU: 96.2% | Memory: 43.4% Anomalies: CPU usage at 96.2% (critical threshold exceeded), CPU trending upward strongly: +55.6% over last 5 readings, Runaway process or resource leak suspected given rapid increase
Opened 2026-07-26 00:03 UTC · Resolved 2026-07-26 00:20 UTC
Handoff Notes ← Dashboard
Timeline
WEBHOOK
2026-07-26 00:03 UTC
Alert received from AI Infra Monitor. Host: claw-gateway1, Severity: HIGH
CONTEXT AGGREGATED
2026-07-26 00:03 UTC
Sources available: 3/3 — Runbook: ✓ | Past incidents: ✓ | Infra health: ✓
Response Plan
2026-07-26 00:03 UTC

Severity

P1 - Single gateway host at 96.2% CPU with sharp upward trend; risk of service degradation/unavailability.

Root Cause

  • Runaway process or resource leak (trending +55.6% over 5 readings)
  • Recent deployment or config change triggering resource exhaustion

Actions

  1. SSH to claw-gateway1 and run top -b -n 1 | head -20 to identify top CPU consumer.
  2. Verify offending process with ps aux --sort=-%cpu | head -10; check journalctl for recent restarts or errors.
  3. Restart the identified service; monitor CPU for 2–3 minutes.
  4. If CPU remains >80% after 3 restarts, escalate to Diego Perez immediately.
  5. Last resort: sudo reboot (expect 2–3 min downtime).

Watch

  • CPU utilization; escalate if sustained >80% post-restart.
  • Memory and disk remain healthy; focus on process-level anomalies.

Escalate If

CPU remains >80% after 3 service restart attempts or continues trending upward.

STATUS CHANGE
2026-07-26 00:15 UTC
Auto-resolver: CPU at 19.1% (below 70% clear threshold) — clean check 1/2
STATUS CHANGE
2026-07-26 00:15 UTC
Auto-resolver: CPU at 19.1% (below 70% clear threshold) — clean check 1/2
STATUS CHANGE
2026-07-26 00:20 UTC
Auto-resolver: CPU at 19.1% (below 70% clear threshold) — clean check 2/2
STATUS CHANGE
2026-07-26 00:20 UTC
AUTO-RESOLVED: CPU sustained below 70% for 2 consecutive checks. Current value: 19.1%
Update Status
Details
ID #2
Severity HIGH
Source infra_monitor
Status RESOLVED
Opened 2026-07-26 00:03