AI and agents2 filesInfrastructure2 filesDevelopment3 filesAbout2 files

Production server died. Restored from backup in a day

  • incident
  • backups

Production server died. Restored from backup in a day

This was not a drill: the server was shut off over an unpaid invoice, taking the panel, the inbounds and every client config with it. Backups were already in place — a 03:30 cron job to external storage with 14-day rotation.

I restored the panel, the inbounds and the transport, then switched the CDN over. Two traps along the way: swapping a live SQLite file without flushing its write-ahead log, and an SSH lockout caused by socket configuration — the second one needed the provider’s console.