Highly-available monitoring with Prometheus and Alertmanager on NixOS

This post is the end result of a year-long nerd-snipe caused by a real problem: How can I be sure that I am told when my site goes down, when the service that tells me can also go down? Strange issues I host multiple services on multiple servers: This site NixCI Social Dance Today Intray Tickler Smos These have been running for anywhere from two years to eleven years. Over that time, all sorts of…