I just received complaints from my developers that builds weren't happening today. When I looked at TeamCity, I saw the agents were stuck in the Stopping state since Friday. I checked the VMs and they were indeed powered off. To get it working again, I restarted the TC server and the agents started properly and started working through the build queue.
Need help fixing this to avoid future issues.