Build Queue Stuck
Team City professional 17.1.2 with 2 agents. As of this morning, the build queue is no longer working. builds are queued and agents are available and idle, but no builds are being run. If I reboot the server running Team City, it appears to start the builds, but the build numbers are ??? instead of the increments defined in the settings. These builds are not actually running either, but the server thinks they are.The queued builds Time to Start is 'no estimate yet'.
The agents are idle and I can review the agents from the server UI. One of the agents is on the server. Disabling and re-enabling the agents doesn't solve it either. I don't think communication with the agents is the issue, just the build generation and handoff. The server isn't used for anything else and we haven't made any changes. A good build was done yesterday afternoon.
I upgraded the to most recent build (from 17.1.1) on the server and the problem is still there.
Let me know what logs or dumps can help diagnose the issue.
Thanks,
Shawn
Please sign in to leave a comment.
Hi Shawn,
First please check that there are available agents and that the build son the queue show being compatible with the agents. If the builds seem to be compatible and it still doesn't work, please take a thread dump of the server (https://confluence.jetbrains.com/display/TCD10/Reporting+Issues#ReportingIssues-ServerThreadDump), and send it to us along the teamcity-server.log. You can use the "Submit a request" button on top of the page for sending us the files.
Thanks for the follow up, Denis! After creating the server thread dump we found the issue - the database server's disk was full. Slightly embarrassing actually, but we got it figured out and builds are being handed to agents correctly again.