Slow builds after upgrading to version 8

After upgrading TeamCity from 7.1.3 to 8.0.4, I've seen significant performance problems on my server: builds that took 1m20s are now 2-3 minutes, and running tests jumped from 7 minutes to 15-20. This behavior happens when I run the builds outside of TeamCity as well, and disappears when I turn off the Teamcity Server service.

I've checked cpu/memory/network activity, and nothing stands out. I downgraded to 7.1.5 and my performance problems disappeared. I installed a copy of 8.0.4 with an empty internal database and configuration, and experienced the same issues. I tried it with 8.0.1, same result. Installed to another disk, again the same. I then installed (an empty) 8.0.4 on another server and it is NOT experiencing these performance problems. They're both Windows Server 2008 with the same patches, although they have different hardware.

Any suggestions on where to look next or what details to provide? No antivirus software is running, windows search is disabled, and 7.1.5 works fine regardless.

7 comments
Comment actions Permalink

So if you run agent as a service, tests are slow, but if you run it via agent.bat, tests are fast? What user account do you use when agent is running as a service?

0
Comment actions Permalink

I've tried running the teamcity server as a service (running as my user account with admin rights), and running the teamcity-server.bat through command line. In both cases, while the teamcity server is running, my builds and tests are slow. I'm running the tests outside of Teamcity by calling my nant script on the command line.

0
Comment actions Permalink

I don't quite understand. TeamCity server does not run any builds, it gathers information from builds. Build is running on the agent. So I thought the problem is caused by AGENT running as a service not by server.

0
Comment actions Permalink

No, all the agents are stopped. I am running teamcity-server.bat from the command line, on an empty database and build configuration. I then invoke my nant build scripts manually in the command line, and they are significantly slower. When I shut down teamcity-server.bat, they return to normal performance. I'm not interacting with Teamcity in any way, other than having the server running while doing these actions.

0
Comment actions Permalink

So it looks like TeamCity server uses some resources on your machine and this causes slow down in the scripts? Have you checked how much CPU is used by TeamCity java process?

0
Comment actions Permalink

I have checked memory, cpu, and network usage - nothing stood out as overloaded. I can't get more specific numbers until later tonight - we're currently running off the 7.1.5 version so I'd have to switch over again.

0
Comment actions Permalink

You can also try version 8.0.5 which was released recently.


0

Please sign in to leave a comment.