Checking for Changes taking long time

Hi,

We are using TeamCity 7.1.4 with VCS being Git.

We have noticed that over the past couple of weeks, the "Checking for Changes" takes a long time for all applications (about 10 minutes to run).
We have about 1100 build configurations using the same vcs-root.

I have tried to restarting services, changing polling time from 60 seconds to 120 seconds to 180 seconds.

I have attached the server thread dump from when there was only 1 build running in the middle of "Checking for Changes".



Attachment(s):
threadDump-2014-04-28_22.33.43.txt.zip
4 comments
Comment actions Permalink

Hi Jayesh,

I would recommend to upgrade to the latest TeamCity release (8.1.2 as of now) and check if the issue is still actual there. BTW, in addition to lots of fixed there also are many new features.
Otherwise we might be investigating an issue which has been fixed already.

0
Comment actions Permalink

Thanks Yegor for the reply.  We are currently heavily invested in the REST API.  Since the migration to 8.x will require a conversion period (it will take another few months), would you be able to point us in the right direction where the possible cause might be ?   I've seen other posts like this, but the resolution didn't apply to us.  I am curious if the number of build configurations is the bottleneck as even though I have 60 seconds or 90 seconds or 180 seconds of polling interval, the vcs logs show a repository is checked every 7 minutes.  That's the minimum time we see in the checking for changes.  What is the limitation of the number of build config monitoring VCS for a single TeamCity server ?

0
Comment actions Permalink

Hi Yegor,

I was able to reproduce this in our dev environment using TeamCity 7.1.4 and another instance which used TeamCity 8.1.2.  Attached is the teamcity-vcs.log.

Any suggestions ?



Attachment(s):
teamcity-vcs.log.zip
0
Comment actions Permalink

Hi Jayesh,

sorry for delay. Could you please take 10-15 thread dumps with an interval of several seconds when a build is collecting changes in TeamCity 8.1.2 and attach them to here together with teamcity-server.log and teamcity-vcs.log?

0

Please sign in to leave a comment.