Build fails after 12 hrs with: Read timed out

I am new to Team City, and was not the original user that setup Team City for our company.
We are using TFS 2003 and Team City is 8.1.5. The project that I am trying to setup for build is fairly large (4.75 GB) and I think that related.
I am not sure what is need to help anyone diagnose my issue - so I will start with the build log.
Any help or ideas would be wonderful.

[16:24:33]TeamCity server version is 8.1.5 (build 30240)

[16:24:33]Checking for changes

[16:24:33]Will collect changes in 1 VCS roots

[16:24:33]Loading current repository state for VCS root 'myHqWeb'

[16:24:33]Waiting for completion of current operations for the VCS root 'myHqWeb'

[16:24:33]Detecting changes in VCS root 'myHqWeb' (used in myHqWeb)

[16:24:33]Agent time zone: America/Chicago

[16:24:33]Agent is running under JRE: 1.7.0_51-b13

[16:24:33]Publishing internal artifacts

[16:24:33][Publishing internal artifacts] Sending using ArtifactsCachePublisher

[16:24:33][Publishing internal artifacts] Sending using WebPublisher

[16:24:33]Clearing temporary directory: E:\TeamCity\buildAgent1\temp\buildTmp

[16:24:33]Checkout directory: E:\TeamCity\buildAgent1\work\251d6066a8a1bdb5

[16:24:33]Updating sources: server side checkout (11h:59m:59s)

[16:24:33][Updating sources] Using vcs information from server. Reason: no revision information for buildtype myHqWeb and checkout directory E:\TeamCity\buildAgent1\work\251d6066a8a1bdb5 on agent

[16:24:33][Updating sources] Will perform clean checkout

[16:24:33][Updating sources] Clean checkout reasons

[16:24:33][Clean checkout reasons] Agent doesn't have any version of the project sources

[16:24:33][Clean checkout reasons] Checkout directory is empty or doesn't exist

[16:24:33][Updating sources] Building and caching clean patch for VCS root: myHqWeb

[04:24:33][Updating sources] Problem while loading patch data stream: Read timed out

[04:24:33]Will repeat attempt when server will be available, number of attempts left: 2

[04:24:43]Updating sources: server side checkout (1h:31m:44s)

[04:24:43][Updating sources] Will perform clean checkout

[04:24:43][Updating sources] Clean checkout reasons

[04:24:43][Clean checkout reasons] Agent doesn't have any version of the project sources

[04:24:43][Clean checkout reasons] Checkout directory is empty or doesn't exist

[04:24:43][Updating sources] Building and caching clean patch for VCS root: myHqWeb

[05:56:27][Updating sources] Failed to build patch for build #0.0.1.41042 {build id=5506}, VCS root: "myHqWeb" {instance id=921, parent internal id=65, parent id=MOCK_MyHqWeb, description: "tfs: http://hqtfs03:8080/ $/Tastefully Simple myHq Web/Main"}, due to error: Failed to build patch. Failed to build patch to version ChangesetVersionSpec instance 41042

  ChangesetId: 41042

under workspace TeamCity-S-l7ddtvow1rfmosmob7qm5qn13/TSIMPLE\TeamCityService(TeamCity checkout workspace). There is not enough space on the disk.

[05:56:27][Updating sources] Repository sources transferred

[05:56:27]Will repeat attempt when server will be available, number of attempts left: 1

[05:56:37]Updating sources: server side checkout (11h:59m:59s)

[05:56:37][Updating sources] Will perform clean checkout

[05:56:37][Updating sources] Clean checkout reasons

[05:56:37][Clean checkout reasons] Agent doesn't have any version of the project sources

[05:56:37][Clean checkout reasons] Checkout directory is empty or doesn't exist

[05:56:37][Updating sources] Building and caching clean patch for VCS root: myHqWeb

[17:56:37][Updating sources] Problem while loading patch data stream: Read timed out

[17:56:37]Problem while loading patch data stream: Read timed out

[17:56:37]java.net.SocketTimeoutException: Read timed out

 at java.net.SocketInputStream.socketRead0(Native Method)

 at java.net.SocketInputStream.read(SocketInputStream.java:152)

 at java.net.SocketInputStream.read(SocketInputStream.java:122)

 at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)

 at java.io.BufferedInputStream.read(BufferedInputStream.java:254)

 at org.apache.commons.httpclient.HttpParser.readRawLine(HttpParser.java:78)

 at org.apache.commons.httpclient.HttpParser.readLine(HttpParser.java:106)

 at org.apache.commons.httpclient.HttpConnection.readLine(HttpConnection.java:1116)

 at org.apache.commons.httpclient.HttpMethodBase.readStatusLine(HttpMethodBase.java:1973)

 at org.apache.commons.httpclient.HttpMethodBase.readResponse(HttpMethodBase.java:1735)

 at org.apache.commons.httpclient.HttpMethodBase.execute(HttpMethodBase.java:1098)

 at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:398)

 at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171)

 at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397)

 at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323)

 at jetbrains.buildServer.http.ServerStreamProvider.getStream(ServerStreamProvider.java:112)

 at jetbrains.buildServer.agent.impl.patch.PatchStreamProviderImpl.getServerStream(PatchStreamProviderImpl.java:63)

 at jetbrains.buildServer.agent.impl.patch.PatchStreamProviderImpl.getPatchesStream(PatchStreamProviderImpl.java:37)

 at jetbrains.buildServer.agent.impl.patch.PatchDownloaderImpl.downloadPatch(PatchDownloaderImpl.java:144)

 at jetbrains.buildServer.agent.impl.patch.PatchDownloaderImpl.copyPatchAndCheck(PatchDownloaderImpl.java:59)

 at jetbrains.buildServer.agent.impl.patch.UpdateSourcesPatcherBase.copyPatchToTempFile(UpdateSourcesPatcherBase.java:71)

 at jetbrains.buildServer.agent.impl.patch.UpdateSourcesFromServer.updateSources(UpdateSourcesFromServer.java:60)

 at jetbrains.buildServer.agent.impl.patch.UpdateSourcesBuildStageBase.doSourceUpdate(UpdateSourcesBuildStageBase.java:91)

 at jetbrains.buildServer.agent.impl.patch.UpdateSourcesBuildStageBase.doRecoverableStage(UpdateSourcesBuildStageBase.java:59)

 at jetbrains.buildServer.agent.impl.buildStages.startStages.RecoverableBuildStage.doLastAttempt(RecoverableBuildStage.java:112)

 at jetbrains.buildServer.agent.impl.buildStages.startStages.RecoverableBuildStage.doBuildStage(RecoverableBuildStage.java:70)

 at jetbrains.buildServer.agent.impl.buildStages.BuildStagesExecutor$1.callStage(BuildStagesExecutor.java:31)

 at jetbrains.buildServer.agent.impl.buildStages.BuildStagesExecutor$1.callStage(BuildStagesExecutor.java:24)

 at jetbrains.buildServer.agent.impl.buildStages.StagesExecutor.callRunStage(StagesExecutor.java:78)

 at jetbrains.buildServer.agent.impl.buildStages.StagesExecutor.doStages(StagesExecutor.java:37)

 at jetbrains.buildServer.agent.impl.buildStages.BuildStagesExecutor.doStages(BuildStagesExecutor.java:24)

 at jetbrains.buildServer.agent.impl.BuildRunAction.doStages(BuildRunAction.java:70)

 at jetbrains.buildServer.agent.impl.BuildRunAction.runBuild(BuildRunAction.java:50)

 at jetbrains.buildServer.agent.impl.BuildAgentImpl.doActualBuild(BuildAgentImpl.java:265)

 at jetbrains.buildServer.agent.impl.BuildAgentImpl.access$100(BuildAgentImpl.java:52)

 at jetbrains.buildServer.agent.impl.BuildAgentImpl$1.run(BuildAgentImpl.java:231)

 at java.lang.Thread.run(Thread.java:744)

[17:56:37]Problem while loading patch data stream

[17:56:37]jetbrains.buildServer.agent.impl.patch.PatchDownloaderImpl$3: Problem while loading patch data stream

 at jetbrains.buildServer.agent.impl.patch.PatchDownloaderImpl.downloadPatch(PatchDownloaderImpl.java:153)

 at jetbrains.buildServer.agent.impl.patch.PatchDownloaderImpl.copyPatchAndCheck(PatchDownloaderImpl.java:59)

 at jetbrains.buildServer.agent.impl.patch.UpdateSourcesPatcherBase.copyPatchToTempFile(UpdateSourcesPatcherBase.java:71)

 at jetbrains.buildServer.agent.impl.patch.UpdateSourcesFromServer.updateSources(UpdateSourcesFromServer.java:60)

 at jetbrains.buildServer.agent.impl.patch.UpdateSourcesBuildStageBase.doSourceUpdate(UpdateSourcesBuildStageBase.java:91)

 at jetbrains.buildServer.agent.impl.patch.UpdateSourcesBuildStageBase.doRecoverableStage(UpdateSourcesBuildStageBase.java:59)

 at jetbrains.buildServer.agent.impl.buildStages.startStages.RecoverableBuildStage.doLastAttempt(RecoverableBuildStage.java:112)

 at jetbrains.buildServer.agent.impl.buildStages.startStages.RecoverableBuildStage.doBuildStage(RecoverableBuildStage.java:70)

 at jetbrains.buildServer.agent.impl.buildStages.BuildStagesExecutor$1.callStage(BuildStagesExecutor.java:31)

 at jetbrains.buildServer.agent.impl.buildStages.BuildStagesExecutor$1.callStage(BuildStagesExecutor.java:24)

 at jetbrains.buildServer.agent.impl.buildStages.StagesExecutor.callRunStage(StagesExecutor.java:78)

 at jetbrains.buildServer.agent.impl.buildStages.StagesExecutor.doStages(StagesExecutor.java:37)

 at jetbrains.buildServer.agent.impl.buildStages.BuildStagesExecutor.doStages(BuildStagesExecutor.java:24)

 at jetbrains.buildServer.agent.impl.BuildRunAction.doStages(BuildRunAction.java:70)

 at jetbrains.buildServer.agent.impl.BuildRunAction.runBuild(BuildRunAction.java:50)

 at jetbrains.buildServer.agent.impl.BuildAgentImpl.doActualBuild(BuildAgentImpl.java:265)

 at jetbrains.buildServer.agent.impl.BuildAgentImpl.access$100(BuildAgentImpl.java:52)

 at jetbrains.buildServer.agent.impl.BuildAgentImpl$1.run(BuildAgentImpl.java:231)

 at java.lang.Thread.run(Thread.java:744)

Caused by: java.net.SocketTimeoutException: Read timed out

 at java.net.SocketInputStream.socketRead0(Native Method)

 at java.net.SocketInputStream.read(SocketInputStream.java:152)

 at java.net.SocketInputStream.read(SocketInputStream.java:122)

 at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)

 at java.io.BufferedInputStream.read(BufferedInputStream.java:254)

 at org.apache.commons.httpclient.HttpParser.readRawLine(HttpParser.java:78)

 at org.apache.commons.httpclient.HttpParser.readLine(HttpParser.java:106)

 at org.apache.commons.httpclient.HttpConnection.readLine(HttpConnection.java:1116)

 at org.apache.commons.httpclient.HttpMethodBase.readStatusLine(HttpMethodBase.java:1973)

 at org.apache.commons.httpclient.HttpMethodBase.readResponse(HttpMethodBase.java:1735)

 at org.apache.commons.httpclient.HttpMethodBase.execute(HttpMethodBase.java:1098)

 at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:398)

 at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171)

 at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397)

 at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323)

 at jetbrains.buildServer.http.ServerStreamProvider.getStream(ServerStreamProvider.java:112)

 at jetbrains.buildServer.agent.impl.patch.PatchStreamProviderImpl.getServerStream(PatchStreamProviderImpl.java:63)

 at jetbrains.buildServer.agent.impl.patch.PatchStreamProviderImpl.getPatchesStream(PatchStreamProviderImpl.java:37)

 at jetbrains.buildServer.agent.impl.patch.PatchDownloaderImpl.downloadPatch(PatchDownloaderImpl.java:144)

 ... 18 more

[17:56:37]##teamcity[buildStatisticValue key='buildStageDuration:buildFinishing' value='9.1923392E7']

[17:56:37]Publishing internal artifacts

[17:56:37][Publishing internal artifacts] Sending using ArtifactsCachePublisher

[17:56:37][Publishing internal artifacts] Sending using WebPublisher

[17:56:37]Build failed to start. Artifacts will not be published for this build

[17:56:37]##teamcity[buildStatisticValue key='buildStageDuration:artifactsPublishing' value='262.0']

[17:56:37]Build finished


Performed a second build using a different agent:

[15:42:16]Checking for changes

[15:42:16]Publishing internal artifacts

[15:42:16][Publishing internal artifacts] Sending using ArtifactsCachePublisher

[15:42:17][Publishing internal artifacts] Sending using WebPublisher

[15:42:16]Clearing temporary directory: E:\TeamCity\BuildAgent2\temp\buildTmp

[15:42:16]Checkout directory: E:\TeamCity\BuildAgent2\work\b7c686dcf6e1f912

[15:42:16]Updating sources: server side checkout (12h:0m)

[15:42:16][Updating sources] Using vcs information from server. Reason: no revision information for buildtype myHqWeb and checkout directory E:\TeamCity\BuildAgent2\work\b7c686dcf6e1f912 on agent

[15:42:18][Updating sources] Will perform clean checkout

[15:42:18][Updating sources] Clean checkout reasons

[15:42:18][Clean checkout reasons] Agent doesn't have any version of the project sources

[15:42:18][Clean checkout reasons] Checkout directory is empty or doesn't exist

[15:42:18][Updating sources] Building and caching clean patch for VCS root: myHqWeb

[03:42:17][Updating sources] Problem while loading patch data stream: Read timed out

[03:42:17]Will repeat attempt when server will be available, number of attempts left: 2

[03:42:27]Updating sources: server side checkout (4h:10m:57s)

[03:42:27][Updating sources] Will perform clean checkout

[03:42:27][Updating sources] Clean checkout reasons

[03:42:27][Clean checkout reasons] Agent doesn't have any version of the project sources

[03:42:27][Clean checkout reasons] Checkout directory is empty or doesn't exist

[03:42:27][Updating sources] Building and caching clean patch for VCS root: myHqWeb

[07:53:24][Updating sources] Build canceled

1 comment
Comment actions Permalink

Hi Aaron,

The default timeout for VCS changes patch download by agent from server is set to 12 hours. Please check that there is no problems with network connection between agent and server.
Could you please enable "debug-vcs" logging preset and attach teamcity-vcs.log file covering the issue?

0

Please sign in to leave a comment.