Build has "Cannot stop" message

Hello,

I got a message "Cannot stop" for the first time when running a build on a remote build agent.

Server version: TeamCity 8.0.5
All TeamCity machines are CentOS5
All build agents are separate VMs.

The only solution I found was to 'kill -9 <pid>' the java process on the TeamCity agent and then restart the build agent process.

Here is what was in the build agent's teamcity-agent.log:
[2014-01-16 14:06:06,524]   INFO - erStages.start.CallRunnerStage - ----------------------------------------- [ Silvercore::ANSIBLE QA DEPLOY #QADEPLOY_qa03_2.55.0_130(32359) (buildId = 93498) ] -----------------------------------------
[2014-01-16 14:06:06,530]   INFO - nner2.OsProcessHandlerListener - /usr/local/TeamCity/buildAgent/temp/agentTmp/custom_script8961001133632659500
[2014-01-16 14:06:08,477]   INFO -    jetbrains.buildServer.AGENT - Updating agent parameters on the server: AgentDetails{Name='tcagent07', AgentId=11, BuildId=93498, AgentOwnAddress='null', AlternativeAddresses=[10.120.210.39], Port=9090, Version='27692', PluginsVersion='27692-md5-650e9607258106b52e93f874865e1f2e', AvailableRunners=[Ant, Duplicator, gradle-runner, Inspection, Ipr, JPS, Maven2, rake-runner, simpleRunner], AvailableVcs=[perforce, mercurial, jetbrains.git, svn, cvs], AuthorizationToken='b097b22b1934d3f9339d88a4a8e0af2b'}
[2014-01-16 14:06:09,400]   INFO - ges.RunnerFinishStagesExecutor - Call finish stage jetbrains.buildServer.agent.impl.buildStages.runnerStages.finish.UnsubscribePropertiesFileUpdaterRunnedFStage
[2014-01-16 14:06:09,401]   INFO - ges.RunnerFinishStagesExecutor - Call finish stage jetbrains.buildServer.agent.impl.buildStages.runnerStages.finish.FlushBuildLogRunnerFStage
[2014-01-16 14:06:09,405]   INFO - ges.RunnerFinishStagesExecutor - Call finish stage jetbrains.buildServer.agent.impl.buildStages.runnerStages.finish.FireRunnerFinishedFStage
[2014-01-16 14:06:09,406]   INFO - mpl$TeamCitySpringSubConatiner - Closing SubContext: running build runner context id=93,498 runner 6 of 6: startup date [Thu Jan 16 14:06:06 UTC 2014]; parent: SubContext: running build context id=93498
[2014-01-16 14:06:09,406]   INFO - ages.BuildFinishStagesExecutor - Call finish stage jetbrains.buildServer.agent.impl.buildStages.finishStages.FlushBuildLogFStage
[2014-01-16 14:06:09,447]   INFO - ages.BuildFinishStagesExecutor - Call finish stage jetbrains.buildServer.agent.impl.buildStages.finishStages.FireBeforeBuildFinishFStage
[2014-01-16 14:06:09,449]   INFO - ages.BuildFinishStagesExecutor - Call finish stage jetbrains.buildServer.agent.impl.buildStages.finishStages.PublishBuildPropertiesFStage
[2014-01-16 14:06:09,451]   INFO - ernalArtifactsProcessingLogger - Publishing artifacts process started
[2014-01-16 14:06:09,451]   INFO - ernalArtifactsProcessingLogger - Start: Searching for artifacts to publish in [/usr/local/TeamCity/buildAgent/temp/agentTmp/build.finish.properties.gz=>.teamcity/properties]
[2014-01-16 14:06:09,451]   INFO - ernalArtifactsProcessingLogger - Done:  Searching for artifacts to publish, found [1] file
[2014-01-16 14:06:09,451]   INFO - ernalArtifactsProcessingLogger - Start: Pre-processing artifacts if needed (archiving)
[2014-01-16 14:06:09,452]   INFO - ernalArtifactsProcessingLogger - Done: Pre-processing artifacts if needed (archiving)
[2014-01-16 14:06:09,452]   INFO - ages.BuildFinishStagesExecutor - Call finish stage jetbrains.buildServer.agent.impl.buildStages.finishStages.PublishArtifactsFStage
[2014-01-16 14:06:09,452]   INFO - ernalArtifactsProcessingLogger - Publishing artifacts process started
[2014-01-16 14:06:09,452]   INFO - ernalArtifactsProcessingLogger - Start: Searching for artifacts to publish in [teamcity-info.xml]
[2014-01-16 14:06:09,452]   INFO -    jetbrains.buildServer.AGENT - Internal artifact path teamcity-info.xml not found
[2014-01-16 14:06:09,452]   INFO - ernalArtifactsProcessingLogger - Done:  Searching for artifacts to publish, found [0] files
[2014-01-16 14:06:09,452]   INFO - ernalArtifactsProcessingLogger - Start: Pre-processing artifacts if needed (archiving)
[2014-01-16 14:06:09,452]   INFO - ernalArtifactsProcessingLogger - Done: Pre-processing artifacts if needed (archiving)
[2014-01-16 14:06:09,452]   INFO -    jetbrains.buildServer.AGENT - Publishing artifacts process started
[2014-01-16 14:06:09,452]   INFO -    jetbrains.buildServer.AGENT - Start: Searching for artifacts to publish in [test_*.zip]
[2014-01-16 14:06:09,453]   WARN -    jetbrains.buildServer.AGENT - Artifacts path 'test_*.zip' not found
[2014-01-16 14:06:09,453]   INFO -    jetbrains.buildServer.AGENT - Done:  Searching for artifacts to publish, found [0] files
[2014-01-16 14:06:09,453]   INFO -    jetbrains.buildServer.AGENT - Start: Pre-processing artifacts if needed (archiving)
[2014-01-16 14:06:09,453]   INFO -    jetbrains.buildServer.AGENT - Done: Pre-processing artifacts if needed (archiving)
[2014-01-16 14:06:09,453]   INFO - ages.BuildFinishStagesExecutor - Call finish stage jetbrains.buildServer.agent.impl.buildStages.finishStages.WaitForArtifactsPublishedFStage
[2014-01-16 14:06:09,495]   INFO - ernalArtifactsProcessingLogger - Start: Sending files
[2014-01-16 14:06:09,543]   INFO - ernalArtifactsProcessingLogger - Done publishing artifacts to '.teamcity/properties', total files published: 1
[2014-01-16 14:06:09,543]   INFO - ernalArtifactsProcessingLogger - Done: Sending files
[2014-01-16 14:06:09,633]   INFO - ernalArtifactsProcessingLogger - Publishing artifacts process finished
[2014-01-16 14:06:09,764]   INFO - ernalArtifactsProcessingLogger - Publishing artifacts process finished
[2014-01-16 14:06:09,810]   INFO -    jetbrains.buildServer.AGENT - Publishing artifacts process finished
[2014-01-16 14:06:09,895]   INFO - ages.BuildFinishStagesExecutor - Call finish stage jetbrains.buildServer.agent.impl.buildStages.finishStages.RevertPersonalChangesFStage
[2014-01-16 14:06:09,895]   INFO - ages.BuildFinishStagesExecutor - Call finish stage jetbrains.buildServer.agent.impl.buildStages.finishStages.FireAfterArtifactsPublishedFStage
[2014-01-16 14:06:09,896]   INFO - ages.BuildFinishStagesExecutor - Call finish stage jetbrains.buildServer.agent.impl.buildStages.finishStages.SendBuildInterruptedIfNeededFStage
[2014-01-16 14:06:09,896]   INFO - ages.BuildFinishStagesExecutor - Call finish stage jetbrains.buildServer.agent.impl.buildStages.finishStages.FinishBuildOnAgentFStage
[2014-01-16 14:06:09,896]   INFO -    jetbrains.buildServer.AGENT - Build finished: 93498
[2014-01-16 14:06:09,984]   INFO - nt.impl.BuildRunAgentStateImpl - Disposing build context
[2014-01-16 14:06:09,984]   INFO - mpl$TeamCitySpringSubConatiner - Closing SubContext: running build context id=93498: startup date [Thu Jan 16 13:52:50 UTC 2014]; parent: jetbrains.buildServer.agent.AgentMain2$2@7776cad3
[2014-01-16 14:06:09,985]   INFO - ent.impl.BuildAgentStateHolder - Build data was released for buildId= 93498
[2014-01-16 14:06:09,985]   INFO - ages.BuildFinishStagesExecutor - Call finish stage jetbrains.buildServer.agent.impl.buildStages.finishStages.FireBuildFinishedFStage
[2014-01-16 14:06:09,985]   INFO - l.directories.DirectoryMapImpl - Cleaning up old checkout directories. Default lifetime = 192 hour(s)
[2014-01-16 14:06:10,007]   INFO - ctories.CleanupRegistryCleaner - Removing files from .old to meet free space requirements.
[2014-01-16 14:06:10,007]   INFO - ctories.CleanupRegistryCleaner - Start deleting files from /usr/local/TeamCity/buildAgent/temp/.old
[2014-01-16 14:06:10,008]   INFO - ctories.CleanupRegistryCleaner - Stop deleting files from /usr/local/TeamCity/buildAgent/temp/.old. 10 file(s) were deleted.
[2014-01-16 14:06:10,008]   INFO - ctories.CleanupRegistryCleaner - Start deleting files from /usr/local/TeamCity/buildAgent/work/.old
[2014-01-16 14:06:10,008]   INFO - ages.BuildFinishStagesExecutor - Call finish stage jetbrains.buildServer.agent.impl.buildStages.finishStages.RegisterPropertiesFileNamesFStage
[2014-01-16 14:06:10,008]   INFO - ctories.CleanupRegistryCleaner - Stop deleting files from /usr/local/TeamCity/buildAgent/work/.old. 1 file(s) were deleted.
[2014-01-16 14:06:11,408]   INFO -    jetbrains.buildServer.AGENT - Updating agent parameters on the server: AgentDetails{Name='tcagent07', AgentId=11, BuildId=null, AgentOwnAddress='null', AlternativeAddresses=[10.120.210.39], Port=9090, Version='27692', PluginsVersion='27692-md5-650e9607258106b52e93f874865e1f2e', AvailableRunners=[Ant, Duplicator, gradle-runner, Inspection, Ipr, JPS, Maven2, rake-runner, simpleRunner], AvailableVcs=[perforce, mercurial, jetbrains.git, svn, cvs], AuthorizationToken='b097b22b1934d3f9339d88a4a8e0af2b'}
[2014-01-16 14:12:46,222]   INFO -    jetbrains.buildServer.AGENT - Updating agent parameters on the server: AgentDetails{Name='tcagent07', AgentId=11, BuildId=null, AgentOwnAddress='null', AlternativeAddresses=[10.120.210.39], Port=9090, Version='27692', PluginsVersion='27692-md5-650e9607258106b52e93f874865e1f2e', AvailableRunners=[Ant, Duplicator, gradle-runner, Inspection, Ipr, JPS, Maven2, rake-runner, simpleRunner], AvailableVcs=[perforce, mercurial, jetbrains.git, svn, cvs], AuthorizationToken='b097b22b1934d3f9339d88a4a8e0af2b'}
[2014-01-16 14:40:57,846]   INFO -    jetbrains.buildServer.AGENT - Stop command was not performed. No build to stop with reason: BuildInterruptReason.SERVER_STOP_BUILD
[2014-01-16 14:42:46,694]   INFO -    jetbrains.buildServer.AGENT - Updating agent parameters on the server: AgentDetails{Name='tcagent07', AgentId=11, BuildId=null, AgentOwnAddress='null', AlternativeAddresses=[10.120.210.39], Port=9090, Version='27692', PluginsVersion='27692-md5-650e9607258106b52e93f874865e1f2e', AvailableRunners=[Ant, Duplicator, gradle-runner, Inspection, Ipr, JPS, Maven2, rake-runner, simpleRunner], AvailableVcs=[perforce, mercurial, jetbrains.git, svn, cvs], AuthorizationToken='b097b22b1934d3f9339d88a4a8e0af2b'}
[2014-01-16 14:55:08,278]   INFO - s.agent.StacktracesAgentPlugin - Start getting thread dumps
[2014-01-16 14:55:08,278]   INFO - rocesses.ProcessTreeTerminator - Using jetbrains.buildServer.processes.ProcessTreeTerminatorLinux
[2014-01-16 14:55:08,296]   INFO - ses.ProcessTreeTerminatorLinux - Thread is Process thread model: false
[2014-01-16 14:55:08,296]   INFO - stacktraces.agent.DoThreadDump - Running processes:
[2014-01-16 14:55:08,296]   INFO - acktraces.agent.nix.JdkLocator - Looking for JPS in agent-running jvm...
[2014-01-16 14:55:08,297]   INFO - acktraces.agent.nix.JdkLocator - Lookup for JPS. Found: /usr/java/jdk1.6.0_24/bin/jps
[2014-01-16 14:55:08,297]   INFO - r.stacktraces.agent.nix.JpsRun - Fetcing list of running java processes
[2014-01-16 14:55:08,297]   INFO - r.stacktraces.agent.nix.JpsRun - Starting jps: /usr/java/jdk1.6.0_24/bin/jps -q
[2014-01-16 14:55:08,447]   INFO - r.stacktraces.agent.nix.JpsRun - Found java processes: [8202, 18850, 18871]

[2014-01-16 14:55:08,447]   INFO - aces.agent.nix.NixDoThreadDump - detected java processes: [8202, 18850, 18871]
[2014-01-16 14:55:15,489]   INFO -    jetbrains.buildServer.AGENT - Stop command was not performed. No build to stop with reason: BuildInterruptReason.SERVER_STOP_BUILD
[2014-01-16 14:57:25,163]   INFO -    jetbrains.buildServer.AGENT - Stop command was not performed. No build to stop with reason: BuildInterruptReason.SERVER_STOP_BUILD
[2014-01-16 15:06:02,968]   INFO - agent.impl.AgentPortFileWriter - Delete agent runtime file from /usr/local/TeamCity/buildAgent/bin/../logs/buildAgent.port
[2014-01-16 15:06:02,968]   INFO - buildServer.agent.AgentMain2$2 - Closing jetbrains.buildServer.agent.AgentMain2$2@7776cad3: startup date [Wed Nov 20 20:11:35 UTC 2013]; root of context hierarchy
[2014-01-16 15:06:02,972]   INFO -    jetbrains.buildServer.AGENT - Stop command was not performed. No build to stop with reason: BuildInterruptReason.AGENT_SHUTDOWN
[2014-01-16 15:06:02,972]   INFO -    jetbrains.buildServer.AGENT - Starting agent shutdown sequence, reason: Stop command called
[2014-01-16 15:06:02,985]   INFO -    jetbrains.buildServer.AGENT - Unregistering from build server: 11
[2014-01-16 15:06:03,014]   INFO -    jetbrains.buildServer.AGENT - Recieved stop command from launcher
[2014-01-16 15:06:03,014]   INFO -    jetbrains.buildServer.AGENT - Stop command was not performed. No build to stop with reason: BuildInterruptReason.AGENT_SHUTDOWN
[2014-01-16 15:09:24,740]   INFO -   jetbrains.buildServer.SERVER - Starting TeamCity agent
[2014-01-16 15:09:24,741]   INFO - s.buildServer.agent.AgentMain2 -

Is there another solution other than stopping the build agent process?


Thanks,
-Dave

Please sign in to leave a comment.