Upgrading to 6.0.2 resulted in 100% CPU

I've recently (today) upgraded our TC Enterprise server to 6.0.2. It now uses 100% CPU when building a very small .NET application using Maven. The java.exe image is locked at 100% with the Tomcat6.exe image not far behind. I'm able to perform the builds without issue on the same system from the command line using Maven. It only goes fubar when I use TC to drive the builds. Thoughts? What logs do you need? I can't take thread dumps because the server is unresponsive when I run a build.

6 comments
Comment actions Permalink

I let a build run, and it finished (with errors, unlike before) but TeamCity never thought it was finished. It ran for over two hours. It usually takes about a minute. The java.exe image pegged the CPU at 100% the entire time. PLEASE HELP!!!!!!!!

VSI for vSphere4 Feature - Hello World4.1.x (Trunk) #8 (03 Feb 11 14:28)
Overview
Changes (0)
Build Log
Build Parameters
Download full build log (~4.88Kb) zipped
Important messages | Tail | All messages
[14:28:06]: Checking for changes
[14:28:09]: Clearing temporary directory: C:\teamcity\build\temp\buildTmp
[14:28:09]: Checkout directory: C:\teamcity\build\work\66a545abce6a6181
[14:28:09]: Updating sources: server side checkout... (2s)
[14:28:09]: [Updating sources: server side checkout...] Will perform clean checkout. Reason: Checkout directory is empty or doesn't exist
[14:28:09]: [Updating sources: server side checkout...] Building clean patch for VCS root: ctycvsprd06.isus.emc.com-virtualization
[14:28:11]: [Updating sources: server side checkout...] Transferring cached clean patch for VCS root: ctycvsprd06.isus.emc.com-virtualization
[14:28:11]: [Updating sources: server side checkout...] Repository sources transferred: 82.66Kb total
[14:28:11]: [Updating sources: server side checkout...] Removing C:\teamcity\build\work\66a545abce6a6181
[14:28:11]: [Updating sources: server side checkout...] Updating C:\teamcity\build\work\66a545abce6a6181
[14:28:14]: ##teamcity[buildNumber '8']
[14:28:14]: Using watcher: C:\teamcity\build\plugins\mavenPlugin\maven-watcher\maven-watcher-agent.jar
[14:28:14]: MAVEN_OPTS =  -javaagent:C:\teamcity\build\plugins\mavenPlugin\maven-watcher\maven-watcher-agent.jar -Dteamcity.buildType.id=bt31 -Dteamcity.build.changedFiles.file=C:\teamcity\build\temp\buildTmp\changedFiles9105195993104354304.txt -Dbuild.number=8 -Dteamcity.build.properties.file=C:\teamcity\build\temp\buildTmp\teamcity.build2606988847519831814.properties -Dteamcity.configuration.properties.file=C:\teamcity\build\temp\buildTmp\teamcity.config500285748368796527.properties "-Dteamcity.buildConfName=4.1.x (Trunk)" -Dagent.work.dir=C:\teamcity\build\work -Dteamcity.build.checkoutDir=C:\teamcity\build\work\66a545abce6a6181 -Djava.io.tmpdir=C:\teamcity\build\temp\buildTmp "-Duser.home=C:\Documents and Settings\teamcity" -Dfile.encoding=Cp1252 "-Dteamcity.projectName=VSI for vSphere4 Feature - Hello World" -Dteamcity.agent.dotnet.agent_url=http://localhost:9090/RPC2 -Dteamcity.build.tempDir=C:\teamcity\build\temp\buildTmp -Duser.variant= -Duser.name=teamcity -Dos.arch=x86 -Duser.language=en "-Dbuild.vcs.number.ctycvsprd06_isus_emc_com_virtualization=17 Jan 13:53:41" -Dteamcity.dotnet.nunitlauncher2.0=C:\teamcity\build\plugins\dotnetPlugin\bin\JetBrains.BuildServer.NUnitLauncher2.0.exe -Dteamcity.dotnet.nunitlauncher2.0.vsts=C:\teamcity\build\plugins\dotnetPlugin\bin\JetBrains.BuildServer.NUnitLauncher2.0.VSTS.exe -Dteamcity.dotnet.nunitlauncher1.1=C:\teamcity\build\plugins\dotnetPlugin\bin\JetBrains.BuildServer.NUnitLauncher1.1.exe -Dteamcity.runner.properties.file=C:\teamcity\build\temp\buildTmp\teamcity.runner2125194008835284228.properties -Dagent.home.dir=C:\teamcity\build -Dteamcity.build.id=2056 -Dteamcity.agent.dotnet.build_id=2056 -Dagent.name=vsi.lss.emc.com -Dteamcity.dotnet.platform=C:\teamcity\build\plugins\dotnetPlugin\bin\JetBrains.TeamCity.PlatformProcessRunner.1.1.exe "-DMSTest.10.0=C:\Program Files\Microsoft Visual Studio 10.0\Common7\IDE\MSTest.exe" -Dteamcity.build.workingDir=C:\teamcity\build\work\66a545abce6a6181 -Dteamcity.dotnet.nunitaddin=C:\teamcity\build\plugins\dotnetPlugin\bin\JetBrains.TeamCity.NUnitAddin-NUnit "-Dteamcity.version=6.0.2 (build 15857)" -Dcom.jetbrains.maven.watcher.report.file=C:\teamcity\build\temp\buildTmp\maven-build-info.xml -Dteamcity.dotnet.nunitlauncher=C:\teamcity\build\plugins\dotnetPlugin\bin\JetBrains.BuildServer.NUnitLauncher.exe -Dfile.separator=\ "-Dbuild.vcs.number.1=17 Jan 13:53:41" -Dteamcity.dotnet.nunitlauncher.msbuild.task=C:\teamcity\build\plugins\dotnetPlugin\bin\JetBrains.BuildServer.MSBuildLoggers.dll -Dteamcity.auth.userId=TeamCityBuildId=2056 -Dteamcity.auth.password=iUDorSGoIhdfVmz0XdzJ5DDczdL35KE1 -Duser.timezone=America/Chicago -Dteamcity.agent.cpuBenchmark=200 "-Dos.name=Windows 2003" -Dteamcity.tests.recentlyFailedTests.file=C:\teamcity\build\temp\buildTmp\testsToRunFirst274861854889616141.txt -Dpath.separator=; -Dos.version=5.2 -Dagent.ownPort=9090 "-Dbuild.vcs.number=17 Jan 13:53:41" -Duser.country=US
[14:28:14]: M2_HOME = C:\maven\active
[14:28:14]: PATH = C:\maven\active\bin;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;c:\maven;C:\WINDOWS\system32\WindowsPowerShell\v1.0;C:\Program Files\Graphviz2.26.3\bin;C:\WINDOWS\system32\WindowsPowerShell\v1.0
[14:28:14]: JAVA_HOME = C:\Program Files\Java\jdk1.6.0_20
[14:28:14]: Starting: C:\maven\active\bin\mvn.bat -f C:\teamcity\build\work\66a545abce6a6181\pom.xml -B install
[14:28:14]: in directory: C:\teamcity\build\work\66a545abce6a6181
[14:28:16]: [INFO] Scanning for projects...
[14:28:17]: [INFO] snapshot com.emc.vsi:emc-vsi-vsphere4-features:4.1.0-SNAPSHOT: checking for updates from localhost
[14:28:17]: [INFO] snapshot com.emc.vsi:emc-vsi-vsphere4-features:4.1.0-SNAPSHOT: checking for updates from maven.lostcreations.com-snapshots
[14:28:17]: [INFO] snapshot com.emc.vsi:emc-vsi-vsphere4:4.1.0-SNAPSHOT: checking for updates from localhost
[14:28:17]: [INFO] snapshot com.emc.vsi:emc-vsi-vsphere4:4.1.0-SNAPSHOT: checking for updates from maven.lostcreations.com-snapshots
[14:28:17]: [INFO] snapshot com.emc.vsi:emc-vsi:4.1.0-SNAPSHOT: checking for updates from localhost
[14:28:17]: [INFO] snapshot com.emc.vsi:emc-vsi:4.1.0-SNAPSHOT: checking for updates from maven.lostcreations.com-snapshots
[14:28:18]: [INFO] Reactor build order:
[14:28:18]: [INFO]   EMC VSI for VMware vSphere Feature - HelloWorld
[14:28:18]: [INFO]   EMC VSI for VMware vSphere Feature - HelloWorld - Lib
[14:28:18]: [INFO] snapshot net.sf.nvn:nvn-plugin:0.0.7-SNAPSHOT: checking for updates from maven.lostcreations.com-snapshots
[14:28:18]: [INFO] snapshot net.sf.nvn:nvn-plugin:0.0.7-SNAPSHOT: checking for updates from localhost
[14:28:18]: [INFO] snapshot net.sf.nvn:nvn-plugin:0.0.7-SNAPSHOT: checking for updates from maven.lostcreations.com-snapshots
[14:28:18]: [INFO] snapshot net.sf.nvn:nvn:0.0.7-SNAPSHOT: checking for updates from maven.lostcreations.com-snapshots
[14:28:19]: [INFO] snapshot net.sf.nvn:nvn:0.0.7-SNAPSHOT: checking for updates from localhost
[14:28:19]: [INFO] snapshot net.sf.nvn:nvn:0.0.7-SNAPSHOT: checking for updates from maven.lostcreations.com-snapshots
[14:28:19]: [INFO] snapshot net.sf.nvn:nvn-commons:0.0.7-SNAPSHOT: checking for updates from maven.lostcreations.com-snapshots
[14:28:20]: [INFO] snapshot net.sf.nvn:nvn-commons:0.0.7-SNAPSHOT: checking for updates from localhost
[14:28:20]: [INFO] snapshot net.sf.nvn:nvn-commons:0.0.7-SNAPSHOT: checking for updates from maven.lostcreations.com-snapshots
[14:28:22]: [INFO] ------------------------------------------------------------------------
[14:28:22]: [INFO] Building EMC VSI for VMware vSphere Feature - HelloWorld
[14:28:22]: [INFO]    task-segment: [install]
[14:28:23]: [INFO] ------------------------------------------------------------------------
[14:28:23]: com.emc.vsi:emc-vsi-vsphere4-features-helloworld
[14:28:23]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld] Importing data from 'C:/teamcity/build/work/66a545abce6a6181/target/surefire-reports/TEST-*.xml' with 'surefire' processor
[14:28:23]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld] Surefire report watcher
[14:28:23]: [Surefire report watcher] Watching paths:
[14:28:23]: [Surefire report watcher] C:\teamcity\build\work\66a545abce6a6181\target\surefire-reports\TEST-*.xml
[14:34:23]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld] [INFO] [site:attach-descriptor {execution: default-attach-descriptor}]
[14:35:49]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld] [INFO] [install:install {execution: default-install}]
[14:35:49]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld] [INFO] Installing C:\teamcity\build\work\66a545abce6a6181\pom.xml to c:\maven\repository\com\emc\vsi\emc-vsi-vsphere4-features-helloworld\4.1.0-SNAPSHOT\emc-vsi-vsphere4-features-helloworld-4.1.0-SNAPSHOT.pom
[14:36:05]: [INFO] ------------------------------------------------------------------------
[14:36:05]: [INFO] Building EMC VSI for VMware vSphere Feature - HelloWorld - Lib
[14:36:05]: [INFO]    task-segment: [install]
[14:36:05]: [INFO] ------------------------------------------------------------------------
[14:36:05]: com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib
[14:36:06]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] Importing data from 'C:/teamcity/build/work/66a545abce6a6181/EMC.VSI.VSphere4.Features.HelloWorld/target/surefire-reports/TEST-*.xml' with 'surefire' processor
[14:36:06]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] Surefire report watcher
[14:36:06]: [Surefire report watcher] Watching paths:
[14:36:06]: [Surefire report watcher] C:\teamcity\build\work\66a545abce6a6181\EMC.VSI.VSphere4.Features.HelloWorld\target\surefire-reports\TEST-*.xml
[14:37:53]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] [nvn:initialize {execution: default-initialize}]
[14:37:53]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] NVN-initialize: initialized version: 4.1.0-SNAPSHOT
[14:37:53]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] NVN-initialize: initialized nvn version: 4.1.0.8
[14:48:25]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] NVN-initialize: initialized msproject
[14:48:25]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] NVN-initialize: build configuration: Release
[14:48:25]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] NVN-initialize: build platform:      AnyCPU
[14:48:25]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] NVN-initialize: Initialized build directory (relative): bin\Release
[14:48:25]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] NVN-initialize: Initialized build directory (absolute): C:\teamcity\build\work\66a545abce6a6181\EMC.VSI.VSphere4.Features.HelloWorld\bin\Release
[14:48:25]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] NVN-initialize: artifact name: EMC.VSI.VSphere4.Features.HelloWorld
[14:48:36]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] NVN-initialize: initialized bin artifact: C:\teamcity\build\work\66a545abce6a6181\EMC.VSI.VSphere4.Features.HelloWorld\bin\Release\EMC.VSI.VSphere4.Features.HelloWorld.dll
[14:48:36]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] NVN-initialize: initialized pdb artifact: C:\teamcity\build\work\66a545abce6a6181\EMC.VSI.VSphere4.Features.HelloWorld\bin\Release\EMC.VSI.VSphere4.Features.HelloWorld.pdb
[14:48:36]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] [nvn:assembly-info {execution: default-assembly-info}]
[14:48:56]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] snapshot com.emc.vsi:emc-vsi-vsphere4-framework-lib:4.1.0-SNAPSHOT: checking for updates from localhost
[14:48:56]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] snapshot com.emc.vsi:emc-vsi-vsphere4-framework-lib:4.1.0-SNAPSHOT: checking for updates from maven.lostcreations.com-snapshots
[14:49:24]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] snapshot com.emc.vsi:emc-vsi-vsphere4-framework:4.1.0-SNAPSHOT: checking for updates from localhost
[14:49:24]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] snapshot com.emc.vsi:emc-vsi-vsphere4-framework:4.1.0-SNAPSHOT: checking for updates from maven.lostcreations.com-snapshots
[14:49:24]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] snapshot com.emc:emc-assemblyutils-lib:4.1.0-SNAPSHOT: checking for updates from localhost
[14:49:24]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] snapshot com.emc:emc-assemblyutils-lib:4.1.0-SNAPSHOT: checking for updates from maven.lostcreations.com-snapshots
[14:49:24]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] snapshot com.emc:emc-assemblyutils:4.1.0-SNAPSHOT: checking for updates from localhost
[14:49:24]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] snapshot com.emc:emc-assemblyutils:4.1.0-SNAPSHOT: checking for updates from maven.lostcreations.com-snapshots
[14:49:24]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] snapshot com.emc.vsi:emc-vsi-core-features:4.1.0-SNAPSHOT: checking for updates from localhost
[14:49:24]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] snapshot com.emc.vsi:emc-vsi-core-features:4.1.0-SNAPSHOT: checking for updates from maven.lostcreations.com-snapshots
[14:49:25]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] snapshot com.emc.vsi:emc-vsi-core:4.1.0-SNAPSHOT: checking for updates from localhost
[14:49:25]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] snapshot com.emc.vsi:emc-vsi-core:4.1.0-SNAPSHOT: checking for updates from maven.lostcreations.com-snapshots
[14:49:30]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] snapshot com.emc.vsi:emc-vsi-core-lib:4.1.0-SNAPSHOT: checking for updates from localhost
[14:49:30]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] snapshot com.emc.vsi:emc-vsi-core-lib:4.1.0-SNAPSHOT: checking for updates from maven.lostcreations.com-snapshots
[14:49:30]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] snapshot com.emc.vsi:emc-vsi-vsphere4-controls-lib:4.1.0-SNAPSHOT: checking for updates from localhost
[14:49:30]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] snapshot com.emc.vsi:emc-vsi-vsphere4-controls-lib:4.1.0-SNAPSHOT: checking for updates from maven.lostcreations.com-snapshots
[14:49:30]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] snapshot com.emc.vsi:emc-vsi-vsphere4-controls:4.1.0-SNAPSHOT: checking for updates from localhost
[14:49:30]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] snapshot com.emc.vsi:emc-vsi-vsphere4-controls:4.1.0-SNAPSHOT: checking for updates from maven.lostcreations.com-snapshots
[14:49:38]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] [nvn:wsdl {execution: default-wsdl}]
[14:49:49]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] [nvn:xsd {execution: default-xsd}]
[14:59:51]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] [dependency:unpack {execution: unpack-wix-resources}]
[14:59:51]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] Configured Artifact: com.emc.vsi:emc-vsi-wix-resources:?:zip
[14:59:51]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] Unpacking c:\maven\repository\com\emc\vsi\emc-vsi-wix-resources\1.2.0\emc-vsi-wix-resources-1.2.0.zip to
[14:59:51]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib]   C:\teamcity\build\work\66a545abce6a6181\EMC.VSI.VSphere4.Features.HelloWorld\bin\Release\Resources
[14:59:51]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib]    with includes null and excludes:null
[15:00:33]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] [nvn:msbuild {execution: default-msbuild}]
[15:07:52]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] NVN-msbuild: execution #0: C:\WINDOWS\Microsoft.NET\Framework\v4.0.30319\msbuild.exe /target:Build /property:Platform=AnyCPU /property:Configuration=Release /property:OutputPath=C:\teamcity\build\work\66a545abce6a6181\EMC.VSI.VSphere4.Features.HelloWorld\bin\Release /property:ReferencePath="c:\maven\repository\org\apache\log4net\1.2.10;c:\maven\repository\com\vmware\viplugins2\4.0.0.0;c:\maven\repository\com\emc\vsi\emc-vsi-core-features\4.1.0-SNAPSHOT;c:\maven\repository\com\microsoft\dotnetfx\3.5.SP1" /nodeReuse:false C:\teamcity\build\work\66a545abce6a6181\EMC.VSI.VSphere4.Features.HelloWorld\EMC.VSI.VSphere4.Features.HelloWorld.csproj
[15:08:00]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] Microsoft (R) Build Engine Version 4.0.30319.1
[15:08:00]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [Microsoft .NET Framework, Version 4.0.30319.1]
[15:08:00]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] Copyright (C) Microsoft Corporation 2007. All rights reserved.
[15:08:00]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] Build started 2/3/2011 3:07:57 PM.
[15:08:00]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] Project "C:\teamcity\build\work\66a545abce6a6181\EMC.VSI.VSphere4.Features.HelloWorld\EMC.VSI.VSphere4.Features.HelloWorld.csproj" on node 1 (Build target(s)).
[15:08:00]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] PrepareForBuild:
[15:08:00]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib]   Creating directory "obj\Release\".
[15:08:45]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] CoreResGen:
[15:08:45]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib]   C:\Program Files\Microsoft SDKs\Windows\v7.0A\bin\ResGen.exe /useSourcePath /r:c:\maven\repository\com\emc\vsi\emc-vsi-core-features\4.1.0-SNAPSHOT\EMC.VSI.Features.dll /r:c:\maven\repository\org\apache\log4net\1.2.10\log4net.dll /r:c:\WINDOWS\Microsoft.NET\Framework\v2.0.50727\mscorlib.dll /r:"c:\Program Files\Reference Assemblies\Microsoft\Framework\v3.5\System.Core.dll" /r:c:\WINDOWS\Microsoft.NET\Framework\v2.0.50727\System.Data.dll /r:c:\WINDOWS\Microsoft.NET\Framework\v2.0.50727\System.dll /r:c:\WINDOWS\Microsoft.NET\Framework\v2.0.50727\System.Drawing.dll /r:c:\WINDOWS\Microsoft.NET\Framework\v2.0.50727\System.Windows.Forms.dll /r:c:\WINDOWS\Microsoft.NET\Framework\v2.0.50727\System.Xml.dll /r:c:\maven\repository\com\vmware\viplugins2\4.0.0.0\VIPlugins2.dll /compile MarsFeatureContentControl.resx,obj\Release\EMC.VSI.VSphere4.Features.HelloWorld.MarsFeatureContentControl.resources PlutoFeatureContentControl.resx,obj\Release\EMC.VSI.VSphere4.Features.HelloWorld.PlutoFeatureContentControl.resources
[15:18:37]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] CoreCompile:
[15:18:37]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib]   c:\WINDOWS\Microsoft.NET\Framework\v4.0.30319\Csc.exe /noconfig /nowarn:1701,1702 /nostdlib+ /errorreport:prompt /warn:4 /define:TRACE /reference:c:\maven\repository\com\emc\vsi\emc-vsi-core-features\4.1.0-SNAPSHOT\EMC.VSI.Features.dll /reference:c:\maven\repository\org\apache\log4net\1.2.10\log4net.dll /reference:c:\WINDOWS\Microsoft.NET\Framework\v2.0.50727\mscorlib.dll /reference:"c:\Program Files\Reference Assemblies\Microsoft\Framework\v3.5\System.Core.dll" /reference:c:\WINDOWS\Microsoft.NET\Framework\v2.0.50727\System.Data.dll /reference:c:\WINDOWS\Microsoft.NET\Framework\v2.0.50727\System.dll /reference:c:\WINDOWS\Microsoft.NET\Framework\v2.0.50727\System.Drawing.dll /reference:c:\WINDOWS\Microsoft.NET\Framework\v2.0.50727\System.Windows.Forms.dll /reference:c:\WINDOWS\Microsoft.NET\Framework\v2.0.50727\System.Xml.dll /reference:c:\maven\repository\com\vmware\viplugins2\4.0.0.0\VIPlugins2.dll /debug:pdbonly /filealign:512 /optimize+ /out:obj\Release\EMC.VSI.VSphere4.Features.HelloWorld.dll /resource:obj\Release\EMC.VSI.VSphere4.Features.HelloWorld.MarsFeatureContentControl.resources /resource:obj\Release\EMC.VSI.VSphere4.Features.HelloWorld.PlutoFeatureContentControl.resources /target:library EarthFeatureContextControl.cs EarthFeatureContextControl.Designer.cs LabelEx.cs LabelEx.Designer.cs MoonFeatureContextControl.cs MoonFeatureContextControl.Designer.cs PlutoFeatureContentControl.cs PlutoFeatureContentControl.Designer.cs SettingsContentControl.cs SettingsContentControl.Designer.cs TextBoxEx.cs TextBoxEx.Designer.cs TheFeature.cs Properties\AssemblyInfo.cs MarsFeatureContentControl.cs MarsFeatureContentControl.Designer.cs TheFeatureInError.cs WidgetConfigContentControl.cs WidgetConfigContentControl.Designer.cs
[15:23:36]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] TheFeature.cs(304,17): warning CS0067: The event 'EMC.VSI.VSphere4.Features.HelloWorld.TheFeature.EMCOptionControl1.CheckboxEnabledChanged' is never used [C:\teamcity\build\work\66a545abce6a6181\EMC.VSI.VSphere4.Features.HelloWorld\EMC.VSI.VSphere4.Features.HelloWorld.csproj]
[15:23:58]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] TheFeature.cs(413,17): warning CS0067: The event 'EMC.VSI.VSphere4.Features.HelloWorld.TheFeature.EMCOptionControl2.CheckboxEnabledChanged' is never used [C:\teamcity\build\work\66a545abce6a6181\EMC.VSI.VSphere4.Features.HelloWorld\EMC.VSI.VSphere4.Features.HelloWorld.csproj]
[15:23:58]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] TheFeature.cs(526,17): warning CS0067: The event 'EMC.VSI.VSphere4.Features.HelloWorld.TheFeature.EMCOptionControl3.CheckboxEnabledChanged' is never used [C:\teamcity\build\work\66a545abce6a6181\EMC.VSI.VSphere4.Features.HelloWorld\EMC.VSI.VSphere4.Features.HelloWorld.csproj]
[15:24:12]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] TheFeature.cs(625,17): warning CS0067: The event 'EMC.VSI.VSphere4.Features.HelloWorld.TheFeature.VMOptionControl1.CheckboxEnabledChanged' is never used [C:\teamcity\build\work\66a545abce6a6181\EMC.VSI.VSphere4.Features.HelloWorld\EMC.VSI.VSphere4.Features.HelloWorld.csproj]
[15:24:40]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] _CopyFilesMarkedCopyLocal:
[15:24:52]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib]   Copying file from "c:\maven\repository\com\emc\vsi\emc-vsi-core-features\4.1.0-SNAPSHOT\EMC.VSI.Features.dll" to "C:\teamcity\build\work\66a545abce6a6181\EMC.VSI.VSphere4.Features.HelloWorld\bin\Release\EMC.VSI.Features.dll".
[15:24:52]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib]   Copying file from "c:\maven\repository\com\emc\vsi\emc-vsi-core-features\4.1.0-SNAPSHOT\EMC.VSI.Features.pdb" to "C:\teamcity\build\work\66a545abce6a6181\EMC.VSI.VSphere4.Features.HelloWorld\bin\Release\EMC.VSI.Features.pdb".
[15:24:52]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] CopyFilesToOutputDirectory:
[15:24:57]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib]   Copying file from "obj\Release\EMC.VSI.VSphere4.Features.HelloWorld.dll" to "C:\teamcity\build\work\66a545abce6a6181\EMC.VSI.VSphere4.Features.HelloWorld\bin\Release\EMC.VSI.VSphere4.Features.HelloWorld.dll".
[15:25:24]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib]   EMC.VSI.VSphere4.Features.HelloWorld -> C:\teamcity\build\work\66a545abce6a6181\EMC.VSI.VSphere4.Features.HelloWorld\bin\Release\EMC.VSI.VSphere4.Features.HelloWorld.dll
[15:25:29]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib]   Copying file from "obj\Release\EMC.VSI.VSphere4.Features.HelloWorld.pdb" to "C:\teamcity\build\work\66a545abce6a6181\EMC.VSI.VSphere4.Features.HelloWorld\bin\Release\EMC.VSI.VSphere4.Features.HelloWorld.pdb".
[15:26:38]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] PostBuildEvent:
[15:26:38]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib]   C:\teamcity\build\work\66a545abce6a6181\EMC.VSI.VSphere4.Features.HelloWorld\\CopyBuildOutputOnBuild.bat "C:\teamcity\build\work\66a545abce6a6181\EMC.VSI.VSphere4.Features.HelloWorld\" "C:\teamcity\build\work\66a545abce6a6181\EMC.VSI.VSphere4.Features.HelloWorld\bin\Release\"
[15:27:48]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib]   "C:\Program Files\EMC\Virtual Storage Integrator\vSphere4\Features\HelloWorld Does Not Exist"
[15:28:05]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] Done Building Project "C:\teamcity\build\work\66a545abce6a6181\EMC.VSI.VSphere4.Features.HelloWorld\EMC.VSI.VSphere4.Features.HelloWorld.csproj" (Build target(s)).
[15:28:36]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] Build succeeded.
[15:28:48]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] "C:\teamcity\build\work\66a545abce6a6181\EMC.VSI.VSphere4.Features.HelloWorld\EMC.VSI.VSphere4.Features.HelloWorld.csproj" (Build target) (1) ->
[15:28:48]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] (CoreCompile target) ->
[15:28:48]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib]   TheFeature.cs(304,17): warning CS0067: The event 'EMC.VSI.VSphere4.Features.HelloWorld.TheFeature.EMCOptionControl1.CheckboxEnabledChanged' is never used [C:\teamcity\build\work\66a545abce6a6181\EMC.VSI.VSphere4.Features.HelloWorld\EMC.VSI.VSphere4.Features.HelloWorld.csproj]
[15:28:48]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib]   TheFeature.cs(413,17): warning CS0067: The event 'EMC.VSI.VSphere4.Features.HelloWorld.TheFeature.EMCOptionControl2.CheckboxEnabledChanged' is never used [C:\teamcity\build\work\66a545abce6a6181\EMC.VSI.VSphere4.Features.HelloWorld\EMC.VSI.VSphere4.Features.HelloWorld.csproj]
[15:28:48]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib]   TheFeature.cs(526,17): warning CS0067: The event 'EMC.VSI.VSphere4.Features.HelloWorld.TheFeature.EMCOptionControl3.CheckboxEnabledChanged' is never used [C:\teamcity\build\work\66a545abce6a6181\EMC.VSI.VSphere4.Features.HelloWorld\EMC.VSI.VSphere4.Features.HelloWorld.csproj]
[15:28:48]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib]   TheFeature.cs(625,17): warning CS0067: The event 'EMC.VSI.VSphere4.Features.HelloWorld.TheFeature.VMOptionControl1.CheckboxEnabledChanged' is never used [C:\teamcity\build\work\66a545abce6a6181\EMC.VSI.VSphere4.Features.HelloWorld\EMC.VSI.VSphere4.Features.HelloWorld.csproj]
[15:28:48]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib]     4 Warning(s)
[15:28:48]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib]     0 Error(s)
[15:28:48]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] Time Elapsed 00:20:28.75
[15:31:57]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] NVN-msbuild:
[15:31:57]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] ##teamcity[publishArtifacts 'EMC.VSI.VSphere4.Features.HelloWorld/bin/Release/EMC.VSI.VSphere4.Features.HelloWorld.dll => .']
[15:31:57]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] Publishing artifacts
[15:31:57]: [Publishing artifacts] Paths to publish: [EMC.VSI.VSphere4.Features.HelloWorld/bin/Release/EMC.VSI.VSphere4.Features.HelloWorld.dll => .]
[15:31:58]: [Publishing artifacts] Sending files
[15:31:58]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] NVN-msbuild:
[15:31:58]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] ##teamcity[publishArtifacts 'EMC.VSI.VSphere4.Features.HelloWorld/bin/Release/EMC.VSI.VSphere4.Features.HelloWorld.pdb => .']
[15:31:58]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] Publishing artifacts
[15:31:58]: [Publishing artifacts] Paths to publish: [EMC.VSI.VSphere4.Features.HelloWorld/bin/Release/EMC.VSI.VSphere4.Features.HelloWorld.pdb => .]
[15:31:58]: [Publishing artifacts] Sending files
[15:32:04]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] [nvn:candle {execution: default-candle}]
[15:39:47]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] NVN-candle: execution #0: "C:\Program Files\Windows Installer XML v3.5\bin\candle.exe" -out C:\teamcity\build\work\66a545abce6a6181\EMC.VSI.VSphere4.Features.HelloWorld\bin\Release\Setup.wixobj -dBuildOutput=C:\teamcity\build\work\66a545abce6a6181\EMC.VSI.VSphere4.Features.HelloWorld\bin\Release -dEmcLong="EMC Corporation" -dEmcShort=EMC -dLocalRepoRoot=c:\maven\repository -dLongName="EMC VSI HelloWorld for VMware vSphere" -dProductGuid=25C00494-E8FF-4074-B292-5047D48E3A74 -dProjectDescription="The test Feature(s) for the EMC VSI for VMware vSphere framework." -dResources=C:\teamcity\build\work\66a545abce6a6181\EMC.VSI.VSphere4.Features.HelloWorld\bin\Release\Resources -dShortName=HelloWorld -dUpgradeGuid=5E31CD05-C15A-4D13-99E1-1E81943CAB32 -dVersion=4.1.0 -dVsiForVSphereRequiredConditionMessage="EMC Virtual Storage Integrator (VSI) for VMware vSphere is required. Setup will now exit." -dVsiLong="Virtual Storage Integrator" -dVsiShort=VSI C:\teamcity\build\work\66a545abce6a6181\EMC.VSI.VSphere4.Features.HelloWorld\Setup.wxs
[15:42:57]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] Microsoft (R) Windows Installer Xml Compiler version 3.5.2006.0
[15:42:57]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] Copyright (C) Microsoft Corporation. All rights reserved.
[15:42:58]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] Setup.wxs
[15:43:17]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] [nvn:light {execution: default-light}]
[15:51:19]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] [INFO] NVN-light: execution #0: "C:\Program Files\Windows Installer XML v3.5\bin\light.exe" -out C:\teamcity\build\work\66a545abce6a6181\EMC.VSI.VSphere4.Features.HelloWorld\bin\Release\emc-vsi-hw-4.0.0-vmware-vsphere-WINDOWS-x86.msi -ext WiXUtilExtension -ext WixUIExtension -sw1076 C:\teamcity\build\work\66a545abce6a6181\EMC.VSI.VSphere4.Features.HelloWorld\bin\Release\Setup.wixobj
[15:56:29]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] Microsoft (R) Windows Installer Xml Linker version 3.5.2006.0
[15:56:29]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] Copyright (C) Microsoft Corporation. All rights reserved.
[16:09:55]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] light.exe : error LGHT0217 : Error executing ICE action 'ICE01'. The most common cause of this kind of ICE failure is an incorrectly registered scripting engine. See http://wix.sourceforge.net/faq.html#Error217 for details and how to solve this problem. The following string format was not expected by the external UI message logger: "The Windows Installer Service could not be accessed. This can occur if the Windows Installer is not correctly installed. Contact your support personnel for assistance.".
[16:11:16]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] light.exe : error LGHT0217 : Error executing ICE action 'ICE02'. The most common cause of this kind of ICE failure is an incorrectly registered scripting engine. See http://wix.sourceforge.net/faq.html#Error217 for details and how to solve this problem. The following string format was not expected by the external UI message logger: "The Windows Installer Service could not be accessed. This can occur if the Windows Installer is not correctly installed. Contact your support personnel for assistance.".
[16:12:45]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] light.exe : error LGHT0217 : Error executing ICE action 'ICE03'. The most common cause of this kind of ICE failure is an incorrectly registered scripting engine. See http://wix.sourceforge.net/faq.html#Error217 for details and how to solve this problem. The following string format was not expected by the external UI message logger: "The Windows Installer Service could not be accessed. This can occur if the Windows Installer is not correctly installed. Contact your support personnel for assistance.".
[16:14:04]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] light.exe : error LGHT0217 : Error executing ICE action 'ICE04'. The most common cause of this kind of ICE failure is an incorrectly registered scripting engine. See http://wix.sourceforge.net/faq.html#Error217 for details and how to solve this problem. The following string format was not expected by the external UI message logger: "The Windows Installer Service could not be accessed. This can occur if the Windows Installer is not correctly installed. Contact your support personnel for assistance.".
[16:15:39]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] light.exe : error LGHT0217 : Error executing ICE action 'ICE05'. The most common cause of this kind of ICE failure is an incorrectly registered scripting engine. See http://wix.sourceforge.net/faq.html#Error217 for details and how to solve this problem. The following string format was not expected by the external UI message logger: "The Windows Installer Service could not be accessed. This can occur if the Windows Installer is not correctly installed. Contact your support personnel for assistance.".
[16:17:12]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] light.exe : error LGHT0217 : Error executing ICE action 'ICE06'. The most common cause of this kind of ICE failure is an incorrectly registered scripting engine. See http://wix.sourceforge.net/faq.html#Error217 for details and how to solve this problem. The following string format was not expected by the external UI message logger: "The Windows Installer Service could not be accessed. This can occur if the Windows Installer is not correctly installed. Contact your support personnel for assistance.".
[16:18:57]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] light.exe : error LGHT0217 : Error executing ICE action 'ICE07'. The most common cause of this kind of ICE failure is an incorrectly registered scripting engine. See http://wix.sourceforge.net/faq.html#Error217 for details and how to solve this problem. The following string format was not expected by the external UI message logger: "The Windows Installer Service could not be accessed. This can occur if the Windows Installer is not correctly installed. Contact your support personnel for assistance.".
[16:21:03]: [com.emc.vsi:emc-vsi-vsphere4-features-helloworld-lib] light.exe : error LGHT0216 : An unexpected Win32 exception with error code 0x643 occurred: Action - 'ICE08' Fatal error during installation
[16:23:53]: [INFO] ------------------------------------------------------------------------
[16:23:53]: [ERROR] BUILD ERROR
[16:23:53]: [INFO] ------------------------------------------------------------------------
[16:23:53]: [INFO] Error running light:
[16:23:53]: Embedded error: light exited with an unsuccessful error code: 216
[16:23:53]: [INFO] ------------------------------------------------------------------------
[16:23:53]: [INFO] For more information, run Maven with the -e switch
[16:23:53]: [INFO] ------------------------------------------------------------------------
[16:23:53]: [INFO] Total time: 115 minutes 36 seconds
[16:23:53]: [INFO] Finished at: Thu Feb 03 16:23:53 CST 2011
[16:23:53]: [INFO] Final Memory: 27M/66M
[16:23:53]: [INFO] ------------------------------------------------------------------------
[16:25:27]: Process exited with code 1
[16:25:28]: Publishing artifacts
[16:25:28]: [Publishing artifacts] Paths to publish: [C:\teamcity\build\temp\buildTmp\.tc-maven-bi\maven-build-info.xml.gz => .teamcity]
[16:25:28]: [Publishing artifacts] Sending files
[16:26:17]: Surefire report watcher
[16:26:17]: Waiting for 2 service processes to complete
[16:26:17]: Publishing artifacts
[16:26:17]: [Publishing artifacts] Paths to publish: [teamcity-info.xml]
[16:26:17]: [Publishing artifacts] Sending files
[16:26:18]: Build finished

0
Comment actions Permalink

Please try to take thread dump from the agent java process. You can do it using Java jstack utility.

0
Comment actions Permalink

Here are three dumps about 10 seconds a part. The offending Java process was sitting at 99%. Please help me fix this, we are stuck without builds while this is occurring. FYI, I have an enterprise license as well. I submitted a problem report, but haven't heard back. The license isn't attached to my e-mail, but I can provide you the key. I work for EMC, and it was bought by our controller.



Attachment(s):
tc-6.0.2-jstack-dump.txt.zip
0
Comment actions Permalink

Hi. This is a very critical issue for us. We cannot proceed with a release until the build server is fixed. We paid for an enterprise license, and I submitted a trouble ticket, and have not heard back. Please, I would like to resolve this ASAP.

0
Comment actions Permalink

It seems we found the cause of the problem. Please watch/vote for this issue: http://youtrack.jetbrains.net/issue/TW-15335
Once the fix is available the patch will be attached to this issue. I hope the patch will be available on Monday.

0
Comment actions Permalink

Great! In the meantime, is there a way to globally disable the reporting engine so I can run builds?

0

Please sign in to leave a comment.