TC server got really slow today

All of a sudden today the web client got really slow and flakey (click on a tab and it takes a minute to get there).. I'm on build 5504 on the default DB on windows. I tried rebooting the machine, didn't matter. There are some weird log msgs on the server too.
(log msgs at end)

Any ideas?


INFO - serverSide.impl.DBBuildHistory - End creating history entry for Ikopi :: Integration.ui 89159
INFO - jetbrains.buildServer.SERVER - Finished 89159
INFO - tbrains.buildServer.ACTIVITIES - Build started; name=Ikopi :: Integration.ui, personal=false, buildId=89160
INFO - tbrains.buildServer.ACTIVITIES - Configuration removed from queue; name=Ikopi :: Integration.ui, requestor=Unexpected finish, comment=null, user=null
INFO - r.serverSide.impl.BuildStarter - jetbrains.buildServer.serverSide.ExecutionException: jetbrains.buildServer.xmlrpc.RemoteCallException: Call http://172.29.2.126:9090/RPC2 buildAgent.run: org.apache.xmlrpc.XmlRpcException: java.lang.Exception: java.lang.IllegalStateException: Already running a build 28776 false
jetbrains.buildServer.serverSide.ExecutionException: jetbrains.buildServer.xmlrpc.RemoteCallException: Call http://172.29.2.126:9090/RPC2 buildAgent.run: org.apache.xmlrpc.XmlRpcException: java.lang.Exception: java.lang.IllegalStateException: Already running a build 28776 false
at jetbrains.buildServer.serverSide.impl.XmlRpcBasedAgent.run(XmlRpcBasedAgent.java:49)
at jetbrains.buildServer.serverSide.impl.BuildStarter$1.run(BuildStarter.java:30)
at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source)
at java.util.concurrent.FutureTask.run(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)
Caused by: jetbrains.buildServer.xmlrpc.RemoteCallException: Call http://172.29.2.126:9090/RPC2 buildAgent.run: org.apache.xmlrpc.XmlRpcException: java.lang.Exception: java.lang.IllegalStateException: Already running a build 28776 false
at jetbrains.buildServer.xmlrpc.AbstractXmlRpcTarget.call(AbstractXmlRpcTarget.java:24)
at jetbrains.buildServer.serverSide.impl.XmlRpcBasedAgent.run(XmlRpcBasedAgent.java:88)
... 7 more
Caused by: org.apache.xmlrpc.XmlRpcException: java.lang.Exception: java.lang.IllegalStateException: Already running a build 28776 false
at org.apache.xmlrpc.XmlRpcClientResponseProcessor.decodeException(XmlRpcClientResponseProcessor.java:104)
at org.apache.xmlrpc.XmlRpcClientResponseProcessor.decodeResponse(XmlRpcClientResponseProcessor.java:71)
at org.apache.xmlrpc.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:73)
at org.apache.xmlrpc.TCXmlRpcClient$1.execute(TCXmlRpcClient.java)
at org.apache.xmlrpc.XmlRpcClient.execute(XmlRpcClient.java:194)
at org.apache.xmlrpc.XmlRpcClient.execute(XmlRpcClient.java:185)
at org.apache.xmlrpc.XmlRpcClient.execute(XmlRpcClient.java:178)
at jetbrains.buildServer.xmlrpc.impl.CommonsXmlRpcTargetImpl$1.execute(CommonsXmlRpcTargetImpl.java:7)
at jetbrains.buildServer.xmlrpc.AbstractXmlRpcTarget.call(AbstractXmlRpcTarget.java:40)
... 8 more
INFO - tbrains.buildServer.ACTIVITIES - Configuration added to queue; name=Ikopi :: Integration.ui; requestor=Unexpected finish
INFO - tbrains.buildServer.ACTIVITIES - Finishing build 89160, name: Integration.ui, personal: false, failed: false, interrupted: true, cancelled:
INFO - serverSide.impl.DBBuildHistory - Start creating history entry for Ikopi :: Integration.ui 89160, date: 1190386325781
INFO - serverSide.impl.DBBuildHistory - End creating history entry for Ikopi :: Integration.ui 89160
INFO - jetbrains.buildServer.SERVER - Finished 89160
INFO - tbrains.buildServer.ACTIVITIES - Build started; name=Ikopi :: Integration.ui, personal=false, buildId=89161
INFO - tbrains.buildServer.ACTIVITIES - Configuration removed from queue; name=Ikopi :: Integration.ui, requestor=Unexpected finish, comment=null, user=null
INFO - r.serverSide.impl.BuildStarter - jetbrains.buildServer.serverSide.ExecutionException: jetbrains.buildServer.xmlrpc.RemoteCallException: Call http://172.29.2.126:9090/RPC2 buildAgent.run: org.apache.xmlrpc.XmlRpcException: java.lang.Exception: java.lang.IllegalStateException: Already running a build 28776 false
jetbrains.buildServer.serverSide.ExecutionException: jetbrains.buildServer.xmlrpc.RemoteCallException: Call http://172.29.2.126:9090/RPC2 buildAgent.run: org.apache.xmlrpc.XmlRpcException: java.lang.Exception: java.lang.IllegalStateException: Already running a build 28776 false
at jetbrains.buildServer.serverSide.impl.XmlRpcBasedAgent.run(XmlRpcBasedAgent.java:49)
at jetbrains.buildServer.serverSide.impl.BuildStarter$1.run(BuildStarter.java:30)
at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source)
at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source)
at java.util.concurrent.FutureTask.run(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.lang.Thread.run(Unknown Source)
Caused by: jetbrains.buildServer.xmlrpc.RemoteCallException: Call http://172.29.2.126:9090/RPC2 buildAgent.run: org.apache.xmlrpc.XmlRpcException: java.lang.Exception: java.lang.IllegalStateException: Already running a build 28776 false
at jetbrains.buildServer.xmlrpc.AbstractXmlRpcTarget.call(AbstractXmlRpcTarget.java:24)
at jetbrains.buildServer.serverSide.impl.XmlRpcBasedAgent.run(XmlRpcBasedAgent.java:88)
... 7 more
Caused by: org.apache.xmlrpc.XmlRpcException: java.lang.Exception: java.lang.IllegalStateException: Already running a build 28776 false
at org.apache.xmlrpc.XmlRpcClientResponseProcessor.decodeException(XmlRpcClientResponseProcessor.java:104)
at org.apache.xmlrpc.XmlRpcClientResponseProcessor.decodeResponse(XmlRpcClientResponseProcessor.java:71)
at org.apache.xmlrpc.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:73)
at org.apache.xmlrpc.TCXmlRpcClient$1.execute(TCXmlRpcClient.java)
at org.apache.xmlrpc.XmlRpcClient.execute(XmlRpcClient.java:194)
at org.apache.xmlrpc.XmlRpcClient.execute(XmlRpcClient.java:185)
at org.apache.xmlrpc.XmlRpcClient.execute(XmlRpcClient.java:178)
at jetbrains.buildServer.xmlrpc.impl.CommonsXmlRpcTargetImpl$1.execute(CommonsXmlRpcTargetImpl.java:7)
at jetbrains.buildServer.xmlrpc.AbstractXmlRpcTarget.call(AbstractXmlRpcTarget.java:40)
... 8 more

3 comments

Couple other comments: CPU usage on the server box is high: tomcat6.exe is bouncing from 40-70%. There is nothing else running on the box (3g ram, P4 3ghz). I have the max heap size set to 1.2 gig. Memory usage is 148meg so memory isn't a prob

0

I would suggest you to try our fresh EAP build (do not forget to make full
backup of your database and config files before upgrade). Chances are this
problem is fixed in this build (we fixed similar bug in this build).

--
Pavel Sher
Software Developer
JetBrains, Inc.
http://www.jetbrains.com
"Develop with pleasure!"



"phil swenson" <no_reply@jetbrains.com> wrote in message
news:27816241.1190390167689.JavaMail.itn@is.intellij.net...

Couple other comments: CPU usage on the server box is high: tomcat6.exe
is bouncing from 40-70%. There is nothing else running on the box (3g
ram, P4 3ghz). I have the max heap size set to 1.2 gig. Memory usage is
148meg so memory isn't a prob



0

I did switch and it seems better.

0

Please sign in to leave a comment.