In the last few days we have encountered some Troubles with our TeamCity Server.
After some time our Server needs a lot processor performance and TeamCity cannot be accessed.
Some points to our setup:
- TeamCity runs on a headless ubuntu VM.
- Problem exists in Version 8.0.2 and 8.0.6
- We run Youtrack (Version 5.0.6) on the same server.
- Our Build Agent runs on a seperate windows XP VM.
with the top command we found the process that is using so much CPU
then we used ps x command to find out what commands the process is running with the folowing output, letting us suggest that something is wrong with the TeamCity-Server:
28343 ? Sl 68:57 /usr/lib/jvm/java-6-openjdk-amd64/bin/java -Djava.util.logging.config.file=/usr/share/TeamCity/conf/logging.properties -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager -server -Xmx512m -XX:MaxPermSize=270m -Dlog4j.configuration=file:/usr/share/TeamCity/bin/../conf/teamcity-server-log4j.xml -Dteamcity_logs=../logs/ -Djava.awt.headless=true -Djava.endorsed.dirs=/usr/sha
In our teamcity-server.log we find the folowing waring:
[2014-01-22 14:58:54,110] WARN - jetbrains.buildServer.SERVER - Average TeamCity server memory usage for 'PS Old Gen' pool during the last <strong>5</strong> minutes is <strong>96.5%</strong> of maximum available memory: <strong>341.37 MB</strong>. This can cause significant server slowdown. Please review TeamCity <a href='http://www.jetbrains.net/confluence/display/TCD8/Reporting+Issues#ReportingIssues-ReportingIssues-OutOfMemoryProblems' target='_blank'>documentation</a> for possible solutions.
Stopping and starting the Server usually has no effect or we get some other strange exceptions afterwards .Usually we have to reboot our VM to get TeamCity and Youtrack back online.
Unfortunatly I couldn't find out a solution for this Problem yet. Does anyone have any suggestions why our Server dayly stops working and uses that high performance?