InspectionGeneralDataCleaner cleanup step takes ~7 hours

All,

We've started noticing our server clean-up taking an excessively long time (~7 hours total). From looking at the log, it looks like it's getting stuck on the InspectionGeneralDataCleaner step. The disc clean-up runs very quickly

...
[2009-08-29 22:00:57,028]   INFO -  jetbrains.buildServer.CLEANUP - Global cleanup
[2009-08-29 22:00:57,028]   INFO -  jetbrains.buildServer.CLEANUP -     Running global cleaner TestFailureRateCollector
[2009-08-29 22:00:57,091]   INFO -  jetbrains.buildServer.CLEANUP -     Running global cleaner TestInfoTrunkCleaner
[2009-08-29 22:00:57,091]   INFO -  jetbrains.buildServer.CLEANUP -      0 records copied from test_info_trunk to test_info
[2009-08-29 22:00:57,091]   INFO -  jetbrains.buildServer.CLEANUP -     Running global cleaner PersonalBuildCleaner
[2009-08-29 22:00:57,106]   INFO -  jetbrains.buildServer.CLEANUP -     Running global cleaner DeleteZombiePersonalChangesFiles
[2009-08-29 22:00:57,106]   INFO -  jetbrains.buildServer.CLEANUP -     Running global cleaner BrokenDependenciesCleaner
[2009-08-29 22:00:57,106]   INFO -  jetbrains.buildServer.CLEANUP -     Running global cleaner InspectionGeneralDataCleaner
[2009-08-30 05:22:36,633]   INFO -  jetbrains.buildServer.CLEANUP -     Running global cleaner UnusedVcsRootsCleaner

[2009-08-30 05:22:36,633]   INFO -  jetbrains.buildServer.CLEANUP -     Running global cleaner DuplicatesGeneralDataCleaner
[2009-08-30 05:22:36,680]   INFO -  jetbrains.buildServer.CLEANUP -     Running global cleaner OldAgentsCleaner
[2009-08-30 05:22:36,680]   INFO -  jetbrains.buildServer.CLEANUP -     Running global cleaner PatchCacheImpl
[2009-08-30 05:22:36,680]   INFO -  jetbrains.buildServer.CLEANUP -     Running global cleaner ClearcaseCacheGeneralDataCleaner
[2009-08-30 05:22:36,836]   INFO - erver.serverSide.impl.DBFacade - Connection pool configured (oracle.jdbc.driver.OracleDriver, maximum number of connections: 50)
[2009-08-30 05:22:36,836]   INFO - erver.serverSide.impl.DBFacade - Connection pool URL: jdbc:oracle:thin:@dbserver:1521
[2009-08-30 05:22:36,836]   INFO -  jetbrains.buildServer.CLEANUP - Clean-up completed in 26553746 ms
...

Anyone have any ideas what may be causing this and how we can fix it? We're running TeamCity 4.5.4 with an Oracle database back end.

It's getting to the point where the server is still performing its maintenence when our developers start arriving for work in the morning!

Many thanks,


Andy

4 comments
Comment actions Permalink

Could you please submit a bug report to our tracker: http://jetbrains.net/tracker
Please also provide some details about your inspections builds: how many of them are in the history, how many warnings/errors are reported per build.

0
Comment actions Permalink

Pavel,

Sure http://jetbrains.net/tracker/issue/TW-9365

Let me know if you need any more information/logs/etc.

Many thanks,


Andy

0
Comment actions Permalink

Pavel,

In the short term (or until the bug gets resolved), can you suggest any work-arounds for this issue? With the server cleanup running all night, our nightly builds can't run and we're having to restart the server every morning.

Many thanks,


Andy

0
Comment actions Permalink

We are still investigating this issue. Chances are the cleanup time will decrease if you will use more aggressive cleanup policy for configurations with inspection runner. Also we added additional debug logging to the cleaner to better understand what happens. Such logging is included into the upcoming 4.5.5 build, which we hope to release in the nearest time.

0

Please sign in to leave a comment.