TeamCity deleting whole checkout directories on wrong drives

Hi,

Lately we've been having hard drive space issues.

All of our work is done on the P: drive, but I have a TeamCity config on the C:\Tools directory (in house tools present on each machine) for each agent, to keep them updated.

Sometimes we have had less than 3Gb of free space on our C: drive.  When this happens, TeamCity reports that the Free disk space under both drive is no met, even though we might have 100Gb free on the drive P:  An exemple will follow.

It is very annoying when (in our case) some heap dump log files eventually eat up all of the drive space on C: and then TeamCity flushes our whole C:\Tools directory, instead of maybe just warning us disk space is getting low...

I believe a warning would be nicer, say, at 3Gb, and then an error at 1Gb left, and then stoping there, without deleting previously used workspaces.

What happened today is that we have had an out of space problem on the drive P: (800Mb left) and then TeamCity flushed our C:\Tools anyway! (there was 20Gb left on the C: drive of that particular agent at the time.)

I believe this in due to the fact that once one drive goes under 3Gb, the error is reported on all of the drives.

[2011-08-05 12:55:23,426]   INFO - ace.DirectoryCleanerForceClean - Free disk space under directory P:\WS\TeamCity\TrunkDebuggerPBG2 is 800.7Mb, required 3.0Gb.
[2011-08-05 12:55:23,442]   INFO - ace.DirectoryCleanerForceClean - Free disk space under directory C:\TeamCity\buildAgent\temp\agentTmp is 20.4Gb, required 3.0Gb.
[2011-08-05 12:55:23,442]   INFO - ace.DirectoryCleanerForceClean - Free disk space requirement of 3.0Gb is not met for directory P:\WS\TeamCity\TrunkDebuggerPBG2 (only 800.7Mb is free).
[2011-08-05 12:55:23,442]   INFO - ace.DirectoryCleanerForceClean - Free disk space requirement of 3.0Gb is not met for directory C:\TeamCity\buildAgent\temp\agentTmp (only 20.4Gb is free).

4 comments
Comment actions Permalink

I've filed TW-18224 for this bug, please watch.

Thanks

0
Comment actions Permalink

Pascal,

Can you please detail:
> TeamCity flushes our whole C:\Tools directory

What is being cleaned exactly and why it is not desired?
Can you provide the agent logs covering the case?

Also, please note the TeamCIty version that yuou use.

You can reply directly into the issue.

0
Comment actions Permalink

On that particular agent, there are projects on the C: and P: drives.

At the time of the problem, there was *plenty* of space on the C: drive (20Gb+), but only 800Mb on the P: drive.  The space problem is on the P: drive.

Deleting workspace to free more space on the C: drive is useless.  This is what happens in this case.  Furthermore, the workspace we have on our C: drive (the C:\Tools directory) is used by all of our projects, rendering every subsequent attempt to build anything on the P: drive condemned to failure.



We are currently using 6.5.3.  The last time we had the problem might have been on 6.5.2.  We haven't had a space problem on our P: drive for awhile now, so the bug didn't have the occasion to pop.
0
Comment actions Permalink

I do not have the logs for the period of when this happened, but really, everything needed is in the 4 log lines provided and this one is really quite simple:

Not enough room on drive P: => do not delete stuff on drive C:

0

Please sign in to leave a comment.