Not enough disk space for two checkouts

I want to set up a triggered clean build overnight. The problem is, when I do that, it moves the existing checkout directory to the .old folder and then tries to check out another copy (it doesn't pause to clean up the .old files first.) Although the builds aren't that big, the source files are more than half the capacity of the disk so I don't have space for two checkout directories on the machine at the same time.

Here is a log:

[2023-07-25 02:00:20,227]   INFO - uildStages.BuildStagesExecutor - Call stage jetbrains.buildServer.agent.impl.buildStages.startStages.CreateCheckoutDirectoryStage
[2023-07-25 02:00:20,227]   INFO - uildStages.BuildStagesExecutor - Call stage jetbrains.buildServer.agent.impl.buildStages.startStages.steps.RunAllBuildStepsStage
[2023-07-25 02:00:20,227]   INFO - uildStages.BuildStagesExecutor - Call stage jetbrains.buildServer.agent.impl.buildStages.startStages.ClearRevisionInfoIfCleanBuildStage
[2023-07-25 02:00:20,242]   INFO -    jetbrains.buildServer.AGENT - Will clear revision info for checkout directory 'cef9b9e220fae651' and build id '1738'
[2023-07-25 02:00:20,242]   INFO -    jetbrains.buildServer.AGENT - Deleted 'cef9b9e220fae651.xml'
[2023-07-25 02:00:20,242]   INFO - uildStages.BuildStagesExecutor - Call stage jetbrains.buildServer.agent.impl.buildStages.startStages.CleanBuildCheckoutDirectoryIfNeededStage
[2023-07-25 02:00:20,242]   INFO - CheckoutDirectoryIfNeededStage - Clean build enabled: removing old files from D:\BuildAgent\work\cef9b9e220fae651
[2023-07-25 02:00:20,258]   INFO - rectories.DirectoryCleanerImpl - Move directory D:\BuildAgent\work\cef9b9e220fae651 to D:\BuildAgent\work\.old\cef9b9e220fae651_1 for cleaning
[2023-07-25 02:00:20,258]   INFO - uildStages.BuildStagesExecutor - Call stage jetbrains.buildServer.agent.impl.buildStages.startStages.CleanGeneratedFilesStage
[2023-07-25 02:00:20,258]   INFO - uildStages.BuildStagesExecutor - Call stage jetbrains.buildServer.agent.impl.buildStages.startStages.LogCheckoutDirectoryStage
[2023-07-25 02:00:20,258]   INFO -    jetbrains.buildServer.AGENT - Checkout directory: D:\BuildAgent\work\cef9b9e220fae651
[2023-07-25 02:00:20,258]   INFO - uildStages.BuildStagesExecutor - Call stage jetbrains.buildServer.agent.impl.patch.CheckoutSourcesBuildStage
[2023-07-25 02:00:20,258]   INFO - l.patch.AbstractSourcesUpdater - Updating sources: agent side checkout
[2023-07-25 02:00:20,273]   INFO -    jetbrains.buildServer.AGENT - Marking checkout directory cef9b9e220fae651 for build id 1738 as 'dirty'
[2023-07-25 02:00:20,273]   INFO -    jetbrains.buildServer.AGENT - No revision information for cef9b9e220fae651.xml on agent
[2023-07-25 02:00:20,273]   INFO -    jetbrains.buildServer.AGENT - Recording vcs state: revision: 87, VCS root signature: 559910aac4540b50, checkout rules: =>
[2023-07-25 02:00:20,273]   INFO -    jetbrains.buildServer.AGENT - Stored new configuration file cef9b9e220fae651.xml
[2023-07-25 02:00:20,273]   INFO -    jetbrains.buildServer.AGENT - Marking checkout directory cef9b9e220fae651 for build id 1738 as 'clean'
[2023-07-25 02:00:20,273]   INFO - pl.patch.ProjectSourcesOnAgent - Updating sources for root id=1; name=lawn_mowing_sim; revision: 87
[2023-07-25 02:00:20,351]   INFO - ernalArtifactsProcessingLogger - Publishing artifacts process finished
[2023-07-25 02:46:36,115]   WARN - l.patch.AbstractSourcesUpdater - Error while checkout on agent: Svn checkout: error for SVN path https://192.168.20.153:18080/svn/lawn_mowing_sim/trunk; Exit code: 1; svn: E155009: Failed to run the WC DB work queue associated with 'D:\BuildAgent\work\cef9b9e220fae651\Assets\Textures\Quarantine_Textures', work item 7289 (file-install Assets/Textures/T_HQ_Low_Asphalt1_Damaged1_1_BC.png 1 0 1 1)
svn: E720112: Can't write to stream: There is not enough space on the disk.

I tried adding the Free Disk Space Build Feature and that correctly detected that it didn't have enough space. But instead of cleaning the existing checkout, it once again moved it and then started getting another copy. I had checked the fail build flag, however it still tries to check out all the files and runs out of disk space before getting to fail the build or clean up the old files. Here is a log of that:

[2023-07-25 19:23:35,112]   WARN - ace.DirectoryCleanerForceClean - Free disk space requirement of 300 GB could not be met for directory D:\BuildAgent\system (only 159.86 GB is free)
[2023-07-25 19:23:35,112]   INFO - uildStages.BuildStagesExecutor - Call stage jetbrains.buildServer.agent.impl.buildStages.startStages.ClearExpiredBuildWorkingDirectoriesStage
[2023-07-25 19:23:35,128]   INFO - l.directories.DirectoryMapImpl - Cleaning up old checkout directories. Default lifetime = 192 hour(s)
[2023-07-25 19:23:35,159]   INFO - uildStages.BuildStagesExecutor - Call stage jetbrains.buildServer.agent.impl.buildStages.startStages.UpdateDirectoryMapStage
[2023-07-25 19:23:35,174]   INFO - uildStages.BuildStagesExecutor - Call stage jetbrains.buildServer.agent.impl.buildStages.startStages.RegisterPropertiesFileNamesStage
[2023-07-25 19:23:35,174]   INFO - uildStages.BuildStagesExecutor - Call stage jetbrains.buildServer.agent.impl.buildStages.startStages.DownloadToolsStage
[2023-07-25 19:23:35,174]   INFO -    jetbrains.buildServer.AGENT - Tools are not required for the build
[2023-07-25 19:23:35,174]   INFO - uildStages.BuildStagesExecutor - Call stage jetbrains.buildServer.agent.impl.buildStages.startStages.CleanAgentTempDirectoryStage
[2023-07-25 19:23:35,174]   INFO - rectories.DirectoryCleanerImpl - Move directory D:\BuildAgent\temp\agentTmp to D:\BuildAgent\temp\.old\agentTmp_5 for cleaning
[2023-07-25 19:23:35,174]   INFO - uildStages.BuildStagesExecutor - Call stage jetbrains.buildServer.agent.impl.buildStages.startStages.CleanBuildTempDirectoryStage
[2023-07-25 19:23:35,174]   INFO - s.CleanBuildTempDirectoryStage - Clearing temporary directory: D:\BuildAgent\temp\buildTmp
[2023-07-25 19:23:35,174]   INFO - rectories.DirectoryCleanerImpl - Move directory D:\BuildAgent\temp\buildTmp to D:\BuildAgent\temp\.old\buildTmp_5 for cleaning
[2023-07-25 19:23:35,174]   INFO - uildStages.BuildStagesExecutor - Call stage jetbrains.buildServer.agent.impl.buildStages.startStages.CreateAgentTempDirectoryStage
[2023-07-25 19:23:35,174]   INFO - uildStages.BuildStagesExecutor - Call stage jetbrains.buildServer.agent.impl.buildStages.startStages.CreateBuildTempDirectoryStage
[2023-07-25 19:23:35,174]   INFO - uildStages.BuildStagesExecutor - Call stage jetbrains.buildServer.agent.impl.buildStages.startStages.FireBuildStartedStage
[2023-07-25 19:23:35,221]   INFO - uildServer.swabra.SwabraLogger - Swabra cleanup is disabled
[2023-07-25 19:23:35,221]   INFO - uildStages.BuildStagesExecutor - Call stage jetbrains.buildServer.agent.impl.buildStages.startStages.PublishBuildPropertiesStage
[2023-07-25 19:23:35,221]   INFO - ernalArtifactsProcessingLogger - Publishing artifacts process started
[2023-07-25 19:23:35,221]   INFO - ernalArtifactsProcessingLogger - Start: Searching for artifacts to publish in [D:\BuildAgent\temp\agentTmp\build.start.properties.gz=>.teamcity/properties]
[2023-07-25 19:23:35,221]   INFO - ernalArtifactsProcessingLogger - Done:  Searching for artifacts to publish, found [1] file
[2023-07-25 19:23:35,221]   INFO - ernalArtifactsProcessingLogger - Start: Pre-processing artifacts if needed (archiving)
[2023-07-25 19:23:35,221]   INFO - ernalArtifactsProcessingLogger - Done: Pre-processing artifacts if needed (archiving)
[2023-07-25 19:23:35,331]   INFO - ernalArtifactsProcessingLogger - Start: Publishing files using WebPublisher
[2023-07-25 19:23:35,471]   INFO - ernalArtifactsProcessingLogger - Done publishing artifacts from [D:/BuildAgent/temp/agentTmp/build.start.properties.gz] to [.teamcity/properties], using 'WebPublisher', total files published: 1
[2023-07-25 19:23:35,471]   INFO - ernalArtifactsProcessingLogger - Done: Publishing files
[2023-07-25 19:23:35,471]   INFO - uildStages.BuildStagesExecutor - Call stage jetbrains.buildServer.agent.impl.buildStages.startStages.CreateCheckoutDirectoryStage
[2023-07-25 19:23:35,471]   INFO - uildStages.BuildStagesExecutor - Call stage jetbrains.buildServer.agent.impl.buildStages.startStages.steps.RunAllBuildStepsStage
[2023-07-25 19:23:35,471]   INFO - uildStages.BuildStagesExecutor - Call stage jetbrains.buildServer.agent.impl.buildStages.startStages.ClearRevisionInfoIfCleanBuildStage
[2023-07-25 19:23:35,471]   INFO -    jetbrains.buildServer.AGENT - Will clear revision info for checkout directory 'cef9b9e220fae651' and build id '1783'
[2023-07-25 19:23:35,471]   INFO -    jetbrains.buildServer.AGENT - Deleted 'cef9b9e220fae651.xml'
[2023-07-25 19:23:35,471]   INFO - uildStages.BuildStagesExecutor - Call stage jetbrains.buildServer.agent.impl.buildStages.startStages.CleanBuildCheckoutDirectoryIfNeededStage
[2023-07-25 19:23:35,471]   INFO - CheckoutDirectoryIfNeededStage - Clean build enabled: removing old files from D:\BuildAgent\work\cef9b9e220fae651
[2023-07-25 19:23:35,534]   INFO - rectories.DirectoryCleanerImpl - Move directory D:\BuildAgent\work\cef9b9e220fae651 to D:\BuildAgent\work\.old\cef9b9e220fae651_5 for cleaning
[2023-07-25 19:23:35,534]   INFO - uildStages.BuildStagesExecutor - Call stage jetbrains.buildServer.agent.impl.buildStages.startStages.CleanGeneratedFilesStage
[2023-07-25 19:23:35,534]   INFO - uildStages.BuildStagesExecutor - Call stage jetbrains.buildServer.agent.impl.buildStages.startStages.LogCheckoutDirectoryStage
[2023-07-25 19:23:35,534]   INFO -    jetbrains.buildServer.AGENT - Checkout directory: D:\BuildAgent\work\cef9b9e220fae651
[2023-07-25 19:23:35,534]   INFO - uildStages.BuildStagesExecutor - Call stage jetbrains.buildServer.agent.impl.patch.CheckoutSourcesBuildStage
[2023-07-25 19:23:35,534]   INFO - l.patch.AbstractSourcesUpdater - Updating sources: agent side checkout

Any ideas if what I'm trying to do here is even possible with Team City?

0
1 comment

We gave up and bought a bigger drive.

0

Please sign in to leave a comment.