TeamCity 2018.x shared data directory
Hi,
I have a large installation of TeamCity (over 4000 projects and a data directory around 800GB). I am interested in putting this on a file share and wondered what people had experiences of doing in this space? I know the usual advice was to make this directory local, but we need to put it on a central file share now as it is getting too large to maintain when we want to refresh the TeamCity VM on a semi regular basis, and due to 2018.x versions of TeamCity having some HA support.
What are people using as their data directory store and how is it working for them?
Some of the options I am looking at are:
- Azure storage account with SMB access;
- DFS share on a Windows server;
- Some type of NAS?SAN storage with replication.
I am currently using a premium disk on a Windows server to do this but I am having issues where Windows believes the disk is damaged when the VM is rebuilt which causes us major problems in getting the data available again.
Thanks,
Andrew.
Please sign in to leave a comment.
Hi Andrew,
A question about your data directory. You mention it taking about 800 GB. This directory by default includes build artifacts, and we provide an external storage solution for that (https://confluence.jetbrains.com/display/TCD18/Configuring+Artifacts+Storage), are you already using it for your artifacts? If yes, that would mean that the 800GB are internal artifacts, such as build logs, etc. This should only happen if your clean up policy retains everything, independently of how old or useful it is. I would suggest a more aggressive clean-up policy. If you aren't using it, we can only recommend moving your artifacts to it. Internal artifacts are always stored in the local storage, though.
With this in mind, please consider the following article when evaluating your options: https://confluence.jetbrains.com/display/TCD18/TeamCity+Data+Directory#TeamCityDataDirectory-RecommendationsastochoosingDataDirectoryLocation
Hi,
Thanks for this. i am not using artifact storage in Azure as I noticed in the documentation it was marked as experimental. I have had a play with it today, and wondered what happened with artifacts in the artifacts store for the relevant project that was on disk before the new location was chosen? I notice those files are not moved. Will the artifacts still be available for old builds from the disk location, and will those old files eventually get cleaned out as per the cleanup policies? I know going forward the artifacts will be stored and cleaned up in Azure, I am just wondering about the historical files as those aren't moved.
Thanks.
Andrew.