S3 Intelligent tiering
We currently use “standard” class for TeamCity S3 storage. In order to be more cost efficient, we would like to evaluate and use S3’s intelligent storage. I have done some preliminary testing and found that there appear to be issues with TeamCity detecting items in S3 that have been tiered leading to missing or duplicate artifacts.
I want to determine if S3 tiering with TeamCity can actually work or ny other approach that may yield similar cost savings.
If viable, determine/discuss a tiering approach given the usage patterns of TeamCity artifacts.
Please sign in to leave a comment.
I will confirm regarding the Amazon S3 Intelligent-Tiering usage with the development team. In the meantime, please note that it is also possible to use Google Cloud Storage and Azure Blob to store artifacts: https://www.jetbrains.com/help/teamcity/2024.03/configuring-artifacts-storage.html#external-artifacts-storage. Please check if they may satisfy your requirements.
Best regards,
Anton
okay!! that'd be great
I have also checked out the link and no, they really don't.
I will be waiting on a feedback after your confirmation with the development team.
Thanks again.
Could you confirm if you have the S3 Access Point configured?
Best regards,
Anton
Yes Anton. The S3 Access point is configured.
I've confirmed with the development team that the support for Intelligent-Tiering storage requires some work on our side. There is a task for it in our issue tracker: https://youtrack.jetbrains.com/issue/TW-79992. Please vote for it for visibility and to receive updates. I have already notified the development regarding your request as well.
Best regards,
Anton
Okay. thanks for the feedback. I've made the vote. I see there are subtasks that has been created on other issues regarding storage as well.
One more thing, is there a possible expected time for the issue's resolution? I'll need to get back to my team with a timeline of any sorts.
Best regards,
Anton
Okay I will continue checking on the tracker from time to catch up on any recent updates.
Thanks for the feedack.