Parallel Tests build feature is not creating more than 1 batch

Created December 12, 2022 07:34

We're trying to use Parallel Test build feature to run our tests however when feature is enabled it creates only 1 batch and do not parallelize the run. We use composite build with build chains to create environment, execute tests and destroy environment. After enabling feature tried 4 build but none of them created more than 1 batch for same set of tests.

We've a build step written in PowerShell script to call testcafe runner which invoke tests.

Our build chain for test execution in Teamcity looks like:

Without Parallel build feature:

Enabled Parallel build feature with 2/3 batches:

Teamcity version: TeamCity Enterprise 2022.10

Agents: 3 agents available

1 comment

Guilherme Barbosa

Created December 12, 2022 12:30

Hello,

It looks like it does not detect the tests due to the build runner being used, and because of the way the tests are being executed (testcafe called from a PS script). As explained in our documentation:

A build of a generated build configuration will run the same set of build steps as defined in the original build configuration. If some of these steps are of the Maven, Gradle, IntelliJ IDEA Project, or .NET type, and they were executing some tests, then these build runners will automatically run only the fraction of the tests corresponding to the current batch.

If you want to use the Parallel Tests build feature, please consider to use one of the runners above instead.

Thank you,

Guilherme

Please sign in to leave a comment.