Running NUnit tests in parallel?

Has anyone at JetBrains given some thought to making TeamCity run multiple tests (particularly with NUnit) in parallel to take advantage of multi-CPU machines? I haven't thought this out thoroughly myself, but basically, the developers would need to somehow specify that certain tests do not conflict with each other or maybe that certain tests do conflict with each other and from that the build server could work out which ones can be run at the same time?

5 comments

Evgeny,

Sorry for the delay in reply.

Frankly, we do not widely use tests paralleling ourself yet. But we do think in that direction. For now, we are in the process of addressing support for parallel tests execution on the level of reporting and providing correct test output. So we will support reporting tests that are run in parallel (e.g. in Ant's parallel task, or by TestNG).

After that we might look into supporting tests parallel running in our NUnit runner. But I am not sure the result can appear in the nearest future.

You can file a corresponding issue into our tracker ( http://jetbrains.net/jira/browse/TW ) and provide your considerations on the subject.

It's interesting, is anyone using PNUnit or something with alike functionality?

--
Best regards,

Yegor Yarko
Project Manager
JetBrains, Inc
http://www.jetbrains.com
"Develop with pleasure!"

0

OK, I've created a feature: http://jetbrains.net/jira/browse/TW-4300

If we end up implementing our own parallelization I'll add some thoughts on how to do it in TeamCity to that feature.

0

On Tue, 22 Jan 2008 06:22:33 -0200, Yegor Yarko (JetBrains)
<no_reply@jetbrains.com> wrote:

Evgeny,

>

Sorry for the delay in reply.

>

Frankly, we do not widely use tests paralleling ourself yet. But we do
think in that direction. For now, we are in the process of addressing
support for parallel tests execution on the level of reporting and
providing correct test output. So we will support reporting tests that
are run in parallel (e.g. in Ant's parallel task, or by TestNG).

>

After that we might look into supporting tests parallel running in our
NUnit runner. But I am not sure the result can appear in the nearest
future.

>

You can file a corresponding issue into our tracker
( http://jetbrains.net/jira/browse/TW ) and provide your considerations
on the subject.

>

It's interesting, is anyone using PNUnit or something with alike
functionality?

>

--
Best regards,

>

Yegor Yarko
Project Manager
JetBrains, Inc
http://www.jetbrains.com
"Develop with pleasure!"


I've not used PNUnit, but I think that a simpler route to paralellizing
would be to run tests in multiple agents. Say you have 1000 tests and 3
idle agents, distributing the tests into the three agents would make a lot
of sense when the test run time is greater than the build time. It'll give
better utilization to agents time too.

Regards,
Pablo


--


Mixing Bowls May Be Licked if the Cat Doesn't Want Them!

Pablo Montilla
www.odyssey.com.uy

0

Hello Yegor,

Is there any progress regarding parallel tests? Have you tried integrating PNunit or any similar parallel tests runner into TC?

0

Hi Andrew,

No, unfortunately running parallel tests has not been implemented yet. Please watch and vote for the feature request: https://youtrack.jetbrains.com/issue/TW-4300.
TeamCity does not have a dedicated feature to run test in parallel on different agents. Usual tool for setting this up in TeamCity is using TeamCity snapshot dependencies and artifact dependencies to transfer files between the builds.

0

Please sign in to leave a comment.