teamcity build statistics and clover 2

Hello there,

I'm sure you already heard, that atlassian released clover 2 with a fine feature called 'test optimization'.
This feature does a bit more than teamcity can do, e.g. skipping tests (instead of 'just' reordering).

I'm wondering now, how this will interfere with TeamCitys nice statistics about test-count and alike ? I'm afraid, that I'll get a graph that is jumping up and down and that it will be very difficult to get an impression of what the total count of tests in the test-suite will be ?

Would it be easy to officially support 'skipped' tests ? I'd really like to see statistics like 'Total / Success / Failure / Skipped'. As clover reports to the console how many tests have been skipped it should be easy for TeamCity to pick up that count.

4 comments
Comment actions Permalink

any help on this one ?

0
Comment actions Permalink

Probably it would be better to enable this feature in the clover for personal builds only. They are not affecting statistics and will run faster. Build script can be modified to check whether a build is personal or not, for this you can check whether build.is.personal property exists (or BUILD_IS_PERSONAL environment variable).

--
Pavel Sher

0
Comment actions Permalink

we are using cvs and eclipse, so only 'official' builds are available to us.

On the screenshots of TC4.0  (http://www.jetbrains.com/teamcity/features/newfeatures.html#Build_Chains_and_Enhanced_Build_Dependencies) I saw the notion of 'ignored' tests.
Can this number be influenced and does it influence statistics ?

At least from the screenshot it looks exactly like what we needed.

0
Comment actions Permalink

Unfortunately ignored tests number will affect build statistics too because there is no "totat tests" statistics counter.

However chances are some workarounds could be done. Please take a look here http://www.jetbrains.net/confluence/display/TCD4/Build+Script+Interaction+with+TeamCity

In brief if you can determine what tests were passed/failed/ignored you can provide your own tests statistics with help of teamcity-info.xml

--
Pavel Sher

0

Please sign in to leave a comment.