TC 5 EAP initial impressions/questions

A (very) quick summary of a quick trial.

Installation went without issues (exe installer on Wim32).

It seems that the Maven runner didn't pick up the existing JAVA_HOME though.

My main disappointment is that inspections and duplicate analysis seems
not to be available for the Maven 2 runner. Any you anticipating adding
this in the future?

The project in question is a Maven multi-module project. It would be
much better if the presentation of all TC results (build
success/failure), summary of test runs would be broken down per maven
module as well.

In addition to inspections and test coverage, some basic code metrics
would be a nice feature. It's a great pity that the (IDEA)
MetricsReloaded plugin is laying by the wayside, unmaintained.

It would also be nice to have a full-browser-screen tail of the current
build log.

Is there some UI for seeing ignored tests (JUnit4 @Ignore annotation)?

It there some option to explore running time of a test through history?

Thanks,
-tt

3 comments
Comment actions Permalink

Any feedback? A lot of Java projects are using hudson with its own maven runner.

Having the TC features available for its maven runner would at least make TeamCity a reasonable evaluation option for such projects.

0
Comment actions Permalink

Hello Taras,

  Regarding duplicates and inspections - these runners are already available in TeamCity 4.5.x , please select Duplicates Runner and Inspection runner and see their options.

  Test history duration graph is available on the Tests tab for a build, there is an icon which shows test duration history for individual test.

  Per-module division won't be available in TeamCity 5.0 (unless you configure separate build configurations for separate modules)

  Regards,
  KIR

0
Comment actions Permalink

Taras,

Several more bits in addition to Kir's answer...


> It seems that the Maven runner didn't pick up the existing JAVA_HOME though.

Can you provide more details on this creating an issue.? What OS do you use and how JDK is installed? What are Java-related environment variables listed on agent's details page in TeamCity UI? Is there any related logging in the build log or agent log?


> The project in question is a Maven multi-module project. It would be
> much better if the presentation of all TC results (build
> success/failure), summary of test runs would be broken down per maven
> module as well.

Could you please elaborate on this? What per-module features do you need and _why_? We would like to understand better what initial problems does these features solve so that we can figure out how they will match existing TeamCity features and approaches. This can actually deserve a separate thread.


> In addition to inspections and test coverage, some basic code metrics
> would be a nice feature.

Actually, metrics charts can be added with some in-the-build-script customizations. TeamCity can display custom charts and any HTML reports. And there seems to be lots of tools which specialize in metrics calculation.
As a side note, we are rather skeptical about significance of metrics in general. If you think the metrics are important, can you please list the most important, so that if we get to this, we have something to start with?


> It's a great pity that the (IDEA) MetricsReloaded plugin is laying by the wayside, unmaintained.

Plugin maintenance aside, I am not sure TeamCity would be able to reuse it out of the box since this will at least require running the plugin in some special IDEA headless mode...


> It would also be nice to have a full-browser-screen tail of the current build log.

You mean you tried build log tail (new in TeamCity 5.0) and are not satisfied with it? Can you please explain?


> Is there some UI for seeing ignored tests (JUnit4 @Ignore annotation)?

TeamCity does not support JUnit4 ignored tests since we are pluging into JUnit Ant task and AFAIK the task does not support these tests. Anyway, feel free to vote for the related issue.


Thank you for the feedback!


--

Best regards,

Yegor Yarko

QA Engineer (TeamCity)

JetBrains, Inc

http://www.jetbrains.com

"Develop with pleasure!"

0

Please sign in to leave a comment.