Group failed tests by failure reason (e.g., by stacktrace)
When introducing global changes to codebase it's pretty easy to break a lot of tests. But typically there will be only a limited number of failure reason. For example, if it's UI tests and you altered a commonly used page by removing a button, then all the tests which expect a button to be present will fail.
What I think could be useful is for TC to say me that those 1k failed tests are failing with the same message (so they all will be fixed as soon as I fix that problem). Right now the only way to do it is to click each test to expand the output and check it manually.
I thought I would be able to achieve that through CSV export, but there are no test output in it.
Is there currently any way to group test results by output, or at least export them along with their outputs?
Please sign in to leave a comment.
Hi Viktor,
I'm afraid this option isn't currently available. There are a few grouping options for tests, but for not as deep as at a stacktrace level.
You could pull the tests from the REST API, which will include the stacktrace instead of the CSV, but if you are looking for automatic grouping, I'm afraid I can only suggest opening a feature request in our issue tracker: https://youtrack.jetbrains.com/issues/TW