Reporting Test Metadata
A test run in TeamCity can be associated with some additional information (metadata), complementing test status, execution time, and output. This information can be used to provide extra logs, screenshots, numeric values, tags, and so on.
You can now use service messages to report this kind of additional test data in TeamCity and then view it in the TeamCity web UI.
Reporting additional test data
Additional test data is reported using the
testMetadata service message, with the following attributes:
name(optional) is a name of the metadata item, used to distinguish different metadata items for the same test and to show this item in the UI. When omitted, TeamCity autogenerates the name, but does not show it in UI.
testName(optional) is the name of the test for which this metadata is generated, excluding the suite name. If the service message is reported in the middle of the test or immediately after its finish, the testName attribute can be skipped. If the metadata is reported later, it should contain the full test name, including suites, packages and so on.
value(mandatory) contains the metadata value associated with the test. The max value length is 1024.
type(optional) defaults to text unless otherwise specified. The type affects how metadata is stored and how its value is shown in the TeamCity UI.
If the format of the service message is incorrect, a corresponding note about it is written into build log.The types of data which can be recognised by TeamCity are as follows:
You can see a graph of changes for a numeric value, from build to build for the given test.
Links to build artifacts
The path to the artifact should be relative to the build artifacts directory, and can reference a file inside archive:
When showing links to artifacts, TeamCity shows both the
name attribute and the filename of the referenced image. If name was autogenerated, it is not shown.
Images from artifacts directory
The path to the image should be relative to the build artifacts directory. When displaying images, TeamCity shows both the
name attribute and the filename of the referenced image.
Videos from artifacts directory
The path to the video fragment should be relative to the build artifacts directory. When displaying video fragments, TeamCity shows both the
name attribute and the filename of the referenced video.
Displaying additional test data
You can view additional test data in various places in the TeamCity web UI.
Additional test data for a failed test
To view additional data for a test, expand the stacktrace: TeamCity shows it before test failure details in a separate Test Metadata section.
Additional test data graph for numeric values
To view the test data graph, expand the stacktrace: TeamCity shows it before test failure details in a separate Test Metadata section.
Additional data for successful tests
To view additional data for a successful test, go to the Tests tab or the Test History tab: the OK status for a test is now clickable if additional test data is present: