Run/Debug Configuration: TestNG
The TestNG run/debug configuration is used to launch the tests that comply with the TestNG framework. The dialog consists of the following tabs:
The composition of this tab depends on the selected testing scope - package, project, etc.
|All in package||Click this radio button to perform all tests in a certain package.
|Suite||Click this radio button to perform all tests in a certain test suite.
|Group||Click this radio button to perform all tests in a certain group.
|Class||Click this radio button to launch all tests in a class.
|Method||Click this radio button to launch a single test method.
|Pattern||Click this radio button to launch all test method conforming to a certain pattern.
These parameters should be defined regardless of the testing type.
|Output directory||Specify the test output directory where the reports will be generated.|
|VM options||Specify the string passed to the VM for launching the tests.
Usually this string contains the options such as
When specifying the options, follow these rules:
|Test runner parameters||Type the list of arguments to be passed to the test runner, same way as if you were entering these
in the command line.
Use the same rules as for specifying the VM options.
|Working directory||Specify the current directory to be used by the running test. This directory defined the starting point for all relative input and output paths. By default, the directory where the project file resides is used as a working directory.|
|Environment Variables||Click the Browse button to open the Environment Variables dialog box, where you can create variables and specify their values.|
|Use classpath and JDK of the module||Select a module from the list of modules configured in your project. The classpath and JDK of this module will be used to run your application with the current run configuration.|
|Use alternative JRE||Check this option to enable defining a JRE other than the one used by the project / module.|
|Properties file||Specify the
|Add/Remove||Use this buttons to create or remove properties.|
|Add/Remove||Use these buttons to make up a list of listeners.|
Code Coverage tab
Use this tab to configure code coverage monitoring options.
|Choose code coverage runner||Select the desired code coverage runner.|
|Sampling||Select this option to measure code coverage with minimal slow-down.|
|Tracing||Select this option to collect accurate branch coverage. This mode is available for the IntelliJ IDEA code coverage runner only.|
|Track per test coverage||Select this check box to detect lines covered by one test and all tests covering line. If this check box
is selected, becomes available on the toolbar of the coverage statistic pop-up window.
Refer to the section Viewing Code Coverage Results.
|Merge data with previous results||When you run your unit testing or application configuration several times, use this item to calculate statistics in the Project View, taking into account the statistics of each time you have run the configuration.|
|Packages and classes to record code coverage data||Click and buttons to specify classes and packages to be measured. You can also remove classes and packages from the list by selecting them in the list and clicking the button.|
|Enable coverage in test folders.||If this check box is selected, the folders marked as test are included in the code coverage analysis.|
|Is Active||Select check boxes in this column to have the log entries displayed in the corresponding tabs in the Run tool window or Debug tool window.|
|Log File Entry||The read-only fields in this column list the log files to show. The list can contain:
|Skip Content||Select this check box to have the previous content of the selected log skipped.|
|Save console output to file||Select this check box to save the console output to the specified location. Type the path manually, or click the browse button and point to the desired location in the dialog that opens.|
|Show console when standard out changes||Select this check box to activate output console and bring it forward, if associated process writes to Standard.out.|
|Show console when standard error changes||Select this check box to activate output console and bring it forward, if associated process writes to Standard.err.|
|Click this button to open the Edit Log Files Aliases dialog where you can select a new log entry and specify an alias for it.|
|Click this button to edit the properties of the selected log file entry in the Edit Log Files Aliases dialog.|
|Click this button to remove the selected log entry from the list.|
|Click this button to edit the select log file entry. The button is available only when an entry is selected.|
|Alt+Insert||Click this button to add a new configuration to the list.|
|Alt+Delete||Click this button to remove the selected configuration from the list.|
|Ctrl+D||Click this button to create a copy of the selected configuration.|
|Edit defaults||Click this button to edit the default configuration templates. The defaults are used for newly created configurations.|
|or||Alt+Up or Alt+Down||Use these buttons to move the selected configuration or folder up and down in the list.
The order of configurations or folders in the list defines the order in which configurations appear in the Run/Debug drop-down list on the main toolbar.
|Move into new folder / Create new folder||Use this button to create a new folder.
If one or more run/debug configurations are in focus, the selected run/debug configurations are automatically moved to the newly created folder. If only a category is in focus, an empty folder is created.
Move run/debug configurations to a folder using drag-and-drop, or the buttons.
|Sort configurations||Click this button to sort configurations in alphabetical order.|
|Name||In this text box, specify the name of the current run/debug configuration. This field does not appear for the default run/debug configurations.|
|Defaults||This node in the left-hand pane of the dialog box contains the default run/debug configuration settings. Select the desired configuration to change its default settings in the right-hand pane. The defaults are applied to all newly created run/debug configurations.|
Select this check box to make the run/debug configuration available to other team members.
If the directory-based project format is used,
the settings for a run/debug configuration are stored in a separate .xml file in the
If the file-based format is used,
the settings are stored in the
This check box is not available when editing the run/debug configuration defaults.
|Before launch||Specify which tasks must be performed before applying the run/debug configuration.
The specified tasks are performed in the order they appear in the list.