CLion 2016.2 Help

Test Runner Tab

In this section:

Basics

The Test Runner tab opens in the Run tool window when a testing session begins, and features the same toolbar buttons.

  1. The color of the status bar indicates whether the tests have passed successfully. If at least one of the tests fails, the status bar turns red.
  2. The left-hand pane shows the tree view of all tests within the current run/debug configuration.
    • The root node represents the test case selected to run.
    • The nested nodes represent the hierarchy of test suites and test cases.
    • The leaf nodes represent the individual tests.

    The status of each test is indicated by an icon. Double-click a node to open the respective test class or test method in the editor.

  3. The testing toolbar provides controls that enable you to monitor the tests and analyze results. Some of the commands are duplicated on the context menus of the test tree nodes.
  4. The Output pane shows the output of the current test suit.
  5. The inline statistics show the list of executed tests with the execution time of each test.

Run toolbar

ItemTooltip and ShortcutDescription
run Rerun
Ctrl+F5
Click this button to rerun the current process.

The process reruns always in the same console regardless of whether this console is pinned or not.

stop Stop
Ctrl+F2
Click this button to terminate the current process externally by means of the standard mechanisms.
debug_layout LayoutClick this button to choose a layout of the toolbars by selecting the desired option from the pop-up menu.
pin2.png PinWhen this button is pressed, the current tab will not be overwritten; instead, the results of the next command will be displayed in a new tab.
close Ctrl+Shift+F4 Click this button to close the selected tab of the Run tool window and terminate the current process.
help F1 Click this button to show reference.

Testing toolbar

ItemTooltip
and Shortcut
Description
testPassedShow PassedClick this button to show tests that passed successfully.
testIgnoredShow IgnoredClick this button to show the ignored tests in the tree view of all tests within the current run/debug configuration or test class.
sortAlphabeticallySort alphabeticallyClick this button to sort tests in alphabetical order.
sortByDurationSort by durationClick this button to sort tests by duration.
expandAll.png collapseAll Expand All/Collapse All
Ctrl+NumPad Plus Ctrl+NumPad -
Click these buttons to have all nodes in the tree view of tests expanded.

These buttons are only available if the tested application contains more than test case.

arrowUparrowDownPrevious/Next Failed Test
Ctrl+Alt+Up/Ctrl+Alt+Down
Click these buttons to navigate between the failed tests.
exportToTextFile.pngExport Test ResultsClick this button to have the results of the selected test saved in a file. In the Export Test Results that opens, specify the file to save the output in and the format in which the data will be saved. If you want to view the test results later, choose the XML format.

To view the saved test results later, click ij_test_junit_import_test_results.png and specify the XML file where they are stored.

iconAction_blueClick this cog button to access the context menu with the following options:
  • Track Running Test: turn this option on to monitor execution of the current test. If a test suite contains multiple tests, the tree view of tests expands to show sequential test methods, as they are executed.
  • Show Inline Statistics: turn this option on to have the statistics shown next to a test result, displaying the time used for executing each test.
  • Scroll to Stacktrace: turn this option on to have the console scroll to the beginning of the trace of the last failed test.
    If you click the root node (the test package) in the tree view with this option turned off, the console will show the very beginning of the test.

    This option is helpful when a test package contains multiple test classes and test methods. If some of the tests fail, you can scroll in the console to the beginning of a stack trace of an exception or assertion.

  • Open Source at Exception: use this option to explore the results of a test that fails as an error, throwing an uncaught exception.
    If you double-click the failed test class or method in the tree view with this option turned on, the respective test class or method will open in the editor, with the caret placed at the line that caused the problem.
  • Autoscroll to Source: turn this option on to have the currently selected test in the tree view synchronized with the editor automatically.
  • Set Auto Test Delay: point to this node to reveal the list of available delays between file saving and rerunning tests. The selected value gets the check mark.
  • Select First Failed Test When Finished: turn this option on to have the first failed test automatically selected in the tree view upon completing the tests.

Test status icons

IconDescription
testErrorTest error. This status is assigned to tests that caused an exception from the tested source code.
testFailedTest failed. If at least one test receives this status, the entire tree is marked as terminated as well.
testIgnoredTest ignored.
testInProgress1Test in progress.
testPassedTest passed successfully.
testPausedTest paused.
testTerminatedTest terminated. This status is assigned to tests that were cancelled by clicking the Stop button stop. If at least one test receives this status, the entire tree is marked as terminated as well.
testNotRanTest not run. This status is assigned to a test when CLion has not launched it at all, for example, because testing was terminated by clicking the Stop button stop.png.

Output pane

This pane shows output of each test, generated at runtime, including all the messages sent to the output stream, and the error messages. The following table shows the toolbar buttons and context menu commands available for the Output pane.

ItemKeyboard ShortcutDescription
arrowUpUp the Stack Trace
Ctrl+Alt+Down
Click this button to navigate up in the stack trace and have the cursor jump to the corresponding location in the source code.
arrowDownDown the Stack Trace
Ctrl+Alt+Up
Click this button to navigate down in the stack trace and have the cursor jump to the corresponding location in the source code.
icon_softWrapUse Soft WrapsClick this button to toggle the soft wrap mode of the output.
scrollToEnd.pngScroll to the endClick this button to navigate to the bottom of the stack trace and have the cursor jump to the corresponding location in the source code.
print.pngPrintClick this button to configure printing out the console output in the Print dialog box that opens.
Clear AllChoose this item on the context menu to have all messages for the selected test deleted.
Copy ContentCtrl+CChoose this item on the context menu to have the current contents of the Output pane placed to the Clipboard.
Compare with ClipboardChoose this item on the context menu to invoke the Differences Viewer which shows the current contents of the Clipboard in the left-hand pane and the contents of the Output pane for the selected test in the right-hand pane.

Context menu commands

CommandKeyboard shortcutDescription
Run <test name>Ctrl+Shift+F10Run the selected test with the current temporary run/debug configuration or choose another configuration from the subordinate context menu.
Debug <test name> Debug the selected test with the current temporary run/debug configuration or choose another configuration from the subordinate context menu.
Run <test name> with CoverageCtrl+Shift+F10Run the selected test and collect coverage data in accordance with the current temporary run/debug configuration.
Create <test name>Create a run/debug configuration on the base of the selected test.
Save <test name>Save the temporary run/debug configurationn
Jump to SourceF4Choose this command to move the focus to the editor, to the definition of a test class, or test method.
Show SourceCtrl+EnterChoose this command to open source code in the editor, but leave the focus with the Test Runner tab.

See Also

Last modified: 22 November 2016