PyCharm 2019.1 Help

Performing Tests

Generally, PyCharm runs and debugs tests in the same way as other applications, by running the run/debug configurations you have created. When doing so, it passes the specified test classes or methods to the test runner.

In many cases, you can initiate a testing session from a context menu. For this purpose, the Run and Debug commands are provided in certain context menus. For example, these commands are available for a test class, directory, or a package in the Project Tool Window. They are also available for a test class or method you are currently working on in the editor.

If you run a test for which there is no permanent run/debug configuration, a temporary configuration is created. You can then save such a configuration using the Run/debug configuration dialog if you want to reuse it later.

The tests run in the background, so you can execute several tests at the same time.

Each running configuration gets its own tab in the Run tool window (the Test Results tab). One tab can aggregate several tests.

Note also that the commands shown in the context menu, are context-sensitive, that is the testing command that shows depends on the test runner and the place where this command is invoked.

Run or debug a test

To start running or debugging a test, you can use the main toolbar, or a context menu in the Project tool window or in the editor:

  • Using the main toolbar:

    1. Select the necessary run/debug configuration from the list on the main toolbar.

    2. Click Run Run or Debug Debug to the right of the list. (Alternatively, go to Run | Run (Shift+F10) or Run | Debug (Shift+F9) on the main menu.)

  • Using a context menu:

    Right-click a test file or test class in the Project tool window, or open it in the editor, and right-click the background. From the context menu, select Run <class name> / Run <filename> or Debug....

Run all tests in a directory

  1. In the Project tool window, select the directory that contains tests to be executed.

  2. From the context menu, select the corresponding run command.

    If the directory contains tests that belong to the different testing frameworks, select the configuration to be used.

    For example, select Run pytest in <directory name>'.

    Run all tests in a directory
  3. Explore results in the test runner.

    Running all pytest tests from one directory

By default, all tests are executed one by one. You can change this behavior for the pytest testing framework and execute your tests in parallel.

Run tests in parallel

Enable test multiprocessing to optimize execution of your pytest tests.

To explicitly specify the number of CPUs for test execution:

  1. Install the pytest-xdist package as described in Install, uninstall, and upgrade packages.

  2. Specify pytest as the project testing framework. See Choosing Your Testing Framework for more details.

  3. Select Edit configurations... from the list of the Run/Debug configurations on the main toolbar. In the Run/Debug Configurations dialog, expand the Pytest tests group, and select pytest in <directory name>.

    PyCharm creates this configuration when you run all tests in a directory for the very first time. If you haven't executed the tests yet, click the the Add button icon and specify the Run/Debug Configuration parameters .

  4. In the Run/Debug Configurations dialog, in the Additional Arguments field specify the number of the CPUs to run the tests: -n <number of CPUs> and save the changes.

    Editing Run/Debug configuration for a group of pytest tests

  5. Now run all the tests in the directory again and inspect the output in the Run tool window. In the shown example, The total execution time is 12s 79ms as compared to 30s 13ms when running the same tests consequentially. The test report provides information about the CPUs used to run the tests and execution time.

Alternatively, you can specify the number of CPUs to run your tests in the pytest.ini file. For example,

[pytest] addopts = -n3

Last modified: 17 July 2019

See Also

Reference: