Containers

How does it work

• To run a step in a container, use the container block:

  job("Example"){ // displayName is optional // it will be shown in the job run results container(displayName = "Say Hello", image = "alpine") { shellScript { content = "echo Hello" } } }

• You can use container images either from Docker Hub or from your own Space Packages registries.

• Depending on your task, in a container, you can run a shell script, arbitrary Kotlin code, or a container image command.

  All these three options are mutually exclusive.

• During the run, the container has access to the project repository.

• You can adjust container resources for resource-consuming steps.

• If your job requires additional network services like MySQL or Redis, you can run them in service containers.

• The environment where a job will eventually run (cloud or self-hosted workers) depends on the Default worker pool parameter and job requirements. Learn more about how to specify job run environment.

• Containers are billed for each minute of work based on the run environment. Learn more

Container image sources

You can use three sources of container images:

• Docker Hub.

  To use an image from Docker Hub, specify the image name:

  container(image = "hello-world")

  Note that Space caches the images downloaded from Docker Hub. The cache lifetime is no longer than three hours. The disk space required for storing cached images is provided free of charge.

• Your Space Packages registry.

  To use an image from Space Packages, specify the full image URL:

  container(image = "mycompany.registry.jetbrains.space/p/projectkey/mydocker/hello-world")

  Important: If you want to use an image from a private registry created in another project, you must first attach this private registry to the current project.

• It's also possible to build an image in one step and then use it for running the next steps. See an example

Directory structure and working directory

Before running user jobs, Automation runs a hidden "bootstrap" job that

1. creates a disk volume,

2. clones the project sources from the Git server to the volume,

3. mounts the volume to the container. By default, the volume is mounted to /mnt/space.

Here:

• /mnt/space is the parent directory for step data.

  To change the default path, use the job.container.mountDir parameter.

  To get this path in a shellScript or kotlinScript, use the JB_SPACE_STEP_DATA_PATH environment variable.

• /mnt/space/work/{git-repo-name} is the default project source code location. Here {git-repo-name} stands for the project's Git repository name. It is also the container's default working directory. For details on how to check out additional project repositories, refer to Check out Source Code.

  To change the default path, use the job.container.workDir parameter.

  To get this path in a shellScript or kotlinScript, use the JB_SPACE_WORK_DIR_PATH environment variable.

• /mnt/space/share is the external storage used for file sharing.

  To get this path in a shellScript or kotlinScript, use the JB_SPACE_FILE_SHARE_PATH environment variable.

What can you run in a container

• Shell scripts:

  job("Run shell script") { container(displayName = "Show dir contents", image = "ubuntu") { shellScript { interpreter = "/bin/bash" content = """ echo Working dir contents ls /mnt/space/work """ } } }

  Learn more

• Arbitrary Kotlin code:

  job("Run Kotlin code") { container(displayName = "Say Hello", image = "amazoncorretto:17-alpine") { kotlinScript { api -> println("Hello world!") } } }

  Learn more

• Container image commands:

  job("Run container command") { container(displayName = "Say Hello", image = "alpine") { args("echo", "Hello World!") } }

  Learn more

Container resources

A job can contain not more than 50 containers (steps). Each container has the following resources constraints:

All containers within a job use the same disk volume (it contains the project repository). The default volume size is 5 GB and the maximum allowed size is 30 GB. To specify resources and volume size, use the job.container.resources and job.volumeSize parameters. All parameters support corresponding units:

• job.container.resources.cpu: You can set a value in .cpu or .mcpu (millicpu), for example, cpu = 250.mcpu is the same as cpu = 0.25.cpu.

• job.container.resources.memory and job.volumeSize: You can set their values in .mb (MB) and .gb (GB), for example, volumeSize = 10.gb.

Destination ports for outbound connections