Datalore 2023.1 Help

Customize or update environment

You can build a custom Docker image on top of the default one to customize your environment (install some package from apt to be available in your notebooks, or set up a custom Python environment by pre-installing the required libraries).

Generate indexes to ensure the editor's proper work

After you create a new custom environment or update one of our environments, run the following command in the same file:

RUN /opt/datalore/build_code_insight_data.sh /[environment_path]
where [environment_path] is the path to the environment you created or updated.

If not performed, these indexes will be updated every time the agent starts, which slows down the editor.

Add the created environment file to the main datalore pod

Add the file to following directory:

/opt/datalore/configs/environment_info

Make sure you follow these instructions:

  • For a conda environment, specify the respective .yml file matching the envrionment name. For example, if you created a conda environment called somename, add an environment_somename.yml file.

  • For a pip environment, specify the respective .txt file matching the envrionment name. For example, if you created a pip environment called somename, add an requirements_somename.txt file.

Examples

Modify the pip/minimal environment

FROM jetbrains/datalore-agent:2023.1 RUN my_set_credentials_and_urls.sh RUN /opt/python/envs/minimal/bin/python -m pip install -r my_additional_packages.txt RUN /opt/datalore/build_code_insight_data.sh /opt/python/envs/minimal

Create a new environment

Assuming the name of the new environment is myenv:

FROM jetbrains/datalore-agent:2023.1 RUN my_set_credentials_and_urls.sh RUN /opt/python/bin/python -m venv /opt/python/envs/myenv RUN /opt/python/envs/myenv/bin/python -m pip install -r /tmp/requirements_myenv.txt RUN /opt/datalore/build_code_insight_data.sh /opt/python/envs/myenv
Last modified: 22 March 2023