Docker Images

Example docker images are maintained at https://github.com/dask/dask-docker and https://hub.docker.com/r/daskdev/ .

Each image installs the full Dask conda package (including the distributed scheduler), numpy, and pandas on top of a miniconda installation on top of a Debian image.

These images are large, around 1GB.

  • daskdev/dask: This a normal debian + miniconda image with the full Dask
    conda package (including the distributed scheduler), Numpy, and Pandas. This image is about 1GB in size.
  • daskdev/dask-notebook: This is based on the Jupyter base-notebook image and so is appropriate for use both normally as a Jupyter server, but also as part of a JupyterHub deployment. It also includes a matching Dask software environment described above. This image is about 2GB in size.

Extensibility

Users can mildly customize the software environment by populating the environment variables EXTRA_APT_PACKAGES, EXTRA_CONDA_PACKAGES, and EXTRA_PIP_PACKAGES. If these environmet variables are set they will trigger calls to the following respectively:

apt-get install $EXTRA_APT_PACKAGES
conda install $EXTRA_CONDA_PACKAGES
pip install $EXTRA_PIP_PACKAGES

Note that using these can significantly delay the container from starting, especially when using apt, or conda (pip is relatively fast).

Source

Docker files are maintained at https://github.com/dask/dask-docker . This repository also includes a docker-compose configuration.