Docker

Utils

See docker images

$ docker images

$ docker image ls

See docker containers

$ docker ps -a

Delete an image

$ docker rmi IMAGE_ID

Delete images with known name

$ docker rmi $(docker images | grep 'name')

$ docker rmi -f $(docker images | grep 'mambaforge')

Delete a container

$ docker rm CONTAINER_ID

Delete all containers

$ docker system prune -a

Pull an image

$ docker pull IMAGENAME

Run an image

$ docker run -it IMAGE_ID /bin/bash

$ docker run -it NAME:latest python file.py

$ docker run -it --privileged=true IMAGE ID /bin/bash

$ docker run -it ubuntu /bin/bash

$ docker run -it python:3.9-slim-buster /bin/bash

$ docker run -it mambaorg/micromamba /bin/bash # 

$ docker run -it condaforge/mambaforge /bin/bash # https://hub.docker.com/r/condaforge/mambaforge 

$ docker run -it pangeo/pangeo-notebook /bin/bash

$ docker run -it condaforge/mambaforge:24.9.0-0 /bin/bash  # conda 24.9.0; mamba 1.5.9; python 3.12.7

$ docker run -it ghcr.io/prefix-dev/pixi:0.34.0 /bin/bash

Run an image and provide a notebook

$ docker run -p 8888:8888 jupyter/pyspark-notebook

$ docker run -it -p 8888:8888 -p 8787:8787 IMAGENAME

Run an image and provide jupyter lab

$ docker run -it --rm -p 8888:8888 IMAGENAME start.sh jupyter lab

$ docker run -p 8888:8888 -e JUPYTER_ENABLE_LAB=yes IMAGENAME

Stop a container

$ docker stop CONTAINER_ID

Write

A docker file with a few python dependencies called Dockerfile:

Linux

FROM ubuntu

RUN apt-get update && apt-get install -y curl

Python

https://uwekorn.com/2021/03/01/deploying-conda-environments-in-docker-how-to-do-it-right.html 

FROM mambaorg/micromamba

RUN micromamba install -y -n base -c conda-forge dask pyarrow s3fs python && micromamba clean --all --yes

ENV KEY=value

ENV KEY2=${key}2

or

FROM condaforge/mambaforge

COPY conda-linux-64.lock .
# from pathlib import Path
# out = Path("~/.netrc").expanduser().read_text().strip()

RUN echo out > ~/.netrc

RUN conda create --name env --file conda-linux-64.lock && conda clean --all --yes

Build

Build an image of a Docker file in your current directory. 

Must have a file called Dockerfile in it

$ docker build .

$ DOCKER_BUILDKIT=0  docker build. # See error message

 Build with a tag (name

$ docker build -t NAME:latest .

Build and run

docker run -it $(docker build -q .)

docker run --rm -it $(docker build -q .)

Build an image of a Docker compose file in your current directory

docker-compose up

From artifactory

docker login COMPANY-cr.jfrog.io

company-cr.jfrog.io/alpine:latest

Install

Miniconda

ARG MINICONDA_VERSION=4.8.3

ARG PY_VERSION=py38

ARG CONDA_DIR=$HOME/miniconda3

RUN mkdir $HOME/miniconda3

RUN wget --quiet https://repo.anaconda.com/miniconda/Miniconda3-${PY_VERSION}_${MINICONDA_VERSION}-Linux-x86_64.sh -O ~/miniconda.sh && \

   /bin/bash ~/miniconda.sh -b -p ${CONDA_DIR} && \

   rm ~/miniconda.sh

Dask with lab extension

https://jupyter-docker-stacks.readthedocs.io/en/latest/using/recipes.html#dask-jupyterlab-extension 

Tutorial

$ git clone https://github.com/docker/doodle.git

$ cd doodle\cheers2019 ; docker build -t USER/cheers2019 .

$ docker run -it --rm USER/cheers2019

$ docker login ; docker push USER/cheers2019

Install on windows

https://docs.docker.com/docker-for-windows/install/

> Enable-WindowsOptionalFeature -Online -FeatureName Microsoft-Hyper-V -All

> Enable-WindowsOptionalFeature -Online -FeatureName Containers -All

https://support.bluestacks.com/hc/en-us/articles/115003174386-How-can-I-enable-virtualization-VT-on-my-PC-#%E2%80%9C3%E2%80%9D 

more ~/.docker/config.json