How to create an Airflow task where I start a Docker container with GPU support

  airflow, docker, gpu

How could I create an Airflow task where I would start a Docker container that is using GPU. When running from the terminal I would just use --gpus all flag. I can`t do that using DockerOperator, because it does not support device_requests parameter, which is used underneath when calling docker run with --gpus all flag.

Source: Docker Questions

LEAVE A COMMENT