Questions tagged prefect

Explore the latest questions and answers asked by our top developers.

How do I set the "mounts" option in the "create_host_config" to mount a Windows UNC path (or lettered path) network drive within the Docker SDK?

Any and all help appreciated! I’m specifically trying to use the DockerRun flow configuration within a Prefect flow. The DockerRun flow config uses "create_host_config" of the python Docker SDK. If I mount a local path, the Docker Agent has no problem binding and reading/writing to the path. However, when I pass a network path, I […]

By user8359348
Published
Categorised as docker, prefect, sdk, windows Tagged , , ,

Cant Access Prefect Server Remotely

I used the command prefect server start –postgres-port=5433 –server-port=5001 –hasura-port=5002 –graphql-port=5003 –expose to start prefect server at the allowed ports in my azure network. And when i do a docker ps i get CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES 873bfa5bd6bc prefecthq/ui:core-0.15.7 "/docker-entrypoint.…" 23 minutes ago Up 23 minutes (healthy) 80/tcp, 0.0.0.0:8080->8080/tcp tmp_ui_1 9ca79a768265 […]

By caxefaizan
Published
Categorised as docker, graphql, prefect, python Tagged , , ,

Running Prefect on centos 8 Server with public IP

I tried to run prefect on centos 8 server, I expect prefect can run with centos public IP, but I don’t understand why prefect always runs with default address (localhost) from google i found that i need to configure config.toml to run prefect with public IP. i did this but some how it didn’t work […]

By Dimas Aps
Published
Categorised as centos8, docker, prefect, python Tagged , , ,

Attempting to Start Prefect Server in Docker Container

I’m relatively new to Docker and Prefect, and I’m trying to start Prefect Server in a docker container. Here’s my Dockerfile… FROM docker:dind WORKDIR /app COPY . . RUN apk update && apk add python3-dev libffi-dev openssl-dev gcc libc-dev make cargo && python3 -m ensurepip –upgrade && pip3 install docker-compose prefect && prefect backend server […]

By mssraymond
Published
Categorised as docker, prefect Tagged ,

How to deploy prefect workflow on azure web app service?

Can anyone has an idea about how to deploy prefect UI and backed on azure web app server using docker/docker-compose? I need to deploy prefect workflow on the azure web app service. Thanks for your help. Source: Docker Questions

Access Google credentials secret from a DockerRun in Prefect

I have started working with prefect and I am trying to save my results to Google cloud Storage: import prefect from prefect.engine.results import GCSResult from prefect.run_configs import DockerRun, LocalRun from prefect.storage import Docker, Local @prefect.task(checkpoint=True, result=GCSResult(bucket="redacted")) def task1(): return 1 storage = Local(…) run_config = LocalRun() with prefect.Flow( "myflow", storage=storage, run_config=run_config ) as flow: results […]

By LoicM
Published
Categorised as credentials, docker, prefect, python Tagged , , ,

How to configure Prefect backend server to point to Postgres

Having difficulties configuring Prefect to run locally. Installed via pip3, depends on docker(already installed) and docker-compose, installed, tested. works. I already have a running Postgres server, I like to configure to use that one. But it seems like one is used in docker too ? Any help is appreciated. When running: prefect backend server prefect […]

By Jesperrekuh
Published
Categorised as configure, docker, prefect Tagged , ,

How to execute a prefect Flow on a docker image via a Dask Executor?

I have the following task which is currently running on a Local Dask Executor. The server on which the agent is running is a different python environment from the one needed to execute my_task. I have a Docker image with the appropriate environment. My question is: How do I run this Flow on a Dask […]

By Newskooler
Published
Categorised as docker, docker-image, etl, prefect Tagged , , ,

How to execute a prefect Flow on a docker image?

My goal: I have a built docker image and want to run all my Flows on that image. Currently: I have the following task which is running on a Local Dask Executor. The server on which the agent is running is a different python environment from the one needed to execute my_task – hence the […]

By Newskooler
Published
Categorised as docker, docker-image, etl, prefect Tagged , , ,

Still Have Questions?


Our dedicated development team is here for you!

We can help you find answers to your question for as low as 5$.

Contact Us
faq