Prefect integrations for working with Docker
Prefect integrations for working with Docker.
Note! The DockerRegistryCredentials
in prefect-docker
is a unique block, separate from the DockerRegistry
in prefect
core. While DockerRegistry
implements a few functionality from both DockerHost
and DockerRegistryCredentials
for convenience, it does not allow much configuration to interact with a Docker host.
Do not use DockerRegistry
with this collection. Instead, use DockerHost
and DockerRegistryCredentials
.
Requires an installation of Python 3.7+.
We recommend using a Python virtual environment manager such as pipenv, conda or virtualenv.
These tasks are designed to work with Prefect 2.0. For more information about how to use Prefect, please refer to the Prefect documentation.
Install prefect-docker
with pip
:
pip install prefect-docker
Then, register to view the block on Prefect Cloud:
prefect block register -m prefect_docker
Note, to use the load
method on Blocks, you must already have a block document saved through code or saved through the UI.
from prefect import flow, get_run_logger
from prefect_docker.images import pull_docker_image
from prefect_docker.containers import (
create_docker_container,
start_docker_container,
get_docker_container_logs,
stop_docker_container,
remove_docker_container,
)
@flow
def docker_flow():
logger = get_run_logger()
pull_docker_image("prefecthq/prefect", "latest")
container = create_docker_container(
image="prefecthq/prefect", command="echo 'hello world!' && sleep 60"
)
start_docker_container(container_id=container.id)
logs = get_docker_container_logs(container_id=container.id)
logger.info(logs)
stop_docker_container(container_id=container.id)
remove_docker_container(container_id=container.id)
return container
from prefect import flow
from prefect_docker import DockerHost
from prefect_docker.containers import create_docker_container
@flow
def create_docker_container_flow():
docker_host = DockerHost(
base_url="tcp://127.0.0.1:1234",
max_pool_size=4
)
container = create_docker_container(
docker_host=docker_host,
image="prefecthq/prefect",
command="echo 'hello world!'"
)
create_docker_container_flow()
If you encounter any bugs while using prefect-docker
, feel free to open an issue in the prefect-docker repository.
If you have any questions or issues while using prefect-docker
, you can find help in either the Prefect Discourse forum or the Prefect Slack community.
Feel free to ⭐️ or watch prefect-docker
for updates too!
If you'd like to install a version of prefect-docker
for development, clone the repository and perform an editable install with pip
:
git clone https://github.com/PrefectHQ/prefect-docker.git
cd prefect-docker/
pip install -e ".[dev]"
# Install linting pre-commit hooks
pre-commit install