Hi everyone! I've recently started trying Flyte in order to deploy some ML pipelines. Since i use some privately developed libraries in my code i figured out that i must dockerize and push it to the registry in order to execute the flows w/ pyflyte . However, i haven't use Docker extensively so i have trouble pushing and using. Is there any sort of guide on how to extend the demo image or a base dockerfile to begin with? Thank you very much!

FROM <http://ghcr.io/flyteorg/flytekit:tag|ghcr.io/flyteorg/flytekit:tag> # whichever tag you want to build on

USER root

# Upgrade pip, git not needed if you don't want it
RUN apt-get -y install git && pip install --upgrade pip

# Install python packages
RUN pip install ........ \
     .......

# If we want to install custom git packages we do something like this:
# RUN pip install git+<https://gitrepolinkhere>

USER flytekit

CMD [] # Not needed

This is a basic Dockerfile structure we use to build custom images You can also use ImageSpec from 1.6.0 onwards I believe, but this is more explicit and manual @Fotis Kalioras

Thanks for the quick reply! One question more. If my modules are local .py files can i import them directly or must i setup a private repository?

You can just use the inbuilt

COPY

command for Docker to copy the modules from your local build path into the Docker container's working directory. By default it's /root or $HOME So If you want to use relative paths with "./"

COPY ./path/to/your/modules/on/local ./path/to/docker/container/directory

Or absolute paths in terms of PATH

COPY /absolute/path/here/on/local /absolute/path/inside/docker/container

Thank you very much, going to try it!