https://flyte.org logo
Title
e

Eduardo Matus

01/17/2023, 4:56 PM
Hi everyone, Having some doubts about this: https://docs.flyte.org/projects/cookbook/en/latest/auto/core/containerization/multi_images.html Basically, there are 2 containers (for trainer and predictor). How the workflow should run to run the task images?
k

Kevin Su

01/17/2023, 5:07 PM
Those two container will be running in two different pod, and use different image
e

Eduardo Matus

01/17/2023, 6:10 PM
So, in this command pyflyte run --image <registry/repo:version> --remote example.py wf. I should pass --image 1 --image 2 --image n if I’m using multiple images?
y

Yee

01/17/2023, 7:18 PM
almost yeah, you need to give them names
--image a.com/b:123 --image trainer=a.com/c:123
if there’s no name then it becomes the default
if there’s more than one default it will error
e

Eduardo Matus

01/17/2023, 7:35 PM
perfect.. thanks
f

Frank Shen

01/17/2023, 9:50 PM
@Yee, I have two images, one for spark task, therefore extra param --service-account spark will be supplied; The other image is with custom packages, therefore it cannot work with --service-account spark. How do I submit the workflow using pyflyte run --remote ? The conflict is --service-account spark is needed for spark tasks but not other tasks.
s

Samhita Alla

01/18/2023, 5:24 AM
I'm not sure that's possible. A task or a workflow execution can only have a single service account. Would like @Yee to confirm.
k

Kevin Su

01/18/2023, 5:25 AM
we can’t for now. we have an issue for it. https://github.com/flyteorg/flyte/issues/3241