hey all trying to run remotely the `multiregion house price Flyte #flyte-support

hey all, trying to run remotely the `multiregion_h...

cold-train-21872

08/11/2023, 11:26 PM

hey all, trying to run remotely the

multiregion_house_price_predictor

example with

ImageSpec

for the flytectl sandbox. Without

ImageSpec

the module is not found:

Copy code

ModuleNotFoundError: No module named 'xgboost'

But with

ImageSpec

added to the dynamic task I get the following error:

Copy code

Message:

    failed to run command envd build --path /tmp/flytexs2bdbs9/local_flytekit/e1e44db9fea33d3ded1b106d31be4f95  --platform linux/amd64 --output type=image,name=localhost:30000/imagespec:W0u7emmgOREVgTE342Grvg..,push=true with error b'time="2023-08-13T00:09:15Z" level=fatal msg="Cannot get public key path"\n'

SYSTEM ERROR! Contact platform administrators.

cold-train-21872

08/13/2023, 12:21 AM

Not sure which image is currently stable with the envd buildkit but I am using:

sha-713f3f86a4d74d555e1a55b52065119df39117e3

This is how I defined `ImageSpec`:

Copy code

image = ImageSpec(
    name="imagespec",
    registry="localhost:30000",
    packages=["scikit-learn", "pandas", "xgboost"],
)

tall-lock-23197

08/14/2023, 5:15 AM

Are you seeing that error on your terminal while you are registering/executing the workflow?

cold-train-21872

08/15/2023, 11:15 PM

Sorry for the delay @tall-lock-23197 this was on the flyte console during execution - I should also clarify, since

multiregion_house_price_predictor

imports from

house_price_predictor

, this occurs with

ImageSpec

used in the former, but is used/not used in the latter.

tall-lock-23197

08/16/2023, 4:50 AM

If your tasks are using custom dependencies, then you need to assign the image to

container_image

in your task decorators. Not sure why you're seeing the error though; it looks SSH-related. For the time being, can you push it to your dockerhub? You just have to specify the dockerhub username in the registry field.

10 Views

Open in Slack

Previous Next