Hi, I am running into an error when trying to run the BigQuery Query example. The

no_io_wf

workflow is running fine, however, the

full_bigquery_wf

is failing on the

Python Task

with the following error:

ModuleNotFoundError: No module named 'flytekitplugins.bigquery'

hi @Jake Dodd, please install the bigquery plugin:

pip install flytekitplugins-bigquery

.

Hi @Samhita Alla, I have added

flytekitplugins-bigquery

as a dependency to Poetry and am registering the workflow using the command:

poetry run pyflyte run --remote demo/bigquery.py full_bigquery_wf --version 1

this will work locally. but for it to work on the cluster, you need to build an image or use image spec to specify the dependency. here's an example:

custom_image = ImageSpec(
    name="ray-flyte-plugin",
    registry="<your-registry>",
    packages=["flytekitplugins-ray"],
)

@task(
    task_config=ray_config,
    requests=Resources(mem="2Gi", cpu="2"),
    container_image=custom_image,
)
def ray_task(n: int) -> typing.List[int]:
    futures = [f.remote(i) for i in range(n)]
    return ray.get(futures)

ah ok, thanks @Samhita Alla, I’ll give it a go with

ImageSpec