#CNMKCU6FR I am trying to pass a tensorflow h5 model file between tasks but seems to have hit an issue. Is there any example for passing h5 files between tasks. [1/1] currentAttempt done. Last Error: USER::Pod failed. No message received from kubernetes. [adpz8w6l67zrzfglb9m9-n4-0] terminated with exit code (137). Reason [Error]. Message: use python type that flyte support."} {"asctime": "2022-09-06 083946,752", "name": "flytekit", "levelname": "WARNING", "message": "Unsupported Type <class 'keras.engine.training.Model'> found, Flyte will default to use PickleFile as the transport. Pickle can only be used to send objects between the exact same version of Python, and we strongly recommend to use python type that flyte support."} Different versions of python message is also confusing since all of my tasks are present in the same container and follow the same versions.

Hi! I want to make creating Project with a certain default IAM role with less friction. My understanding is like this(excluding Domain for simplicity): 1-

cluster_resource_manager.templates

helm value contains all the default k8s resources for a namespace(including namespace itself and ServiceAccount which we use to specify an IAM role) 2- We can specify a default IAM role for the ServiceAccounts. 3- User creates a project using

flytectl create project

4- flyteadmin creates namespace, serviceaccount and all other resoruces under

cluster_resource_manaager.templates

helm value. Our projects need different default IAM roles and we want our users to not have to go to the created namespace and create a ServiceAccount then specify it for each execution. So, is there any way to create projects with different default IAM roles/ServiceAccounts?

Hi, newbie question… Do I really need kubernetes to run Flyte?. I need to run ML workflows on docker images for a small (but growing) project.

Hey, what is the preferred way of providing project specific IAM Roles to a workflow? I am trying to run a workflow using an IAM role with permissions suitable for only that project. In my launch plan I enter some role e.g., as in the picture below but it doesn’t seem to be picked up when I describe the Pod. Does your default role e.g.,

eks-flyte-user-rule

assume the IAM Role you provide in the launch plan, or is it assumed by some service account that gets created?

Environment:
      ...
      AWS_ROLE_ARN:                       arn:aws:iam::<account_id>:role/eks-flyte-user-role

like 'cr.flyte.org/flyteorg/flytescheduler-release:v0.19.3'

hi y’all! I am using https://grafana.com/grafana/dashboards/13980 and see that the workflow query uses

label_values(flyte:propeller:all:collector:flyteworkflow, wf)

When I look at my propeller prom metrics however the

wf

label is empty. Why?

# HELP flyte:propeller:all:collector:flyteworkflow Current FlyteWorkflow levels per instance of propeller
# TYPE flyte:propeller:all:collector:flyteworkflow gauge
flyte:propeller:all:collector:flyteworkflow{domain="development",project="testproject",task="",wf=""} 1

Do I need to run

flytectl register files

first?

Hi folks, I am running into an error when running a simple hello_world workflow. I am using a custom docker image. Any idea why?

FROM python:3.8-buster

WORKDIR /root
ENV VENV /opt/venv
ENV LANG C.UTF-8
ENV LC_ALL C.UTF-8
ENV PYTHONPATH /root

ARG tag
ARG wandb_api_key
ARG wandb_username

ENV FLYTE_INTERNAL_IMAGE $tag
ENV WANDB_API_KEY $wandb_api_key
ENV WANDB_USERNAME $wandb_username

# Install the AWS cli separately to prevent issues with boto being written over
RUN pip3 install awscli

RUN apt-get update && apt-get install -y curl

ENV VENV /opt/venv
# Virtual environment
RUN python3 -m venv ${VENV}
ENV PATH="${VENV}/bin:$PATH"

# Install Python dependencies
COPY requirements.txt /root/.
RUN pip install -r /root/requirements.txt

# Copy the actual code
COPY src/ /root/src/

[1/1] currentAttempt done. Last Error: USER::Pod failed. No message received from kubernetes.
[ab8dm4nttv49wgvn59kg-n0-0] terminated with exit code (1). Reason [Error]. Message: 
rtlib._bootstrap>", line 1014, in _gcd_import
  File "<frozen importlib._bootstrap>", line 991, in _find_and_load
  File "<frozen importlib._bootstrap>", line 973, in _find_and_load_unlocked
ModuleNotFoundError: No module named 'site-packages.flytekit'
Traceback (most recent call last):
  File "/opt/venv/bin/pyflyte-fast-execute", line 8, in <module>
    sys.exit(fast_execute_task_cmd())
  File "/opt/venv/lib/python3.8/site-packages/click/core.py", line 1130, in __call__
    return self.main(*args, **kwargs)
  File "/opt/venv/lib/python3.8/site-packages/click/core.py", line 1055, in main
    rv = self.invoke(ctx)
  File "/opt/venv/lib/python3.8/site-packages/click/core.py", line 1404, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/opt/venv/lib/python3.8/site-packages/click/core.py", line 760, in invoke
    return __callback(*args, **kwargs)
  File "/opt/venv/lib/python3.8/site-packages/flytekit/bin/entrypoint.py", line 513, in fast_execute_task_cmd
    subprocess.run(cmd, check=True)
  File "/usr/local/lib/python3.8/subprocess.py", line 516, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['pyflyte-execute', '--inputs', '<s3://senn-ai-mlops-flyte/metadata/propeller/flytesnacks-development-ab8dm4nttv49wgvn59kg/n0/data/inputs.pb>', '--output-prefix', '<s3://senn-ai-mlops-flyte/metadata/propeller/flytesnacks-development-ab8dm4nttv49wgvn59kg/n0/data/0>', '--raw-output-data-prefix', '<s3://senn-ai-mlops-flyte/data/sk/ab8dm4nttv49wgvn59kg-n0-0>', '--checkpoint-path', '<s3://senn-ai-mlops-flyte/data/sk/ab8dm4nttv49wgvn59kg-n0-0/_flytecheckpoints>', '--prev-checkpoint', '""', '--dynamic-addl-distro', '<s3://senn-ai-mlops-flyte/mo/flytesnacks/development/NRI2T5OSZMCFXKR4CUNLWO7MSM======/fastab502ef8d4ae75b6b5497a94633e8642.tar.gz>', '--dynamic-dest-dir', '/root', '--resolver', 'site-packages.flytekit.core.python_auto_container.default_task_resolver', '--', 'task-module', 'src.workflows.hello_world', 'task-name', 'say_hello']' returned non-zero exit status 1.

Are there some docs on ingress for flyte if we need to use another ingress service like emissary-ingress? Looks like flyte-binary service has 8088 for http and 8089 for grpc, but using a custom domain like example.com, not sure how to map the routes to both. I tried just mapping 8088 and console works, but I got this error when I tried to run `flytectl register`:

Error: rpc error: code = Unimplemented desc = unexpected HTTP status code received from server: 404 (Not Found); transport: received unexpected content-type "text/plain; charset=utf-8"

Maybe this error is unrelated? Not sure

Hello, I'm at a point with flyte now where I'm asking myself how bigger data (talking GBs) is passed efficiently between tasks. I cannot imagine that if I have a setup on e.g. AWS that those bigger output/input data is synced with S3 all the time. Or am I missing something? What would be the way to exchange big data between tasks inside a workflow without up and downloading it on every task again? I can imagine that it could be shared over a mounted volume from the k8s cluster, but that would probably interfere with the caching mechanism at some point, right?