Team...we are new users of flyte...we are testing ...
# ask-the-community
r
Team...we are new users of flyte...we are testing it out...ran into this issue...any suggestions? RPC Failed, with Status: StatusCode.INVALID_ARGUMENT details: failed to compile workflow for [resource_type:WORKFLOW project:"my-project" domain:"development" name:"workflows.test3.wf1" version:"OMhNJ6fT8cbHx2E4o52aNg"] with err failed to compile workflow with err Collected Errors: 1 Error 0: Code: NoNodesFound, Node Id: resource_type:WORKFLOW project:"my-project" domain:"development" name:"workflows.test3.wf1" version:"OMhNJ6fT8cbHx2E4o52aNg", Description: Can't find any nodes in workflow [resource_type:WORKFLOW project:"my-project" domain:"development" name:"workflows.test3.wf1" version:"OMhNJ6fT8cbHx2E4o52aNg"].
k
are you able to share you code snippet
r
@Akash Dubey will clean up some confidential info and will be able to share the code snippet shortly... but in general what does "NoNodesFound" mean?
k
It seems that you have no tasks in your workflow
Empty workflow
r
@Akash Dubey i see..will look into it
a
@Ketan (kumare3) import typing from flytekit import task, workflow import pandas as pd # Define Flyte tasks @task def read_csv_task(file_path: str) -> pd.DataFrame: return pd.read_csv(file_path) @task def merge_dataframes(df1: pd.DataFrame, df2: pd.DataFrame) -> pd.DataFrame: return pd.merge(df1, df2, on='A', how='inner') # Define the workflow @workflow def process_csv_files(file1: str="/home/ubuntu/flyte/my_project/workflows/sample.csv", file2: str="/home/ubuntu/flyte/my_project/workflows/sample2.csv") -> pd.DataFrame: df1 = read_csv_task(file1) df2 = read_csv_task(file2) merged_df = merge_dataframes(df1, df2) return merged_df I keeps giving the error no module found workflow.test4
My file name is test4.ipynb
@Ketan (kumare3) can we pls huddle?
d
@Akash Dubey I could be wrong, but it seems you're calling a task using a positional argument, which is not supported by Flyte Also the
mo module found
type of errors typically had to do with missing files in your current folder. Do you have an `__init__.py`in the same folder as your workflow code?
a
Yes David I have init.py in the same folder
Little confused over keyword arguments but I think I sorted it
import typing from flytekit import task, workflow import pandas as pd # Define Flyte tasks @task def read_csv_task(file_path: str) -> pd.DataFrame: return pd.read_csv(file_path) @task def merge_dataframes(df1: pd.DataFrame, df2: pd.DataFrame) -> pd.DataFrame: return pd.merge(df1, df2, on='A', how='inner') # Define the workflow @workflow def process_csv_files(file1: str="/home/ubuntu/flyte/my_project/workflows/sample.csv", file2: str="/home/ubuntu/flyte/my_project/workflows/sample2.csv") -> pd.DataFrame: df1 = read_csv_task(file_path="/home/ubuntu/flyte/my_project/workflows/sample.csv") df2 = read_csv_task(file_path="/home/ubuntu/flyte/my_project/workflows/sample2.csv") merged_df = merge_dataframes(df1=df1, df2=df2) print(merged_df) process_csv_files(file1="/home/ubuntu/flyte/my_project/workflows/sample.csv", file2="/home/ubuntu/flyte/my_project/workflows/sample2.csv")
Now it runs into this error "FlyteValidationException: USERValidationError error=Failed to bind output o0 for function workflows.test5.process_csv_files: Python value cannot be None, expected <class 'pandas.core.frame.DataFrame'>/<FlyteLiteral structured_dataset_type { }>, cause=Python value cannot be None, expected <class 'pandas.core.frame.DataFrame'>/<FlyteLiteral structured_dataset_type { }>
d
I think you only need to return
merged_df
from the workflow I just ran it succesfully replacing
print(merged_df)
with
return merged_df
as the error message indicates the wf is not actually returning anything
a
Hey David, Yes it ran for me as well.....Many thanks!
r
@Ketan (kumare3) @David Espejo (he/him) @Kevin Su would it be possible to have about 30 mins of your time today to resolve the issues we are having? Akash and I booked office hours for last night (11PM central time) but no one showed up for that office hours...we really like flyte and would like to get some complex workflow working and show it to a wider team so that we can make a case to our management about flyte vs other products out there
d
Hey @RK @Akash Dubey sorry for the office hours failure. We'll find a way to prevent this from happening in the future. Could you summarize here (or maybe in a new thread) the problems you're facing/ the goals you have and then we can coordinate resources to help you better?
r
@David Espejo (he/him)... @Akash Dubey has another thread going with the issues we are having currently..will tag u in that thread...thanks for your prompt response
Hi @David Espejo (he/him) @Kevin Su..thanks for your help on this...so we were wondering if u have any training that you can provide us? we would be interested...please let me know..thanks
a few of us will be able to join the training
and learn more about it
k
There is Flyte school
r
pls provide the details
d
@RK there are recorded sessions that should help you get started:

https://www.youtube.com/watch?v=0cP9pLLeqT4

https://www.youtube.com/watch?v=w9l3oW-SUxU

Also the Flyte fundamentals sections in the docs: https://docs.flyte.org/en/latest/flyte_fundamentals/tasks_workflows_and_launch_plans.html
r
thanks @David Espejo (he/him)...we will go over them...any in person training you offer? we would be interested
about 4 - 6 of our team members will join
in person could be via a zoom session is fine as well
do a hands on workshop together...like creating an end-end complex workflow etc.
k
@RK we can do this, but usually this will be with Union. Union offers a fully hosted version of Flyte and many more features. Definitely join our webinar tomorrow https://www.linkedin.com/events/introducingartifactslineageandr7191118941929312256/theater/
as part of the platform you do also get solutions engineering access and they help you and team to rapidly adapt and learn how to build production grade pipelines