Hi I am trying to understand how flyte converts the Python w

Question

Hi I am trying to understand how flyte converts the Python workflow into DAG that can be run on airflow k8s Any pointers on how Python code is parsed Is the DAG represented as a proto Will like to look into running parts of DAG on AWS lambda

Ketan (kumare3) · Answer

It does not run it on airflow

Ketan (kumare3) · Answer

It runs it on its own scheduler engine

Ketan (kumare3) · Answer

The intermediate representation is in protobuf

Alex · Answer

Got it Thanks Any code pointers where this intermediate protobuf representation is generated

Ketan (kumare3) · Answer

The flyteidl repo

Ketan (kumare3) · Answer

Alex · Answer

Thanks

Kevin Su · Answer

flyte can compile airflow workflow to Flyte proto and then run it on the flyte cluster check out this PR <https github com flyteorg flytekit pull 1725>