Hi! I am trying to understand how flyte converts t...
# ask-the-communitya
Alex
09/10/2023, 2:30 AMHi! I am trying to understand how flyte converts the Python workflow into DAG that can be run on airflow / k8s? Any pointers on how Python code is parsed? Is the DAG represented as a proto? Will like to look into running parts of DAG on AWS lambda.
k
Ketan (kumare3)
09/10/2023, 3:24 AM
It does not run it on airflow
Ketan (kumare3)
09/10/2023, 3:24 AM
It runs it on its own scheduler engine
Ketan (kumare3)
09/10/2023, 3:40 AM
The intermediate representation is in protobuf
a
Alex
09/10/2023, 1:50 PMGot it. Thanks. Any code pointers where this intermediate protobuf representation is generated?
k
Ketan (kumare3)
09/10/2023, 2:05 PM
The flyteidl repo
Ketan (kumare3)
09/10/2023, 2:06 PM
a
Alex
09/10/2023, 2:20 PMThanks
k
Kevin Su
09/11/2023, 7:06 PMflyte can compile airflow workflow to Flyte proto, and then run it on the flyte cluster. check out this PR. https://github.com/flyteorg/flytekit/pull/1725