Hi! I am trying to understand how flyte converts t...
# flyte-supporth
hundreds-answer-27689
09/10/2023, 2:30 AMHi! I am trying to understand how flyte converts the Python workflow into DAG that can be run on airflow / k8s? Any pointers on how Python code is parsed? Is the DAG represented as a proto? Will like to look into running parts of DAG on AWS lambda.
f
freezing-airport-6809
09/10/2023, 3:24 AM
It does not run it on airflow
freezing-airport-6809
09/10/2023, 3:24 AM
It runs it on its own scheduler engine
freezing-airport-6809
09/10/2023, 3:40 AM
The intermediate representation is in protobuf
👍 1
h
hundreds-answer-27689
09/10/2023, 1:50 PMGot it. Thanks. Any code pointers where this intermediate protobuf representation is generated?
f
freezing-airport-6809
09/10/2023, 2:05 PM
The flyteidl repo
freezing-airport-6809
09/10/2023, 2:06 PM
h
hundreds-answer-27689
09/10/2023, 2:20 PMThanks
❤️ 1
g
glamorous-carpet-83516
09/11/2023, 7:06 PMflyte can compile airflow workflow to Flyte proto, and then run it on the flyte cluster. check out this PR. https://github.com/flyteorg/flytekit/pull/1725
👍 1
2 Views