Hello, Do you know if there is a flytekit plugins ...
# flyte-support
s
Hello, Do you know if there is a flytekit plugins for airflow? I need to detect if an Airflow dag run is completed from Flyte. Thanks.
s
@broad-monitor-993, thank you. However, that package allows an Airflow dag to trigger a Flyte workfl. What I want is different. I want Flyte to check the status of an Airflow dag run, so that Flyte can trigger the dependent downstream tasks.
Any idea?
a
Is there a python client for airflow that lets you list workflow executions? If that existed then you could write a task that checks if an execution succeeded in the last X hours. It could sleep and retry every so often.
Maybe there is an API?
s
Yes, @abundant-hamburger-66584, I am working on it.
f
also folks - @salmon-refrigerator-32115 as promised this is in the works and landing soon - https://github.com/flyteorg/flytekit/pull/1524
This will make it simple to add all kinds of backend plugins, that are cheap to run, easy to write and very efficient
s
@freezing-airport-6809, awesome!
150 Views