hi team, is it possible to access DAG information ...
# flyte-supportc
clever-scientist-39504
09/12/2023, 9:18 PMhi team, is it possible to access DAG information from a task at runtime?
clever-scientist-39504
09/12/2023, 11:32 PMor to access workflow DAG information locally?
t
thankful-minister-83577
09/12/2023, 11:50 PM
not really… what are you looking to do?
thankful-minister-83577
09/12/2023, 11:50 PM
i mean your task can always query the control plane, hit the getworkflow endpoint of admin.
thankful-minister-83577
09/12/2023, 11:50 PM
but i suspect that’s not what you’re asking.
c
clever-scientist-39504
09/13/2023, 6:39 PMi want to access and use the DAG information ideally at registration time
clever-scientist-39504
09/13/2023, 6:40 PM Copy code
i mean your task can always query the control plane, hit the getworkflow endpoint of admin.t
thankful-minister-83577
09/13/2023, 6:40 PM
at registration time?
thankful-minister-83577
09/13/2023, 6:41 PM
can you explain what you’re trying to do?
thankful-minister-83577
09/13/2023, 6:41 PM
at registration time, the flytekit sdk should already have all the information about the dag (it doesn’t fetch reference things though)
c
clever-scientist-39504
09/13/2023, 6:45 PMi want to send DAG information (relationship between steps) to another service for tracking. currently without flyte, all my steps has a base class so at compile time i construct a graph with information about the relationship between steps. When it’s migrated to flyte, i no longer use a base class and steps are reference workflows now. what’s the best way to send the DAG information?
clever-scientist-39504
09/13/2023, 7:04 PMwould i be able to create a workflow decorator (flyte doc) to get the dag information at compile time, and create a node that sends the tracking information?
f
freezing-airport-6809
09/13/2023, 9:03 PM
The dag information is available in a standardized format from control plane endpoint
freezing-airport-6809
09/13/2023, 9:03 PM
You can say get workflow and it will return a full closure
c
clever-scientist-39504
09/13/2023, 9:04 PMcould you point me to reference on how to query the control plane? would flyteContextManager be able to access this information?
f
freezing-airport-6809
09/13/2023, 9:04 PM
Flyteremote.fetch_workfloe
c
clever-scientist-39504
09/13/2023, 9:06 PMwhat if i want to have a task that have access to the DAG information? would that be possible?
f
freezing-airport-6809
09/13/2023, 9:06 PM
Wdym?
freezing-airport-6809
09/13/2023, 9:06 PM
In python you have the workflow
freezing-airport-6809
09/13/2023, 9:07 PM
You can load it call translate and it will give you the protobuf rep
freezing-airport-6809
09/13/2023, 9:07 PM
Or there are nodes with upstream
And downstream
c
clever-scientist-39504
09/13/2023, 9:08 PMYou can load it call translate and it will give you the protobuf repf
freezing-airport-6809
09/13/2023, 9:10 PM
AFK, I I’ll share when near a laptop
c
clever-scientist-39504
09/13/2023, 9:10 PMthank you!
2 Views