We started working on adding a Flyte source extension to Datahub for tracking metadata and lineage about our Workflows. Is anyone else maybe already working on something similar?
04/28/2022, 2:43 PM
@Rowan Shulver ^
04/28/2022, 3:50 PM
Hi Tim. I spoke with Fredrik regarding this as well. Please keep me posted.
04/29/2022, 2:33 PM
We actually have a prototype for this which we can share
We want to make this into an open source thing and ideally a framework for folks to extend
04/29/2022, 5:05 PM
It would be awesome if you could share that with us. My approach now was to write a new Datahub Source that makes use of flytekits “friendly” Client to pull data. Would be interesting to see which way you would have taken and rather focus on that if you prefer it.