We started working on adding a Flyte source extension to Datahub for tracking metadata and lineage about our Workflows. Is anyone else maybe already working on something similar?
👀 2
h
Haytham Abuelfutuh
04/28/2022, 2:43 PM
@Yee ^
@Rowan Shulver ^
h
Han
04/28/2022, 3:50 PM
Hi Tim. I spoke with Fredrik regarding this as well. Please keep me posted.
k
Ketan (kumare3)
04/29/2022, 2:33 PM
We actually have a prototype for this which we can share
🔥 1
We want to make this into an open source thing and ideally a framework for folks to extend
t
Tim Bauer
04/29/2022, 5:05 PM
It would be awesome if you could share that with us. My approach now was to write a new Datahub Source that makes use of flytekits “friendly” Client to pull data. Would be interesting to see which way you would have taken and rather focus on that if you prefer it.