faint-monitor-96441
08/22/2022, 1:21 PMfreezing-airport-6809
freezing-airport-6809
freezing-airport-6809
freezing-airport-6809
freezing-airport-6809
faint-monitor-96441
08/22/2022, 2:19 PMfaint-monitor-96441
08/22/2022, 2:27 PMfreezing-airport-6809
freezing-airport-6809
freezing-airport-6809
broad-monitor-993
08/22/2022, 2:36 PMbroad-monitor-993
08/22/2022, 2:36 PMthree important pieces which are experiment tracking/model registry/data versioning.I think for experiment tracking we’re planning on relying on integrations with other libraries in the ecosystem (e.g. mlflow) Re: model registry and data versioning and data lineage, what are your requirements? Flyte basically tracks all artifacts at the interface of tasks and workflow (in addition to all dependencies in the execution graph), including models and data, but would be interested in chatting to understand what your needs are.
thankful-minister-83577
thankful-minister-83577
colossal-painter-70298
08/22/2022, 4:35 PMfaint-monitor-96441
08/22/2022, 6:03 PMI think for experiment tracking we’re planning on relying on integrations with other libraries in the ecosystem (e.g. mlflow)That makes sense @broad-monitor-993. For the tracking, we mostly need rudimentary features (eg graphs). For the model registry, we want a centralized thin abstraction layer in front of a blob storage (eg s3) that can reference arbitrary models and metadata. MLFlow suits our needs pretty well here. When it comes to data lineage, we’re currently using DVC but I’m currently looking for alternatives as using git to track revisions isn’t great when domain experts need to be able to manipulate the datasets (fix incorrect labels etc).
thankful-minister-83577
thankful-minister-83577
faint-monitor-96441
08/22/2022, 6:12 PMthankful-minister-83577
thankful-minister-83577
faint-monitor-96441
08/22/2022, 6:16 PMthankful-minister-83577
thankful-minister-83577
thankful-minister-83577
faint-monitor-96441
08/22/2022, 6:19 PMthankful-minister-83577
colossal-painter-70298
08/22/2022, 6:19 PMthankful-minister-83577
thankful-minister-83577
colossal-painter-70298
08/22/2022, 6:21 PMthankful-minister-83577