Bernhard Stadlbauer05/18/2022, 8:54 AM
would also be available if that helps.
Bernhard Stadlbauer05/19/2022, 5:47 AM
plugin at the moment (very similar to this Flyte issue). I thought it might be nice if the
cluster spins up its scheduler and worker nodes with the same image as the one that the Flyte task is running on (in the remote execution case). As a side note, if we things are working, we would also like to upstream our changes and contribute the plugin to the
repository. I've currently based my work on the new (and experimental) dask operator.
Marc Paquette05/19/2022, 3:04 PM
Bernhard Stadlbauer05/19/2022, 5:46 PM
plugin, which is only a few lines of code) 👍 @Marc Paquette Sorry for that, this should be the link: https://github.com/flyteorg/flyte/issues/427
Marc Paquette05/19/2022, 5:46 PM