#6375 [Plugin] Add Xarray Type Transformer
Issue created by
ljstrnadiii
A natural way to persist Xarray datasets and dataarrays to remote storage is with the zarr format. Adding a type transformer to encode and decode could look something like calling .to_zarr and .open_zarr on Xarray objects.
Furthermore, if we use zarr, each chunk natively corresponds to a dask task and transforming Xarray objects builds up dask task graph. By using the dask plugin in addition to an Xarray type transformer plugin, we can trigger all the computations on a remote cluster by simply calling to_zarr.
flyteorg/flyte