it should be easy as the entire system is in go and hence writing go plugins should be easier as most of the machinery exists

flytectl is like a starting point of such a system

and happy to collaborate

the beauty of gosdk might be super small images and fast runtime

we could also do some other optimizations

So basically @Saravanan Arumugam here is what you need to build a task acceptor - 1. a CLI based invocation system - you control this when you generate the task definition. So in python we generate something like

pyflyte-execute …

2. It will take a path to blob store for inputs and a prefix to put the outputs Read this - https://docs.flyte.org/en/latest/concepts/data_management.html#types-of-data and Read - https://pkg.go.dev/github.com/flyteorg/flyteplugins@v1.0.29/go/tasks/pluginmachinery/core/template#pkg-overview Also better than flytectl - copilot already implements some of this - https://pkg.go.dev/github.com/lyft/flyteplugins/copilot

we have been wanting to write a gosdk one-day

and eventually have a rust core data layer that all of them will reuse