Is there any way to run a small task with Flyte without launching a container, as launching a container is bit overkill for that task.

There are ShellTasks, but at the end, to my knowledge, everything is containerized as it's running on kubernetes.

ok, I don't think ShellTasks will be helpful for my usecase as the simpletask that I have will do an API call to Embedding providers, store embedding in vector db and send update to fastapi server.

Yes. This feature may coming soon. Basically, it convert all your small Flyte task to Ray task and run in ray cluster to eliminate Pod creation time.

This is the right usecase to use agents. Can you tell me More about your tasks. Next year we are also working on reusable containers