acoustic-carpenter-78188
04/18/2024, 12:57 AMContainerTask
to run locally, this way decreasing the dependence on a Flyte cluster for local development.
Goal: What should the final outcome look like, ideally?
Iterating on DAGs that make use of ContainerTask
is cumbersome as we currently not able to execute tasks of that type locally.
With flyteorg/flytekit#1745 we're improving the situation somewhat by letting users know that this is an impossibility. That said, there's no fundamental reason for us not to assume certain capabilities, for example access to a docker client, such that we could rely on that to kick off executions of ContainerTask
.
Describe alternatives you've considered
Using a Flyte cluster.
Propose: Link/Inline OR Additional context
As described in flyteorg/flytekit#1745 (comment), we can add support for a subset of what is achievable with ContainerTask
, with a few exceptions, e.g. Pod templates.
Are you sure this issue hasn't been raised already?
☑︎ Yes
Have you read the Code of Conduct?
☑︎ Yes
flyteorg/flyteacoustic-carpenter-78188
04/18/2024, 12:57 AM