Hello Flyte team,
I am trying to build a Flyte container with both k8s_spark and my custom python packages.
I started the Dockerfile from this according to your suggestions (thanks!)
https://github.com/flyteorg/flytesnacks/blob/master/cookbook/integrations/kubernetes/k8s_spark/Dockerfile
However, this container requires changing the root user like this. This causes permission issues for other flyte tasks that access AWS etc. that are setup for the default user only.
ARG spark_uid=1001
# Set /root user and group
RUN chown -R ${spark_uid}:${spark_uid} /root
USER ${spark_uid}