Question: is it possible to use a

Secret

inside of

spark_conf

of a Spark task?

you can use it inside task, don’t need to use it inside spark config. https://docs.flyte.org/projects/cookbook/en/v0.3.66/auto/core/containerization/use_secrets.html

@Kevin Su Don’t the Spark config variables need to be set before the session is created? I.e. before I would be able to access the task context