https://flyte.org logo
#ask-the-community
Title
# ask-the-community
g

Greg Linklater

10/12/2023, 7:47 PM
Question: is it possible to use a
Secret
inside of
spark_conf
of a Spark task?
k

Kevin Su

10/13/2023, 6:26 AM
you can use it inside task, don’t need to use it inside spark config. https://docs.flyte.org/projects/cookbook/en/v0.3.66/auto/core/containerization/use_secrets.html
g

Greg Linklater

10/13/2023, 8:47 AM
@Kevin Su Don’t the Spark config variables need to be set before the session is created? I.e. before I would be able to access the task context