Join Slack
Powered by
Question: is it possible to use a `Secret` inside ...
# flyte-support
s
sparse-pizza-79993
10/12/2023, 7:47 PM
Question: is it possible to use a
Secret
inside of
spark_conf
of a Spark task?
g
glamorous-carpet-83516
10/13/2023, 6:26 AM
you can use it inside task, don’t need to use it inside spark config.
https://docs.flyte.org/projects/cookbook/en/v0.3.66/auto/core/containerization/use_secrets.html
s
sparse-pizza-79993
10/13/2023, 8:47 AM
@glamorous-carpet-83516
Don’t the Spark config variables need to be set before the session is created? I.e. before I would be able to access the task context
Open in Slack
Previous
Next