jolly-florist-66728
12/02/2024, 3:33 PMkubectl edit cm flyte-sandbox-config
, and add some spark configuration inside it (based on the config for flyte-sandbox here). The configuration I used is attached below. Then, I use kubectl rollout restart flyte-sandbox
to restart the deployment.
When running the pyspark_pi example in flytesnacks, the workflow status stuck in queuing.
Does anyone know why this happens and how I can solve it?
Thanks a lot for any help!🙏
# Answer
To resolve the issue of the workflow status being stuck in "queuing" when running the pyspark_pi
example in Flytesnacks, ensure that the Spark configuration is correctly set up in the Flyte sandbox. According to the Flyte documentation, you need to ensure that the Spark operator is properly installed and configured. Additionally, verify that the necessary permissions are granted to the service account used by Flyte to create Spark resources.
Would you like more detailed steps on how to verify and configure these settings?
Sources:
- https://github.com/flyteorg/flyte/pull/3248
- https://discuss.flyte.org/t/15983401/having-some-difficulty-using-the-spark-plugin-for-flyte-in-p/
Slack Link
https://flyte.slack.com/archives/CP2HDHKE1/p1733153547.132949 👍 0 button 👎 0 button 💡 Hint: Mention @runllm in the thread for followups.