Hi everyone~ I am new in Flyte and currently strug...
# flyte-support
e
Hi everyone~ I am new in Flyte and currently struggle on setting up Spark in sandbox (flytectl demo cluster) for local usage. I tried to edit config map with
kubectl edit cm flyte-sandbox-config
, and add some spark configuration inside it (based on the config for flyte-sandbox here). The configuration I used is attached below. Then, I use
kubectl rollout restart flyte-sandbox
to restart the deployment. When running the pyspark_pi example in flytesnacks, the workflow status stuck in queuing. Does anyone know why this happens and how I can solve it? Thanks a lot for any help!🙏
t
can you paste the resolution here after you talk to kevin?
f
you cannot run spark in sandbox. Spark needs too much memory and hard to run in sandbox is what i have observed
e
Thanks for your reply, I'll talk to Kevin and update after our discussion~