Hello I am having trouble building a custom image that will

Question

Hello I am having trouble building a custom image that will execute pyspark tasks ```Last Error USER Spark Job Failed with Error driver container failed with ExitCode 127 Reason ContainerCannotRun``` I have the following in the requirements txt file for spark related dependencies ```flytekit gt =0 20 0 flytekitplugins snowflake flytekitplugins spark scikit learn xgboost unionml SHAP pandas apache beam joblib pyyaml==6 0 boto3==1 9 207 aws secretsmanager caching==1 1 1 5 aws requests auth==0 4 3```

Frank Shen · Answer

I found this <https docs flyte org projects cookbook en latest auto integrations kubernetes k8s spark index html spark docker image>

Frank Shen · Answer

It has the Dockerfile Could you tell me the repo that hosts the dockerfile Could you tell me what spark related dependencies will be needed in the requirements txt

Frank Shen · Answer

I am thinking the following Am I correct ```flytekit gt =0 20 0 flytekitplugins spark```

Eduardo Apolinario (eapolinario) · Answer

< Frank Shen>