Frank Shen
10/21/2022, 5:24 PMLast Error: USER::Spark Job Failed with Error: driver container failed with ExitCode: 127, Reason: ContainerCannotRun
I have the following in the requirements.txt file for spark related dependencies.
flytekit>=0.20.0
flytekitplugins-snowflake
flytekitplugins-spark
scikit-learn
xgboost
unionml
SHAP
pandas
apache-beam
joblib
pyyaml==6.0
boto3==1.9.207
aws-secretsmanager-caching==1.1.1.5
aws-requests-auth==0.4.3
flytekit>=0.20.0
flytekitplugins-spark
Eduardo Apolinario (eapolinario)
10/21/2022, 8:51 PM