Hi flyte team, my spark job needs to install some ...
# flyte-support
m
Hi flyte team, my spark job needs to install some JVM based spark library, in the normal docker file it's something like follwing:
Copy code
RUN mkdir -p /opt/bitnami/spark/jars && \
    cd /opt/bitnami/spark/jars && \
    curl -L -O <https://repo1.maven.org/maven2/com/google/cloud/spark/spark-bigquery-with-dependencies_2.12/0.32.0/spark-bigquery-with-dependencies_2.12-0.32.0.jar> && \
    curl -L -O <https://storage.googleapis.com/hadoop-lib/gcs/gcs-connector-hadoop3-2.2.11.jar> && \
    chmod -R 755 /opt/bitnami/spark/jars/
wondering how would it be in the flyte image build, thanks!
here
m
thanks