Flyte enables production-grade orchestration for machine learning workflows and data processing created to accelerate local workflows to production.

Flyte

<https://github.com/flyteorg/flyte-sdk/pull/193|#193 Update Spark example configuration>
Pull request opened by <https://github.com/pingsutw|pingsutw>
## Summary

• Upgrade flyteplugins-spark to version 2.0.0b20
• Increase driver memory from 1000M to 3000M for better performance
• Add AWS S3 jars to spark configuration for broader cloud support
• Update resource allocation with higher memory limits (3000Mi-5000Mi)
• Switch to run hello_spark_nested as default example
• Add wait() call to block until completion
<https://github.com/flyteorg/flyte-sdk|flyteorg/flyte-sdk>

<https://github.com/flyteorg/flyte-sdk/pull/193|#193 Update Spark example configuration>
Pull request merged by <https://github.com/kumare3|kumare3>
<https://github.com/flyteorg/flyte-sdk|flyteorg/flyte-sdk>