Keith Leo-Smith10/18/2023, 11:43 AM
To be able to set spark config at task runtime just before the spark session is created instead of at Flyte task creation or registration time(The reason is we have a multi tenanted platform where we need to control which meta-store to talk to based on config passed to the flyte task at runtime) Does anybody have any suggestions or tips as to how to solve this issue?
Keith Leo-Smith10/18/2023, 2:39 PM
Keith Leo-Smith10/18/2023, 2:48 PM
Keith Leo-Smith10/18/2023, 3:13 PM
Thomas Newton11/01/2023, 2:53 PM