Keith Leo-Smith
10/18/2023, 11:43 AMTo be able to set spark config at task runtime just before the spark session is created instead of at Flyte task creation or registration time(The reason is we have a multi tenanted platform where we need to control which meta-store to talk to based on config passed to the flyte task at runtime) Does anybody have any suggestions or tips as to how to solve this issue?
Ketan (kumare3)
Keith Leo-Smith
10/18/2023, 2:39 PMKetan (kumare3)
Keith Leo-Smith
10/18/2023, 2:48 PMKetan (kumare3)
Keith Leo-Smith
10/18/2023, 3:13 PMSamhita Alla
Thomas Newton
11/01/2023, 2:53 PMKetan (kumare3)