<#82 Update is_in_cluster> Pull request opened by ...
# flyte-github
c
#82 Update is_in_cluster Pull request opened by pingsutw This pull request introduces improvements to environment detection and refactors cluster checks in both Dask and Spark plugins to use a more reliable method. It also makes minor code style adjustments and reorders imports for clarity. Cluster environment detection improvements: • Refactored the
is_in_cluster()
function in
src/flyte/_tools.py
to use the Flyte internal context for determining cluster execution, replacing the previous environment variable check. • Updated Dask (
plugins/dask/src/flyteplugins/dask/task.py
) and Spark (
plugins/spark/src/flyteplugins/spark/task.py
) plugins to use the new
is_in_cluster()
function for cluster checks, improving reliability of environment detection. [1] [2] [3] [4] flyteorg/flyte-sdk