Hello,
I have the setup env vars in flyte remote s...
# flyte-supports
salmon-refrigerator-32115
02/10/2023, 5:12 PMHello,
I have the setup env vars in flyte remote server and can retrieve them via os.environ.get(“env-var”) and also can get the domain value via os.environ.get(“FLYTE_INTERNAL_TASK_DOMAIN”) in task running on the flyte remote.
However, this will not work if I run the task locally, because the keys are not set locally.
How do I configure my local machine if I want to run the tasks locally to retrieve the same env-vars and FLYTE_INTERNAL_TASK_DOMAIN (pyflyte run locally)?
g
glamorous-carpet-83516
02/10/2023, 8:40 PMFLYTE_INTERNAL_TASK_DOMAIN will not be used when using pyflyte run locally. did you see any error when running locally?
s
salmon-refrigerator-32115
02/10/2023, 9:25 PM@glamorous-carpet-83516,
KeyError: ‘FLYTE_INTERNAL_TASK_DOMAIN’
KeyError: ‘env-var’
salmon-refrigerator-32115
02/10/2023, 10:17 PM@glamorous-carpet-83516, it’s awkward that users have to alter code to run the tasks locally verses remotely to avoid this runtime keyError.
g
glamorous-carpet-83516
02/10/2023, 10:52 PMthe error should not happen. mind sharing you workflow code?
s
salmon-refrigerator-32115
02/11/2023, 12:17 AM Copy code
import os
from flytekit import task, workflow
@task
def get_domain() -> str:
domain = os.environ["FLYTE_INTERNAL_TASK_DOMAIN"]
print(f'FLYTE_INTERNAL_TASK_DOMAIN: {domain}')
return domain
@task
def get_env_var() -> str:
my_var = os.environ["ML_S3_BUCKET_PREFIX"]
print(f'ML_S3_BUCKET_PREFIX: {my_var}')
return my_var
@workflow
def wf() -> None:
get_env_var()
get_domain()salmon-refrigerator-32115
02/11/2023, 12:17 AM@glamorous-carpet-83516,
pyflyte run wf.py wf will fail.
salmon-refrigerator-32115
02/11/2023, 12:18 AMpyflyte run --remote wf.py wf will work.
g
glamorous-carpet-83516
02/11/2023, 12:39 AMohh, FLYTE_INTERNAL_TASK_DOMAIN is only used when running remotely. you can set a default value for it.
Copy code
domain = os.getenv("FLYTE_INTERNAL_TASK_DOMAIN", "default_value")glamorous-carpet-83516
02/11/2023, 12:39 AMor return optional type
Copy code
def get_domain() -> Optional[str]s
salmon-refrigerator-32115
02/11/2023, 12:59 AM@glamorous-carpet-83516, got it. Thanks!
161 Views