Anirudh Sridhar
09/21/2023, 6:02 PMNiels Bantilan
09/21/2023, 6:05 PMflytekit.Secret
configuration it should workAnirudh Sridhar
09/21/2023, 6:08 PMkubectl create secret generic aws-credentials \
--from-literal=AWS_ACCESS_KEY_ID=your-access-key-id \
--from-literal=AWS_SECRET_ACCESS_KEY=your-secret-access-key
Ketan (kumare3)
Anirudh Sridhar
09/21/2023, 6:10 PMNiels Bantilan
09/21/2023, 6:17 PM@task(secret_requests=[
Secret(
group="aws-credentials",
key="AWS_ACCESS_KEY_ID",
),
Secret(
group="aws-credentials",
key="AWS_SECRET_ACCESS_KEY",
),
])
Anirudh Sridhar
09/21/2023, 6:17 PMNiels Bantilan
09/21/2023, 6:18 PMAnirudh Sridhar
09/21/2023, 6:18 PMNiels Bantilan
09/21/2023, 6:20 PMAnirudh Sridhar
09/21/2023, 6:28 PMUnable to locate credentials
@task(task_config=ray_config,
requests=Resources(mem="2Gi", cpu="1"),
container_image=custom_image,
secret_requests=[
Secret(
group="aws-credentials",
key="AWS_ACCESS_KEY_ID",
),
Secret(
group="aws-credentials",
key="AWS_SECRET_ACCESS_KEY",
),
])
Niels Bantilan
09/21/2023, 6:36 PM@task(...)
def my_task(...):
os.environ["AWS_ACCESS_KEY_ID"] = secret_manager.get("aws-credentials", "AWS_ACCESS_KEY_ID")
os.environ["AWS_SECRET_ACCESS_KEY"] = secret_manager.get("aws-credentials", "AWS_SECRET_ACCESS_KEY")
There’s a PR to make this more convenientAnirudh Sridhar
09/21/2023, 6:38 PMsc = SecretsManager()
os.environ["AWS_ACCESS_KEY_ID"] = sc.get("aws-credentials", "AWS_ACCESS_KEY_ID")
os.environ["AWS_SECRET_ACCESS_KEY"] = sc.get("aws-credentials", "AWS_SECRET_ACCESS_KEY")
Message:
Unable to find secret for key AWS_ACCESS_KEY_ID in group aws-credentials in Env Var:_FSEC_AWS-CREDENTIALS_AWS_ACCESS_KEY_ID and FilePath: /etc/secrets/aws-credentials/aws_access_key_id
Niels Bantilan
09/21/2023, 6:54 PMKevin Su
09/21/2023, 8:12 PMNiels Bantilan
09/21/2023, 9:52 PMAnirudh Sridhar
09/22/2023, 4:30 AM@task(task_config=ray_config,
requests=Resources(mem="2Gi", cpu="1"),
container_image=custom_image)
def fn():
sc = SecretsManager()
os.environ["AWS_ACCESS_KEY_ID"] = sc.get("aws-credentials", "AWS_ACCESS_KEY_ID")
os.environ["AWS_SECRET_ACCESS_KEY"] = sc.get("aws-credentials", "AWS_SECRET_ACCESS_KEY")