How do you set up the AWS athena provider/plugin? ...
# flyte-deploymentl
Laura Lin
11/03/2023, 4:00 AMHow do you set up the AWS athena provider/plugin? I followed https://docs.flyte.org/en/latest/deployment/plugins/aws/athena.html#deployment-plugin-setup-aws-athena but I'm not sure what
Ensure that the propeller has the correct service account for Athena.s
Samhita Alla
11/03/2023, 6:24 AM
Have you tried using the default service account? Are you seeing any error?
l
Laura Lin
11/03/2023, 3:17 PMthis is using the default service account
Laura Lin
11/03/2023, 3:17 PMand yea,
Error when trying to reconcile workflow. Error [failed at Node[n0]. RuntimeExecutionError: failed during plugin execution, caused by: failed to execute handle for plugin [athena]: operation error Athena: StartQueryExecution, failed to sign request: failed to retrieve credentials: failed to retrieve credentials, operation error STS: AssumeRoleWithWebIdentity, https response error StatusCode: 400, RequestID: , api error InvalidIdentityToken: No OpenIDConnect provider found in your account for <https://oidc.eks.us-gov-west-1.amazonaws.com/id/>k
Kevin Su
11/03/2023, 7:35 PMneed to update the role that propeller is using
Kevin Su
11/03/2023, 7:36 PMgive it the permission to access the athena
l
Laura Lin
11/03/2023, 7:37 PMis that the AWS iam role? or the service account
k
Kevin Su
11/03/2023, 7:37 PMaws Iam role
l
Laura Lin
11/03/2023, 7:37 PMI added AmazonAthenaFullAccess to the iam-role-flyte. and still running into that issue. is there some weird refresh I need to do?
k
Kevin Su
11/03/2023, 7:39 PMmaybe try to restart the propeller
l
Laura Lin
11/03/2023, 7:39 PMdid that too and still saw the error
k
Kevin Su
11/03/2023, 8:05 PMcc @Haytham Abuelfutuh
l
Laura Lin
11/03/2023, 8:43 PMI'm also just running the example job here: https://docs.flyte.org/projects/cookbook/en/stable/auto_examples/athena_plugin/athena.html
The
no_ioLaura Lin
11/06/2023, 3:43 PMnot really sure what other explicit perms I need to add.
Laura Lin
11/07/2023, 12:10 AMalso added AWSQuicksightAthenaAccess to get the
athena:StartQueryExecutionLaura Lin
11/07/2023, 1:06 AMive figured it out. its cuz I was missing https://docs.flyte.org/en/latest/deployment/configuration/generated/flytepropeller_config.html#aws-config
k
Kevin Su
11/07/2023, 2:40 AMdoes it work now?
l
Laura Lin
11/07/2023, 3:31 AMyes
s
Samhita Alla
11/07/2023, 6:29 AM
@Laura Lin, mind creating an issue? If you could also contribute, that'd be amazing!
17 Views