How do you set up the AWS athena provider/plugin? ...
# flyte-deploymentn
numerous-hamburger-7178
11/03/2023, 4:00 AMHow do you set up the AWS athena provider/plugin? I followed https://docs.flyte.org/en/latest/deployment/plugins/aws/athena.html#deployment-plugin-setup-aws-athena but I'm not sure what
Ensure that the propeller has the correct service account for Athena.t
tall-lock-23197
11/03/2023, 6:24 AM
Have you tried using the default service account? Are you seeing any error?
n
numerous-hamburger-7178
11/03/2023, 3:17 PMthis is using the default service account
numerous-hamburger-7178
11/03/2023, 3:17 PMand yea,
Error when trying to reconcile workflow. Error [failed at Node[n0]. RuntimeExecutionError: failed during plugin execution, caused by: failed to execute handle for plugin [athena]: operation error Athena: StartQueryExecution, failed to sign request: failed to retrieve credentials: failed to retrieve credentials, operation error STS: AssumeRoleWithWebIdentity, https response error StatusCode: 400, RequestID: , api error InvalidIdentityToken: No OpenIDConnect provider found in your account for <https://oidc.eks.us-gov-west-1.amazonaws.com/id/>g
glamorous-carpet-83516
11/03/2023, 7:35 PMneed to update the role that propeller is using
glamorous-carpet-83516
11/03/2023, 7:36 PMgive it the permission to access the athena
n
numerous-hamburger-7178
11/03/2023, 7:37 PMis that the AWS iam role? or the service account
g
glamorous-carpet-83516
11/03/2023, 7:37 PMaws Iam role
n
numerous-hamburger-7178
11/03/2023, 7:37 PMI added AmazonAthenaFullAccess to the iam-role-flyte. and still running into that issue. is there some weird refresh I need to do?
g
glamorous-carpet-83516
11/03/2023, 7:39 PMmaybe try to restart the propeller
n
numerous-hamburger-7178
11/03/2023, 7:39 PMdid that too and still saw the error
g
glamorous-carpet-83516
11/03/2023, 8:05 PMcc @high-park-82026
n
numerous-hamburger-7178
11/03/2023, 8:43 PMI'm also just running the example job here: https://docs.flyte.org/projects/cookbook/en/stable/auto_examples/athena_plugin/athena.html
The
no_ionumerous-hamburger-7178
11/06/2023, 3:43 PMnot really sure what other explicit perms I need to add.
numerous-hamburger-7178
11/07/2023, 12:10 AMalso added AWSQuicksightAthenaAccess to get the
athena:StartQueryExecutionnumerous-hamburger-7178
11/07/2023, 1:06 AMive figured it out. its cuz I was missing https://docs.flyte.org/en/latest/deployment/configuration/generated/flytepropeller_config.html#aws-config
g
glamorous-carpet-83516
11/07/2023, 2:40 AMdoes it work now?
n
numerous-hamburger-7178
11/07/2023, 3:31 AMyes
t
tall-lock-23197
11/07/2023, 6:29 AM
@numerous-hamburger-7178, mind creating an issue? If you could also contribute, that'd be amazing!
22 Views