Flyte enables production-grade orchestration for machine learning workflows and data processing created to accelerate local workflows to production.

Flyte

Hello! We’re running Flyte on AWS EKS (k8s). Due to the security concerns we have a database which resides in VPC separate from the EKS. We would like to access that db from one task without giving access to the whole k8s cluster to that VPC. Do you know good strategies to achieve that?

So far the ideas we’ve came up with were around using some other AWS service like Fargate or Glue to run the task (as just that task can be run within that specific VPC) and trigger it from Flyte. That feels overly complex however.

And you can use specific security groups, and in eks create a node pool in that security group. And then use node selectors

Aha, node pool and node selector sounds like a good idea. We don’t use Aurora currently, it’s an RDS instance, there is a requirement of having separate VPC as this particular network can be accessed from the outside.

<https://docs.aws.amazon.com/eks/latest/userguide/managing-vpc-cni.html> looks like this is also a good option