https://flyte.org logo
#flyte-deployment
Title
# flyte-deployment
f

Faysal Ishtiaq

11/28/2023, 4:06 PM
Hi everyone! I am trying to install flyte on EKS. This is my flyte binary values.yaml
Copy code
configuration:
  database:
    username: <DB_USERNAME>
    password: <DB_PASSWORD>
    host: <RDS_HOST_DNS>
    dbname: postgres
  storage:
    metadataContainer: <BUCKET_NAME>
    userDataContainer: <USER_DATA_BUCKET_NAME>
    provider: s3
    providerConfig:
      s3:
        region: "eu-west-1"
        authType: "iam"
  inline:
    plugins:
      k8s:
        inject-finalizer: true
        default-env-vars:
          - AWS_METADATA_SERVICE_TIMEOUT: 5
          - AWS_METADATA_SERVICE_NUM_ATTEMPTS: 20
    storage:
      cache:
        max_size_mbs: 100
        target_gc_percent: 100

serviceAccount:
  create: true
  annotations:
    eks.amazonaws.com/role-arn: "<FLYTE_BACKEND_IAM_ARN>"

configmap:
  inline:
    tasks:
      task-plugins:
        enabled-plugins:
          - container
          - sidecar
          - K8S-ARRAY
          - ray
        default-for-task-types:
          - container: container
          - container_array: K8S-ARRAY
          - ray:ray
This is my terraform
Copy code
resource "helm_release" "flyte_binary" {
  repository       = "<https://flyteorg.github.io/flyte>"
  chart            = "flyte-binary"
  name             = "flyte-binary"
  namespace        = "flyte"
  create_namespace = true
  recreate_pods    = true
  depends_on       = [helm_release.karpenter, null_resource.karpenter_provisioner_deployment]
  values = [
    file("${path.module}/../helm-chart-values/flyte-binary.yaml")
  ]

  set {
    name  = "configuration.database.username"
    value = module.rds.rds_username
  }

  set {
    name  = "configuration.database.password"
    value = module.rds.rds_password
  }

  set {
    name  = "configuration.database.host"
    value = trimsuffix(module.rds.rds_endpoint, ":5432")
  }

  set {
    name  = "configuration.storage.metadataContainer"
    value = module.s3_flyte_storage_backend.s3_bucket[0]
  }

  set {
    name  = "configuration.storage.userDataContainer"
    value = module.s3_flyte_user_data.s3_bucket[0]
  }

  set {
    name  = "serviceAccount.annotations.eks\\.amazonaws\\.com/role-arn"
    value = aws_iam_role.flyte_service_account_assumed_role.arn
  }
}
And I am getting these errors:
Copy code
$ kubectl logs -n flyte flyte-binary-fd46cc7f8-wdc6l    

Defaulted container "flyte" out of: flyte, wait-for-db (init)
time="2023-11-28T16:25:53Z" level=info msg="Using config file: [/etc/flyte/config.d/000-core.yaml /etc/flyte/config.d/001-plugins.yaml /etc/flyte/config.d/002-database.yaml /etc/flyte/config.d/003-storage.yaml /etc/flyte/config.d/012-database-secrets.yaml /etc/flyte/config.d/100-inline-config.yaml]"
{"json":{"src":"start.go:184"},"level":"panic","msg":"Failed to start Admin, err: database migration failed: ERROR: relation \"description_entities\" does not exist (SQLSTATE 42P01)","ts":"2023-11-28T16:25:54Z"}
panic: (*logrus.Entry) 0xc000f50e70

goroutine 119 [running]:
github.com/sirupsen/logrus.(*Entry).log(0xc000f50d90, 0x0, {0xc000160e80, 0x7d})
        /go/pkg/mod/github.com/sirupsen/logrus@v1.8.1/entry.go:259 +0x45b
github.com/sirupsen/logrus.(*Entry).Log(0xc000f50d90, 0x0, {0xc000eb9e68?, 0x1?, 0x1?})
        /go/pkg/mod/github.com/sirupsen/logrus@v1.8.1/entry.go:293 +0x4f
github.com/sirupsen/logrus.(*Entry).Logf(0xc000f50d90, 0x0, {0x317b93d?, 0x0?}, {0xc0018aa520?, 0x0?, 0x0?})
        /go/pkg/mod/github.com/sirupsen/logrus@v1.8.1/entry.go:338 +0x85
github.com/sirupsen/logrus.(*Entry).Panicf(0x42bab98?, {0x317b93d?, 0x416667?}, {0xc0018aa520?, 0x2a95c00?, 0x42bab01?})
        /go/pkg/mod/github.com/sirupsen/logrus@v1.8.1/entry.go:376 +0x34
github.com/flyteorg/flyte/flytestdlib/logger.Panicf({0x42bab98?, 0xc000d1c400?}, {0x317b93d, 0x1e}, {0xc0018aa520, 0x1, 0x1})
        /flyteorg/build/flytestdlib/logger/logger.go:188 +0x64
github.com/flyteorg/flyte/cmd/single.glob..func4.1()
        /flyteorg/build/cmd/single/start.go:184 +0xcc
golang.org/x/sync/errgroup.(*Group).Go.func1()
        /go/pkg/mod/golang.org/x/sync@v0.3.0/errgroup/errgroup.go:75 +0x64
created by golang.org/x/sync/errgroup.(*Group).Go
        /go/pkg/mod/golang.org/x/sync@v0.3.0/errgroup/errgroup.go:72 +0xa5
Could you please help me solving this issue?
s

Samhita Alla

11/29/2023, 8:00 AM
cc @David Espejo (he/him)
d

David Espejo (he/him)

11/29/2023, 3:03 PM
@Faysal Ishtiaq first of all, thanks for sharing, interesting Terraform module. What version of Postgres are you using?
f

Faysal Ishtiaq

11/29/2023, 3:27 PM
13.10
d

David Espejo (he/him)

11/29/2023, 3:43 PM
Typically on EKS Aurora-compatible Postgres 14.x is what's used
f

Faysal Ishtiaq

11/29/2023, 3:44 PM
I am using RDS
But I can try with Postgres14+ and get back to you
d

David Espejo (he/him)

11/29/2023, 3:45 PM
yep, it's RDS
5 Views