https://flyte.org logo
Join Slack
Powered by
Hi flyte community, facing an issue testing the fl...
# flyte-support
b
Hi flyte community, facing an issue testing the flyte agent locally. based on the documentation https://docs.flyte.org/en/latest/flyte_agents/testing_agents_in_a_local_development_cluster.html
Copy code
./flyte start --config ./flyte-single-binary-local.yaml
The error trace is as follows:
Copy code
2024/08/02 04:47:00 /home/shuliang/aip/flyteflyte/flyte/datacatalog/pkg/repositories/config/migrations/noop/migrations.go:134 insufficient arguments
[0.027ms] [rows:-] SELECT * FROM "tags" LIMIT 1
{"json":{"src":"start.go:237"},"level":"panic","msg":"Failed to start Datacatalog, err: database migration failed: insufficient arguments","ts":"2024-08-02T04:47:00Z"}
panic: (*logrus.Entry) 0xc00083a070

goroutine 84 [running]:
<http://github.com/sirupsen/logrus.(*Entry).log(0xc000839f10|github.com/sirupsen/logrus.(*Entry).log(0xc000839f10>, 0x0, {0xc00120af00, 0x53})
	/home/shuliang/.cache/go/pkg/mod/github.com/sirupsen/logrus@v1.9.3/entry.go:260 +0x491
<http://github.com/sirupsen/logrus.(*Entry).Log(0xc000839f10|github.com/sirupsen/logrus.(*Entry).Log(0xc000839f10>, 0x0, {0xc001107e68?, 0x1?, 0x1?})
	/home/shuliang/.cache/go/pkg/mod/github.com/sirupsen/logrus@v1.9.3/entry.go:304 +0x48
<http://github.com/sirupsen/logrus.(*Entry).Logf(0xc000839f10|github.com/sirupsen/logrus.(*Entry).Logf(0xc000839f10>, 0x0, {0x35f233f?, 0x0?}, {0xc000b01ec0?, 0x0?, 0x0?})
	/home/shuliang/.cache/go/pkg/mod/github.com/sirupsen/logrus@v1.9.3/entry.go:349 +0x7c
<http://github.com/sirupsen/logrus.(*Entry).Panicf(0x448fe20|github.com/sirupsen/logrus.(*Entry).Panicf(0x448fe20>?, {0x35f233f?, 0x4140e5?}, {0xc000b01ec0?, 0x2de9e40?, 0x1?})
	/home/shuliang/.cache/go/pkg/mod/github.com/sirupsen/logrus@v1.9.3/entry.go:387 +0x2e
<http://github.com/flyteorg/flyte/flytestdlib/logger.Panicf({0x448fe20|github.com/flyteorg/flyte/flytestdlib/logger.Panicf({0x448fe20>?, 0xc0006a5b80?}, {0x35f233f, 0x24}, {0xc000b01ec0, 0x1, 0x1})
	/home/shuliang/aip/flyteflyte/flyte/flytestdlib/logger/logger.go:188 +0x5e
<http://github.com/flyteorg/flyte/cmd/single.glob..func4.3()|github.com/flyteorg/flyte/cmd/single.glob..func4.3()>
	/home/shuliang/aip/flyteflyte/flyte/cmd/single/start.go:237 +0xb0
<http://golang.org/x/sync/errgroup.(*Group).Go.func1()|golang.org/x/sync/errgroup.(*Group).Go.func1()>
	/home/shuliang/.cache/go/pkg/mod/golang.org/x/sync@v0.6.0/errgroup/errgroup.go:78 +0x56
created by <http://golang.org/x/sync/errgroup.(*Group).Go|golang.org/x/sync/errgroup.(*Group).Go> in goroutine 1
	/home/shuliang/.cache/go/pkg/mod/golang.org/x/sync@v0.6.0/errgroup/errgroup.go:75 +0x96
✅ 1
🧪 1
d
did you use
Copy code
flytectl demo start --dev
?
We should use
Copy code
POD_NAMESPACE=flyte ./flyte start --config ./flyte-single-binary-local.yaml
This is my mistake
b
yeah I used the 
flytectl demo start --dev
as the documentation said in step 1.
ok let me try the 
POD_NAMESPACE=flyte
tried
Copy code
POD_NAMESPACE=flyte ./flyte start --config ./flyte-single-binary-local.yaml
still the same error …
d
did you have the correct ./flyte-single-binary-local.yaml?
b
Copy code
$ cat ./flyte-single-binary-local.yaml
# This is a sample configuration file for running single-binary Flyte locally against
# a sandbox.
admin:
  # This endpoint is used by flytepropeller to talk to admin
  # and artifacts to talk to admin,
  # and _also_, admin to talk to artifacts
  endpoint: localhost:30080
  authType: Pkce
  insecure: true

catalog-cache:
  endpoint: localhost:8081
  insecure: true
  type: datacatalog

cluster_resources:
  standaloneDeployment: false
  templatePath: $HOME/.flyte/sandbox/cluster-resource-templates

logger:
  show-source: true
  level: 5

propeller:
  create-flyteworkflow-crd: true
  kube-config: $HOME/.flyte/sandbox/kubeconfig
  rawoutput-prefix: <s3://my-s3-bucket/data>

server:
  kube-config: $HOME/.flyte/sandbox/kubeconfig

webhook:
  certDir: $HOME/.flyte/webhook-certs
  localCert: true
  secretName: flyte-sandbox-webhook-secret
  serviceName: flyte-sandbox-local
  servicePort: 9443

tasks:
  task-plugins:
    enabled-plugins:
      - agent-service
      - container
      - sidecar
      - K8S-ARRAY
    default-for-task-types:
      - sensor: agent-service
      - container: container
      - container_array: K8S-ARRAY

plugins:
  # Registered Task Types
  agent-service:
    defaultAgent:
      endpoint: "localhost:8000" # your grpc agent server port
      insecure: true
      timeouts:
        # CreateTask, GetTask and DeleteTask are for async agents.
        # ExecuteTaskSync is for sync agents.
        CreateTask: 5s
        GetTask: 5s
        DeleteTask: 5s
        ExecuteTaskSync: 10s
      defaultTimeout: 10s
    supportedTaskTypes:
        - sensor

  logs:
    kubernetes-enabled: true
    kubernetes-template-uri: <http://localhost:30080/kubernetes-dashboard/#/log/{{.namespace> }}/{{ .podName }}/pod?namespace={{ .namespace }}
    cloudwatch-enabled: false
    stackdriver-enabled: false
  k8s:
    default-env-vars:
      - FLYTE_AWS_ENDPOINT: <http://flyte-sandbox-minio.flyte:9000>
      - FLYTE_AWS_ACCESS_KEY_ID: minio
      - FLYTE_AWS_SECRET_ACCESS_KEY: miniostorage
  k8s-array:
    logs:
      config:
        kubernetes-enabled: true
        kubernetes-template-uri: <http://localhost:30080/kubernetes-dashboard/#/log/{{.namespace> }}/{{ .podName }}/pod?namespace={{ .namespace }}
        cloudwatch-enabled: false
        stackdriver-enabled: false

database:
  postgres:
    username: postgres
    password: postgres
    host: 127.0.0.1
    port: 30001
    dbname: flyte
    options: "sslmode=disable"
storage:
  type: stow
  stow:
    kind: s3
    config:
      region: us-east-1
      disable_ssl: true
      v2_signing: true
      endpoint: <http://localhost:30002>
      auth_type: accesskey
      access_key_id: minio
      secret_key: miniostorage
  container: my-s3-bucket

task_resources:
  defaults:
    cpu: 500m
    memory: 500Mi
  limits:
    cpu: 4
    memory: 4Gi
t
the error message references this file 
datacatalog/pkg/repositories/config/migrations/noop/migrations.go
which i can’t seem to find. do you have an older version somehow?
20 Views
Open in Slack
PreviousNext
Powered by