https://flyte.org logo
Join Slack
Powered by
Hi everyone… I had running flyte on EKS, but for s...
# ask-the-community
e
Hi everyone… I had running flyte on EKS, but for some reason after trying to setup the notifications, can’t make the UI work. Tried using the configuration that had before (working) but flyte scheduler image and flyte admin can’t run. The error in scheduler that I get is this one:
Copy code
Init Containers:
  flytescheduler-check:
    Container ID:  <docker://a8fd892170ade6a0395de645ec513dd810c8d6af23aee1b6cefda29fd3c09aa>c
    Image:         <http://cr.flyte.org/flyteorg/flytescheduler-release:v1.2.0-b1|cr.flyte.org/flyteorg/flytescheduler-release:v1.2.0-b1>
    Image ID:      <docker-pullable://cr.flyte.org/flyteorg/flytescheduler-release@sha256:324a09a2a7ccd3dd50f334ac83ef183f83af2840c87807c562e506055a48e0ba>
    Port:          <none>
    Host Port:     <none>
    Command:
      flytescheduler
      precheck
      --config
      /etc/flyte/config/*.yaml
    State:          Waiting
      Reason:       CrashLoopBackOff
    Last State:     Terminated
      Reason:       Error
      Exit Code:    2
      Started:      Wed, 22 Mar 2023 21:04:50 -0300
      Finished:     Wed, 22 Mar 2023 21:04:54 -0300
    Ready:          False
    Restart Count:  7
    Environment:    <none>
    Mounts:
      /etc/db from db-pass (rw)
      /etc/flyte/config from config-volume (rw)
      /etc/secrets/ from auth (rw)
      /var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-wxvbg (ro)
Anyone can give me some directions?
k
do you have the log of scheduler?
e
Can't access to the log because the pod is initializing
kubectl logs flytescheduler-646dc95688-xdvh4 -n flyte
Error from server (BadRequest): container "flytescheduler" in pod "flytescheduler-646dc95688-xdvh4" is waiting to start: PodInitializing
And for admin, this is from the logs:
Copy code
{
    "json": {},
    "level": "fatal",
    "msg": "caught panic: AWS.SimpleQueueService.NonExistentQueue: The specified queue does not exist or you do not have access to it.\n\tstatus code: 400, request id: b6ecc224-a4af-509a-84f0-9eb2e0ca13c0 [goroutine 1 [running]:\nruntime/debug.Stack()\n\t/usr/local/go/src/runtime/debug/stack.go:24 +0x65\<http://ngithub.com/flyteorg/flyteadmin/pkg/rpc/adminservice.NewAdminServer.func1()|ngithub.com/flyteorg/flyteadmin/pkg/rpc/adminservice.NewAdminServer.func1()>\n\t/go/src/github.com/flyteorg/flyteadmin/pkg/rpc/adminservice/base.go:73 +0x88\npanic({0x22a6000, 0xc00013a340})\n\t/usr/local/go/src/runtime/panic.go:838 +0x207\<http://ngithub.com/flyteorg/flyteadmin/pkg/async/notifications.NewNotificationsProcessor(|ngithub.com/flyteorg/flyteadmin/pkg/async/notifications.NewNotificationsProcessor(>{{0xc000dbd330, 0x3}, {0xc000dbd316, 0x9}, {{0x0, 0x0}}, {{0x0, 0x0}}, {{0xc000db3a40, 0x35}}, ...}, ...)\n\t/go/src/github.com/flyteorg/flyteadmin/pkg/async/notifications/factory.go:103 +0x465\<http://ngithub.com/flyteorg/flyteadmin/pkg/rpc/adminservice.NewAdminServer({0x29acdd0|ngithub.com/flyteorg/flyteadmin/pkg/rpc/adminservice.NewAdminServer({0x29acdd0>?, 0xc000128000}, 0xc0000bc730, {0x29b5468, 0xc000cf8360}, {0x0, 0x0}, {0x0, 0x0}, 0xc0014243c0, ...)\n\t/go/src/github.com/flyteorg/flyteadmin/pkg/rpc/adminservice/base.go:100 +0x6aa\<http://ngithub.com/flyteorg/flyteadmin/pkg/server.newGRPCServer({0x29acdd0|ngithub.com/flyteorg/flyteadmin/pkg/server.newGRPCServer({0x29acdd0>, 0xc000128000}, 0xc0000bc730, 0xc000440000, 0x1ff53e0?, {0x0?, 0x0}, {0x29bcf70, 0xc001748020}, {0x0, ...})\n\t/go/src/github.com/flyteorg/flyteadmin/pkg/server/service.go:113 +0x6c9\<http://ngithub.com/flyteorg/flyteadmin/pkg/server.serveGatewayInsecure(|ngithub.com/flyteorg/flyteadmin/pkg/server.serveGatewayInsecure(>{0x29acdd0?, 0xc000128000}, 0xc0016fdf40?, 0xc000440000, 0xc000697c00, 0x7f7dcda2b108?, 0x9?, {0x29bcf70, 0xc001748020})\n\t/go/src/github.com/flyteorg/flyteadmin/pkg/server/service.go:265 +0x6e5\<http://ngithub.com/flyteorg/flyteadmin/pkg/server.Serve({0x29acdd0|ngithub.com/flyteorg/flyteadmin/pkg/server.Serve({0x29acdd0>, 0xc000128000}, 0x4?, 0x4?)\n\t/go/src/github.com/flyteorg/flyteadmin/pkg/server/service.go:57 +0x19f\<http://ngithub.com/flyteorg/flyteadmin/cmd/entrypoints.glob..func8(0x3c61e80|ngithub.com/flyteorg/flyteadmin/cmd/entrypoints.glob..func8(0x3c61e80>?, {0x2483461?, 0x2?, 0x2?})\n\t/go/src/github.com/flyteorg/flyteadmin/cmd/entrypoints/serve.go:39 +0x128\<http://ngithub.com/spf13/cobra.(*Command).execute(0x3c61e80|ngithub.com/spf13/cobra.(*Command).execute(0x3c61e80>, {0xc000227e20, 0x2, 0x2})\n\t/go/pkg/mod/github.com/spf13/cobra@v1.3.0/command.go:856 +0x67c\<http://ngithub.com/spf13/cobra.(*Command).ExecuteC(0x3c61c00)|ngithub.com/spf13/cobra.(*Command).ExecuteC(0x3c61c00)>\n\t/go/pkg/mod/github.com/spf13/cobra@v1.3.0/command.go:974 +0x3b4\<http://ngithub.com/spf13/cobra.(*Command).Execute(...)|ngithub.com/spf13/cobra.(*Command).Execute(...)>\n\t/go/pkg/mod/github.com/spf13/cobra@v1.3.0/command.go:902\ngithub.com/flyteorg/flyteadmin/cmd/entrypoints.Execute(0xc000c59f70?)\n\t/go/src/github.com/flyteorg/flyteadmin/cmd/entrypoints/root.go:50 +0x3a\nmain.main()\n\t/go/src/github.com/flyteorg/flyteadmin/cmd/main.go:11 +0x77\n]",
    "ts": "2023-03-23T12:12:21Z"
}
152 Views
Open in Slack
PreviousNext
Powered by