https://flyte.org
Join Slack
Hello, is it possible to use Cloud Events feature with bundled Flyte sandbox? I am able to run the c...
# flyte-support
b
Hello, is it possible to use Cloud Events feature with bundled Flyte sandbox? I am able to run the cluster and I can see that it connects to Kafka, however there are no events being produced when workflows executions happen. Thanks in advance!
I can share some details. I'va added a following config section to flyte-sandbox pod:
Copy code
cloudEvents:
      enable: true
      type: kafka
      kafka:
        brokers: flyte-sandbox-kafka-cluster:9093
        version: "3.3.1"
      eventsPublisher:
        topicName: "flyte_event"
        eventTypes:
          - all
Service flyte-sandbox-kafka-cluster:9093 is available, I checked it with telnet. Kafka also works fine:
Copy code
kafka-get-offsets.sh  --bootstrap-server=flyte-sandbox-kafka-cluster:9093 --topic=flyte_event
flyte_event:0:0
This snippet is from Kafka pod itself. If I change cloudEvents.kafka.brokers to something not available, then Flyte doesn't start with an error so I assume with config above it connects successfuly. How can I troubleshoot this problem? Will be appreciated for any assistance!
g
will flyte send event to kafka if broker config is set correctly? you can check the log in the flyte-binary pod, there might have some error messages.
b
No, it doesn't and that's the problem. I cannot find any messages related to cloud events in flyte-binary pod logs.
I think I've found an issue and it was not related to Flyte setup 🙂
165 Views
Open in Slack
PreviousNext
Powered by

Flyte

Flyte enables production-grade orchestration for machine learning workflows and data processing created to accelerate local workflows to production.

Powered by