https://flyte.org logo
#ask-the-community
Title
# ask-the-community
e

Evgeny Romanov

05/16/2023, 2:20 PM
Hello, is it possible to use Cloud Events feature with bundled Flyte sandbox? I am able to run the cluster and I can see that it connects to Kafka, however there are no events being produced when workflows executions happen. Thanks in advance!
I can share some details. I'va added a following config section to flyte-sandbox pod:
Copy code
cloudEvents:
      enable: true
      type: kafka
      kafka:
        brokers: flyte-sandbox-kafka-cluster:9093
        version: "3.3.1"
      eventsPublisher:
        topicName: "flyte_event"
        eventTypes:
          - all
Service flyte-sandbox-kafka-cluster:9093 is available, I checked it with telnet. Kafka also works fine:
Copy code
kafka-get-offsets.sh  --bootstrap-server=flyte-sandbox-kafka-cluster:9093 --topic=flyte_event
flyte_event:0:0
This snippet is from Kafka pod itself. If I change cloudEvents.kafka.brokers to something not available, then Flyte doesn't start with an error so I assume with config above it connects successfuly. How can I troubleshoot this problem? Will be appreciated for any assistance!
k

Kevin Su

05/16/2023, 5:39 PM
will flyte send event to kafka if broker config is set correctly? you can check the log in the flyte-binary pod, there might have some error messages.
e

Evgeny Romanov

05/19/2023, 12:40 PM
No, it doesn't and that's the problem. I cannot find any messages related to cloud events in flyte-binary pod logs.
I think I've found an issue and it was not related to Flyte setup 🙂
4 Views