Hey folks, I am trying to set up kafka to gather p...
# ask-the-community
z
Hey folks, I am trying to set up kafka to gather platform events for external consuming. I am wondering whether all the IDL messages would be sent out via the same topic as it writes https://github.com/flyteorg/flyteadmin/blob/46598814b2bcb277762f96a666b2c4649cbdbe8a/pkg/async/cloudevent/factory.go#L67 also I’m wondering what’s the purpose of this? (is this used for notification or external event?) https://github.com/flyteorg/flyteadmin/blob/bca622830ff563984bd3270708ec8b6a5ff83945/pkg/async/notifications/factory.go#L183
k
Notifications are used to power emails, slack messages etc. Events is external events. But good not on docs here cc @Kevin Su
k
Hey Zhiyi, re 1. yes, all the event will be send out via the same topic. you could set the topic name in this config re 2, Both
EventPublisher
and
CloudEventPublisher
will write WorkflowExecutionEvent and TaskExecutionEvent to pub/sub service.
EventPublisher
create event in protobuf format, and
CloudEventPublisher
create event in Cloud event format.
155 Views