https://flyte.org logo
#ask-the-community
Title
# ask-the-community
d

David Cupp

12/19/2022, 10:33 PM
Hello, I have a question regarding Flyte's scheduling capabilities: Is it true to say that Flyte cannot do anything more complicated than cron? Based on the docs, it looks like the most advanced scheduling options are: 1. interval scheduling [1] 2. cron scheduling [1] 3. AWS cron scheduling [2] 4. manually with an SQS queue? [1] I'd like to know if there is anyway to create schedules with the same expressive power as rrule [3] or something similar. Something weird like "every 3rd thursday except for january or wendesdays" which can't be represented unless you have a list of calendar rules. Also, if Flyte doesnt support advance scheduling out of the box...is it possible to add support for rrule using a core plugin [4]? (I'm guessing the answer is no since it seems designed to handle task executions, but just want to make sure I do my due diligence) [1] https://docs.flyte.org/projects/cookbook/en/latest/auto/core/scheduled_workflows/lp_schedules.html#sphx-glr-auto-core-scheduled-workflows-lp-schedules-py [2] https://docs.aws.amazon.com/AmazonCloudWatch/latest/events/ScheduledEvents.html [3] https://dateutil.readthedocs.io/en/stable/rrule.html [4] https://pkg.go.dev/github.com/lyft/flyteplugins/go/tasks/pluginmachinery/core#Plugin
k

Ketan (kumare3)

12/19/2022, 11:18 PM
hi @David Cupp - so Flyte can be used with • out of the box scheduler (Flyte native scheduler_ - which supports cron and fixed rate scheduling • you can use with AWS Cloudwatch schedules of you can simply write your own trigger system that triggers using the API. This can be arbitrarily complex. Besides this we do not support other scheduling. If you would be open, you can definitely upstream rrule change using the backend native Flyte scheduler (written in golang)
d

David Cupp

12/19/2022, 11:20 PM
Great, thanks for getting back to me.
you can definitely upstream rrule change using the backend native Flyte scheduler
You are saying I could open a PR to add rrule to the open source project?
k

Ketan (kumare3)

12/19/2022, 11:20 PM
@David Cupp absolutely and thank you for checking
we always love contributors, but I would recommend wait for a couple weeks. We are actually moving the entire backend to a mono-repo which might make contributions really efficient
d

David Cupp

12/19/2022, 11:22 PM
No worries. I'm still in the investigation phase right now anyway.
k

Ketan (kumare3)

12/19/2022, 11:34 PM
perfect
74 Views