Dennis O'Brien
02/11/2023, 8:36 AMstart_date
for CronSchedule
that indicates how far back in the past the time based view should go. All past workflow executions will be scheduled when this is registered, perhaps sequentially.
◦ Defaults to a value based on the time the schedule was activated. That is, by default there is no backfill done.
◦ This determines the number of backfill "slots" to be executed.
• Problem: The workflow UI shows the list of workflow executions based on the time they were run. But for scheduled launch plans, I want to see a view based on the scheduled times. How do I know if a particular failed schedule workflow execution ever had a subsequent success?
◦ Potential approach: Have a "schedule time" based view for each schedule.
◦ Visually display the status of each execution slot in the backfill by the status of the last execution. E.g., success, failure, running, etc.
◦ Click on an execution slot to relaunch a failed or successful task or launch a task that has not yet run.
• Problem: Running backfills for a scheduled launch plan is tedious. Is there a better way than just a lot of clicking in the UI?
◦ Potential approach: Provide backfill capabilities in the UI for scheduled launch plans. For example, select a launch plan with a schedule, select a start datetime and end datetime, then run.
◦ Provide a few concurrency and backfill settings. (Borrowed from Airflow)
◦ max_active_runs
sets the maximum number of executions running concurrently. Setting to 1 would backfill sequentially, one at a time.
• Problem: In the workflow UI, in the section "All Executions in the Workflow", there is no easy way to distinguish between scheduled runs and manually triggered runs. And the inputs to the execution are not readily available in this view.
◦ Potential approach: Enable a filtered view of only those executions that were initiated by a schedule (rather than by the user launching via the UI).
◦ Filter by the name of the launch plan used to trigger the workflow execution.
◦ Include columns for the value of the time based argument passed to the workflow. And or include the name of the launch plan used to trigger the execution.
I'd be happy to file these as feature requests, but I'd welcome any feedback before I get started.Ketan (kumare3)
Niels Bantilan
02/13/2023, 3:28 PM