Dennis O'Brien11/02/2022, 10:09 PM
I had created a schedule in my launch plan but failed to provide
@workflow def cohort_ltv_inference(inference_date: datetime, n_days_horizon: int) -> bool: ...
In the workflow web ui, I see the schedule displayed:
launch_plan = LaunchPlan.get_or_create( name="pir_cohort_ltv_inference", workflow=cohort_ltv_inference, schedule=CronSchedule( schedule="45 17 * * *", # At 17:45 daily. ), )
But when I noticed that no scheduled run was actually happening, I looked through the scheduler logs and saw messages like this:
Schedules At 05:45 PM
Ideally the end user would be alerted about this earlier. I saw a related issue on github here, and a PR here. I haven't worked in Go, but I think the function
rpc error: code = InvalidArgument desc = expected_inputs inference_date missing
doesn't handle the case of no
passed to the launch plan
. In general I'm missing some of the familiar scheduler UI I am used to from my experience with Airflow. I know these are very different projects, but for almost all my use cases, I'll eventually be running the ML pipeline on a schedule.
. So it seems like it is interpreting "17:45" as "America/Pacific" rather than "UTC".
Dennis O'Brien11/04/2022, 5:48 PM