Erich Shan
11/27/2023, 7:46 PMdate
so that i can run it dynamically on different data. I also have a launch plan based on it which defaults to that today. i have a jenkins job which registers the launch plan each day. i make the version
of the launch plan = the latest commit hash so that i can identify what state the codebase was in when i executed a flyte workflow.
problem:
when the launch plan gets registered two consecutive days with no changes in git commit hash / version
), the ID of the launch plan is the same but the input start date has changed which throws this error:
Error: rpc error: code = InvalidArgument desc = launch plan with different structure already exists with id resource_type:LAUNCH_PLAN project:<project> domain:<domain> name:<name> version:<git commit hash>
afaik, the launch plan's ID is a combination of { resourceType
project
domain
name
and version
}
anyone know how to work around this? i'd like to keep the version of the flyte launch plan still connected to a git commit hash so that i can trace workflow failures to code changes but i also want to retain being able to run a launch plan with different arguments each day. thanks!Erich Shan
11/27/2023, 11:45 PMSamhita Alla
Rupsha Chaudhuri
11/29/2023, 5:10 PMRupsha Chaudhuri
11/29/2023, 5:11 PMRupsha Chaudhuri
11/29/2023, 5:12 PMSamhita Alla
Rupsha Chaudhuri
11/30/2023, 2:47 PMErich Shan
12/01/2023, 8:17 PMstart_date: str = datetime.strftime(datetime.now() - timedelta(days=1), '%Y-%m-%d-%H:%M:%S')
this variable needs to change each time it's called, does this mean we need to re-register the files each time or is a flytectl update call sufficient to re-evaluate the start_date
variableSamhita Alla
Rupsha Chaudhuri
12/02/2023, 8:05 AM