Hello I am working through setting up a CI CD process to reg Flyte #ask-the-community

Hello! I am working through setting up a CI / CD p...

Evan Sadler

11/28/2022, 6:14 PM

Hello! I am working through setting up a CI / CD process to register and activate launch plans. I am new to CI / CD, so I am curious if folks here have a good solution. I like how

pyflyte

can register a file or folder of launch plans, but I am not exactly sure how to active them all. I don’t want to have to active specific launch plans inside the github actions workflow. My best idea is to throw everything in a Makefile. Any advice is much appreciated!

Copy code

# only sudo code implemented
.SILENT: deploy
.PHONY: deploy
deploy
	pyflyte register [flags] ./recsys/deploy/launchplans.py;
    # I could list them here?
	flytectl update [flags] launchplan prod_ease_train;

Evan Sadler

11/28/2022, 6:15 PM

@Yee for visibility

Yee

11/28/2022, 6:27 PM

btw for reference, these are some of the calls you can do. https://docs.flyte.org/projects/flytectl/en/latest/gen/flytectl_get_launchplan.html#id1

Yee

11/28/2022, 6:33 PM

yeah nm - confirmed internally.

Yee

11/28/2022, 6:33 PM

the activate-all command is a legacy lyft feature that never got ported.

Yee

11/28/2022, 6:33 PM

let’s make an issue for this - handling around this should have good ergonomics. requiring users to call these endpoints and loop over things in a script is not good.

Yee

11/28/2022, 6:34 PM

i’ll put together the issue.

Yee

11/29/2022, 12:30 AM

https://github.com/flyteorg/flyte/issues/3109

Yee

11/29/2022, 12:30 AM

cc @Haytham Abuelfutuh can you skim that issue?

Yee

11/29/2022, 12:30 AM

make sure it makes sense

Haytham Abuelfutuh

11/29/2022, 1:02 AM

Added some comments here: https://github.com/flyteorg/flyte/issues/3109 Maybe @Evan Sadler can chime in too. that would be great

154 Views

Open in Slack

Previous Next