https://flyte.org logo
Title
a

Arshak Ulubabyan

09/06/2022, 1:39 PM
Hi All, @Robin Eklund and I are introducing Flyte to our company pipelines. We have Flyte deployed already and now we are looking into best practices of Flyte usage, particularly how to structure, build and deploy projects, workflows, and tasks, but we have too many questions. Particularly we were reading the doc page Deploying Workflows - Registration , but it was a bit confusing (e.g. it refers to some Make commands but it’s not clear where is that Makefile and what is it’s content, etc) and we didn’t understand clearly how all of that works and where to start. Would anyone be up for a quick call session to guide us a bit? Or if you have any good articles on the topic, please share, that would be very helpful!
k

Ketan (kumare3)

09/06/2022, 1:48 PM
Hi @Arshak Ulubabyan firstly thank you for sharing your progress with the community. Cc @Samhita Alla / @Smriti Satyan that doc page is absolutely not correct The flow should be package and register. Have you looked at this doc https://docs.flyte.org/projects/cookbook/en/stable/auto/larger_apps/index.html We are working on a single command pyflyte register to replace package and flytectl register. But Flytectl is great for ci/cd environments Cc @Yee.
s

Samhita Alla

09/06/2022, 1:54 PM
Will work on the doc page.
s

Smriti Satyan

09/06/2022, 1:59 PM
As @Ketan (kumare3) mentioned, @Arshak Ulubabyan here is some info on pyflyte register- https://docs.flyte.org/projects/flytekit/en/latest/design/clis.html#what-is-pyflyte-register
s

Samhita Alla

09/07/2022, 6:43 AM
@Arshak Ulubabyan, I’d also recommend you to take a look at how Lyft handles the CI/CD: https://docs.flyte.org/en/latest/deployment/ideal_flow.html#case-study-mlops-at-lyft. I’ve created an issue a couple of weeks ago to design a CI/CD setup for Flyte: https://github.com/flyteorg/flyte/issues/2772. If this is what you’re referring to, please give it an upvote. @Eduardo Apolinario (eapolinario), who do you think is the best person to work on this? Regarding the project structure, Eduardo worked on a flytekit python template that you can refer to: https://github.com/flyteorg/flytekit-python-template. We also have a flytectl GitHub action: https://github.com/unionai-oss/flytectl-setup-action. Also, happy to set up a call with the team if you wanna chat about this. Let me know your preferred day and time. cc: @Yee @Yuvraj
e

Eduardo Apolinario (eapolinario)

09/07/2022, 6:50 AM
Thanks for raising this issue, @Arshak Ulubabyan. Happy to hop on a call to discuss your use case. I'm going to work with the team to fix the docs. Also, as Samitha pointed out, we have an issue to work on a template for a CI/CD pipeline. Let us know if this is the direction you were thinking so that we can prioritize that work.
a

Arshak Ulubabyan

09/07/2022, 8:04 AM
@Samhita Alla @Smriti Satyan @Ketan (kumare3) Thanks a lot for the articles, reading them now.
@Eduardo Apolinario (eapolinario) yes, we are building CI/CD pipeline around Flyte. It would be great to have a call! we are available anytime before 11 UTC today or between 14-15 UTC. Otherwise we can find another time tomorrow
@Samhita Alla I missed that you were suggesting a call with the team; would be great to have a call! We are available for a call on 8 Sept anytime between 7:00-12:00 UTC or 13:00-15:00 UTC. The same on Friday. Please let me know what time works for you
s

Samhita Alla

09/07/2022, 5:55 PM
@Eduardo Apolinario (eapolinario), what time works best for you?
e

Eduardo Apolinario (eapolinario)

09/07/2022, 8:57 PM
between 14:00 and 15:00 UTC works for me.
does Friday work for you, @Samhita Alla?
y

Yee

09/07/2022, 9:31 PM
works for me… can you add alireza as well?
s

Samhita Alla

09/08/2022, 4:36 AM
Works for me, @Eduardo Apolinario (eapolinario). You want me to send an invite?
e

Eduardo Apolinario (eapolinario)

09/08/2022, 4:41 AM
Sure, Samhita. Thank you.
s

Samhita Alla

09/08/2022, 11:21 AM
Sent the invite.
y

Yuvraj

09/08/2022, 2:02 PM
@Samhita Alla can you also add me in meeting ?
s

Samhita Alla

09/08/2022, 2:56 PM
Sent the invite, @Yuvraj.