Hi All, <@U041L0THSDP> and I are introducing Flyte...
# ask-the-community
a
Hi All, @Robin Eklund and I are introducing Flyte to our company pipelines. We have Flyte deployed already and now we are looking into best practices of Flyte usage, particularly how to structure, build and deploy projects, workflows, and tasks, but we have too many questions. Particularly we were reading the doc page Deploying Workflows - Registration , but it was a bit confusing (e.g. it refers to some Make commands but it’s not clear where is that Makefile and what is it’s content, etc) and we didn’t understand clearly how all of that works and where to start. Would anyone be up for a quick call session to guide us a bit? Or if you have any good articles on the topic, please share, that would be very helpful!
k
Hi @Arshak Ulubabyan firstly thank you for sharing your progress with the community. Cc @Samhita Alla / @Smriti Satyan that doc page is absolutely not correct The flow should be package and register. Have you looked at this doc https://docs.flyte.org/projects/cookbook/en/stable/auto/larger_apps/index.html We are working on a single command pyflyte register to replace package and flytectl register. But Flytectl is great for ci/cd environments Cc @Yee.
s
Will work on the doc page.
s
As @Ketan (kumare3) mentioned, @Arshak Ulubabyan here is some info on pyflyte register- https://docs.flyte.org/projects/flytekit/en/latest/design/clis.html#what-is-pyflyte-register
s
@Arshak Ulubabyan, I’d also recommend you to take a look at how Lyft handles the CI/CD: https://docs.flyte.org/en/latest/deployment/ideal_flow.html#case-study-mlops-at-lyft. I’ve created an issue a couple of weeks ago to design a CI/CD setup for Flyte: https://github.com/flyteorg/flyte/issues/2772. If this is what you’re referring to, please give it an upvote. @Eduardo Apolinario (eapolinario), who do you think is the best person to work on this? Regarding the project structure, Eduardo worked on a flytekit python template that you can refer to: https://github.com/flyteorg/flytekit-python-template. We also have a flytectl GitHub action: https://github.com/unionai-oss/flytectl-setup-action. Also, happy to set up a call with the team if you wanna chat about this. Let me know your preferred day and time. cc: @Yee @Yuvraj
e
Thanks for raising this issue, @Arshak Ulubabyan. Happy to hop on a call to discuss your use case. I'm going to work with the team to fix the docs. Also, as Samitha pointed out, we have an issue to work on a template for a CI/CD pipeline. Let us know if this is the direction you were thinking so that we can prioritize that work.
a
@Samhita Alla @Smriti Satyan @Ketan (kumare3) Thanks a lot for the articles, reading them now.
@Eduardo Apolinario (eapolinario) yes, we are building CI/CD pipeline around Flyte. It would be great to have a call! we are available anytime before 11 UTC today or between 14-15 UTC. Otherwise we can find another time tomorrow
@Samhita Alla I missed that you were suggesting a call with the team; would be great to have a call! We are available for a call on 8 Sept anytime between 700 1200 UTC or 1300 1500 UTC. The same on Friday. Please let me know what time works for you
s
@Eduardo Apolinario (eapolinario), what time works best for you?
e
between 14:00 and 15:00 UTC works for me.
does Friday work for you, @Samhita Alla?
y
works for me… can you add alireza as well?
s
Works for me, @Eduardo Apolinario (eapolinario). You want me to send an invite?
e
Sure, Samhita. Thank you.
s
Sent the invite.
y
@Samhita Alla can you also add me in meeting ?
s
Sent the invite, @Yuvraj.
113 Views