Arshak Ulubabyan

    Arshak Ulubabyan

    2 weeks ago
    Hi All, @Robin Eklund and I are introducing Flyte to our company pipelines. We have Flyte deployed already and now we are looking into best practices of Flyte usage, particularly how to structure, build and deploy projects, workflows, and tasks, but we have too many questions. Particularly we were reading the doc page Deploying Workflows - Registration , but it was a bit confusing (e.g. it refers to some Make commands but it’s not clear where is that Makefile and what is it’s content, etc) and we didn’t understand clearly how all of that works and where to start. Would anyone be up for a quick call session to guide us a bit? Or if you have any good articles on the topic, please share, that would be very helpful!
    Ketan (kumare3)

    Ketan (kumare3)

    2 weeks ago
    Hi @Arshak Ulubabyan firstly thank you for sharing your progress with the community. Cc @Samhita Alla / @Smriti Satyan that doc page is absolutely not correct The flow should be package and register. Have you looked at this doc https://docs.flyte.org/projects/cookbook/en/stable/auto/larger_apps/index.html We are working on a single command pyflyte register to replace package and flytectl register. But Flytectl is great for ci/cd environments Cc @Yee.
    Samhita Alla

    Samhita Alla

    2 weeks ago
    Will work on the doc page.
    Smriti Satyan

    Smriti Satyan

    2 weeks ago
    As @Ketan (kumare3) mentioned, @Arshak Ulubabyan here is some info on pyflyte register- https://docs.flyte.org/projects/flytekit/en/latest/design/clis.html#what-is-pyflyte-register
    Samhita Alla

    Samhita Alla

    2 weeks ago
    @Arshak Ulubabyan, I’d also recommend you to take a look at how Lyft handles the CI/CD: https://docs.flyte.org/en/latest/deployment/ideal_flow.html#case-study-mlops-at-lyft. I’ve created an issue a couple of weeks ago to design a CI/CD setup for Flyte: https://github.com/flyteorg/flyte/issues/2772. If this is what you’re referring to, please give it an upvote. @Eduardo Apolinario (eapolinario), who do you think is the best person to work on this? Regarding the project structure, Eduardo worked on a flytekit python template that you can refer to: https://github.com/flyteorg/flytekit-python-template. We also have a flytectl GitHub action: https://github.com/unionai-oss/flytectl-setup-action. Also, happy to set up a call with the team if you wanna chat about this. Let me know your preferred day and time. cc: @Yee @Yuvraj
    Eduardo Apolinario (eapolinario)

    Eduardo Apolinario (eapolinario)

    2 weeks ago
    Thanks for raising this issue, @Arshak Ulubabyan. Happy to hop on a call to discuss your use case. I'm going to work with the team to fix the docs. Also, as Samitha pointed out, we have an issue to work on a template for a CI/CD pipeline. Let us know if this is the direction you were thinking so that we can prioritize that work.
    Arshak Ulubabyan

    Arshak Ulubabyan

    2 weeks ago
    @Samhita Alla @Smriti Satyan @Ketan (kumare3) Thanks a lot for the articles, reading them now.
    @Eduardo Apolinario (eapolinario) yes, we are building CI/CD pipeline around Flyte. It would be great to have a call! we are available anytime before 11 UTC today or between 14-15 UTC. Otherwise we can find another time tomorrow
    @Samhita Alla I missed that you were suggesting a call with the team; would be great to have a call! We are available for a call on 8 Sept anytime between 7:00-12:00 UTC or 13:00-15:00 UTC. The same on Friday. Please let me know what time works for you
    Samhita Alla

    Samhita Alla

    2 weeks ago
    @Eduardo Apolinario (eapolinario), what time works best for you?
    Eduardo Apolinario (eapolinario)

    Eduardo Apolinario (eapolinario)

    2 weeks ago
    between 14:00 and 15:00 UTC works for me.
    does Friday work for you, @Samhita Alla?
    Yee

    Yee

    2 weeks ago
    works for me… can you add alireza as well?
    Samhita Alla

    Samhita Alla

    2 weeks ago
    Works for me, @Eduardo Apolinario (eapolinario). You want me to send an invite?
    Eduardo Apolinario (eapolinario)

    Eduardo Apolinario (eapolinario)

    2 weeks ago
    Sure, Samhita. Thank you.
    Samhita Alla

    Samhita Alla

    2 weeks ago
    Sent the invite.
    y

    Yuvraj

    2 weeks ago
    @Samhita Alla can you also add me in meeting ?
    Samhita Alla

    Samhita Alla

    2 weeks ago
    Sent the invite, @Yuvraj.