https://flyte.org logo
s

SeungTaeKim

08/17/2022, 6:03 AM
hello, flyte team. I have a question about workflow register process. I am currently automating ML process through flyte with github CI, and I have problem, launchplan deactivation. The workflow successfully registered in flyte, but it does not show DAG and users cannot start "launch" in console. where do I check log? I hope to get some advice. thanks
s

Samhita Alla

08/17/2022, 6:24 AM
Hi, @SeungTaeKim! Can you try hitting
https://<url_domain>/api/v1/workflows/<project>/<domain>/<wf>/<version>
?
s

SeungTaeKim

08/17/2022, 6:27 AM
That is the problem because I cannot see any execution ID from the workflow (it is registered, but never executed now)
s

Samhita Alla

08/17/2022, 6:30 AM
Sorry, use version, not execution ID. ^ Modified the URL.
s

SeungTaeKim

08/17/2022, 6:31 AM
oh, I try right away
It returns
not found
the same message
s

Samhita Alla

08/17/2022, 6:33 AM
I think the version somehow doesn’t exist.
😣 1
cc: @Prafulla Mahindrakar, any idea how to debug this?
p

Prafulla Mahindrakar

08/17/2022, 6:35 AM
Hi @SeungTaeKim what command did you use to register your workflows . And also can you use flytectl to get the workflow and see if they are archived. Archived workflows cannot be launched and hence might be showing as disabled .
Also i find it strange that you have a slash in your workflow version . Can you try one registering a version without slash
s

SeungTaeKim

08/17/2022, 7:17 AM
some of workflow I executed before is working well,,, I think it is other problem.
p

Prafulla Mahindrakar

08/17/2022, 7:24 AM
Can you try this command on your workflow
Copy code
flytectl update workflow-meta -p flytesnacks -d development flyte_project_template.mlflow_flyte_test.mlflow_wf --activate
If this doesn’t work , then i would suggest trying to create an execution from flytectl and see if that works. https://docs.flyte.org/projects/flytectl/en/latest/gen/flytectl_create_execution.html Want to see if its UI / workflow issue
s

SeungTaeKim

08/17/2022, 7:29 AM
It has returned
unknown flag
. Are you talking to the commands like
workflow-execution-config
or
workflow-meta
??
p

Prafulla Mahindrakar

08/17/2022, 7:29 AM
sorry workflow-meta
s

SeungTaeKim

08/17/2022, 7:29 AM
got it, hang on a second
I think the registration process have wrong process because CLI also returns
not found
, the same error of console ui
p

Prafulla Mahindrakar

08/17/2022, 7:32 AM
what command did you use to register and are you using the right project/domain
s

SeungTaeKim

08/17/2022, 7:33 AM
my team use github action CI with the codes below.
Copy code
- name: Create project
        run: |
          flytectl create project --name ${{ env.FLYTE_PROJECT }} --id ${{ env.FLYTE_PROJECT }} || true
           if [ !-z "${{ env.FLYTE_DESCRIPTION }}" ]; then
            flytectl update project -p ${{ env.FLYTE_PROJECT }} --description ${{ env.FLYTE_DESCRIPTION }}
           fi

      - name: Archive launchplans
        run: |
          (flytectl get launchplan -p {{ $env.FLYTE_PROJECT }} -d {{ $env.FLYTE_DOMAIN }} -o json || echo "") | jq -rc 'if type=="array" then map(.id)[] else .id end' | while read id; do
              name=$(echo $id | jq -r .name)
              version=$(echo $id | jq -r .version)

              flytectl update launchplan $name -p ${{ env.FLYTE_PROJECT }} -d ${{ env.FLYTE_DOMAIN }} --version $version --archive
          done

      - name: Serialize project
        run: |
          mkdir _pb_output
          echo pyflyte --pkgs ${{ env.PROJECT_NAME }} serialize --local-source-root . --image ${{ env.IMAGE_TAG }} workflows -f _pb_output/
          pyflyte --pkgs ${{ env.PROJECT_NAME }} serialize --local-source-root . --image ${{ env.IMAGE_TAG }} workflows -f _pb_output/

      - name: Register serialized project
        run: |
          flytectl register files _pb_output/* -p ${{ env.FLYTE_PROJECT }} -d ${{ env.FLYTE_DOMAIN }} --version ${{ env.VERSION }}

      - name: Activate launchplans
        run: |
          tomlq -rc '.qraft.flyte.active_launch_plans[]' pyproject.toml | while read name; do
             flytectl update launchplan $name -p ${{ env.FLYTE_PROJECT }} -d ${{ env.FLYTE_DOMAIN }} --version ${{ env.VERSION }} --activate
          done
p

Prafulla Mahindrakar

08/17/2022, 7:35 AM
This might be easier , can we hop on a call and check https://meet.google.com/noo-wzwc-aoe
❤️ 1
s

SeungTaeKim

08/17/2022, 7:40 AM
Oh, I am sorry to say I cannot access the video call now. I am on my office, it's little bit difficult to contact. so thank you to your help 🙂
p

Prafulla Mahindrakar

08/17/2022, 7:41 AM
Ok sure. Np. One thing i wanted to check more here is how the UI is pulling the same workflows in the UI then if cli is throwing those errors . which leads me to check if the parameters of project and domain are right
Can you confirm if this

https://flyte-org.slack.com/files/U03HPGSLZN3/F03TYFM2NQ2/screenshot_from_2022-08-17_14-25-24.png

image you captured was from flytesnacks-development project/domain
s

SeungTaeKim

08/17/2022, 7:48 AM
I have checked the project name different,
flytesnacks
into
flyte-project-template
, and CLI returns
successfully updated
. but the the launch plan button is still deactivated
p

Prafulla Mahindrakar

08/17/2022, 7:52 AM
Hmm that’s strange .Would mind creating this execution from cli and will add UI team to check more on this .
👍 1
🙏 1
s

SeungTaeKim

08/17/2022, 7:56 AM
Great. I try the process I did with CLI and said you the result
s

Samhita Alla

08/17/2022, 8:43 AM
@SeungTaeKim, are you seeing the same result with CLI?
s

SeungTaeKim

08/17/2022, 8:43 AM
@Samhita Alla yeah, troubling with the same one, I am still searching solutions
s

Samhita Alla

08/17/2022, 10:07 AM
@SeungTaeKim, can you try by getting the launchplan first and then updating it?
Copy code
flytectl get launchplan -p <project> -d <domain> <wf>

flytectl update launchplan -p <project> -d <domain> <name_of_lp> --version <version> --activate
Just wondering if launch plan + version flag would work.
❤️ 1
p

Prafulla Mahindrakar

08/17/2022, 10:47 AM
@SeungTaeKim what was the result of the cli execution .
❤️ 1
As Samhita suggested you should be able to activate the launchplan .by default all registered launchplans are active unless you explicitly deactivate using archive flag. But archived executions can be launched from cli and hence was interested to see the results
❤️ 1
s

SeungTaeKim

08/17/2022, 1:53 PM
I haven't found the solution yet. The whole result I saw is
Not Found
, so I guess Flyte admin does not found the registration file (The path is registered with CLI, but not file) I think I should check where the filed gone tomorrow
👍 1
I have solved the problem,
Not Found
error I mentioned yesterday. It was the problem of version name, which have not to contain
/
in version name. as @Samhita Alla mentioned on https://flyte-org.slack.com/archives/CNMKCU6FR/p1660717490719359?thread_ts=1660716204.783219&amp;cid=CNMKCU6FR, I think Flyte call the registered filed through API, so if the version name include slash, it interprets wrong path. I have spend 2 days to solve this. Thank you all
🎉 2
12 Views